2024-09-14T10:59:50.723 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:59:50.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:59:50.844 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168 branch: main description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904168' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqSrsDaUvpTqkAQmgRF2RhFekaaM72eB4cMbiBgSoLEsxZGXLsMJKRma88cKUreH+2YJngF25sHuGxDMawM0lc= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8BfyeAb4U7IZY7AR+msHawAueKH3pAiIgYOQDYm1gEGCErr/AKEtlAtx1g954BCq99o+VT3sH2IsctTA/khFI= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:59:50.844 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:59:50.845 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:59:50.845 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:59:50.847 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:59:50.870 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:59:50.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:59:50.871 INFO:teuthology.packaging:ref: None 2024-09-14T10:59:50.871 INFO:teuthology.packaging:tag: None 2024-09-14T10:59:50.871 INFO:teuthology.packaging:branch: main 2024-09-14T10:59:50.871 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:59:50.871 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:59:51.108 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:59:51.110 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:59:51.117 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:59:51.117 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:59:51.192 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:59:51.219 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:59:51.227 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:59:51.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:54:31.412241', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqSrsDaUvpTqkAQmgRF2RhFekaaM72eB4cMbiBgSoLEsxZGXLsMJKRma88cKUreH+2YJngF25sHuGxDMawM0lc='} 2024-09-14T10:59:51.270 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:54:31.414281', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8BfyeAb4U7IZY7AR+msHawAueKH3pAiIgYOQDYm1gEGCErr/AKEtlAtx1g954BCq99o+VT3sH2IsctTA/khFI='} 2024-09-14T10:59:51.271 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:59:51.278 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:59:51.278 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:59:51.278 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:59:51.346 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c1752fbe0>, signals=[15]) 2024-09-14T10:59:51.346 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:59:51.354 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:59:51.354 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T10:59:51.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:51.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T10:59:51.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:59:51.508 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:59:51.515 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-09-14T10:59:51.534 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-09-14T10:59:51.534 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-09-14T10:59:51.592 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-09-14T10:59:51.592 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-09-14T10:59:51.592 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-09-14T10:59:51.592 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:59:51.592 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:59:51.593 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:59:51.594 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-09-14T10:59:51.615 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-14T10:59:51.633 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-14T10:59:51.634 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:59:51.692 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:59:51.693 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:59:51.693 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:59:51.693 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-14T10:59:51.715 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:59:51.725 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:59:51.783 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:59:51.783 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:59:51.786 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:59:51.802 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:59:51.810 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:59:51.810 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:59:51.844 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:59:51.946 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:59:52.003 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:59:52.021 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:59:52.021 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:59:52.021 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:59:52.022 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:59:52.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:59:52.038 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-14T10:59:52.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:59:52.039 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-09-14T10:59:52.097 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:59:52.098 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.14.0-503.el9.x86_64 2024-09-14T10:59:52.098 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2024-09-14T10:59:52.099 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:59:52.100 INFO:teuthology.task.kernel:Running kernel on smithi130: 5.14.0-503.el9.x86_64 2024-09-14T10:59:52.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2024-09-14T10:59:54.488 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-14T10:59:56.239 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-14T10:59:57.469 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.2 MB 00:03 2024-09-14T11:00:00.498 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-14T11:00:00.637 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-14T11:00:04.232 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 7.4 kB/s | 19 kB 00:02 2024-09-14T11:00:05.144 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-14T11:00:06.645 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-14T11:00:08.379 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-14T11:00:09.900 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-14T11:00:11.091 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 3.5 kB/s | 1.7 kB 00:00 2024-09-14T11:00:13.147 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:00:13.148 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:00:13.241 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-14T11:00:13.247 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-14T11:00:13.247 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-09-14T11:00:13.247 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout:Install 4 Packages 2024-09-14T11:00:13.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:00:13.249 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 79 M 2024-09-14T11:00:13.249 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 126 M 2024-09-14T11:00:13.249 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-14T11:00:13.643 INFO:teuthology.orchestra.run.smithi171.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 199 kB/s | 23 kB 00:00 2024-09-14T11:00:14.359 INFO:teuthology.orchestra.run.smithi171.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-14T11:00:14.835 INFO:teuthology.orchestra.run.smithi171.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-14T11:00:15.406 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:00:15.676 INFO:teuthology.orchestra.run.smithi171.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-14T11:00:15.679 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:00:15.679 INFO:teuthology.orchestra.run.smithi171.stdout:Total 32 MB/s | 79 MB 00:02 2024-09-14T11:00:16.364 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-14T11:00:16.687 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-14T11:00:16.687 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-14T11:00:17.395 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T11:00:17.396 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T11:00:17.490 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T11:00:17.505 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout:Install 4 Packages 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:00:17.506 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 79 M 2024-09-14T11:00:17.507 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 126 M 2024-09-14T11:00:17.507 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-09-14T11:00:17.694 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-14T11:00:17.695 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-14T11:00:17.807 INFO:teuthology.orchestra.run.smithi130.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 81 kB/s | 23 kB 00:00 2024-09-14T11:00:20.145 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-14T11:00:20.822 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:00:20.912 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:23.709 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:23.829 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:27.923 INFO:teuthology.orchestra.run.smithi130.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 1.5 MB/s | 16 MB 00:10 2024-09-14T11:00:28.692 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:28.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:00:33.581 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:00:36.705 INFO:teuthology.orchestra.run.smithi130.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 1.8 MB/s | 35 MB 00:19 2024-09-14T11:00:45.647 INFO:teuthology.orchestra.run.smithi130.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 1.0 MB/s | 29 MB 00:27 2024-09-14T11:00:45.647 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:00:45.647 INFO:teuthology.orchestra.run.smithi130.stdout:Total 2.8 MB/s | 79 MB 00:28 2024-09-14T11:00:46.327 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-09-14T11:00:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-09-14T11:00:46.687 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-09-14T11:00:47.639 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-09-14T11:00:47.640 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-09-14T11:00:50.087 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-09-14T11:00:50.814 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:00:50.897 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:53.710 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:00:53.860 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:58.703 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:00:58.818 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:12.057 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:12.101 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:12.439 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:12.439 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:01:12.439 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:01:12.439 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.349 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.350 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.350 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:01:13.350 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-14T11:01:13.713 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:13.835 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.835 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:13.835 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:01:13.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:01:13.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:01:13.836 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T11:01:13.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:01:13.836 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:13.895 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:13.895 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:13.895 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-09-14T11:01:13.927 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 82.el9 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8274670 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:01:13.928 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:01:13.929 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:01:13.930 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:01:13.930 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:01:13.930 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:01:14.548 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-09-14T11:01:15.882 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:01:15.910 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-09-14T11:01:15.912 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-14T11:01:15.928 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.VP3EmFpLrw 2024-09-14T11:01:15.928 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VP3EmFpLrw 2024-09-14T11:01:15.995 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.VP3EmFpLrw 2024-09-14T11:01:16.130 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.VP3EmFpLrw is 6KB 2024-09-14T11:01:16.179 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.VP3EmFpLrw 2024-09-14T11:01:16.194 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:01:16.258 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:01:16.258 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:01:16.258 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:01:16.258 INFO:teuthology.orchestra.run.smithi171.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:01:16.259 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:01:16.411 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-09-14T11:01:41.756 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:41.796 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:42.216 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:42.217 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T11:01:42.217 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T11:01:42.217 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T11:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T11:01:43.096 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:01:43.097 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-09-14T11:01:43.445 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:43.531 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.532 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:43.532 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T11:01:43.532 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T11:01:43.532 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T11:01:43.532 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T11:01:43.532 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T11:01:43.533 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T11:01:43.593 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T11:01:43.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T11:01:43.594 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.06 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 82.el9 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Group : Unspecified 2024-09-14T11:01:43.636 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 8274670 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : builder@centos.org 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T11:01:43.637 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:01:43.638 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T11:01:43.639 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T11:01:43.639 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 5.14.0-505.el9.x86_64 2024-09-14T11:01:43.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T11:01:44.294 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-09-14T11:01:45.591 INFO:teuthology.orchestra.run.smithi130.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T11:01:45.622 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-09-14T11:01:45.625 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-14T11:01:45.640 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.iJgwZjf8g3 2024-09-14T11:01:45.640 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iJgwZjf8g3 2024-09-14T11:01:45.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.iJgwZjf8g3 2024-09-14T11:01:45.845 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.iJgwZjf8g3 is 6KB 2024-09-14T11:01:45.894 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.iJgwZjf8g3 2024-09-14T11:01:45.909 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T11:01:45.981 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T11:01:45.981 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T11:01:45.981 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T11:01:45.981 INFO:teuthology.orchestra.run.smithi130.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T11:01:45.983 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T11:01:46.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2024-09-14T11:01:46.414 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T11:01:46.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:01:46.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:16.161 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T11:02:16.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:02:16.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:20.989 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-14T11:02:29.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:02:29.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:34.557 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-09-14T11:02:43.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:02:43.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:02:46.621 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-09-14T11:02:58.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:02:58.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:30.029 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T11:03:30.540 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-09-14T11:03:30.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:03:30.894 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:03:30.894 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-09-14T11:03:30.909 INFO:teuthology.orchestra.run.smithi130.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:03:30.910 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:03:30.910 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:03:30.910 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:03:31.911 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T11:03:31.911 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:03:31.974 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2024-09-14T11:03:31.995 DEBUG:teuthology.parallel:result is None 2024-09-14T11:03:42.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:03:42.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:03:42.400 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-14T11:03:42.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:03:42.755 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T11:03:42.755 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-14T11:03:42.771 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-505.el9.x86_64 2024-09-14T11:03:42.771 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T11:03:42.771 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T11:03:42.771 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T11:03:43.772 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T11:03:43.773 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T11:03:43.848 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-09-14T11:03:43.866 DEBUG:teuthology.parallel:result is None 2024-09-14T11:03:43.866 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T11:03:43.873 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T11:03:43.873 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:03:43.876 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T11:03:43.894 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T11:03:43.903 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T11:03:43.957 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T11:03:43.957 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:03:43.960 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T11:03:44.072 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T11:03:44.080 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T11:03:44.081 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:03:44.083 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T11:03:44.112 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:44.122 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:44.124 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:44.134 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T11:03:44.136 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T11:03:44.143 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T11:03:44.143 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:03:44.168 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T11:03:44.204 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T11:03:44.215 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T11:03:44.215 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:03:44.238 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T11:03:44.263 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:44.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:44.388 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:44.470 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:44.512 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:03:44.513 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:03:44.578 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:44.623 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T11:03:44.676 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:44.758 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T11:03:44.805 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:03:44.805 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T11:03:44.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-09-14T11:03:44.876 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-14T11:03:44.917 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:03:44.967 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:03:45.413 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T11:03:45.422 INFO:teuthology.task.internal:Starting timer... 2024-09-14T11:03:45.422 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T11:03:45.486 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T11:03:45.505 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-09-14T11:03:45.556 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-09-14T11:03:45.558 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-09-14T11:03:45.614 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-09-14T11:03:45.616 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T11:03:45.616 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-09-14T11:03:45.637 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-09-14T11:03:45.637 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-09-14T11:03:45.692 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-09-14T11:03:45.692 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi130.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-09-14T11:03:45.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:03:45.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:45.720 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:03:45.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:03:45.751 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T11:03:45.751 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:03:45.804 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-09-14T11:03:45.840 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T11:03:45.853 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T11:03:45.855 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T11:03:45.966 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T11:03:45.976 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T11:03:45.977 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi130.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:07:28.956 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-14T11:07:28.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:07:28.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:29.037 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-09-14T11:07:29.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-09-14T11:07:29.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:07:29.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:07:29.194 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-14T11:07:29.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-14T11:07:29.268 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:07:29.278 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:07:29.278 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:07:29.279 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:07:29.281 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:07:29.281 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:07:29.311 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:07:29.327 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:07:29.337 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T11:07:29.352 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T11:07:29.352 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-09-14T11:07:29.364 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-09-14T11:07:29.376 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-09-14T11:07:29.379 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:07:29.388 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-09-14T11:07:29.393 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:07:29.402 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T11:07:29.416 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T11:07:29.452 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.455 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.477 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:07:29.480 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:07:29.481 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-14T11:07:29.481 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.481 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.481 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.481 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:07:29.482 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:07:29.489 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:07:29.489 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:07:29.490 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:07:29.490 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:07:29.495 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:07:29.495 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:07:29.496 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:07:29.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:29.498 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T11:07:29.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:29.642 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:07:29.642 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:07:29.645 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T11:07:29.646 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T11:07:29.913 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:07:29.914 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:07:29.914 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:07:29.933 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T11:07:29.933 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:07:29.933 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T11:07:29.940 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:07:29.941 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:07:29.961 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T11:07:29.961 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T11:07:30.008 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:07:30.027 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T11:07:30.085 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:07:30.103 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T11:07:30.149 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-09-14T11:07:30.151 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-09-14T11:07:30.167 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-09-14T11:07:30.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-09-14T11:07:30.378 INFO:teuthology.orchestra.run.smithi130.stdout:45 files removed 2024-09-14T11:07:30.400 INFO:teuthology.orchestra.run.smithi171.stdout:45 files removed 2024-09-14T11:07:30.405 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:07:30.428 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T11:07:31.309 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 137 kB/s | 84 kB 00:00 2024-09-14T11:07:31.314 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 140 kB/s | 84 kB 00:00 2024-09-14T11:07:31.834 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 50 kB/s | 24 kB 00:00 2024-09-14T11:07:31.840 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 50 kB/s | 24 kB 00:00 2024-09-14T11:07:32.391 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-09-14T11:07:32.410 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 3.6 kB/s | 1.9 kB 00:00 2024-09-14T11:07:32.841 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-14T11:07:32.968 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-14T11:07:34.610 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-14T11:07:34.980 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-14T11:07:39.211 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.5 MB 00:00 2024-09-14T11:07:40.403 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-14T11:07:40.754 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-14T11:07:41.550 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-14T11:07:42.071 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 111 kB/s | 19 kB 00:00 2024-09-14T11:07:42.842 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T11:07:46.981 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T11:07:48.198 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-14T11:07:49.360 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:49.361 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:49.455 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:07:49.478 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:07:49.479 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:49.480 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:07:49.481 INFO:teuthology.orchestra.run.smithi171.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:07:49.482 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:07:49.483 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:07:49.484 INFO:teuthology.orchestra.run.smithi171.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:07:49.485 INFO:teuthology.orchestra.run.smithi171.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:07:49.486 INFO:teuthology.orchestra.run.smithi171.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:07:49.487 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:07:49.488 INFO:teuthology.orchestra.run.smithi171.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:07:49.489 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:07:49.490 INFO:teuthology.orchestra.run.smithi171.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:07:49.491 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:07:49.492 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:07:49.493 INFO:teuthology.orchestra.run.smithi171.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:07:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:07:49.495 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:07:49.496 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:07:49.497 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:07:49.498 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-09-14T11:07:49.499 INFO:teuthology.orchestra.run.smithi171.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:07:49.500 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:Install 284 Packages 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 2 Packages 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 327 M 2024-09-14T11:07:49.501 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-09-14T11:07:50.108 INFO:teuthology.orchestra.run.smithi171.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-14T11:07:50.300 INFO:teuthology.orchestra.run.smithi171.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 4.6 MB/s | 900 kB 00:00 2024-09-14T11:07:50.376 INFO:teuthology.orchestra.run.smithi171.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.9 MB/s | 145 kB 00:00 2024-09-14T11:07:50.468 INFO:teuthology.orchestra.run.smithi171.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-14T11:07:50.574 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:50.575 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T11:07:50.593 INFO:teuthology.orchestra.run.smithi171.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-14T11:07:50.643 INFO:teuthology.orchestra.run.smithi171.stdout:(6/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 8.9 MB/s | 2.4 MB 00:00 2024-09-14T11:07:50.666 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-09-14T11:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout:====================================================================================================== 2024-09-14T11:07:50.690 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout:====================================================================================================== 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T11:07:50.691 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T11:07:50.692 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T11:07:50.693 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T11:07:50.694 INFO:teuthology.orchestra.run.smithi130.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T11:07:50.695 INFO:teuthology.orchestra.run.smithi130.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T11:07:50.696 INFO:teuthology.orchestra.run.smithi130.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T11:07:50.697 INFO:teuthology.orchestra.run.smithi130.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T11:07:50.698 INFO:teuthology.orchestra.run.smithi130.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T11:07:50.699 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T11:07:50.700 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T11:07:50.701 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T11:07:50.702 INFO:teuthology.orchestra.run.smithi130.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T11:07:50.703 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T11:07:50.704 INFO:teuthology.orchestra.run.smithi130.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T11:07:50.705 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T11:07:50.706 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T11:07:50.707 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T11:07:50.708 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T11:07:50.709 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T11:07:50.710 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T11:07:50.711 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T11:07:50.712 INFO:teuthology.orchestra.run.smithi130.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T11:07:50.713 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout:====================================================================================================== 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout:Install 284 Packages 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2024-09-14T11:07:50.714 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 327 M 2024-09-14T11:07:50.715 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-09-14T11:07:50.877 INFO:teuthology.orchestra.run.smithi171.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-14T11:07:51.094 INFO:teuthology.orchestra.run.smithi171.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 19 MB/s | 22 MB 00:01 2024-09-14T11:07:51.145 INFO:teuthology.orchestra.run.smithi171.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 505 kB/s | 25 kB 00:00 2024-09-14T11:07:51.490 INFO:teuthology.orchestra.run.smithi130.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-09-14T11:07:51.553 INFO:teuthology.orchestra.run.smithi171.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 16 MB/s | 11 MB 00:00 2024-09-14T11:07:51.595 INFO:teuthology.orchestra.run.smithi171.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 764 kB/s | 32 kB 00:00 2024-09-14T11:07:51.737 INFO:teuthology.orchestra.run.smithi171.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 5.2 MB/s | 756 kB 00:00 2024-09-14T11:07:51.857 INFO:teuthology.orchestra.run.smithi130.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 2.4 MB/s | 900 kB 00:00 2024-09-14T11:07:51.907 INFO:teuthology.orchestra.run.smithi130.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 2.8 MB/s | 145 kB 00:00 2024-09-14T11:07:51.962 INFO:teuthology.orchestra.run.smithi171.stdout:(13/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 17 MB 00:01 2024-09-14T11:07:51.988 INFO:teuthology.orchestra.run.smithi171.stdout:(14/286): libcephsqlite-19.3.0-4907.ga2782315.e 645 kB/s | 161 kB 00:00 2024-09-14T11:07:51.999 INFO:teuthology.orchestra.run.smithi130.stdout:(4/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 7.6 MB/s | 5.5 MB 00:00 2024-09-14T11:07:52.013 INFO:teuthology.orchestra.run.smithi171.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 2.5 MB/s | 127 kB 00:00 2024-09-14T11:07:52.038 INFO:teuthology.orchestra.run.smithi171.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 9.9 MB/s | 508 kB 00:00 2024-09-14T11:07:52.105 INFO:teuthology.orchestra.run.smithi171.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 677 kB/s | 45 kB 00:00 2024-09-14T11:07:52.141 INFO:teuthology.orchestra.run.smithi130.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-14T11:07:52.181 INFO:teuthology.orchestra.run.smithi171.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.9 MB/s | 143 kB 00:00 2024-09-14T11:07:52.273 INFO:teuthology.orchestra.run.smithi171.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 1.7 MB/s | 161 kB 00:00 2024-09-14T11:07:52.365 INFO:teuthology.orchestra.run.smithi171.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 3.4 MB/s | 320 kB 00:00 2024-09-14T11:07:52.482 INFO:teuthology.orchestra.run.smithi171.stdout:(21/286): librgw2-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-14T11:07:52.517 INFO:teuthology.orchestra.run.smithi171.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.0 MB/s | 305 kB 00:00 2024-09-14T11:07:52.541 INFO:teuthology.orchestra.run.smithi171.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.7 MB/s | 99 kB 00:00 2024-09-14T11:07:52.541 INFO:teuthology.orchestra.run.smithi130.stdout:(6/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-14T11:07:52.566 INFO:teuthology.orchestra.run.smithi171.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T11:07:52.591 INFO:teuthology.orchestra.run.smithi130.stdout:(7/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 3.5 MB/s | 2.4 MB 00:00 2024-09-14T11:07:52.633 INFO:teuthology.orchestra.run.smithi171.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-14T11:07:52.726 INFO:teuthology.orchestra.run.smithi171.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 373 kB/s | 34 kB 00:00 2024-09-14T11:07:52.793 INFO:teuthology.orchestra.run.smithi171.stdout:(27/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 13 MB/s | 3.2 MB 00:00 2024-09-14T11:07:52.818 INFO:teuthology.orchestra.run.smithi171.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.6 MB/s | 154 kB 00:00 2024-09-14T11:07:53.792 INFO:teuthology.orchestra.run.smithi130.stdout:(8/286): ceph-osd-19.3.0-4907.ga2782315.el9.x86 14 MB/s | 17 MB 00:01 2024-09-14T11:07:53.842 INFO:teuthology.orchestra.run.smithi130.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 505 kB/s | 25 kB 00:00 2024-09-14T11:07:54.119 INFO:teuthology.orchestra.run.smithi171.stdout:(29/286): ceph-test-19.3.0-4907.ga2782315.el9.x 17 MB/s | 50 MB 00:02 2024-09-14T11:07:54.227 INFO:teuthology.orchestra.run.smithi171.stdout:(30/286): ceph-mgr-diskprediction-local-19.3.0- 5.2 MB/s | 7.4 MB 00:01 2024-09-14T11:07:54.252 INFO:teuthology.orchestra.run.smithi171.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.1 MB/s | 291 kB 00:00 2024-09-14T11:07:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 739 kB/s | 49 kB 00:00 2024-09-14T11:07:54.320 INFO:teuthology.orchestra.run.smithi171.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 245 kB/s | 16 kB 00:00 2024-09-14T11:07:54.470 INFO:teuthology.orchestra.run.smithi171.stdout:(34/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 8.4 MB/s | 14 MB 00:01 2024-09-14T11:07:54.495 INFO:teuthology.orchestra.run.smithi171.stdout:(35/286): ceph-volume-19.3.0-4907.ga2782315.el9 1.4 MB/s | 285 kB 00:00 2024-09-14T11:07:54.529 INFO:teuthology.orchestra.run.smithi171.stdout:(36/286): cephadm-19.3.0-4907.ga2782315.el9.noa 3.7 MB/s | 784 kB 00:00 2024-09-14T11:07:54.621 INFO:teuthology.orchestra.run.smithi171.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 676 kB/s | 85 kB 00:00 2024-09-14T11:07:54.625 INFO:teuthology.orchestra.run.smithi130.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 5.4 MB/s | 11 MB 00:02 2024-09-14T11:07:54.646 INFO:teuthology.orchestra.run.smithi171.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 423 kB/s | 49 kB 00:00 2024-09-14T11:07:54.667 INFO:teuthology.orchestra.run.smithi130.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 766 kB/s | 32 kB 00:00 2024-09-14T11:07:54.680 INFO:teuthology.orchestra.run.smithi171.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.6 MB/s | 335 kB 00:00 2024-09-14T11:07:54.705 INFO:teuthology.orchestra.run.smithi171.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-14T11:07:54.731 INFO:teuthology.orchestra.run.smithi171.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.0 MB/s | 262 kB 00:00 2024-09-14T11:07:54.756 INFO:teuthology.orchestra.run.smithi171.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 534 kB/s | 27 kB 00:00 2024-09-14T11:07:54.793 INFO:teuthology.orchestra.run.smithi130.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 5.9 MB/s | 756 kB 00:00 2024-09-14T11:07:54.798 INFO:teuthology.orchestra.run.smithi171.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-14T11:07:54.832 INFO:teuthology.orchestra.run.smithi171.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-14T11:07:54.851 INFO:teuthology.orchestra.run.smithi130.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.7 MB/s | 161 kB 00:00 2024-09-14T11:07:54.865 INFO:teuthology.orchestra.run.smithi171.stdout:(45/286): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-14T11:07:54.891 INFO:teuthology.orchestra.run.smithi171.stdout:(46/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-14T11:07:54.910 INFO:teuthology.orchestra.run.smithi130.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 2.1 MB/s | 127 kB 00:00 2024-09-14T11:07:54.925 INFO:teuthology.orchestra.run.smithi171.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-14T11:07:54.950 INFO:teuthology.orchestra.run.smithi171.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-14T11:07:54.984 INFO:teuthology.orchestra.run.smithi171.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-14T11:07:55.009 INFO:teuthology.orchestra.run.smithi171.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-14T11:07:55.018 INFO:teuthology.orchestra.run.smithi130.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 4.6 MB/s | 508 kB 00:00 2024-09-14T11:07:55.112 INFO:teuthology.orchestra.run.smithi171.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-14T11:07:55.202 INFO:teuthology.orchestra.run.smithi171.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.9 MB/s | 650 kB 00:00 2024-09-14T11:07:55.252 INFO:teuthology.orchestra.run.smithi171.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-14T11:07:55.311 INFO:teuthology.orchestra.run.smithi171.stdout:(54/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.5 MB/s | 523 kB 00:00 2024-09-14T11:07:55.327 INFO:teuthology.orchestra.run.smithi130.stdout:(16/286): ceph-common-19.3.0-4907.ga2782315.el9 5.4 MB/s | 22 MB 00:04 2024-09-14T11:07:55.369 INFO:teuthology.orchestra.run.smithi130.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 1.1 MB/s | 45 kB 00:00 2024-09-14T11:07:55.386 INFO:teuthology.orchestra.run.smithi171.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 2.2 MB/s | 302 kB 00:00 2024-09-14T11:07:55.427 INFO:teuthology.orchestra.run.smithi130.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.4 MB/s | 143 kB 00:00 2024-09-14T11:07:55.444 INFO:teuthology.orchestra.run.smithi171.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 2.1 MB/s | 283 kB 00:00 2024-09-14T11:07:55.486 INFO:teuthology.orchestra.run.smithi130.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.7 MB/s | 161 kB 00:00 2024-09-14T11:07:55.503 INFO:teuthology.orchestra.run.smithi171.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-14T11:07:55.595 INFO:teuthology.orchestra.run.smithi171.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 2.6 MB/s | 559 kB 00:00 2024-09-14T11:07:55.621 INFO:teuthology.orchestra.run.smithi171.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-09-14T11:07:55.646 INFO:teuthology.orchestra.run.smithi171.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 463 kB/s | 23 kB 00:00 2024-09-14T11:07:55.688 INFO:teuthology.orchestra.run.smithi171.stdout:(61/286): avahi-glib-0.8-21.el9.x86_64.rpm 357 kB/s | 15 kB 00:00 2024-09-14T11:07:55.738 INFO:teuthology.orchestra.run.smithi171.stdout:(62/286): atk-2.36.0-5.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T11:07:55.764 INFO:teuthology.orchestra.run.smithi171.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-14T11:07:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T11:07:55.814 INFO:teuthology.orchestra.run.smithi171.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2024-09-14T11:07:55.840 INFO:teuthology.orchestra.run.smithi171.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:07:55.874 INFO:teuthology.orchestra.run.smithi171.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 478 kB/s | 28 kB 00:00 2024-09-14T11:07:55.916 INFO:teuthology.orchestra.run.smithi171.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-14T11:07:55.928 INFO:teuthology.orchestra.run.smithi130.stdout:(20/286): ceph-test-19.3.0-4907.ga2782315.el9.x 24 MB/s | 50 MB 00:02 2024-09-14T11:07:55.941 INFO:teuthology.orchestra.run.smithi171.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 7.7 MB/s | 525 kB 00:00 2024-09-14T11:07:55.962 INFO:teuthology.orchestra.run.smithi130.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 674 kB/s | 320 kB 00:00 2024-09-14T11:07:56.037 INFO:teuthology.orchestra.run.smithi130.stdout:(22/286): librgw2-19.3.0-4907.ga2782315.el9.x86 5.4 MB/s | 5.5 MB 00:01 2024-09-14T11:07:56.062 INFO:teuthology.orchestra.run.smithi130.stdout:(23/286): python3-rbd-19.3.0-4907.ga2782315.el9 2.2 MB/s | 305 kB 00:00 2024-09-14T11:07:56.087 INFO:teuthology.orchestra.run.smithi130.stdout:(24/286): python3-rgw-19.3.0-4907.ga2782315.el9 793 kB/s | 99 kB 00:00 2024-09-14T11:07:56.113 INFO:teuthology.orchestra.run.smithi130.stdout:(25/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-14T11:07:56.146 INFO:teuthology.orchestra.run.smithi130.stdout:(26/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.8 MB/s | 171 kB 00:00 2024-09-14T11:07:56.171 INFO:teuthology.orchestra.run.smithi130.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 586 kB/s | 34 kB 00:00 2024-09-14T11:07:56.197 INFO:teuthology.orchestra.run.smithi130.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 3.0 MB/s | 154 kB 00:00 2024-09-14T11:07:56.200 INFO:teuthology.orchestra.run.smithi171.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 3.0 MB/s | 781 kB 00:00 2024-09-14T11:07:56.242 INFO:teuthology.orchestra.run.smithi171.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 980 kB 00:00 2024-09-14T11:07:56.255 INFO:teuthology.orchestra.run.smithi130.stdout:(29/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 17 MB/s | 3.2 MB 00:00 2024-09-14T11:07:56.306 INFO:teuthology.orchestra.run.smithi130.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 5.7 MB/s | 291 kB 00:00 2024-09-14T11:07:56.337 INFO:teuthology.orchestra.run.smithi171.stdout:(72/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.3 MB/s | 218 kB 00:00 2024-09-14T11:07:56.347 INFO:teuthology.orchestra.run.smithi130.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 1.2 MB/s | 49 kB 00:00 2024-09-14T11:07:56.359 INFO:teuthology.orchestra.run.smithi171.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.0 MB/s | 325 kB 00:00 2024-09-14T11:07:56.389 INFO:teuthology.orchestra.run.smithi130.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 396 kB/s | 16 kB 00:00 2024-09-14T11:07:56.393 INFO:teuthology.orchestra.run.smithi171.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 650 kB/s | 22 kB 00:00 2024-09-14T11:07:56.440 INFO:teuthology.orchestra.run.smithi130.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.6 MB/s | 285 kB 00:00 2024-09-14T11:07:56.460 INFO:teuthology.orchestra.run.smithi171.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 1.1 MB/s | 73 kB 00:00 2024-09-14T11:07:56.494 INFO:teuthology.orchestra.run.smithi171.stdout:(76/286): flexiblas-3.0.4-8.el9.x86_64.rpm 985 kB/s | 33 kB 00:00 2024-09-14T11:07:56.506 INFO:teuthology.orchestra.run.smithi130.stdout:(34/286): cephadm-19.3.0-4907.ga2782315.el9.noa 12 MB/s | 784 kB 00:00 2024-09-14T11:07:56.882 INFO:teuthology.orchestra.run.smithi130.stdout:(35/286): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-14T11:07:56.894 INFO:teuthology.orchestra.run.smithi171.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 3.1 MB/s | 1.7 MB 00:00 2024-09-14T11:07:56.936 INFO:teuthology.orchestra.run.smithi171.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 436 kB/s | 18 kB 00:00 2024-09-14T11:07:56.995 INFO:teuthology.orchestra.run.smithi171.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-14T11:07:57.053 INFO:teuthology.orchestra.run.smithi171.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-14T11:07:57.096 INFO:teuthology.orchestra.run.smithi171.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-14T11:07:57.165 INFO:teuthology.orchestra.run.smithi130.stdout:(36/286): ModemManager-glib-1.20.2-1.el9.x86_64 509 kB/s | 335 kB 00:00 2024-09-14T11:07:57.246 INFO:teuthology.orchestra.run.smithi171.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 3.1 MB/s | 473 kB 00:00 2024-09-14T11:07:57.305 INFO:teuthology.orchestra.run.smithi171.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:07:57.347 INFO:teuthology.orchestra.run.smithi171.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 817 kB/s | 34 kB 00:00 2024-09-14T11:07:57.366 INFO:teuthology.orchestra.run.smithi130.stdout:(37/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 12 MB/s | 14 MB 00:01 2024-09-14T11:07:57.391 INFO:teuthology.orchestra.run.smithi130.stdout:(38/286): bluez-libs-5.56-6.el9.x86_64.rpm 166 kB/s | 85 kB 00:00 2024-09-14T11:07:57.416 INFO:teuthology.orchestra.run.smithi130.stdout:(39/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 197 kB/s | 49 kB 00:00 2024-09-14T11:07:57.422 INFO:teuthology.orchestra.run.smithi171.stdout:(85/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-14T11:07:57.500 INFO:teuthology.orchestra.run.smithi130.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 734 kB/s | 80 kB 00:00 2024-09-14T11:07:57.608 INFO:teuthology.orchestra.run.smithi130.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 249 kB/s | 27 kB 00:00 2024-09-14T11:07:57.725 INFO:teuthology.orchestra.run.smithi130.stdout:(42/286): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-14T11:07:57.789 INFO:teuthology.orchestra.run.smithi171.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-14T11:07:57.831 INFO:teuthology.orchestra.run.smithi171.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 796 kB/s | 33 kB 00:00 2024-09-14T11:07:57.833 INFO:teuthology.orchestra.run.smithi130.stdout:(43/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 868 kB/s | 94 kB 00:00 2024-09-14T11:07:57.950 INFO:teuthology.orchestra.run.smithi130.stdout:(44/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-14T11:07:57.993 INFO:teuthology.orchestra.run.smithi130.stdout:(45/286): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-14T11:07:58.018 INFO:teuthology.orchestra.run.smithi130.stdout:(46/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 402 kB/s | 262 kB 00:00 2024-09-14T11:07:58.098 INFO:teuthology.orchestra.run.smithi171.stdout:(88/286): gstreamer1-plugins-base-1.22.1-2.el9. 3.3 MB/s | 2.2 MB 00:00 2024-09-14T11:07:58.101 INFO:teuthology.orchestra.run.smithi130.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-09-14T11:07:58.126 INFO:teuthology.orchestra.run.smithi130.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-14T11:07:58.210 INFO:teuthology.orchestra.run.smithi130.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-14T11:07:58.244 INFO:teuthology.orchestra.run.smithi130.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-14T11:07:58.344 INFO:teuthology.orchestra.run.smithi130.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-09-14T11:07:58.502 INFO:teuthology.orchestra.run.smithi130.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-14T11:07:58.549 INFO:teuthology.orchestra.run.smithi171.stdout:(89/286): adwaita-icon-theme-40.1.1-3.el9.noarc 3.4 MB/s | 12 MB 00:03 2024-09-14T11:07:58.561 INFO:teuthology.orchestra.run.smithi130.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-14T11:07:58.620 INFO:teuthology.orchestra.run.smithi130.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-14T11:07:58.649 INFO:teuthology.orchestra.run.smithi171.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 2.1 MB/s | 219 kB 00:00 2024-09-14T11:07:58.653 INFO:teuthology.orchestra.run.smithi130.stdout:(55/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.7 MB/s | 523 kB 00:00 2024-09-14T11:07:58.679 INFO:teuthology.orchestra.run.smithi130.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-14T11:07:58.691 INFO:teuthology.orchestra.run.smithi171.stdout:(91/286): guava-30.1-6.el9.noarch.rpm 3.9 MB/s | 2.3 MB 00:00 2024-09-14T11:07:58.737 INFO:teuthology.orchestra.run.smithi130.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-14T11:07:58.788 INFO:teuthology.orchestra.run.smithi130.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 4.1 MB/s | 559 kB 00:00 2024-09-14T11:07:58.813 INFO:teuthology.orchestra.run.smithi130.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-09-14T11:07:58.846 INFO:teuthology.orchestra.run.smithi130.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 399 kB/s | 23 kB 00:00 2024-09-14T11:07:58.872 INFO:teuthology.orchestra.run.smithi130.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-14T11:07:58.897 INFO:teuthology.orchestra.run.smithi130.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-14T11:07:58.899 INFO:teuthology.orchestra.run.smithi171.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 2.6 MB/s | 657 kB 00:00 2024-09-14T11:07:58.930 INFO:teuthology.orchestra.run.smithi130.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-14T11:07:58.942 INFO:teuthology.orchestra.run.smithi171.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 2.5 MB/s | 632 kB 00:00 2024-09-14T11:07:58.956 INFO:teuthology.orchestra.run.smithi130.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 911 kB/s | 53 kB 00:00 2024-09-14T11:07:58.984 INFO:teuthology.orchestra.run.smithi171.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 1.1 MB/s | 45 kB 00:00 2024-09-14T11:07:58.989 INFO:teuthology.orchestra.run.smithi130.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-14T11:07:59.014 INFO:teuthology.orchestra.run.smithi130.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-14T11:07:59.048 INFO:teuthology.orchestra.run.smithi130.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 484 kB/s | 28 kB 00:00 2024-09-14T11:07:59.051 INFO:teuthology.orchestra.run.smithi171.stdout:(95/286): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-14T11:07:59.073 INFO:teuthology.orchestra.run.smithi130.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.9 MB/s | 113 kB 00:00 2024-09-14T11:07:59.107 INFO:teuthology.orchestra.run.smithi130.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 8.8 MB/s | 525 kB 00:00 2024-09-14T11:07:59.193 INFO:teuthology.orchestra.run.smithi171.stdout:(96/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 2.8 MB/s | 413 kB 00:00 2024-09-14T11:07:59.232 INFO:teuthology.orchestra.run.smithi130.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-14T11:07:59.316 INFO:teuthology.orchestra.run.smithi130.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 980 kB 00:00 2024-09-14T11:07:59.374 INFO:teuthology.orchestra.run.smithi130.stdout:(72/286): flac-libs-1.3.3-12.el9.x86_64.rpm 3.7 MB/s | 218 kB 00:00 2024-09-14T11:07:59.418 INFO:teuthology.orchestra.run.smithi171.stdout:(97/286): gtk3-3.24.31-5.el9.x86_64.rpm 3.1 MB/s | 4.9 MB 00:01 2024-09-14T11:07:59.458 INFO:teuthology.orchestra.run.smithi130.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 1.4 MB/s | 325 kB 00:00 2024-09-14T11:07:59.508 INFO:teuthology.orchestra.run.smithi130.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 433 kB/s | 22 kB 00:00 2024-09-14T11:07:59.584 INFO:teuthology.orchestra.run.smithi130.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 973 kB/s | 73 kB 00:00 2024-09-14T11:07:59.642 INFO:teuthology.orchestra.run.smithi130.stdout:(76/286): flexiblas-3.0.4-8.el9.x86_64.rpm 563 kB/s | 33 kB 00:00 2024-09-14T11:07:59.801 INFO:teuthology.orchestra.run.smithi130.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 4.0 MB/s | 1.7 MB 00:00 2024-09-14T11:07:59.859 INFO:teuthology.orchestra.run.smithi130.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-14T11:07:59.909 INFO:teuthology.orchestra.run.smithi130.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T11:07:59.968 INFO:teuthology.orchestra.run.smithi130.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-14T11:08:00.018 INFO:teuthology.orchestra.run.smithi130.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-14T11:08:00.027 INFO:teuthology.orchestra.run.smithi171.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 3.1 MB/s | 3.5 MB 00:01 2024-09-14T11:08:00.060 INFO:teuthology.orchestra.run.smithi171.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 392 kB/s | 13 kB 00:00 2024-09-14T11:08:00.094 INFO:teuthology.orchestra.run.smithi171.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.6 MB/s | 53 kB 00:00 2024-09-14T11:08:00.136 INFO:teuthology.orchestra.run.smithi130.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 4.0 MB/s | 473 kB 00:00 2024-09-14T11:08:00.136 INFO:teuthology.orchestra.run.smithi171.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 574 kB/s | 24 kB 00:00 2024-09-14T11:08:00.185 INFO:teuthology.orchestra.run.smithi130.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-14T11:08:00.236 INFO:teuthology.orchestra.run.smithi130.stdout:(84/286): gsm-1.0.19-6.el9.x86_64.rpm 680 kB/s | 34 kB 00:00 2024-09-14T11:08:00.237 INFO:teuthology.orchestra.run.smithi171.stdout:(102/286): java-11-openjdk-devel-11.0.20.1.1-2. 3.2 MB/s | 3.3 MB 00:01 2024-09-14T11:08:00.270 INFO:teuthology.orchestra.run.smithi171.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 1.0 MB/s | 35 kB 00:00 2024-09-14T11:08:00.296 INFO:teuthology.orchestra.run.smithi171.stdout:(104/286): jsoup-1.13.1-10.el9.noarch.rpm 2.3 MB/s | 377 kB 00:00 2024-09-14T11:08:00.337 INFO:teuthology.orchestra.run.smithi171.stdout:(105/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 266 kB/s | 11 kB 00:00 2024-09-14T11:08:00.363 INFO:teuthology.orchestra.run.smithi171.stdout:(106/286): lcms2-2.12-3.el9.x86_64.rpm 1.8 MB/s | 168 kB 00:00 2024-09-14T11:08:00.388 INFO:teuthology.orchestra.run.smithi171.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-14T11:08:00.413 INFO:teuthology.orchestra.run.smithi171.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 610 kB/s | 31 kB 00:00 2024-09-14T11:08:00.439 INFO:teuthology.orchestra.run.smithi171.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 453 kB/s | 23 kB 00:00 2024-09-14T11:08:00.464 INFO:teuthology.orchestra.run.smithi171.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-09-14T11:08:00.498 INFO:teuthology.orchestra.run.smithi171.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 671 kB/s | 40 kB 00:00 2024-09-14T11:08:00.523 INFO:teuthology.orchestra.run.smithi171.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 256 kB/s | 15 kB 00:00 2024-09-14T11:08:00.549 INFO:teuthology.orchestra.run.smithi171.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-14T11:08:00.574 INFO:teuthology.orchestra.run.smithi171.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 425 kB/s | 21 kB 00:00 2024-09-14T11:08:00.578 INFO:teuthology.orchestra.run.smithi130.stdout:(85/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 4.2 MB/s | 1.4 MB 00:00 2024-09-14T11:08:00.600 INFO:teuthology.orchestra.run.smithi171.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 379 kB/s | 19 kB 00:00 2024-09-14T11:08:00.625 INFO:teuthology.orchestra.run.smithi171.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-14T11:08:00.651 INFO:teuthology.orchestra.run.smithi171.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-09-14T11:08:00.684 INFO:teuthology.orchestra.run.smithi171.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-14T11:08:00.737 INFO:teuthology.orchestra.run.smithi130.stdout:(86/286): adwaita-icon-theme-40.1.1-3.el9.noarc 4.8 MB/s | 12 MB 00:02 2024-09-14T11:08:00.742 INFO:teuthology.orchestra.run.smithi171.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 349 kB/s | 32 kB 00:00 2024-09-14T11:08:00.787 INFO:teuthology.orchestra.run.smithi130.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 665 kB/s | 33 kB 00:00 2024-09-14T11:08:00.793 INFO:teuthology.orchestra.run.smithi171.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-14T11:08:00.852 INFO:teuthology.orchestra.run.smithi171.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.2 MB/s | 241 kB 00:00 2024-09-14T11:08:00.894 INFO:teuthology.orchestra.run.smithi171.stdout:(122/286): libfontenc-1.1.3-17.el9.x86_64.rpm 747 kB/s | 31 kB 00:00 2024-09-14T11:08:00.953 INFO:teuthology.orchestra.run.smithi171.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 2.7 MB/s | 435 kB 00:00 2024-09-14T11:08:00.978 INFO:teuthology.orchestra.run.smithi171.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 986 kB/s | 83 kB 00:00 2024-09-14T11:08:01.020 INFO:teuthology.orchestra.run.smithi171.stdout:(125/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 880 kB/s | 37 kB 00:00 2024-09-14T11:08:01.045 INFO:teuthology.orchestra.run.smithi171.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 135 kB 00:00 2024-09-14T11:08:01.113 INFO:teuthology.orchestra.run.smithi171.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.5 MB/s | 142 kB 00:00 2024-09-14T11:08:01.154 INFO:teuthology.orchestra.run.smithi130.stdout:(88/286): gstreamer1-plugins-base-1.22.1-2.el9. 3.9 MB/s | 2.2 MB 00:00 2024-09-14T11:08:01.171 INFO:teuthology.orchestra.run.smithi171.stdout:(128/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-14T11:08:01.197 INFO:teuthology.orchestra.run.smithi171.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 1.7 MB/s | 256 kB 00:00 2024-09-14T11:08:01.214 INFO:teuthology.orchestra.run.smithi171.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-14T11:08:01.231 INFO:teuthology.orchestra.run.smithi171.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 1.2 MB/s | 41 kB 00:00 2024-09-14T11:08:01.281 INFO:teuthology.orchestra.run.smithi171.stdout:(132/286): libnotify-0.7.9-8.el9.x86_64.rpm 875 kB/s | 44 kB 00:00 2024-09-14T11:08:01.315 INFO:teuthology.orchestra.run.smithi171.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.6 MB/s | 171 kB 00:00 2024-09-14T11:08:01.341 INFO:teuthology.orchestra.run.smithi171.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 567 kB/s | 34 kB 00:00 2024-09-14T11:08:01.345 INFO:teuthology.orchestra.run.smithi130.stdout:(89/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-09-14T11:08:01.374 INFO:teuthology.orchestra.run.smithi171.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-14T11:08:01.412 INFO:teuthology.orchestra.run.smithi130.stdout:(90/286): gtk3-3.24.31-5.el9.x86_64.rpm 7.8 MB/s | 4.9 MB 00:00 2024-09-14T11:08:01.416 INFO:teuthology.orchestra.run.smithi171.stdout:(136/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-14T11:08:01.433 INFO:teuthology.orchestra.run.smithi171.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-14T11:08:01.471 INFO:teuthology.orchestra.run.smithi130.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 1.7 MB/s | 219 kB 00:00 2024-09-14T11:08:01.483 INFO:teuthology.orchestra.run.smithi171.stdout:(138/286): libsbc-1.4-9.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-14T11:08:01.555 INFO:teuthology.orchestra.run.smithi130.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 4.5 MB/s | 657 kB 00:00 2024-09-14T11:08:01.584 INFO:teuthology.orchestra.run.smithi171.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-14T11:08:01.626 INFO:teuthology.orchestra.run.smithi171.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.4 MB/s | 206 kB 00:00 2024-09-14T11:08:01.685 INFO:teuthology.orchestra.run.smithi171.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.6 MB/s | 164 kB 00:00 2024-09-14T11:08:01.735 INFO:teuthology.orchestra.run.smithi171.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2024-09-14T11:08:01.760 INFO:teuthology.orchestra.run.smithi171.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 472 kB/s | 36 kB 00:00 2024-09-14T11:08:01.805 INFO:teuthology.orchestra.run.smithi130.stdout:(93/286): guava-30.1-6.el9.noarch.rpm 3.6 MB/s | 2.3 MB 00:00 2024-09-14T11:08:01.844 INFO:teuthology.orchestra.run.smithi171.stdout:(144/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-14T11:08:01.863 INFO:teuthology.orchestra.run.smithi130.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 1.6 MB/s | 632 kB 00:00 2024-09-14T11:08:01.888 INFO:teuthology.orchestra.run.smithi130.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 541 kB/s | 45 kB 00:00 2024-09-14T11:08:01.903 INFO:teuthology.orchestra.run.smithi171.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 1.9 MB/s | 324 kB 00:00 2024-09-14T11:08:01.970 INFO:teuthology.orchestra.run.smithi171.stdout:(146/286): libwayland-client-1.21.0-1.el9.x86_6 500 kB/s | 33 kB 00:00 2024-09-14T11:08:02.037 INFO:teuthology.orchestra.run.smithi171.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.0 MB/s | 193 kB 00:00 2024-09-14T11:08:02.062 INFO:teuthology.orchestra.run.smithi171.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 211 kB/s | 19 kB 00:00 2024-09-14T11:08:02.072 INFO:teuthology.orchestra.run.smithi130.stdout:(96/286): iso-codes-4.6.0-3.el9.noarch.rpm 6.8 MB/s | 3.5 MB 00:00 2024-09-14T11:08:02.114 INFO:teuthology.orchestra.run.smithi130.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 1.8 MB/s | 413 kB 00:00 2024-09-14T11:08:02.121 INFO:teuthology.orchestra.run.smithi171.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 154 kB/s | 13 kB 00:00 2024-09-14T11:08:02.145 INFO:teuthology.orchestra.run.smithi171.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 509 kB/s | 42 kB 00:00 2024-09-14T11:08:02.178 INFO:teuthology.orchestra.run.smithi171.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 4.8 MB/s | 277 kB 00:00 2024-09-14T11:08:02.262 INFO:teuthology.orchestra.run.smithi171.stdout:(152/286): libxshmfence-1.3-10.el9.x86_64.rpm 151 kB/s | 13 kB 00:00 2024-09-14T11:08:02.304 INFO:teuthology.orchestra.run.smithi171.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 839 kB/s | 133 kB 00:00 2024-09-14T11:08:02.329 INFO:teuthology.orchestra.run.smithi171.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 535 kB/s | 36 kB 00:00 2024-09-14T11:08:02.372 INFO:teuthology.orchestra.run.smithi171.stdout:(155/286): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-14T11:08:02.389 INFO:teuthology.orchestra.run.smithi130.stdout:(98/286): jansi-2.3.3-6.el9.x86_64.rpm 209 kB/s | 110 kB 00:00 2024-09-14T11:08:02.430 INFO:teuthology.orchestra.run.smithi171.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-14T11:08:02.456 INFO:teuthology.orchestra.run.smithi171.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-09-14T11:08:02.473 INFO:teuthology.orchestra.run.smithi130.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 8.3 MB/s | 3.3 MB 00:00 2024-09-14T11:08:02.481 INFO:teuthology.orchestra.run.smithi171.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 350 kB/s | 18 kB 00:00 2024-09-14T11:08:02.498 INFO:teuthology.orchestra.run.smithi130.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 120 kB/s | 13 kB 00:00 2024-09-14T11:08:02.531 INFO:teuthology.orchestra.run.smithi171.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 181 kB/s | 9.0 kB 00:00 2024-09-14T11:08:02.532 INFO:teuthology.orchestra.run.smithi130.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 909 kB/s | 53 kB 00:00 2024-09-14T11:08:02.557 INFO:teuthology.orchestra.run.smithi130.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 410 kB/s | 24 kB 00:00 2024-09-14T11:08:02.590 INFO:teuthology.orchestra.run.smithi130.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-14T11:08:02.615 INFO:teuthology.orchestra.run.smithi130.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 607 kB/s | 35 kB 00:00 2024-09-14T11:08:02.649 INFO:teuthology.orchestra.run.smithi130.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-14T11:08:02.675 INFO:teuthology.orchestra.run.smithi130.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 189 kB/s | 11 kB 00:00 2024-09-14T11:08:02.698 INFO:teuthology.orchestra.run.smithi171.stdout:(160/286): maven-resolver-1.6.1-10.el9.noarch.r 3.0 MB/s | 517 kB 00:00 2024-09-14T11:08:02.708 INFO:teuthology.orchestra.run.smithi130.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 411 kB/s | 24 kB 00:00 2024-09-14T11:08:02.733 INFO:teuthology.orchestra.run.smithi130.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 526 kB/s | 31 kB 00:00 2024-09-14T11:08:02.758 INFO:teuthology.orchestra.run.smithi130.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 456 kB/s | 23 kB 00:00 2024-09-14T11:08:02.784 INFO:teuthology.orchestra.run.smithi130.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 395 kB/s | 20 kB 00:00 2024-09-14T11:08:02.790 INFO:teuthology.orchestra.run.smithi171.stdout:(161/286): maven-shared-utils-3.3.4-3.el9.noarc 1.6 MB/s | 151 kB 00:00 2024-09-14T11:08:02.809 INFO:teuthology.orchestra.run.smithi130.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-14T11:08:02.843 INFO:teuthology.orchestra.run.smithi130.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 258 kB/s | 15 kB 00:00 2024-09-14T11:08:02.849 INFO:teuthology.orchestra.run.smithi171.stdout:(162/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-14T11:08:02.868 INFO:teuthology.orchestra.run.smithi130.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 486 kB/s | 28 kB 00:00 2024-09-14T11:08:02.910 INFO:teuthology.orchestra.run.smithi130.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 320 kB/s | 21 kB 00:00 2024-09-14T11:08:02.935 INFO:teuthology.orchestra.run.smithi130.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 286 kB/s | 19 kB 00:00 2024-09-14T11:08:02.960 INFO:teuthology.orchestra.run.smithi130.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 375 kB/s | 19 kB 00:00 2024-09-14T11:08:02.986 INFO:teuthology.orchestra.run.smithi130.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 607 kB/s | 30 kB 00:00 2024-09-14T11:08:03.008 INFO:teuthology.orchestra.run.smithi171.stdout:(163/286): maven-lib-3.6.3-15.el9.noarch.rpm 2.7 MB/s | 1.5 MB 00:00 2024-09-14T11:08:03.019 INFO:teuthology.orchestra.run.smithi130.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-14T11:08:03.041 INFO:teuthology.orchestra.run.smithi171.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 339 kB/s | 11 kB 00:00 2024-09-14T11:08:03.053 INFO:teuthology.orchestra.run.smithi130.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 473 kB/s | 32 kB 00:00 2024-09-14T11:08:03.117 INFO:teuthology.orchestra.run.smithi171.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.8 MB/s | 139 kB 00:00 2024-09-14T11:08:03.128 INFO:teuthology.orchestra.run.smithi130.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-14T11:08:03.153 INFO:teuthology.orchestra.run.smithi130.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2024-09-14T11:08:03.187 INFO:teuthology.orchestra.run.smithi130.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 7.3 MB/s | 435 kB 00:00 2024-09-14T11:08:03.192 INFO:teuthology.orchestra.run.smithi171.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-14T11:08:03.212 INFO:teuthology.orchestra.run.smithi130.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 529 kB/s | 31 kB 00:00 2024-09-14T11:08:03.234 INFO:teuthology.orchestra.run.smithi171.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 868 kB/s | 36 kB 00:00 2024-09-14T11:08:03.238 INFO:teuthology.orchestra.run.smithi130.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T11:08:03.263 INFO:teuthology.orchestra.run.smithi130.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T11:08:03.276 INFO:teuthology.orchestra.run.smithi171.stdout:(168/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 1.1 MB/s | 46 kB 00:00 2024-09-14T11:08:03.288 INFO:teuthology.orchestra.run.smithi130.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 730 kB/s | 37 kB 00:00 2024-09-14T11:08:03.318 INFO:teuthology.orchestra.run.smithi171.stdout:(169/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 776 kB/s | 32 kB 00:00 2024-09-14T11:08:03.322 INFO:teuthology.orchestra.run.smithi130.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-14T11:08:03.347 INFO:teuthology.orchestra.run.smithi130.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-14T11:08:03.360 INFO:teuthology.orchestra.run.smithi171.stdout:(170/286): openblas-0.3.26-2.el9.x86_64.rpm 924 kB/s | 38 kB 00:00 2024-09-14T11:08:03.372 INFO:teuthology.orchestra.run.smithi130.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T11:08:03.398 INFO:teuthology.orchestra.run.smithi130.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T11:08:03.423 INFO:teuthology.orchestra.run.smithi130.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 821 kB/s | 41 kB 00:00 2024-09-14T11:08:03.456 INFO:teuthology.orchestra.run.smithi130.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-14T11:08:03.482 INFO:teuthology.orchestra.run.smithi130.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 746 kB/s | 44 kB 00:00 2024-09-14T11:08:03.507 INFO:teuthology.orchestra.run.smithi130.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 667 kB/s | 34 kB 00:00 2024-09-14T11:08:03.541 INFO:teuthology.orchestra.run.smithi130.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-14T11:08:03.566 INFO:teuthology.orchestra.run.smithi130.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-14T11:08:03.591 INFO:teuthology.orchestra.run.smithi130.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-14T11:08:03.641 INFO:teuthology.orchestra.run.smithi130.stdout:(138/286): libsbc-1.4-9.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-14T11:08:03.666 INFO:teuthology.orchestra.run.smithi130.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-14T11:08:03.692 INFO:teuthology.orchestra.run.smithi130.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:08:03.720 INFO:teuthology.orchestra.run.smithi130.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-14T11:08:03.742 INFO:teuthology.orchestra.run.smithi130.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-14T11:08:03.768 INFO:teuthology.orchestra.run.smithi130.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 707 kB/s | 36 kB 00:00 2024-09-14T11:08:03.801 INFO:teuthology.orchestra.run.smithi130.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-14T11:08:03.835 INFO:teuthology.orchestra.run.smithi130.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.1 MB/s | 144 kB 00:00 2024-09-14T11:08:03.860 INFO:teuthology.orchestra.run.smithi130.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-14T11:08:03.877 INFO:teuthology.orchestra.run.smithi130.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 799 kB/s | 33 kB 00:00 2024-09-14T11:08:03.902 INFO:teuthology.orchestra.run.smithi130.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 463 kB/s | 19 kB 00:00 2024-09-14T11:08:03.919 INFO:teuthology.orchestra.run.smithi130.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 307 kB/s | 13 kB 00:00 2024-09-14T11:08:03.945 INFO:teuthology.orchestra.run.smithi130.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 993 kB/s | 42 kB 00:00 2024-09-14T11:08:03.970 INFO:teuthology.orchestra.run.smithi130.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.3 MB/s | 277 kB 00:00 2024-09-14T11:08:03.995 INFO:teuthology.orchestra.run.smithi130.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-14T11:08:04.020 INFO:teuthology.orchestra.run.smithi130.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-09-14T11:08:04.046 INFO:teuthology.orchestra.run.smithi130.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-09-14T11:08:04.079 INFO:teuthology.orchestra.run.smithi130.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-14T11:08:04.172 INFO:teuthology.orchestra.run.smithi130.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-14T11:08:04.197 INFO:teuthology.orchestra.run.smithi130.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 1.3 MB/s | 151 kB 00:00 2024-09-14T11:08:04.222 INFO:teuthology.orchestra.run.smithi130.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 353 kB/s | 18 kB 00:00 2024-09-14T11:08:04.272 INFO:teuthology.orchestra.run.smithi130.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-14T11:08:04.348 INFO:teuthology.orchestra.run.smithi130.stdout:(160/286): maven-resolver-1.6.1-10.el9.noarch.r 6.8 MB/s | 517 kB 00:00 2024-09-14T11:08:04.389 INFO:teuthology.orchestra.run.smithi130.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 7.7 MB/s | 1.5 MB 00:00 2024-09-14T11:08:04.415 INFO:teuthology.orchestra.run.smithi130.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-14T11:08:04.448 INFO:teuthology.orchestra.run.smithi130.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-14T11:08:04.499 INFO:teuthology.orchestra.run.smithi130.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 225 kB/s | 11 kB 00:00 2024-09-14T11:08:04.557 INFO:teuthology.orchestra.run.smithi130.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-14T11:08:04.624 INFO:teuthology.orchestra.run.smithi130.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-14T11:08:04.683 INFO:teuthology.orchestra.run.smithi130.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 624 kB/s | 36 kB 00:00 2024-09-14T11:08:04.694 INFO:teuthology.orchestra.run.smithi171.stdout:(171/286): openblas-openmp-0.3.26-2.el9.x86_64. 3.7 MB/s | 4.9 MB 00:01 2024-09-14T11:08:04.741 INFO:teuthology.orchestra.run.smithi130.stdout:(168/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 787 kB/s | 46 kB 00:00 2024-09-14T11:08:04.769 INFO:teuthology.orchestra.run.smithi171.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2024-09-14T11:08:04.800 INFO:teuthology.orchestra.run.smithi130.stdout:(169/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 553 kB/s | 32 kB 00:00 2024-09-14T11:08:04.858 INFO:teuthology.orchestra.run.smithi130.stdout:(170/286): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-14T11:08:04.870 INFO:teuthology.orchestra.run.smithi171.stdout:(173/286): opus-1.3.1-10.el9.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-09-14T11:08:04.948 INFO:teuthology.orchestra.run.smithi171.stdout:(174/286): orc-0.4.31-8.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-09-14T11:08:05.129 INFO:teuthology.orchestra.run.smithi171.stdout:(175/286): osinfo-db-20240701-2.el9.noarch.rpm 2.8 MB/s | 531 kB 00:00 2024-09-14T11:08:05.221 INFO:teuthology.orchestra.run.smithi171.stdout:(176/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 805 kB/s | 74 kB 00:00 2024-09-14T11:08:05.242 INFO:teuthology.orchestra.run.smithi130.stdout:(171/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 11 MB/s | 8.8 MB 00:00 2024-09-14T11:08:05.363 INFO:teuthology.orchestra.run.smithi171.stdout:(177/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 3.5 MB/s | 8.8 MB 00:02 2024-09-14T11:08:05.409 INFO:teuthology.orchestra.run.smithi130.stdout:(172/286): openblas-openmp-0.3.26-2.el9.x86_64. 9.0 MB/s | 4.9 MB 00:00 2024-09-14T11:08:05.422 INFO:teuthology.orchestra.run.smithi171.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 2.3 MB/s | 468 kB 00:00 2024-09-14T11:08:05.432 INFO:teuthology.orchestra.run.smithi130.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 861 kB/s | 163 kB 00:00 2024-09-14T11:08:05.472 INFO:teuthology.orchestra.run.smithi171.stdout:(179/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-14T11:08:05.474 INFO:teuthology.orchestra.run.smithi130.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 3.0 MB/s | 200 kB 00:00 2024-09-14T11:08:05.514 INFO:teuthology.orchestra.run.smithi171.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.6 MB/s | 246 kB 00:00 2024-09-14T11:08:05.516 INFO:teuthology.orchestra.run.smithi130.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 2.1 MB/s | 183 kB 00:00 2024-09-14T11:08:05.540 INFO:teuthology.orchestra.run.smithi171.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 852 kB/s | 57 kB 00:00 2024-09-14T11:08:05.558 INFO:teuthology.orchestra.run.smithi130.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 6.2 MB/s | 531 kB 00:00 2024-09-14T11:08:05.565 INFO:teuthology.orchestra.run.smithi171.stdout:(182/286): pipewire-jack-audio-connection-kit-1 181 kB/s | 9.1 kB 00:00 2024-09-14T11:08:05.583 INFO:teuthology.orchestra.run.smithi130.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-14T11:08:05.590 INFO:teuthology.orchestra.run.smithi171.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T11:08:05.625 INFO:teuthology.orchestra.run.smithi130.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 6.9 MB/s | 468 kB 00:00 2024-09-14T11:08:05.641 INFO:teuthology.orchestra.run.smithi171.stdout:(184/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.7 MB/s | 192 kB 00:00 2024-09-14T11:08:05.650 INFO:teuthology.orchestra.run.smithi130.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 3.6 MB/s | 246 kB 00:00 2024-09-14T11:08:05.684 INFO:teuthology.orchestra.run.smithi130.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-09-14T11:08:05.700 INFO:teuthology.orchestra.run.smithi171.stdout:(185/286): plexus-cipher-1.7-27.el9.noarch.rpm 441 kB/s | 26 kB 00:00 2024-09-14T11:08:05.734 INFO:teuthology.orchestra.run.smithi130.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 686 kB/s | 57 kB 00:00 2024-09-14T11:08:05.742 INFO:teuthology.orchestra.run.smithi171.stdout:(186/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 11 MB/s | 1.9 MB 00:00 2024-09-14T11:08:05.759 INFO:teuthology.orchestra.run.smithi171.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 60 kB 00:00 2024-09-14T11:08:05.759 INFO:teuthology.orchestra.run.smithi130.stdout:(182/286): pipewire-jack-audio-connection-kit-1 122 kB/s | 9.1 kB 00:00 2024-09-14T11:08:05.776 INFO:teuthology.orchestra.run.smithi171.stdout:(188/286): plexus-containers-component-annotati 545 kB/s | 18 kB 00:00 2024-09-14T11:08:05.785 INFO:teuthology.orchestra.run.smithi130.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T11:08:05.801 INFO:teuthology.orchestra.run.smithi171.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.8 MB/s | 80 kB 00:00 2024-09-14T11:08:05.827 INFO:teuthology.orchestra.run.smithi171.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 665 kB/s | 34 kB 00:00 2024-09-14T11:08:05.843 INFO:teuthology.orchestra.run.smithi130.stdout:(184/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-14T11:08:05.910 INFO:teuthology.orchestra.run.smithi130.stdout:(185/286): plexus-cipher-1.7-27.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-09-14T11:08:05.944 INFO:teuthology.orchestra.run.smithi130.stdout:(186/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 10 MB/s | 1.9 MB 00:00 2024-09-14T11:08:05.952 INFO:teuthology.orchestra.run.smithi171.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 1.6 MB/s | 254 kB 00:00 2024-09-14T11:08:05.969 INFO:teuthology.orchestra.run.smithi130.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 60 kB 00:00 2024-09-14T11:08:05.995 INFO:teuthology.orchestra.run.smithi171.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 6.3 MB/s | 1.1 MB 00:00 2024-09-14T11:08:06.003 INFO:teuthology.orchestra.run.smithi130.stdout:(188/286): plexus-containers-component-annotati 313 kB/s | 18 kB 00:00 2024-09-14T11:08:06.028 INFO:teuthology.orchestra.run.smithi130.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-14T11:08:06.053 INFO:teuthology.orchestra.run.smithi130.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 672 kB/s | 34 kB 00:00 2024-09-14T11:08:06.095 INFO:teuthology.orchestra.run.smithi130.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-14T11:08:06.162 INFO:teuthology.orchestra.run.smithi130.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-14T11:08:06.221 INFO:teuthology.orchestra.run.smithi130.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-14T11:08:06.313 INFO:teuthology.orchestra.run.smithi130.stdout:(194/286): poppler-data-0.4.9-9.el9.noarch.rpm 8.6 MB/s | 1.9 MB 00:00 2024-09-14T11:08:06.345 INFO:teuthology.orchestra.run.smithi171.stdout:(193/286): java-11-openjdk-headless-11.0.20.1.1 5.6 MB/s | 39 MB 00:06 2024-09-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi130.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-14T11:08:06.371 INFO:teuthology.orchestra.run.smithi171.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 406 kB/s | 152 kB 00:00 2024-09-14T11:08:06.371 INFO:teuthology.orchestra.run.smithi130.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-14T11:08:06.404 INFO:teuthology.orchestra.run.smithi171.stdout:(195/286): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-14T11:08:06.429 INFO:teuthology.orchestra.run.smithi171.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.4 MB/s | 83 kB 00:00 2024-09-14T11:08:06.438 INFO:teuthology.orchestra.run.smithi130.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-14T11:08:06.480 INFO:teuthology.orchestra.run.smithi171.stdout:(197/286): poppler-data-0.4.9-9.el9.noarch.rpm 3.6 MB/s | 1.9 MB 00:00 2024-09-14T11:08:06.497 INFO:teuthology.orchestra.run.smithi130.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-14T11:08:06.505 INFO:teuthology.orchestra.run.smithi171.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.6 MB/s | 679 kB 00:00 2024-09-14T11:08:06.530 INFO:teuthology.orchestra.run.smithi171.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 4.8 MB/s | 245 kB 00:00 2024-09-14T11:08:06.556 INFO:teuthology.orchestra.run.smithi171.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-14T11:08:06.564 INFO:teuthology.orchestra.run.smithi130.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-14T11:08:06.581 INFO:teuthology.orchestra.run.smithi171.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 509 kB/s | 26 kB 00:00 2024-09-14T11:08:06.607 INFO:teuthology.orchestra.run.smithi171.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 380 kB/s | 19 kB 00:00 2024-09-14T11:08:06.623 INFO:teuthology.orchestra.run.smithi130.stdout:(200/286): python3-jsonpatch-1.21-16.el9.noarch 439 kB/s | 26 kB 00:00 2024-09-14T11:08:06.632 INFO:teuthology.orchestra.run.smithi171.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-14T11:08:06.658 INFO:teuthology.orchestra.run.smithi171.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 691 kB/s | 35 kB 00:00 2024-09-14T11:08:06.690 INFO:teuthology.orchestra.run.smithi130.stdout:(201/286): python3-jsonpointer-2.0-4.el9.noarch 288 kB/s | 19 kB 00:00 2024-09-14T11:08:06.708 INFO:teuthology.orchestra.run.smithi171.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-14T11:08:06.748 INFO:teuthology.orchestra.run.smithi130.stdout:(202/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-14T11:08:06.783 INFO:teuthology.orchestra.run.smithi171.stdout:(206/286): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-14T11:08:06.807 INFO:teuthology.orchestra.run.smithi130.stdout:(203/286): python3-markupsafe-1.1.1-12.el9.x86_ 596 kB/s | 35 kB 00:00 2024-09-14T11:08:06.809 INFO:teuthology.orchestra.run.smithi171.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 2.2 MB/s | 222 kB 00:00 2024-09-14T11:08:06.834 INFO:teuthology.orchestra.run.smithi171.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T11:08:06.851 INFO:teuthology.orchestra.run.smithi171.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 1.0 MB/s | 42 kB 00:00 2024-09-14T11:08:06.877 INFO:teuthology.orchestra.run.smithi171.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 6.3 MB/s | 269 kB 00:00 2024-09-14T11:08:06.902 INFO:teuthology.orchestra.run.smithi171.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T11:08:06.927 INFO:teuthology.orchestra.run.smithi171.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T11:08:06.949 INFO:teuthology.orchestra.run.smithi130.stdout:(204/286): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-09-14T11:08:06.952 INFO:teuthology.orchestra.run.smithi171.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T11:08:06.978 INFO:teuthology.orchestra.run.smithi171.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-14T11:08:07.024 INFO:teuthology.orchestra.run.smithi130.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.3 MB/s | 250 kB 00:00 2024-09-14T11:08:07.062 INFO:teuthology.orchestra.run.smithi171.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T11:08:07.082 INFO:teuthology.orchestra.run.smithi130.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-14T11:08:07.087 INFO:teuthology.orchestra.run.smithi171.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-14T11:08:07.121 INFO:teuthology.orchestra.run.smithi171.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-14T11:08:07.146 INFO:teuthology.orchestra.run.smithi171.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 612 kB/s | 36 kB 00:00 2024-09-14T11:08:07.150 INFO:teuthology.orchestra.run.smithi130.stdout:(207/286): python3-numpy-1.20.1-5.el9.x86_64.rp 15 MB/s | 5.1 MB 00:00 2024-09-14T11:08:07.167 INFO:teuthology.orchestra.run.smithi130.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 921 kB/s | 77 kB 00:00 2024-09-14T11:08:07.171 INFO:teuthology.orchestra.run.smithi171.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-14T11:08:07.197 INFO:teuthology.orchestra.run.smithi171.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T11:08:07.200 INFO:teuthology.orchestra.run.smithi130.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-14T11:08:07.222 INFO:teuthology.orchestra.run.smithi171.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 9.9 MB/s | 510 kB 00:00 2024-09-14T11:08:07.225 INFO:teuthology.orchestra.run.smithi130.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-14T11:08:07.248 INFO:teuthology.orchestra.run.smithi171.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-14T11:08:07.259 INFO:teuthology.orchestra.run.smithi130.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-14T11:08:07.273 INFO:teuthology.orchestra.run.smithi171.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-14T11:08:07.284 INFO:teuthology.orchestra.run.smithi130.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 4.6 MB/s | 279 kB 00:00 2024-09-14T11:08:07.298 INFO:teuthology.orchestra.run.smithi171.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 7.4 MB/s | 383 kB 00:00 2024-09-14T11:08:07.318 INFO:teuthology.orchestra.run.smithi130.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-14T11:08:07.324 INFO:teuthology.orchestra.run.smithi171.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-14T11:08:07.343 INFO:teuthology.orchestra.run.smithi130.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 917 kB/s | 54 kB 00:00 2024-09-14T11:08:07.358 INFO:teuthology.orchestra.run.smithi171.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.2 MB/s | 555 kB 00:00 2024-09-14T11:08:07.400 INFO:teuthology.orchestra.run.smithi171.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-14T11:08:07.401 INFO:teuthology.orchestra.run.smithi130.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-14T11:08:07.425 INFO:teuthology.orchestra.run.smithi171.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 791 kB/s | 53 kB 00:00 2024-09-14T11:08:07.450 INFO:teuthology.orchestra.run.smithi171.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 4.4 MB/s | 230 kB 00:00 2024-09-14T11:08:07.468 INFO:teuthology.orchestra.run.smithi130.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-14T11:08:07.476 INFO:teuthology.orchestra.run.smithi171.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-14T11:08:07.501 INFO:teuthology.orchestra.run.smithi171.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 5.9 MB/s | 306 kB 00:00 2024-09-14T11:08:07.527 INFO:teuthology.orchestra.run.smithi171.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-14T11:08:07.552 INFO:teuthology.orchestra.run.smithi171.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 6.9 MB/s | 358 kB 00:00 2024-09-14T11:08:07.577 INFO:teuthology.orchestra.run.smithi171.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 844 kB/s | 42 kB 00:00 2024-09-14T11:08:07.603 INFO:teuthology.orchestra.run.smithi171.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-14T11:08:07.628 INFO:teuthology.orchestra.run.smithi171.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-14T11:08:07.662 INFO:teuthology.orchestra.run.smithi171.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 14 MB/s | 859 kB 00:00 2024-09-14T11:08:07.688 INFO:teuthology.orchestra.run.smithi171.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-14T11:08:07.738 INFO:teuthology.orchestra.run.smithi171.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 6.6 MB/s | 505 kB 00:00 2024-09-14T11:08:07.827 INFO:teuthology.orchestra.run.smithi130.stdout:(217/286): java-11-openjdk-headless-11.0.20.1.1 6.8 MB/s | 39 MB 00:05 2024-09-14T11:08:07.852 INFO:teuthology.orchestra.run.smithi130.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 94 kB/s | 36 kB 00:00 2024-09-14T11:08:07.878 INFO:teuthology.orchestra.run.smithi130.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-14T11:08:07.903 INFO:teuthology.orchestra.run.smithi130.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T11:08:07.953 INFO:teuthology.orchestra.run.smithi130.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 1.4 MB/s | 69 kB 00:00 2024-09-14T11:08:07.963 INFO:teuthology.orchestra.run.smithi171.stdout:(240/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-14T11:08:07.989 INFO:teuthology.orchestra.run.smithi171.stdout:(241/286): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-09-14T11:08:08.012 INFO:teuthology.orchestra.run.smithi130.stdout:(222/286): sisu-0.3.4-10.el9.noarch.rpm 3.7 MB/s | 510 kB 00:00 2024-09-14T11:08:08.037 INFO:teuthology.orchestra.run.smithi130.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-14T11:08:08.056 INFO:teuthology.orchestra.run.smithi171.stdout:(242/286): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-14T11:08:08.079 INFO:teuthology.orchestra.run.smithi130.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-14T11:08:08.081 INFO:teuthology.orchestra.run.smithi171.stdout:(243/286): gperftools-libs-2.9.1-3.el9.x86_64.r 3.3 MB/s | 308 kB 00:00 2024-09-14T11:08:08.106 INFO:teuthology.orchestra.run.smithi171.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 385 kB/s | 19 kB 00:00 2024-09-14T11:08:08.113 INFO:teuthology.orchestra.run.smithi130.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.0 MB/s | 152 kB 00:00 2024-09-14T11:08:08.140 INFO:teuthology.orchestra.run.smithi171.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 780 kB/s | 26 kB 00:00 2024-09-14T11:08:08.146 INFO:teuthology.orchestra.run.smithi130.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-14T11:08:08.165 INFO:teuthology.orchestra.run.smithi171.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:08:08.191 INFO:teuthology.orchestra.run.smithi171.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T11:08:08.205 INFO:teuthology.orchestra.run.smithi130.stdout:(227/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 911 kB/s | 53 kB 00:00 2024-09-14T11:08:08.225 INFO:teuthology.orchestra.run.smithi171.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-14T11:08:08.247 INFO:teuthology.orchestra.run.smithi130.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 6.9 MB/s | 944 kB 00:00 2024-09-14T11:08:08.266 INFO:teuthology.orchestra.run.smithi171.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T11:08:08.272 INFO:teuthology.orchestra.run.smithi130.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-14T11:08:08.300 INFO:teuthology.orchestra.run.smithi171.stdout:(250/286): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-09-14T11:08:08.305 INFO:teuthology.orchestra.run.smithi130.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-14T11:08:08.331 INFO:teuthology.orchestra.run.smithi130.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-14T11:08:08.342 INFO:teuthology.orchestra.run.smithi171.stdout:(251/286): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-14T11:08:08.368 INFO:teuthology.orchestra.run.smithi171.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-14T11:08:08.393 INFO:teuthology.orchestra.run.smithi171.stdout:(253/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 470 kB/s | 43 kB 00:00 2024-09-14T11:08:08.419 INFO:teuthology.orchestra.run.smithi171.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-14T11:08:08.452 INFO:teuthology.orchestra.run.smithi171.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-14T11:08:08.478 INFO:teuthology.orchestra.run.smithi171.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T11:08:08.489 INFO:teuthology.orchestra.run.smithi130.stdout:(232/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-14T11:08:08.511 INFO:teuthology.orchestra.run.smithi171.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.6 MB/s | 220 kB 00:00 2024-09-14T11:08:08.515 INFO:teuthology.orchestra.run.smithi130.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 463 kB/s | 96 kB 00:00 2024-09-14T11:08:08.540 INFO:teuthology.orchestra.run.smithi130.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 1.7 MB/s | 358 kB 00:00 2024-09-14T11:08:08.557 INFO:teuthology.orchestra.run.smithi130.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 635 kB/s | 42 kB 00:00 2024-09-14T11:08:08.578 INFO:teuthology.orchestra.run.smithi171.stdout:(258/286): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-14T11:08:08.582 INFO:teuthology.orchestra.run.smithi130.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.6 MB/s | 385 kB 00:00 2024-09-14T11:08:08.604 INFO:teuthology.orchestra.run.smithi171.stdout:(259/286): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-14T11:08:08.607 INFO:teuthology.orchestra.run.smithi130.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.0 MB/s | 134 kB 00:00 2024-09-14T11:08:08.629 INFO:teuthology.orchestra.run.smithi171.stdout:(260/286): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-14T11:08:08.641 INFO:teuthology.orchestra.run.smithi130.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 10 MB/s | 859 kB 00:00 2024-09-14T11:08:08.655 INFO:teuthology.orchestra.run.smithi171.stdout:(261/286): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-14T11:08:08.658 INFO:teuthology.orchestra.run.smithi130.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 843 kB/s | 64 kB 00:00 2024-09-14T11:08:08.680 INFO:teuthology.orchestra.run.smithi171.stdout:(262/286): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-14T11:08:08.692 INFO:teuthology.orchestra.run.smithi130.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.9 MB/s | 505 kB 00:00 2024-09-14T11:08:08.705 INFO:teuthology.orchestra.run.smithi171.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-14T11:08:08.730 INFO:teuthology.orchestra.run.smithi171.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-14T11:08:08.742 INFO:teuthology.orchestra.run.smithi130.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-14T11:08:08.756 INFO:teuthology.orchestra.run.smithi171.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:08:08.775 INFO:teuthology.orchestra.run.smithi130.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-14T11:08:08.789 INFO:teuthology.orchestra.run.smithi171.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-14T11:08:08.800 INFO:teuthology.orchestra.run.smithi130.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-14T11:08:08.815 INFO:teuthology.orchestra.run.smithi171.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-14T11:08:08.849 INFO:teuthology.orchestra.run.smithi171.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-14T11:08:08.874 INFO:teuthology.orchestra.run.smithi171.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-14T11:08:08.900 INFO:teuthology.orchestra.run.smithi171.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-14T11:08:08.909 INFO:teuthology.orchestra.run.smithi130.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-14T11:08:08.925 INFO:teuthology.orchestra.run.smithi171.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-14T11:08:08.950 INFO:teuthology.orchestra.run.smithi171.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-14T11:08:08.951 INFO:teuthology.orchestra.run.smithi130.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 942 kB/s | 26 kB 00:00 2024-09-14T11:08:08.976 INFO:teuthology.orchestra.run.smithi171.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T11:08:08.976 INFO:teuthology.orchestra.run.smithi130.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T11:08:09.001 INFO:teuthology.orchestra.run.smithi130.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T11:08:09.009 INFO:teuthology.orchestra.run.smithi171.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-14T11:08:09.027 INFO:teuthology.orchestra.run.smithi130.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 6.2 MB/s | 151 kB 00:00 2024-09-14T11:08:09.035 INFO:teuthology.orchestra.run.smithi171.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-14T11:08:09.069 INFO:teuthology.orchestra.run.smithi130.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T11:08:09.069 INFO:teuthology.orchestra.run.smithi171.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-14T11:08:09.102 INFO:teuthology.orchestra.run.smithi130.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-14T11:08:09.111 INFO:teuthology.orchestra.run.smithi171.stdout:(277/286): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-14T11:08:09.127 INFO:teuthology.orchestra.run.smithi130.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T11:08:09.145 INFO:teuthology.orchestra.run.smithi171.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-14T11:08:09.153 INFO:teuthology.orchestra.run.smithi130.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T11:08:09.170 INFO:teuthology.orchestra.run.smithi171.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-14T11:08:09.178 INFO:teuthology.orchestra.run.smithi130.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-14T11:08:09.195 INFO:teuthology.orchestra.run.smithi171.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-14T11:08:09.203 INFO:teuthology.orchestra.run.smithi130.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-14T11:08:09.229 INFO:teuthology.orchestra.run.smithi171.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-14T11:08:09.254 INFO:teuthology.orchestra.run.smithi171.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 3.4 MB/s | 206 kB 00:00 2024-09-14T11:08:09.280 INFO:teuthology.orchestra.run.smithi171.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-09-14T11:08:09.338 INFO:teuthology.orchestra.run.smithi171.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-14T11:08:09.379 INFO:teuthology.orchestra.run.smithi130.stdout:(255/286): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-09-14T11:08:09.404 INFO:teuthology.orchestra.run.smithi130.stdout:(256/286): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-09-14T11:08:09.438 INFO:teuthology.orchestra.run.smithi130.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T11:08:09.471 INFO:teuthology.orchestra.run.smithi130.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 5.5 MB/s | 144 kB 00:00 2024-09-14T11:08:09.496 INFO:teuthology.orchestra.run.smithi130.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 464 kB/s | 11 kB 00:00 2024-09-14T11:08:09.522 INFO:teuthology.orchestra.run.smithi130.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-14T11:08:09.538 INFO:teuthology.orchestra.run.smithi171.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 12 MB/s | 3.5 MB 00:00 2024-09-14T11:08:09.547 INFO:teuthology.orchestra.run.smithi130.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-14T11:08:09.572 INFO:teuthology.orchestra.run.smithi130.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-14T11:08:09.597 INFO:teuthology.orchestra.run.smithi171.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-14T11:08:09.597 INFO:teuthology.orchestra.run.smithi130.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-14T11:08:09.604 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:08:09.605 INFO:teuthology.orchestra.run.smithi171.stdout:Total 16 MB/s | 327 MB 00:20 2024-09-14T11:08:09.648 INFO:teuthology.orchestra.run.smithi130.stdout:(264/286): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-14T11:08:09.673 INFO:teuthology.orchestra.run.smithi130.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T11:08:09.698 INFO:teuthology.orchestra.run.smithi130.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T11:08:09.740 INFO:teuthology.orchestra.run.smithi130.stdout:(267/286): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-14T11:08:09.765 INFO:teuthology.orchestra.run.smithi130.stdout:(268/286): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-09-14T11:08:09.807 INFO:teuthology.orchestra.run.smithi130.stdout:(269/286): protobuf-compiler-3.14.0-13.el9.x86_ 751 kB/s | 863 kB 00:01 2024-09-14T11:08:09.824 INFO:teuthology.orchestra.run.smithi130.stdout:(270/286): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-14T11:08:09.849 INFO:teuthology.orchestra.run.smithi130.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-14T11:08:09.883 INFO:teuthology.orchestra.run.smithi130.stdout:(272/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-14T11:08:09.909 INFO:teuthology.orchestra.run.smithi130.stdout:(273/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-09-14T11:08:09.934 INFO:teuthology.orchestra.run.smithi130.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-14T11:08:09.959 INFO:teuthology.orchestra.run.smithi130.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T11:08:09.984 INFO:teuthology.orchestra.run.smithi130.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-14T11:08:10.009 INFO:teuthology.orchestra.run.smithi130.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-14T11:08:10.035 INFO:teuthology.orchestra.run.smithi130.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-14T11:08:10.060 INFO:teuthology.orchestra.run.smithi130.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-14T11:08:10.085 INFO:teuthology.orchestra.run.smithi130.stdout:(280/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-14T11:08:10.110 INFO:teuthology.orchestra.run.smithi130.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T11:08:10.136 INFO:teuthology.orchestra.run.smithi130.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T11:08:10.161 INFO:teuthology.orchestra.run.smithi130.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-14T11:08:10.211 INFO:teuthology.orchestra.run.smithi130.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T11:08:10.436 INFO:teuthology.orchestra.run.smithi130.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-14T11:08:10.570 INFO:teuthology.orchestra.run.smithi130.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 8.0 MB/s | 3.5 MB 00:00 2024-09-14T11:08:10.577 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:08:10.577 INFO:teuthology.orchestra.run.smithi130.stdout:Total 16 MB/s | 327 MB 00:19 2024-09-14T11:08:12.799 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-09-14T11:08:12.983 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-09-14T11:08:12.983 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-09-14T11:08:13.704 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-09-14T11:08:13.890 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-09-14T11:08:13.890 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-09-14T11:08:16.394 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-09-14T11:08:16.394 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-09-14T11:08:17.040 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-09-14T11:08:17.040 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-09-14T11:08:26.444 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:08:26.604 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:08:26.759 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-09-14T11:08:26.842 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:08:26.877 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:08:26.947 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:08:26.985 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:08:27.038 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:08:27.072 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:08:27.097 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:08:27.144 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:08:27.191 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T11:08:27.355 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T11:08:27.508 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-09-14T11:08:27.526 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:08:27.591 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T11:08:27.616 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:27.623 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T11:08:27.733 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T11:08:27.738 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:27.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:27.779 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T11:08:27.842 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T11:08:27.851 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:27.874 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T11:08:27.880 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:08:27.900 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T11:08:27.925 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:08:27.945 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T11:08:27.956 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:08:27.991 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:08:28.016 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:08:28.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:08:28.081 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:08:28.109 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:08:28.137 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:08:28.286 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T11:08:28.313 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:08:28.393 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:08:28.522 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:08:28.524 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:08:28.552 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:28.561 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:08:28.598 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:28.659 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:08:28.693 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:08:28.704 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:28.733 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:28.745 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T11:08:28.774 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T11:08:28.796 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:28.800 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T11:08:28.821 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:08:28.826 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T11:08:28.852 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:28.866 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T11:08:28.872 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:28.917 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T11:08:28.942 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T11:08:28.971 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T11:08:29.064 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:29.103 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:29.116 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T11:08:29.221 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:08:29.231 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T11:08:29.251 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:08:29.268 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T11:08:29.287 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:08:29.305 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T11:08:29.332 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:29.362 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:08:29.415 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:08:29.438 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:08:29.455 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:08:29.466 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:29.507 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:08:29.522 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T11:08:29.539 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:08:29.555 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T11:08:29.566 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:08:29.584 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:29.592 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:08:29.609 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T11:08:29.617 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:08:29.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:08:29.678 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:08:29.703 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:08:29.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:08:29.767 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:29.785 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:29.808 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T11:08:29.857 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:08:29.976 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:08:29.977 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T11:08:30.012 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T11:08:30.026 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:08:30.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:08:30.077 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T11:08:30.105 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:08:30.121 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T11:08:30.167 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T11:08:30.184 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:08:30.213 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T11:08:30.224 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:08:30.238 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T11:08:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T11:08:30.276 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:08:30.290 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T11:08:30.315 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T11:08:30.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:08:30.343 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T11:08:30.376 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T11:08:30.401 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T11:08:30.418 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:08:30.441 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T11:08:30.474 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:30.547 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T11:08:30.561 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:08:30.599 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T11:08:30.623 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:08:30.629 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T11:08:30.683 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T11:08:30.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T11:08:30.766 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T11:08:30.844 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T11:08:30.877 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T11:08:30.921 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T11:08:30.962 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T11:08:31.038 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T11:08:31.159 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:08:31.173 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T11:08:31.231 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T11:08:31.244 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:08:31.280 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:08:31.350 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:08:31.387 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:08:31.424 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:08:31.462 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:08:31.533 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:08:31.597 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:08:31.632 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:08:31.667 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:08:31.706 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:08:31.739 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:08:31.770 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T11:08:31.771 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:08:31.813 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:08:31.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T11:08:31.879 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:08:31.895 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T11:08:31.923 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:08:31.960 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:08:31.965 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T11:08:32.001 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T11:08:32.036 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T11:08:32.054 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:08:32.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T11:08:32.117 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:08:32.138 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T11:08:32.169 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T11:08:32.191 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:08:32.201 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T11:08:32.236 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T11:08:32.238 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:08:32.275 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T11:08:32.283 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:08:32.308 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T11:08:32.330 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:08:32.356 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T11:08:32.376 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:08:32.398 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T11:08:32.418 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:08:32.456 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T11:08:32.491 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T11:08:32.527 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T11:08:32.557 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:08:32.604 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:08:32.622 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T11:08:32.654 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:08:32.693 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T11:08:32.766 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T11:08:32.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:08:32.805 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T11:08:32.805 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:08:32.841 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T11:08:32.846 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:08:32.887 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:08:32.887 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T11:08:32.912 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:08:32.933 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T11:08:32.975 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T11:08:33.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:08:33.114 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T11:08:33.150 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:08:33.160 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T11:08:33.191 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:08:33.201 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T11:08:33.305 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T11:08:33.343 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T11:08:33.384 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T11:08:33.397 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:08:33.425 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T11:08:33.444 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:08:33.449 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T11:08:33.483 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:08:33.522 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:08:33.545 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T11:08:33.564 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:08:33.593 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:33.607 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:33.607 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:08:33.607 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:08:33.678 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T11:08:33.718 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T11:08:33.789 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:08:33.868 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:08:33.925 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T11:08:33.934 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:08:33.959 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:33.961 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T11:08:33.985 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:33.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T11:08:34.020 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:08:34.022 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T11:08:34.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T11:08:34.092 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:34.104 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T11:08:34.104 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T11:08:34.105 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:08:34.296 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T11:08:34.374 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T11:08:34.433 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T11:08:34.446 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:34.458 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:34.475 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:34.483 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T11:08:34.489 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:34.490 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:08:34.490 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:08:34.509 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T11:08:34.540 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:08:34.575 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:08:34.608 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:08:34.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:08:34.685 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:08:34.774 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:08:34.824 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:08:34.856 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:08:34.954 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:34.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:08:34.988 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:35.002 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T11:08:35.002 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T11:08:35.002 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:08:35.016 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:08:35.044 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T11:08:35.078 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T11:08:35.111 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T11:08:35.153 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T11:08:35.188 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T11:08:35.276 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T11:08:35.319 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T11:08:35.374 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T11:08:35.479 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T11:08:35.534 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T11:08:35.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:08:35.822 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:08:35.856 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:08:35.958 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:08:36.000 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:08:36.201 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:08:36.248 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:08:36.276 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T11:08:36.288 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:08:36.322 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T11:08:36.362 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T11:08:36.576 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T11:08:36.793 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:08:36.821 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T11:08:36.858 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:08:36.895 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:08:36.929 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:08:36.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:08:37.013 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T11:08:37.053 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T11:08:37.098 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T11:08:37.147 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:08:37.177 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:08:37.255 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:08:37.600 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T11:08:37.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T11:08:37.706 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T11:08:37.740 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T11:08:37.773 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T11:08:37.937 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:08:37.956 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T11:08:37.988 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T11:08:38.054 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:08:38.073 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T11:08:38.736 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T11:08:38.844 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T11:08:39.374 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:08:39.470 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:08:39.523 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:08:39.555 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:08:39.583 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:08:39.612 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:39.625 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:08:39.625 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:08:39.682 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:08:39.709 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:08:39.737 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:08:40.062 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:08:40.109 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:40.122 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T11:08:40.197 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T11:08:40.227 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:40.248 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T11:08:40.259 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:08:40.283 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T11:08:40.291 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:08:40.310 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T11:08:40.320 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:08:40.339 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:40.351 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T11:08:40.351 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T11:08:40.351 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:08:40.396 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:08:40.398 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T11:08:40.427 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T11:08:40.429 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:08:40.455 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:08:40.463 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T11:08:40.498 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:08:40.520 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:40.784 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T11:08:40.826 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:40.829 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:40.872 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:08:40.901 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:08:40.909 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T11:08:40.926 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:08:40.941 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T11:08:40.960 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:08:40.965 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T11:08:40.986 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:08:40.986 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T11:08:41.011 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:08:41.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:08:41.044 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T11:08:41.076 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:08:41.085 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T11:08:41.117 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:08:41.119 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T11:08:41.151 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:08:41.159 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T11:08:41.184 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:41.200 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:08:41.236 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:08:41.457 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T11:08:41.502 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T11:08:41.530 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T11:08:41.555 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T11:08:41.581 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T11:08:41.606 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T11:08:41.631 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T11:08:41.659 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T11:08:41.691 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:08:41.695 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T11:08:41.740 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T11:08:41.770 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T11:08:41.818 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T11:08:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:08:41.845 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T11:08:41.892 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:08:41.926 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:08:41.962 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:08:42.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:08:42.093 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:08:42.128 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:42.148 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:42.174 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:08:42.226 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:08:42.269 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:08:42.298 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:42.309 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T11:08:42.436 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T11:08:42.493 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T11:08:42.518 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T11:08:42.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T11:08:42.621 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T11:08:42.662 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T11:08:42.694 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:42.714 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T11:08:42.740 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T11:08:42.766 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T11:08:42.801 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T11:08:42.829 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:53.928 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:53.970 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:08:54.007 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:08:54.053 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:08:54.082 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:08:54.119 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:08:54.505 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T11:08:54.552 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T11:08:54.580 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T11:08:54.612 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T11:08:54.644 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:08:54.645 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T11:08:54.676 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:54.681 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T11:08:54.749 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:54.778 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:08:55.189 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T11:08:55.220 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:55.304 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T11:08:55.330 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T11:08:57.138 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:57.176 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:57.649 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:57.686 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:57.741 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:57.779 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:57.876 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:57.876 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:08:57.876 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:08:57.876 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:08:57.905 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:08:58.252 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T11:08:58.289 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:58.383 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T11:08:58.383 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T11:08:58.383 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T11:08:58.383 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:08:58.416 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:09:07.267 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:09:07.267 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-09-14T11:09:07.267 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-09-14T11:09:07.267 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-09-14T11:09:07.268 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-09-14T11:09:07.268 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-09-14T11:09:07.268 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-09-14T11:09:07.268 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-09-14T11:09:07.268 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:07.445 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:07.461 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:07.461 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:07.461 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:09:07.461 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-09-14T11:09:07.679 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-09-14T11:09:07.680 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-09-14T11:09:07.680 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:07.854 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:07.870 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T11:09:07.870 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:07.870 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T11:09:07.870 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:08.937 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:08.964 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:08.964 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:08.965 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:09:08.965 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:08.965 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:08.965 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:09.196 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:09.220 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:09.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T11:09:09.364 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:09.588 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:09.611 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T11:09:09.611 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:09.611 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T11:09:09.611 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:09.612 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T11:09:09.612 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:09.672 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:09.695 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:09.695 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:09.696 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:09:09.696 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:09.696 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:09.696 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:09.798 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:09:10.056 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T11:09:10.079 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:10.188 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T11:09:12.655 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:09:12.764 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:09:12.821 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:09:12.876 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:09:13.028 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T11:09:13.061 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:09:13.117 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:09:13.122 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T11:09:13.179 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T11:09:13.194 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:09:13.243 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T11:09:13.291 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:09:13.422 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:09:13.428 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T11:09:13.479 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:09:13.483 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T11:09:13.518 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:09:13.552 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T11:09:13.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T11:09:13.780 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T11:09:13.825 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T11:09:13.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T11:09:14.376 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:09:14.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:14.729 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T11:09:14.789 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:14.796 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:14.838 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:09:14.869 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:09:14.897 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:09:14.932 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:09:14.969 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:09:14.996 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:09:15.022 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:09:15.048 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:09:15.072 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:09:15.107 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:09:15.141 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:09:15.150 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T11:09:15.168 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:09:15.187 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T11:09:15.198 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:09:15.218 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T11:09:15.226 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:09:15.246 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T11:09:15.261 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:09:15.281 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T11:09:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:09:15.318 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T11:09:15.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:09:15.337 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T11:09:15.363 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T11:09:15.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:09:15.388 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T11:09:15.405 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:09:15.413 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T11:09:15.439 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T11:09:15.450 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:09:15.465 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T11:09:15.489 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:09:15.491 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T11:09:15.522 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T11:09:15.531 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:09:15.550 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T11:09:15.575 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:09:15.585 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T11:09:15.607 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:09:15.621 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T11:09:15.630 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:09:15.651 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T11:09:15.683 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:09:15.686 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T11:09:15.712 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T11:09:15.724 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:09:15.749 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T11:09:15.754 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:09:15.783 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:09:15.787 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T11:09:15.809 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:09:15.829 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T11:09:15.874 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T11:09:15.905 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T11:09:15.928 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T11:09:15.979 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:09:15.981 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T11:09:16.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:09:16.014 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T11:09:16.044 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T11:09:16.045 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:09:16.073 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T11:09:16.080 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:09:16.098 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T11:09:16.112 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:09:16.242 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:09:16.268 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T11:09:16.299 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T11:09:16.302 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:09:16.326 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T11:09:16.353 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T11:09:16.385 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T11:09:16.389 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:09:16.425 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:16.514 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T11:09:16.543 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:16.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T11:09:16.589 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:16.605 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:16.634 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:09:16.648 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T11:09:16.656 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:09:16.681 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:16.803 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T11:09:16.852 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:16.868 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T11:09:16.897 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T11:09:16.920 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T11:09:17.062 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.086 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.102 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.102 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:09:17.102 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:17.319 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:09:17.367 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.398 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:09:17.399 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.416 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T11:09:17.416 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T11:09:17.416 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:17.436 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:09:17.480 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:09:17.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:09:17.641 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T11:09:17.718 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T11:09:17.765 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T11:09:17.802 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T11:09:17.827 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T11:09:17.879 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:17.910 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:17.925 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:18.251 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:18.281 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:18.297 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T11:09:18.466 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:18.546 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:18.584 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:18.613 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:18.810 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:09:18.817 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:18.865 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:09:18.895 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T11:09:18.900 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:18.922 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:18.932 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:18.961 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T11:09:18.968 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:19.039 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:19.095 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:19.106 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:19.138 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:19.156 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T11:09:19.161 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:19.189 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:09:19.213 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T11:09:19.249 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:19.270 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T11:09:19.299 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:19.366 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T11:09:19.406 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:19.417 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T11:09:19.444 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T11:09:19.495 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T11:09:19.645 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:19.677 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:09:19.795 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:09:19.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:19.941 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:19.967 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T11:09:20.001 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T11:09:20.068 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T11:09:20.092 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:23.001 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:23.065 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:23.264 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T11:09:23.331 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:24.029 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:24.057 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:24.173 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:24.288 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T11:09:24.323 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:24.339 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:09:24.368 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:24.392 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:24.392 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:24.392 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:09:24.392 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:24.393 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:24.393 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:24.439 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T11:09:24.443 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:24.455 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:24.478 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:09:24.515 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:09:24.572 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:09:24.593 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T11:09:24.596 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:24.612 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:24.612 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:09:24.612 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:24.625 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T11:09:24.649 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:24.701 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:24.713 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T11:09:24.735 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T11:09:24.764 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T11:09:24.813 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T11:09:24.837 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:24.852 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T11:09:24.852 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T11:09:24.853 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:25.572 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:25.595 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:25.596 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:25.596 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:09:25.596 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:25.596 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:25.596 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:25.639 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:25.661 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:25.662 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:25.662 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:09:25.662 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:25.812 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:09:25.836 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:25.880 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:25.902 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T11:09:25.903 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:25.903 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T11:09:25.903 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:25.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:25.997 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:26.214 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T11:09:26.237 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:30.718 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:09:30.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:09:30.799 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:09:30.903 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:09:30.942 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T11:09:30.967 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:30.983 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T11:09:30.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:09:30.998 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:31.015 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T11:09:31.091 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:31.091 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:31.119 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T11:09:31.182 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:31.184 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:31.200 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:09:31.206 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:09:31.217 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T11:09:31.217 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:31.217 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:09:31.226 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:09:31.226 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:31.226 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:31.226 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:31.281 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:31.307 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T11:09:31.307 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:31.350 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:31.389 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:31.411 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T11:09:31.418 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T11:09:31.426 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T11:09:31.436 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T11:09:31.436 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:31.437 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T11:09:31.437 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:31.500 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:31.568 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T11:09:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:41.433 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:09:41.434 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:09:41.435 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:09:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:09:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:09:41.436 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:09:41.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:09:41.461 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:09:41.462 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:09:41.463 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:09:41.464 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:09:41.465 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:09:41.466 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:09:41.467 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:09:41.468 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:09:41.469 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:09:41.470 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:09:41.471 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:09:41.472 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:09:41.473 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:09:41.474 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:09:41.475 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:09:41.476 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:09:41.477 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:09:41.478 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:09:41.479 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:09:41.480 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:09:41.481 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:09:41.482 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:09:41.482 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:41.482 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:09:41.482 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:09:41.789 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:41.789 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T11:09:41.789 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T11:09:41.789 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T11:09:41.789 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T11:09:41.790 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T11:09:41.791 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T11:09:41.792 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T11:09:41.815 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T11:09:41.816 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T11:09:41.817 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T11:09:41.818 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T11:09:41.819 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T11:09:41.820 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T11:09:41.821 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T11:09:41.822 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T11:09:41.823 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T11:09:41.824 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T11:09:41.825 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T11:09:41.826 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T11:09:41.827 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T11:09:41.828 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T11:09:41.829 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T11:09:41.830 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T11:09:41.831 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T11:09:41.832 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T11:09:41.833 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T11:09:41.834 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T11:09:41.835 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T11:09:44.870 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:44.870 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:44.870 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-09-14T11:09:44.870 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.870 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:09:44.871 INFO:teuthology.orchestra.run.smithi130.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.872 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.873 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:09:44.874 INFO:teuthology.orchestra.run.smithi130.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:09:44.875 INFO:teuthology.orchestra.run.smithi130.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:09:44.876 INFO:teuthology.orchestra.run.smithi130.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:09:44.877 INFO:teuthology.orchestra.run.smithi130.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:09:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:09:44.879 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:09:44.880 INFO:teuthology.orchestra.run.smithi130.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:09:44.881 INFO:teuthology.orchestra.run.smithi130.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:09:44.882 INFO:teuthology.orchestra.run.smithi130.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:09:44.883 INFO:teuthology.orchestra.run.smithi130.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:09:44.884 INFO:teuthology.orchestra.run.smithi130.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:09:44.885 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:09:44.886 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:09:44.887 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:09:44.888 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:09:44.889 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.890 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:09:44.891 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:09:44.892 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:09:44.893 INFO:teuthology.orchestra.run.smithi130.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:09:44.894 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:09:44.894 INFO:teuthology.orchestra.run.smithi130.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:09:44.894 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:44.894 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-09-14T11:09:45.245 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T11:09:45.245 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:45.245 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-09-14T11:09:45.245 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T11:09:45.246 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.247 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.248 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T11:09:45.249 INFO:teuthology.orchestra.run.smithi171.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T11:09:45.250 INFO:teuthology.orchestra.run.smithi171.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: guava-30.1-6.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T11:09:45.251 INFO:teuthology.orchestra.run.smithi171.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T11:09:45.252 INFO:teuthology.orchestra.run.smithi171.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T11:09:45.253 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:45.254 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T11:09:45.255 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T11:09:45.256 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T11:09:45.257 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T11:09:45.259 INFO:teuthology.orchestra.run.smithi171.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T11:09:45.260 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T11:09:45.261 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T11:09:45.262 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T11:09:45.263 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T11:09:45.264 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T11:09:45.265 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.266 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T11:09:45.267 INFO:teuthology.orchestra.run.smithi171.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T11:09:45.268 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi171.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:45.269 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-09-14T11:09:45.353 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:45.677 DEBUG:teuthology.parallel:result is None 2024-09-14T11:09:45.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:09:45.826 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:09:45.901 INFO:teuthology.orchestra.run.smithi130.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:09:45.902 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:09:45.902 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:09:45.904 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:09:46.046 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T11:09:46.115 INFO:teuthology.orchestra.run.smithi171.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T11:09:46.115 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T11:09:46.115 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T11:09:46.118 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:09:46.118 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:46.118 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:09:46.167 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:46.167 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:09:46.208 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:09:46.209 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:46.209 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:09:46.252 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:09:46.333 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:46.334 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:09:46.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:09:46.452 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:09:46.452 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:46.452 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:09:46.494 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:09:46.574 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:46.575 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:09:46.613 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:09:46.692 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:09:46.692 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:46.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:09:46.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:09:46.810 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:46.811 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:09:46.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:09:46.927 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:09:47.012 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:09:47.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-09-14T11:09:47.015 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-09-14T11:09:47.054 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:09:47.054 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:09:47.094 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:09:47.133 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:09:47.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:09:47.173 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:09:47.223 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:09:47.223 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:09:47.224 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904168', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqSrsDaUvpTqkAQmgRF2RhFekaaM72eB4cMbiBgSoLEsxZGXLsMJKRma88cKUreH+2YJngF25sHuGxDMawM0lc=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK8BfyeAb4U7IZY7AR+msHawAueKH3pAiIgYOQDYm1gEGCErr/AKEtlAtx1g954BCq99o+VT3sH2IsctTA/khFI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:09:47.224 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:09:47.252 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:09:47.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:09:47.323 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:09:47.361 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:47.361 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:09:47.429 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:09:47.430 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-09-14T11:09:47.498 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:09:47.498 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-14 11:09:32.592979299 +0000 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-14 11:07:07.524052347 +0000 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-14 11:07:07.524052347 +0000 2024-09-14T11:09:47.499 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-14 11:07:07.524052347 +0000 2024-09-14T11:09:47.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:09:47.575 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-14T11:09:47.575 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-14T11:09:47.575 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000261649 s, 2.0 MB/s 2024-09-14T11:09:47.576 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:09:47.646 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-14 11:09:32.593979280 +0000 2024-09-14T11:09:47.715 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-14 11:07:07.844046486 +0000 2024-09-14T11:09:47.716 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-14 11:07:07.844046486 +0000 2024-09-14T11:09:47.716 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-14 11:07:07.844046486 +0000 2024-09-14T11:09:47.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:09:47.792 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-14T11:09:47.792 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-14T11:09:47.792 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000218314 s, 2.3 MB/s 2024-09-14T11:09:47.793 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:09:47.864 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-09-14T11:09:47.934 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:09:47.934 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:47.934 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T11:09:47.934 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:47.935 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:47.935 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-14 11:09:32.593979280 +0000 2024-09-14T11:09:47.935 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-14 11:07:08.171040497 +0000 2024-09-14T11:09:47.935 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-14 11:07:08.171040497 +0000 2024-09-14T11:09:47.935 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-14 11:07:08.171040497 +0000 2024-09-14T11:09:47.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:09:48.013 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-14T11:09:48.013 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-14T11:09:48.013 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.0002117 s, 2.4 MB/s 2024-09-14T11:09:48.013 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:09:48.082 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-09-14T11:09:48.152 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:09:48.152 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:48.152 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-09-14 11:09:32.593979280 +0000 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-09-14 11:07:08.482034800 +0000 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-09-14 11:07:08.482034800 +0000 2024-09-14T11:09:48.153 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-09-14 11:07:08.482034800 +0000 2024-09-14T11:09:48.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:09:48.229 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-09-14T11:09:48.229 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-09-14T11:09:48.229 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000186983 s, 2.7 MB/s 2024-09-14T11:09:48.230 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:09:48.301 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:48.301 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:48.301 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:09:48.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:09:48.333 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-14T11:09:48.403 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-14 11:09:32.448349010 +0000 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-14 11:07:09.904175491 +0000 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-14 11:07:09.904175491 +0000 2024-09-14T11:09:48.404 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-14 11:07:09.904175491 +0000 2024-09-14T11:09:48.405 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:09:48.483 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-14T11:09:48.483 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-14T11:09:48.483 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000210074 s, 2.4 MB/s 2024-09-14T11:09:48.484 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:09:48.555 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-14 11:09:32.448349010 +0000 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-14 11:07:10.246168898 +0000 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-14 11:07:10.246168898 +0000 2024-09-14T11:09:48.629 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-14 11:07:10.246168898 +0000 2024-09-14T11:09:48.630 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:09:48.706 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-14T11:09:48.706 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-14T11:09:48.706 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000206596 s, 2.5 MB/s 2024-09-14T11:09:48.707 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:09:48.778 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-14T11:09:48.847 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-14 11:09:32.449348990 +0000 2024-09-14T11:09:48.848 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-14 11:07:10.571162632 +0000 2024-09-14T11:09:48.849 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-14 11:07:10.571162632 +0000 2024-09-14T11:09:48.849 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-14 11:07:10.571162632 +0000 2024-09-14T11:09:48.849 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:09:48.927 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-14T11:09:48.927 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-14T11:09:48.928 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000205346 s, 2.5 MB/s 2024-09-14T11:09:48.929 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:09:48.999 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-14T11:09:49.069 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-14 11:09:32.449348990 +0000 2024-09-14T11:09:49.070 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-14 11:07:10.889156501 +0000 2024-09-14T11:09:49.071 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-14 11:07:10.889156501 +0000 2024-09-14T11:09:49.071 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-09-14 11:07:10.889156501 +0000 2024-09-14T11:09:49.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:09:49.147 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-14T11:09:49.147 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-14T11:09:49.147 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000198731 s, 2.6 MB/s 2024-09-14T11:09:49.148 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:09:49.217 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:49.218 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:09:49.218 INFO:tasks.ceph:Generating config... 2024-09-14T11:09:49.219 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:09:49.219 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:09:49.219 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:09:49.219 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:09:49.219 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:09:49.220 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:09:49.221 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:09:49.221 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:09:49.221 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:09:49.221 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:09:49.221 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T11:09:49.221 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:09:49.221 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:09:49.221 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:09:49.222 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:09:49.223 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:09:49.223 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:09:49.223 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:09:49.223 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:09:49.296 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:09:49.299 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:09:49.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:49.396 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]'), ('mon.b', '172.21.15.171')] 2024-09-14T11:09:49.397 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.171', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:09:49.397 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:49.397 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:09:49.467 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --add b 172.21.15.171 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:49.566 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: generated fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stdout:setting min_mon_release = quincy 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stdout:epoch 0 2024-09-14T11:09:49.567 INFO:teuthology.orchestra.run.smithi130.stdout:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:min_mon_release 17 (quincy) 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:election_strategy: 1 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:09:49.568 INFO:teuthology.orchestra.run.smithi130.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:09:49.569 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:09:49.598 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 96e8008b-f06f-4b4a-864e-50e587612172... 2024-09-14T11:09:49.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:09:49.641 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.695 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:09:49.696 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:09:49.697 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-09-14T11:09:49.698 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.171" 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: mon client directed command retry = 5 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: ms inject socket failures = 5000 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-09-14T11:09:49.699 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.700 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2024-09-14T11:09:49.701 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug objclass = 20 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: lockdep = True 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:09:49.702 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: osd shutdown pgref assert = True 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:49.703 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:49.704 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: lockdep = True 2024-09-14T11:09:49.705 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = True 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: debug rgw = 20 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: debug rgw notification = 20 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw bucket counters cache = True 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt require ssl = False 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:09:49.706 INFO:teuthology.orchestra.run.smithi130.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw s3 auth use sts = True 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw torrent flag = True 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: rgw user counters cache = True 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: setgroup = ceph 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout: setuser = ceph 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-09-14T11:09:49.707 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.708 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:09:49.709 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-14T11:09:49.710 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790],172.21.15.171" 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: mon client directed command retry = 5 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: ms inject socket failures = 5000 2024-09-14T11:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-14T11:09:49.712 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-14T11:09:49.713 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-14T11:09:49.714 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: debug objclass = 20 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: lockdep = True 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: osd shutdown pgref assert = True 2024-09-14T11:09:49.715 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-14T11:09:49.716 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:09:49.717 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: lockdep = True 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-14T11:09:49.718 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = True 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw = 20 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw notification = 20 2024-09-14T11:09:49.719 INFO:teuthology.orchestra.run.smithi171.stdout: rgw bucket counters cache = True 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt require ssl = False 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T11:09:49.720 INFO:teuthology.orchestra.run.smithi171.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: rgw s3 auth use sts = True 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: rgw torrent flag = True 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: rgw user counters cache = True 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: setgroup = ceph 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout: setuser = ceph 2024-09-14T11:09:49.721 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-14T11:09:49.722 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-14T11:09:49.722 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-14T11:09:49.724 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:09:49.724 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:09:49.831 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:09:49.832 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:49.832 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:09:49.862 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:49.862 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:09:49.930 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:09:49.930 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:49.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:09:49.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:50.018 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:09:50.018 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:50.088 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:09:50.088 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:50.088 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:09:50.088 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:09:50.138 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:09:50.138 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:50.208 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:09:50.208 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:09:50.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:09:50.274 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:09:50.276 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:09:50.348 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:09:50.351 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:09:50.351 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:09:50.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:09:50.406 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:09:50.419 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:09:50.474 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:09:50.487 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:09:50.487 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:09:50.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:50.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:50.525 INFO:tasks.ceph:role: osd.0 2024-09-14T11:09:50.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:09:50.525 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:09:50.610 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:50.610 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:50.611 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:51.097 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-14T11:09:51.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-14T11:09:51.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:51.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:51.243 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:51.282 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:51.282 INFO:tasks.ceph:role: osd.1 2024-09-14T11:09:51.282 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:09:51.282 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:09:51.369 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:51.370 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:51.820 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-14T11:09:51.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-14T11:09:51.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:51.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:51.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:52.034 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:52.034 INFO:tasks.ceph:role: osd.2 2024-09-14T11:09:52.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:09:52.035 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:52.122 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:52.592 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-14T11:09:52.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-14T11:09:52.595 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:52.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:09:52.707 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:52.786 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:09:52.786 INFO:tasks.ceph:role: osd.3 2024-09-14T11:09:52.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:09:52.786 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:09:52.872 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:09:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:09:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:09:52.872 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:09:52.873 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:09:53.373 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-09-14T11:09:53.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-09-14T11:09:53.375 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:53.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:09:53.519 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:53.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:53.625+0000 7f00e141a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:09:53.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:53.631+0000 7f00e141a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:09:53.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:53.631+0000 7f00e141a640 -1 bdev(0x562d62b3f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:53.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:53.631+0000 7f00e141a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:09:56.805 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:09:56.851 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:09:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:56.957+0000 7fda7d21c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:09:56.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:56.957+0000 7fda7d21c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:09:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:56.957+0000 7fda7d21c640 -1 bdev(0x5613e143f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:09:56.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:09:56.958+0000 7fda7d21c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:09:59.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:09:59.914 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:00.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:00.018+0000 7f9a8ea44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:10:00.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:00.019+0000 7f9a8ea44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:10:00.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:00.019+0000 7f9a8ea44640 -1 bdev(0x56167ad51800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:00.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:00.019+0000 7f9a8ea44640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:10:03.186 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:10:03.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:03.296+0000 7f457bc0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:03.296+0000 7f457bc0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:03.296+0000 7f457bc0c640 -1 bdev(0x56080aa43800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:03.295 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:10:03.296+0000 7f457bc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:10:06.946 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:10:06.990 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:07.038 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:07.038 INFO:tasks.ceph:role: osd.4 2024-09-14T11:10:07.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:10:07.038 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:07.088 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:07.089 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:07.089 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:07.089 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:07.604 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-14T11:10:07.607 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-14T11:10:07.607 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:07.724 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:07.768 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:07.808 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:07.808 INFO:tasks.ceph:role: osd.5 2024-09-14T11:10:07.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:10:07.808 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:10:07.894 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:07.894 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:07.894 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:07.894 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:07.894 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:07.895 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:07.895 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:07.895 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:07.895 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:07.895 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:08.362 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-14T11:10:08.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-14T11:10:08.364 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:08.416 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:08.458 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:08.536 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:08.537 INFO:tasks.ceph:role: osd.6 2024-09-14T11:10:08.537 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:10:08.537 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:08.623 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:09.113 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-14T11:10:09.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-14T11:10:09.116 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:09.209 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:09.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:09.294 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:10:09.294 INFO:tasks.ceph:role: osd.7 2024-09-14T11:10:09.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:10:09.294 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:10:09.382 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:10:09.873 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-14T11:10:09.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-14T11:10:09.875 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:09.965 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:10.009 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:10.083 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:10.085+0000 7f19897a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:10:10.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:10.089+0000 7f19897a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:10:10.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:10.089+0000 7f19897a8640 -1 bdev(0x55cab70a9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:10.088 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:10.089+0000 7f19897a8640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:10:13.240 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:10:13.285 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:13.347 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:13.349+0000 7f8428287640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:10:13.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:13.349+0000 7f8428287640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:10:13.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:13.349+0000 7f8428287640 -1 bdev(0x55c496003800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:13.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:13.349+0000 7f8428287640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:10:16.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:10:16.801 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:16.864 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:16.866+0000 7f79a9887640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:10:16.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:16.866+0000 7f79a9887640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:10:16.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:16.866+0000 7f79a9887640 -1 bdev(0x55d311c83800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:16.865 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:16.866+0000 7f79a9887640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:10:20.520 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:10:20.565 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:20.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:20.629+0000 7fdf42a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:10:20.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:20.629+0000 7fdf42a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:10:20.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:20.629+0000 7fdf42a0d640 -1 bdev(0x55d5b4379800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:10:20.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-14T11:10:20.629+0000 7fdf42a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:10:24.032 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:10:24.077 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:10:24.077 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.077 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:10:24.123 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:10:24.206 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.206 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:10:24.287 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.287 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:10:24.367 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.367 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:10:24.445 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:10:24.492 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.492 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:10:24.576 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:10:24.658 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.658 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:10:24.738 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:10:24.817 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:24.817 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:10:24.847 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:24.847 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:10:24.886 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:10:24.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:10:24.890 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:10:24.929 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-09-14T11:10:24.929 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD+buVmfZ57EBAAiCeM0FgudIZe0uaxmztu1Q== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQABb+VmZiNfJRAAK7IkFldEepEDJA5/oXXy4w== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAEb+VmOrklORAAxpFY7vnp9k6d4veCFB9rmA== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAIb+Vm5eExARAARJ5VC0LOBSrh086lKPsOvQ== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQALb+VmDWa8ERAAmJsitMMWv/Cv8ljU3V6SUw== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD+buVmK5XqFBAA9fSMh0bPEuvdek217IZ7bg== 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-09-14T11:10:24.930 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQASb+VmA2wfBRAA3sSOR4+2+fTCR1n1953HbQ== 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAVb+VmAbDbFBAAFyUQsCias1sB3RM3n21OEg== 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAYb+VmTvOrMxAAtAIWq9cM6OCLHa6ViC6KMQ== 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAcb+VmSnePJRAAuyRdM/Dy5eJSkRyAckk+nA== 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD+buVm/+BhGBAAkIXONE4HYt4dE0WFrl3J7g== 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-09-14T11:10:24.931 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQD+buVm2U5oHBAAeEPmlTLoT2X8qo5ouXEbSw== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQD+buVmfZ57EBAAiCeM0FgudIZe0uaxmztu1Q== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQABb+VmZiNfJRAAK7IkFldEepEDJA5/oXXy4w== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAEb+VmOrklORAAxpFY7vnp9k6d4veCFB9rmA== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAIb+Vm5eExARAARJ5VC0LOBSrh086lKPsOvQ== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQALb+VmDWa8ERAAmJsitMMWv/Cv8ljU3V6SUw== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQD+buVmK5XqFBAA9fSMh0bPEuvdek217IZ7bg== 2024-09-14T11:10:24.963 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQASb+VmA2wfBRAA3sSOR4+2+fTCR1n1953HbQ== 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAVb+VmAbDbFBAAFyUQsCias1sB3RM3n21OEg== 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAYb+VmTvOrMxAAtAIWq9cM6OCLHa6ViC6KMQ== 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAcb+VmSnePJRAAuyRdM/Dy5eJSkRyAckk+nA== 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQD+buVm/+BhGBAAkIXONE4HYt4dE0WFrl3J7g== 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-09-14T11:10:24.964 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQD+buVm2U5oHBAAeEPmlTLoT2X8qo5ouXEbSw== 2024-09-14T11:10:24.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:24.975 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.069 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.072 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.139 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.204 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.206 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.271 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.273 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.341 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:10:25.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.408 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.473 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.476 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.541 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.543 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.609 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.612 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:10:25.676 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:25.678 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:25.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:25.748 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:10:25.816 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:10:25.816 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:10:25.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:25.963 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:10:26.001 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:10:26.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:26.189 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:10:26.227 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:10:26.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:10:26.379 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:10:26.417 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:26.420 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:10:26.486 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:10:26.487 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:10:26.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:10:26.489 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:10:26.490 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:10:26.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:10:26.492 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:10:26.492 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:10:26.492 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:10:26.530 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:10:26.530 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:10:26.530 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:10:26.530 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:10:26.532 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:10:26.532 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:10:26.533 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:10:26.537 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:10:26.537 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:10:26.537 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:10:26.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:10:31.908 INFO:teuthology.orchestra.run.smithi130.stderr:adjusted tunables profile to default 2024-09-14T11:10:31.920 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:10:31.920 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:10:31.920 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:31.920 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:10:31.958 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:31.958 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:10:32.037 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:32.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:10:32.115 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:10:32.115 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:10:32.195 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:32.195 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:10:32.235 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:32.235 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:10:32.314 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:32.314 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:10:32.393 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-14T11:10:32.393 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:10:32.473 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 238b3c2d-4100-4b07-8495-bfdcdfeba19f 0 2024-09-14T11:10:32.714 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-09-14T11:10:32.725 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 7ceff183-4838-418a-9c2a-f163f9e3865b 1 2024-09-14T11:10:32.924 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-14T11:10:32.935 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new c1f7f0d6-3654-44f6-95f6-4f6a89aea033 2 2024-09-14T11:10:33.132 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-09-14T11:10:33.143 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0 3 2024-09-14T11:10:33.341 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-09-14T11:10:33.353 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 05ca818d-004d-4052-9216-428dfc8b1486 4 2024-09-14T11:10:33.548 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-09-14T11:10:33.560 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new a143b896-1099-4cd9-953e-8b1055d763ae 5 2024-09-14T11:10:33.758 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-09-14T11:10:33.770 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0c8bf135-7a18-423d-84ac-75d120df2472 6 2024-09-14T11:10:33.967 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-09-14T11:10:33.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 1d28866b-395a-40cf-805d-2d28c635d16b 7 2024-09-14T11:10:34.177 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-09-14T11:10:34.188 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:10:34.189 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:10:34.191 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:10:34.191 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:10:34.191 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:10:34.193 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:10:34.193 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:10:34.193 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:10:34.195 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:10:34.196 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:10:34.196 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:10:34.198 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:10:34.198 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:10:34.198 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:10:34.201 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:10:34.201 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:10:34.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:10:34.203 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:10:34.203 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:10:34.203 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:10:34.205 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:10:34.205 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:10:34.205 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:10:34.207 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:10:34.208 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:34.442 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:34.442 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":10,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:34.175220+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:34.456 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:10:34.456 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:10:35.263 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:35.454 INFO:teuthology.misc.health.smithi130.stdout: 2024-09-14T11:10:35.455 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":10,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:34.175220+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:35.461 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-14T11:10:35.463+0000 7f30df7a8640 -1 Falling back to public interface 2024-09-14T11:10:35.464 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:10:35.680 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-09-14T11:10:35.681+0000 7ff16ce14640 -1 Falling back to public interface 2024-09-14T11:10:35.688 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-09-14T11:10:35.689+0000 7fc6b0218640 -1 Falling back to public interface 2024-09-14T11:10:35.701 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-14T11:10:35.703+0000 7f4818a0b640 -1 Falling back to public interface 2024-09-14T11:10:35.701 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-09-14T11:10:35.702+0000 7f8f20c2f640 -1 Falling back to public interface 2024-09-14T11:10:35.926 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-14T11:10:35.927+0000 7f8cbbc16640 -1 Falling back to public interface 2024-09-14T11:10:35.946 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-09-14T11:10:35.947+0000 7f23bba0d640 -1 Falling back to public interface 2024-09-14T11:10:36.169 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-14T11:10:36.170+0000 7fd70ffbf640 -1 Falling back to public interface 2024-09-14T11:10:37.110 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-09-14T11:10:37.111+0000 7f9ec335e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:10:37.110 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-09-14T11:10:37.112+0000 7f9ec335e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:10:38.987 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-14T11:10:38.989+0000 7f30df7a8640 -1 osd.7 0 log_to_monitors true 2024-09-14T11:10:39.448 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-09-14T11:10:39.447+0000 7ff16ce14640 -1 osd.3 0 log_to_monitors true 2024-09-14T11:10:39.483 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-14T11:10:39.485+0000 7f4818a0b640 -1 osd.6 0 log_to_monitors true 2024-09-14T11:10:39.778 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-09-14T11:10:39.779+0000 7fc6b0218640 -1 osd.0 0 log_to_monitors true 2024-09-14T11:10:39.916 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-14T11:10:39.917+0000 7fd70ffbf640 -1 osd.5 0 log_to_monitors true 2024-09-14T11:10:40.295 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-09-14T11:10:40.296+0000 7f8f20c2f640 -1 osd.1 0 log_to_monitors true 2024-09-14T11:10:40.463 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-14T11:10:40.464+0000 7f8cbbc16640 -1 osd.4 0 log_to_monitors true 2024-09-14T11:10:40.570 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-09-14T11:10:40.571+0000 7f23bba0d640 -1 osd.2 0 log_to_monitors true 2024-09-14T11:10:42.254 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-09-14T11:10:42.255+0000 7fc6abc5a640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:10:42.271 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:42.279 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-09-14T11:10:42.281+0000 7ff1687de640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:10:42.299 INFO:tasks.ceph.osd.0.smithi130.stderr:2024-09-14T11:10:42.300+0000 7fc6a3a79640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:42.305 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-14T11:10:42.306+0000 7f30db73c640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:10:42.305 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-14T11:10:42.307+0000 7f4814421640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:10:42.306 INFO:tasks.ceph.osd.3.smithi130.stderr:2024-09-14T11:10:42.308+0000 7ff1605fd640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:42.330 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-14T11:10:42.332+0000 7f480c240640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:42.348 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-14T11:10:42.350+0000 7f30d355b640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:42.660 INFO:teuthology.misc.health.smithi130.stdout: 2024-09-14T11:10:42.660 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":13,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:41.834489+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:42.675 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:10:43.078 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-09-14T11:10:43.079+0000 7f23b743f640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:10:43.098 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-09-14T11:10:43.099+0000 7f8f1c194640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:10:43.098 INFO:tasks.ceph.osd.2.smithi130.stderr:2024-09-14T11:10:43.100+0000 7f23af25e640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:43.113 INFO:tasks.ceph.osd.1.smithi130.stderr:2024-09-14T11:10:43.115+0000 7f8f13fb3640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:43.126 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-14T11:10:43.127+0000 7f8cb74a6640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:10:43.134 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-14T11:10:43.135+0000 7fd70c767640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:10:43.141 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-14T11:10:43.142+0000 7f8caf2c5640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:43.146 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-14T11:10:43.147+0000 7fd703d72640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:10:49.483 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:49.788 INFO:teuthology.misc.health.smithi130.stdout: 2024-09-14T11:10:49.788 INFO:teuthology.misc.health.smithi130.stdout:{"epoch":17,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:46.299061+0000","last_up_change":"2024-09-14T11:10:43.292404+0000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:44.122857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6809","nonce":4246152659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6811","nonce":4246152659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6815","nonce":4246152659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6813","nonce":4246152659}]},"public_addr":"172.21.15.130:6809/4246152659","cluster_addr":"172.21.15.130:6811/4246152659","heartbeat_back_addr":"172.21.15.130:6815/4246152659","heartbeat_front_addr":"172.21.15.130:6813/4246152659","state":["exists","up"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6817","nonce":3369137395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6819","nonce":3369137395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6823","nonce":3369137395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6821","nonce":3369137395}]},"public_addr":"172.21.15.130:6817/3369137395","cluster_addr":"172.21.15.130:6819/3369137395","heartbeat_back_addr":"172.21.15.130:6823/3369137395","heartbeat_front_addr":"172.21.15.130:6821/3369137395","state":["exists","up"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6825","nonce":1425785084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6827","nonce":1425785084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6831","nonce":1425785084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6829","nonce":1425785084}]},"public_addr":"172.21.15.130:6825/1425785084","cluster_addr":"172.21.15.130:6827/1425785084","heartbeat_back_addr":"172.21.15.130:6831/1425785084","heartbeat_front_addr":"172.21.15.130:6829/1425785084","state":["exists","up"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6801","nonce":4189242858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6803","nonce":4189242858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6807","nonce":4189242858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6805","nonce":4189242858}]},"public_addr":"172.21.15.130:6801/4189242858","cluster_addr":"172.21.15.130:6803/4189242858","heartbeat_back_addr":"172.21.15.130:6807/4189242858","heartbeat_front_addr":"172.21.15.130:6805/4189242858","state":["exists","up"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6817","nonce":2608434775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6819","nonce":2608434775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6823","nonce":2608434775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6821","nonce":2608434775}]},"public_addr":"172.21.15.171:6817/2608434775","cluster_addr":"172.21.15.171:6819/2608434775","heartbeat_back_addr":"172.21.15.171:6823/2608434775","heartbeat_front_addr":"172.21.15.171:6821/2608434775","state":["exists","up"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6827","nonce":803554996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6829","nonce":803554996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6833","nonce":803554996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6831","nonce":803554996}]},"public_addr":"172.21.15.171:6827/803554996","cluster_addr":"172.21.15.171:6829/803554996","heartbeat_back_addr":"172.21.15.171:6833/803554996","heartbeat_front_addr":"172.21.15.171:6831/803554996","state":["exists","up"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6809","nonce":3699648391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6811","nonce":3699648391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6815","nonce":3699648391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6813","nonce":3699648391}]},"public_addr":"172.21.15.171:6809/3699648391","cluster_addr":"172.21.15.171:6811/3699648391","heartbeat_back_addr":"172.21.15.171:6815/3699648391","heartbeat_front_addr":"172.21.15.171:6813/3699648391","state":["exists","up"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6801","nonce":1745960304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6803","nonce":1745960304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6807","nonce":1745960304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6805","nonce":1745960304}]},"public_addr":"172.21.15.171:6801/1745960304","cluster_addr":"172.21.15.171:6803/1745960304","heartbeat_back_addr":"172.21.15.171:6807/1745960304","heartbeat_front_addr":"172.21.15.171:6805/1745960304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.827708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.270700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.539300+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.490460+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.447498+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.917574+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.456600+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:39.964918+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:49.800 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:10:49.800 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:10:49.801 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:10:50.312 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'rbd' created 2024-09-14T11:10:50.328 DEBUG:teuthology.orchestra.run.smithi130:> rbd --cluster ceph pool init rbd 2024-09-14T11:10:50.469 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:50.469 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:53.350 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:10:53.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:10:53.351 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:10:53.659 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:53.672 INFO:teuthology.orchestra.run.smithi130.stdout:[{"version":9,"timestamp":"2024-09-14T11:10:43.137856+0000","name":"","changes":[{"name":"osd.5/osd_mclock_max_capacity_iops_ssd","new_value":"6359.146482"}]}] 2024-09-14T11:10:53.672 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:10:53.672 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:10:53.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:10:53.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:10:54.022 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:54.033 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2987381339},{"type":"v1","addr":"172.21.15.171:6825","nonce":2987381339}]},"active_addr":"172.21.15.171:6825/2987381339","active_change":"2024-09-14T11:10:36.098658+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":4064383794}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":373087565}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":763589832}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":180740861}]}]} 2024-09-14T11:10:54.037 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:10:54.037 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:10:54.037 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:54.337 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:54.338 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:53.332149+0000","last_up_change":"2024-09-14T11:10:43.292404+0000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:44.122857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:50.102524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6809","nonce":4246152659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6811","nonce":4246152659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6815","nonce":4246152659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6813","nonce":4246152659}]},"public_addr":"172.21.15.130:6809/4246152659","cluster_addr":"172.21.15.130:6811/4246152659","heartbeat_back_addr":"172.21.15.130:6815/4246152659","heartbeat_front_addr":"172.21.15.130:6813/4246152659","state":["exists","up"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6817","nonce":3369137395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6819","nonce":3369137395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6823","nonce":3369137395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6821","nonce":3369137395}]},"public_addr":"172.21.15.130:6817/3369137395","cluster_addr":"172.21.15.130:6819/3369137395","heartbeat_back_addr":"172.21.15.130:6823/3369137395","heartbeat_front_addr":"172.21.15.130:6821/3369137395","state":["exists","up"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6825","nonce":1425785084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6827","nonce":1425785084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6831","nonce":1425785084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6829","nonce":1425785084}]},"public_addr":"172.21.15.130:6825/1425785084","cluster_addr":"172.21.15.130:6827/1425785084","heartbeat_back_addr":"172.21.15.130:6831/1425785084","heartbeat_front_addr":"172.21.15.130:6829/1425785084","state":["exists","up"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6801","nonce":4189242858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6803","nonce":4189242858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6807","nonce":4189242858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6805","nonce":4189242858}]},"public_addr":"172.21.15.130:6801/4189242858","cluster_addr":"172.21.15.130:6803/4189242858","heartbeat_back_addr":"172.21.15.130:6807/4189242858","heartbeat_front_addr":"172.21.15.130:6805/4189242858","state":["exists","up"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6817","nonce":2608434775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6819","nonce":2608434775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6823","nonce":2608434775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6821","nonce":2608434775}]},"public_addr":"172.21.15.171:6817/2608434775","cluster_addr":"172.21.15.171:6819/2608434775","heartbeat_back_addr":"172.21.15.171:6823/2608434775","heartbeat_front_addr":"172.21.15.171:6821/2608434775","state":["exists","up"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6827","nonce":803554996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6829","nonce":803554996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6833","nonce":803554996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6831","nonce":803554996}]},"public_addr":"172.21.15.171:6827/803554996","cluster_addr":"172.21.15.171:6829/803554996","heartbeat_back_addr":"172.21.15.171:6833/803554996","heartbeat_front_addr":"172.21.15.171:6831/803554996","state":["exists","up"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6809","nonce":3699648391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6811","nonce":3699648391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6815","nonce":3699648391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6813","nonce":3699648391}]},"public_addr":"172.21.15.171:6809/3699648391","cluster_addr":"172.21.15.171:6811/3699648391","heartbeat_back_addr":"172.21.15.171:6815/3699648391","heartbeat_front_addr":"172.21.15.171:6813/3699648391","state":["exists","up"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6801","nonce":1745960304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6803","nonce":1745960304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6807","nonce":1745960304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6805","nonce":1745960304}]},"public_addr":"172.21.15.171:6801/1745960304","cluster_addr":"172.21.15.171:6803/1745960304","heartbeat_back_addr":"172.21.15.171:6807/1745960304","heartbeat_front_addr":"172.21.15.171:6805/1745960304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.827708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.270700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.539300+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.490460+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.447498+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.917574+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.456600+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:39.964918+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:54.351 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:10:54.351 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:10:54.650 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:54.650 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":21,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:10:53.332149+0000","last_up_change":"2024-09-14T11:10:43.292404+0000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:44.122857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:50.102524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6809","nonce":4246152659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6811","nonce":4246152659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6815","nonce":4246152659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6813","nonce":4246152659}]},"public_addr":"172.21.15.130:6809/4246152659","cluster_addr":"172.21.15.130:6811/4246152659","heartbeat_back_addr":"172.21.15.130:6815/4246152659","heartbeat_front_addr":"172.21.15.130:6813/4246152659","state":["exists","up"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6817","nonce":3369137395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6819","nonce":3369137395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6823","nonce":3369137395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6821","nonce":3369137395}]},"public_addr":"172.21.15.130:6817/3369137395","cluster_addr":"172.21.15.130:6819/3369137395","heartbeat_back_addr":"172.21.15.130:6823/3369137395","heartbeat_front_addr":"172.21.15.130:6821/3369137395","state":["exists","up"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6825","nonce":1425785084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6827","nonce":1425785084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6831","nonce":1425785084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6829","nonce":1425785084}]},"public_addr":"172.21.15.130:6825/1425785084","cluster_addr":"172.21.15.130:6827/1425785084","heartbeat_back_addr":"172.21.15.130:6831/1425785084","heartbeat_front_addr":"172.21.15.130:6829/1425785084","state":["exists","up"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6801","nonce":4189242858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6803","nonce":4189242858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6807","nonce":4189242858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6805","nonce":4189242858}]},"public_addr":"172.21.15.130:6801/4189242858","cluster_addr":"172.21.15.130:6803/4189242858","heartbeat_back_addr":"172.21.15.130:6807/4189242858","heartbeat_front_addr":"172.21.15.130:6805/4189242858","state":["exists","up"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6817","nonce":2608434775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6819","nonce":2608434775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6823","nonce":2608434775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6821","nonce":2608434775}]},"public_addr":"172.21.15.171:6817/2608434775","cluster_addr":"172.21.15.171:6819/2608434775","heartbeat_back_addr":"172.21.15.171:6823/2608434775","heartbeat_front_addr":"172.21.15.171:6821/2608434775","state":["exists","up"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6827","nonce":803554996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6829","nonce":803554996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6833","nonce":803554996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6831","nonce":803554996}]},"public_addr":"172.21.15.171:6827/803554996","cluster_addr":"172.21.15.171:6829/803554996","heartbeat_back_addr":"172.21.15.171:6833/803554996","heartbeat_front_addr":"172.21.15.171:6831/803554996","state":["exists","up"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6809","nonce":3699648391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6811","nonce":3699648391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6815","nonce":3699648391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6813","nonce":3699648391}]},"public_addr":"172.21.15.171:6809/3699648391","cluster_addr":"172.21.15.171:6811/3699648391","heartbeat_back_addr":"172.21.15.171:6815/3699648391","heartbeat_front_addr":"172.21.15.171:6813/3699648391","state":["exists","up"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6801","nonce":1745960304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6803","nonce":1745960304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6807","nonce":1745960304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6805","nonce":1745960304}]},"public_addr":"172.21.15.171:6801/1745960304","cluster_addr":"172.21.15.171:6803/1745960304","heartbeat_back_addr":"172.21.15.171:6807/1745960304","heartbeat_front_addr":"172.21.15.171:6805/1745960304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.827708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.270700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.539300+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.490460+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.447498+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.917574+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.456600+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:39.964918+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:10:54.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:10:54.664 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:10:54.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:10:54.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:10:54.665 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:10:54.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:10:54.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:10:54.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:10:54.929 INFO:teuthology.orchestra.run.smithi130.stdout:60129542151 2024-09-14T11:10:54.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:10:54.934 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:54.935 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:10:54.935 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:54.936 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:10:54.937 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:54.937 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:10:54.938 INFO:teuthology.orchestra.run.smithi130.stdout:60129542151 2024-09-14T11:10:54.938 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:10:54.939 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:54.939 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:10:54.940 INFO:teuthology.orchestra.run.smithi130.stdout:60129542150 2024-09-14T11:10:54.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:10:54.941 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:54.942 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:10:55.529 INFO:teuthology.orchestra.run.smithi130.stdout:60129542150 2024-09-14T11:10:55.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.0 2024-09-14T11:10:55.572 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:55.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-14T11:10:55.596 INFO:teuthology.orchestra.run.smithi130.stdout:60129542150 2024-09-14T11:10:55.605 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-09-14T11:10:55.609 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-09-14T11:10:55.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-09-14T11:10:55.615 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-09-14T11:10:55.618 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-09-14T11:10:55.618 INFO:teuthology.orchestra.run.smithi130.stdout:60129542148 2024-09-14T11:10:55.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-14T11:10:55.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2024-09-14T11:10:55.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-14T11:10:55.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-14T11:10:55.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-09-14T11:10:56.548 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:10:56.586 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:10:56.614 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:10:56.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:10:56.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:10:56.634 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:10:56.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:10:56.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:10:57.112 INFO:teuthology.orchestra.run.smithi130.stdout:60129542151 2024-09-14T11:10:57.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-09-14T11:10:57.131 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.172 INFO:teuthology.orchestra.run.smithi130.stdout:60129542150 2024-09-14T11:10:57.182 INFO:teuthology.orchestra.run.smithi130.stdout:60129542151 2024-09-14T11:10:57.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-14T11:10:57.191 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-14T11:10:57.200 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.225 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:57.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-14T11:10:57.239 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.250 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:57.265 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:57.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-14T11:10:57.269 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-14T11:10:57.280 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.285 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:57.288 INFO:teuthology.orchestra.run.smithi130.stdout:60129542149 2024-09-14T11:10:57.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-14T11:10:57.299 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-14T11:10:57.301 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:57.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:10:57.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:10:57.638 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:57.639 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:10:57.651 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:10:56.594063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2899968,"data_stored":1756590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.276093"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603447+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:10:53.603447+0000","last_peered":"2024-09-14T11:10:53.603447+0000","last_clean":"2024-09-14T11:10:53.603447+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:10:53.603447+0000","last_undegraded":"2024-09-14T11:10:53.603447+0000","last_fullsized":"2024-09-14T11:10:53.603447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.347444+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:10:53.347444+0000","last_peered":"2024-09-14T11:10:53.347444+0000","last_clean":"2024-09-14T11:10:53.347444+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:10:53.347444+0000","last_undegraded":"2024-09-14T11:10:53.347444+0000","last_fullsized":"2024-09-14T11:10:53.347444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603380+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:10:53.603380+0000","last_peered":"2024-09-14T11:10:53.603380+0000","last_clean":"2024-09-14T11:10:53.603380+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:10:53.603380+0000","last_undegraded":"2024-09-14T11:10:53.603380+0000","last_fullsized":"2024-09-14T11:10:53.603380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.347529+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:10:53.347529+0000","last_peered":"2024-09-14T11:10:53.347529+0000","last_clean":"2024-09-14T11:10:53.347529+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:10:53.347529+0000","last_undegraded":"2024-09-14T11:10:53.347529+0000","last_fullsized":"2024-09-14T11:10:53.347529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.346556+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:10:53.346556+0000","last_peered":"2024-09-14T11:10:53.346556+0000","last_clean":"2024-09-14T11:10:53.346556+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:10:53.346556+0000","last_undegraded":"2024-09-14T11:10:53.346556+0000","last_fullsized":"2024-09-14T11:10:53.346556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.338879+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:10:53.338879+0000","last_peered":"2024-09-14T11:10:53.338879+0000","last_clean":"2024-09-14T11:10:53.338879+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:10:53.338879+0000","last_undegraded":"2024-09-14T11:10:53.338879+0000","last_fullsized":"2024-09-14T11:10:53.338879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603361+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:10:53.603361+0000","last_peered":"2024-09-14T11:10:53.603361+0000","last_clean":"2024-09-14T11:10:53.603361+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:10:53.603361+0000","last_undegraded":"2024-09-14T11:10:53.603361+0000","last_fullsized":"2024-09-14T11:10:53.603361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.345181+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:10:53.345181+0000","last_peered":"2024-09-14T11:10:53.345181+0000","last_clean":"2024-09-14T11:10:53.345181+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:10:53.345181+0000","last_undegraded":"2024-09-14T11:10:53.345181+0000","last_fullsized":"2024-09-14T11:10:53.345181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.602652+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:10:53.602652+0000","last_peered":"2024-09-14T11:10:53.602652+0000","last_clean":"2024-09-14T11:10:53.602652+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:10:53.602652+0000","last_undegraded":"2024-09-14T11:10:53.602652+0000","last_fullsized":"2024-09-14T11:10:53.602652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:10:57.652 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:10:57.946 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:57.946 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:10:57.958 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T11:10:56.594063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219084,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755636,"statfs":{"total":773094113280,"available":772869771264,"internally_reserved":0,"allocated":2899968,"data_stored":1756590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.276093"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603447+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:10:53.603447+0000","last_peered":"2024-09-14T11:10:53.603447+0000","last_clean":"2024-09-14T11:10:53.603447+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:10:53.603447+0000","last_undegraded":"2024-09-14T11:10:53.603447+0000","last_fullsized":"2024-09-14T11:10:53.603447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.347444+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:10:53.347444+0000","last_peered":"2024-09-14T11:10:53.347444+0000","last_clean":"2024-09-14T11:10:53.347444+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:10:53.347444+0000","last_undegraded":"2024-09-14T11:10:53.347444+0000","last_fullsized":"2024-09-14T11:10:53.347444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603380+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:10:53.603380+0000","last_peered":"2024-09-14T11:10:53.603380+0000","last_clean":"2024-09-14T11:10:53.603380+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:10:53.603380+0000","last_undegraded":"2024-09-14T11:10:53.603380+0000","last_fullsized":"2024-09-14T11:10:53.603380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.347529+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:10:53.347529+0000","last_peered":"2024-09-14T11:10:53.347529+0000","last_clean":"2024-09-14T11:10:53.347529+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:10:53.347529+0000","last_undegraded":"2024-09-14T11:10:53.347529+0000","last_fullsized":"2024-09-14T11:10:53.347529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.346556+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:10:53.346556+0000","last_peered":"2024-09-14T11:10:53.346556+0000","last_clean":"2024-09-14T11:10:53.346556+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:10:53.346556+0000","last_undegraded":"2024-09-14T11:10:53.346556+0000","last_fullsized":"2024-09-14T11:10:53.346556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.338879+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:10:53.338879+0000","last_peered":"2024-09-14T11:10:53.338879+0000","last_clean":"2024-09-14T11:10:53.338879+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:10:53.338879+0000","last_undegraded":"2024-09-14T11:10:53.338879+0000","last_fullsized":"2024-09-14T11:10:53.338879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.603361+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:10:53.603361+0000","last_peered":"2024-09-14T11:10:53.603361+0000","last_clean":"2024-09-14T11:10:53.603361+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:10:53.603361+0000","last_undegraded":"2024-09-14T11:10:53.603361+0000","last_fullsized":"2024-09-14T11:10:53.603361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.345181+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:10:53.345181+0000","last_peered":"2024-09-14T11:10:53.345181+0000","last_clean":"2024-09-14T11:10:53.345181+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:10:53.345181+0000","last_undegraded":"2024-09-14T11:10:53.345181+0000","last_fullsized":"2024-09-14T11:10:53.345181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T11:10:53.602652+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:10:53.602652+0000","last_peered":"2024-09-14T11:10:53.602652+0000","last_clean":"2024-09-14T11:10:53.602652+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:10:53.602652+0000","last_undegraded":"2024-09-14T11:10:53.602652+0000","last_fullsized":"2024-09-14T11:10:53.602652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:10:57.959 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:10:57.959 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:10:57.959 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:10:57.959 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:10:58.292 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:10:58.292 INFO:teuthology.orchestra.run.smithi130.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:10:58.305 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:10:58.305 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:10:58.318 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T11:10:58.319 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:10:58.347 DEBUG:teuthology.orchestra.run.smithi130:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T11:10:58.534 INFO:teuthology.orchestra.run.smithi130.stderr:...+.+........+......+.+...+.....+.+++++++++++++++++++++++++++++++++++++++++++++*.......+.........+..+...+..........+..+...+.......+..+.+...........+.+..+.......+...+.....+......+.+++++++++++++++++++++++++++++++++++++++++++++*.+..+...+...+.........+......+............+.......+.....+.....................+....+...+............+...+...+.....+.+.....+.............+..+...+.......+...+...+.....+.........+.+..............+....+.....+...............+.......+..+++++ 2024-09-14T11:10:58.769 INFO:teuthology.orchestra.run.smithi130.stderr:....+++++++++++++++++++++++++++++++++++++++++++++*.....+.....+...+......+....+......+..+...+....+...+..+.+..+............+.......+......+..+.......+.....+...+.+......+...........+...+....+..+.........+....+...............+...+...+...........+.............+......+..+...+.........+.+.....+.......+.....+...+++++++++++++++++++++++++++++++++++++++++++++*.........+..+...+.............+...+.....+.+...+.................+.+...+.....+............+.........+....+...........+...+.+.................+....+..............+.+.........+..............+..........+........+.............+..+..........+........................+...........+...+....+...+.........+........+......+.+........+...+....+...........+.......+.....+.+..+.......+..+..........+..................+.....+.+............+...+............+........+....+..+.+...+..+.........+.....................+............+...+....+......+..+.+....................+............+....+......+............+...+..+................+..+....+...........+.........+...+.+..............+.+.....+.....................+.....................+.......+..+....+..+..........+..+...+...+.+.....+..........+......+...+...........+...+.........................+...+........................+...+.................+.+.................+......+++++ 2024-09-14T11:10:58.784 INFO:teuthology.orchestra.run.smithi130.stderr:----- 2024-09-14T11:10:58.791 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:10:58.830 DEBUG:teuthology.orchestra.run.smithi130:> sudo update-ca-trust 2024-09-14T11:10:59.922 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:10:59.951 DEBUG:teuthology.orchestra.run.smithi130:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi130.front.sepia.ceph.com 2024-09-14T11:11:00.070 INFO:teuthology.orchestra.run.smithi130.stderr:....+..+...+.+...........+.........+....+..............+...+++++++++++++++++++++++++++++++++++++++*...+++++++++++++++++++++++++++++++++++++++*.....+.+..............+...+............+...+.......+...+..+.+...............+..+...+.+...............+...+..................+..+.+....................+....+......+.....+....+...........+...............+....+..+.+.....+...+.+......+...............+..+..........+..+.............+...+.....+...+.......+..+.............+.....+...+.+........+..........+...+...............+..+.+..+............+.+............+..+.+.....+.+......+..+.......+......+.........+........+......+.......+........+....+..+...+...+.............+......+...+...+..+.+..+...+......+....+......+.....++++++ 2024-09-14T11:11:00.071 INFO:teuthology.orchestra.run.smithi130.stderr:....+.+..+................+++++++++++++++++++++++++++++++++++++++*.....+......+...+...+.......+......+.........+..+++++++++++++++++++++++++++++++++++++++*....++++++ 2024-09-14T11:11:00.071 INFO:teuthology.orchestra.run.smithi130.stderr:----- 2024-09-14T11:11:00.071 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:11:00.071 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:11:00.139 DEBUG:teuthology.orchestra.run.smithi130:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:Certificate request self-signature ok 2024-09-14T11:11:00.217 INFO:teuthology.orchestra.run.smithi130.stderr:subject=CN=smithi130.front.sepia.ceph.com 2024-09-14T11:11:00.224 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:11:00.293 DEBUG:teuthology.orchestra.run.smithi130:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:11:00.364 INFO:teuthology.orchestra.run.smithi130.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T11:11:00.365 DEBUG:teuthology.orchestra.run.smithi130:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:11:00.434 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:11:00.449 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-14T11:11:00.449 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:11:00.449 INFO:tasks.rgw:Creating data pools 2024-09-14T11:11:00.449 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:11:00.449 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-14T11:11:01.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T11:11:03.619 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:11:03.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:11:04.636 INFO:teuthology.orchestra.run.smithi130.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:11:04.666 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:11:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:11:05.654 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:11:06.638 INFO:teuthology.orchestra.run.smithi130.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:11:06.671 DEBUG:tasks.rgw:Pools created 2024-09-14T11:11:06.671 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:11:06.671 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:11:06.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:11:06.672 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:11:06.781 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:06.781 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:08.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:08.683+0000 7f79fa761640 0 -- 172.21.15.130:0/3434435813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc7fce6650 msgr2=0x55fc7fce6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:08.882 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:08.884+0000 7f79fa761640 0 --2- 172.21.15.130:0/3434435813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55fc7fce6650 0x55fc7fce6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:11:08.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:08.888+0000 7f79faf62640 0 -- 172.21.15.130:0/2137139896 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc7fcf0220 msgr2=0x55fc7fcf2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-14T11:11:09.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.089+0000 7f79faf62640 0 --2- 172.21.15.130:0/2137139896 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55fc7fcf0220 0x55fc7fcf2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:11:09.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.094+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 20 realm 2024-09-14T11:11:09.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.096+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.097+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.097+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.098+0000 7f79feb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.098+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.099+0000 7f79feb2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:11:09.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.099+0000 7f79feb2a800 20 searching for the correct realm 2024-09-14T11:11:09.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:09.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:09.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.112+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.113+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.113+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.113+0000 7f79feb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.113+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 zone default found 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 4 Realm: () 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:09.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 zonegroup default 2024-09-14T11:11:09.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:09.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:09.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:09.114+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:10.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:10.671+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:10.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:10.671+0000 7f79feb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:11:10.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:10.671+0000 7f79feb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:10.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:10.672+0000 7f79feb2a800 20 started sync module instance, tier type = 2024-09-14T11:11:10.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:10.672+0000 7f79feb2a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:11:12.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=0 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=1 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=2 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=3 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=4 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=5 2024-09-14T11:11:12.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.696+0000 7f79feb2a800 20 add_watcher() i=6 2024-09-14T11:11:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.697+0000 7f79feb2a800 20 add_watcher() i=7 2024-09-14T11:11:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.697+0000 7f79feb2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.697+0000 7f79feb2a800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:11:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.697+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:11:12.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.697+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:11:12.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.698+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.699+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:11:12.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:11:12.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:11:12.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.700+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.701+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:11:12.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.702+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:11:12.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.703+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:11:12.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.704+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:11:12.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.705+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:11:12.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.706+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:11:12.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:11:12.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.707+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.708+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:11:12.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.709+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.710+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:11:12.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.711+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:11:12.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.712+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:11:12.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.713+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.714+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.715+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.716+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:11:12.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.717+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:11:12.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.718+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:11:12.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:11:12.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.719+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.720+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:11:12.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.721+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.733 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.722+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:11:12.734 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.723+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:11:12.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.724+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:11:12.736 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.725+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.737 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.726+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:11:12.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.727+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:11:12.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.728+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.729+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:11:12.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.730+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.731+0000 7f79feb2a800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.731+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.733+0000 7f79feb2a800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.737+0000 7f78acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:12.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.737+0000 7f79feb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:12.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:12.737+0000 7f79feb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.684+0000 7f79feb2a800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.684+0000 7f79feb2a800 5 note: GC not initialized 2024-09-14T11:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.684+0000 7f79feb2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.684+0000 7f79feb2a800 20 Filter name: none 2024-09-14T11:11:15.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.685+0000 7f78177fe640 20 reqs_thread_entry: start 2024-09-14T11:11:15.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.685+0000 7f78157fa640 20 reqs_thread_entry: start 2024-09-14T11:11:15.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.706+0000 7f78acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:15.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.708+0000 7f79feb2a800 20 remove_watcher() i=0 2024-09-14T11:11:15.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.708+0000 7f79feb2a800 2 removed watcher, disabling cache 2024-09-14T11:11:15.709 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.710+0000 7f79feb2a800 20 remove_watcher() i=1 2024-09-14T11:11:15.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.712+0000 7f79feb2a800 20 remove_watcher() i=2 2024-09-14T11:11:15.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.713+0000 7f79feb2a800 20 remove_watcher() i=3 2024-09-14T11:11:15.712 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.714+0000 7f79feb2a800 20 remove_watcher() i=4 2024-09-14T11:11:15.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.716+0000 7f79feb2a800 20 remove_watcher() i=5 2024-09-14T11:11:15.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.717+0000 7f79feb2a800 20 remove_watcher() i=6 2024-09-14T11:11:15.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.718+0000 7f79feb2a800 20 remove_watcher() i=7 2024-09-14T11:11:15.752 INFO:teuthology.orchestra.run.smithi130.stdout:[] 2024-09-14T11:11:15.753 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:11:15.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:11:15.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:11:15.753 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:11:15.818 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:15.818 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:15.843 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.846+0000 7f9c20b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:15.843 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.846+0000 7f9c20b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:15.847 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:15.850+0000 7f9a827fc640 20 reqs_thread_entry: start 2024-09-14T11:11:15.863 INFO:teuthology.orchestra.run.smithi130.stdout:{"id":"a588039c-1457-497f-adbd-8890a12279b7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:11:15.863 DEBUG:tasks.util.rgw: json result: {'id': 'a588039c-1457-497f-adbd-8890a12279b7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:11:15.863 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T11:11:15.864 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p /tmp/rgw_datacache 2024-09-14T11:11:15.892 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T11:11:15.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:11:15.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:11:15.970 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.068 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.103+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 realm 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:16.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.105+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.106+0000 7f39fdb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:16.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.106+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.107+0000 7f39fdb2e800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:11:16.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.107+0000 7f39fdb2e800 20 searching for the correct realm 2024-09-14T11:11:16.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.109+0000 7f39f9f65640 0 -- 172.21.15.130:0/4235073022 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f39e4042b00 msgr2=0x7f39e4039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:16.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.315+0000 7f39f9f65640 0 -- 172.21.15.130:0/4235073022 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f39e4042b00 msgr2=0x7f39e4039920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:16.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:11:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.319+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 zone default found 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 4 Realm: () 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:16.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 zonegroup default 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.320+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.321+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.321+0000 7f39fdb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.321+0000 7f39fdb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.321+0000 7f39fdb2e800 20 started sync module instance, tier type = 2024-09-14T11:11:16.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.321+0000 7f39fdb2e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=0 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=1 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=2 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=3 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=4 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=5 2024-09-14T11:11:16.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.342+0000 7f39fdb2e800 20 add_watcher() i=6 2024-09-14T11:11:16.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.344+0000 7f39fdb2e800 20 add_watcher() i=7 2024-09-14T11:11:16.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.344+0000 7f39fdb2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:16.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.346+0000 7f38affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.346+0000 7f39fdb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.346+0000 7f39fdb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.346+0000 7f39fdb2e800 5 note: GC not initialized 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.347+0000 7f38aefe5640 20 reqs_thread_entry: start 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.347+0000 7f39fdb2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.347+0000 7f39fdb2e800 20 Filter name: none 2024-09-14T11:11:16.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.347+0000 7f38acfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:16.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.356+0000 7f38affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:16.356 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.358+0000 7f39fdb2e800 20 remove_watcher() i=0 2024-09-14T11:11:16.356 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.358+0000 7f39fdb2e800 2 removed watcher, disabling cache 2024-09-14T11:11:16.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.360+0000 7f39fdb2e800 20 remove_watcher() i=1 2024-09-14T11:11:16.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.362+0000 7f39fdb2e800 20 remove_watcher() i=2 2024-09-14T11:11:16.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.363+0000 7f39fdb2e800 20 remove_watcher() i=3 2024-09-14T11:11:16.362 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.365+0000 7f39fdb2e800 20 remove_watcher() i=4 2024-09-14T11:11:16.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.366+0000 7f39fdb2e800 20 remove_watcher() i=5 2024-09-14T11:11:16.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.369+0000 7f39fdb2e800 20 remove_watcher() i=6 2024-09-14T11:11:16.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.370+0000 7f39fdb2e800 20 remove_watcher() i=7 2024-09-14T11:11:16.378 INFO:teuthology.orchestra.run.smithi130.stdout:[] 2024-09-14T11:11:16.378 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:11:16.379 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:11:16.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:11:16.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:11:16.379 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:11:16.441 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.441 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.468+0000 7f6f9711f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:16.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.468+0000 7f6f9711f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:16.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.472+0000 7f6e557e2640 20 reqs_thread_entry: start 2024-09-14T11:11:16.484 INFO:teuthology.orchestra.run.smithi130.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:11:16.484 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:11:16.484 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:11:16.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:11:16.484 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:11:16.548 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.549 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.576+0000 7fc2f1736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:16.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.576+0000 7fc2f1736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:16.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.579+0000 7fc12b7fe640 20 reqs_thread_entry: start 2024-09-14T11:11:16.593 INFO:teuthology.orchestra.run.smithi130.stdout:{"id":"a588039c-1457-497f-adbd-8890a12279b7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:11:16.593 DEBUG:tasks.util.rgw: json result: {'id': 'a588039c-1457-497f-adbd-8890a12279b7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:11:16.593 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:11:16.594 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:11:16.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:11:16.594 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:11:16.656 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.657 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.683+0000 7fa61631f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:16.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.683+0000 7fa61631f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:16.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.687+0000 7fa4d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:11:16.700 INFO:teuthology.orchestra.run.smithi130.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:11:16.700 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:11:16.701 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:11:16.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:11:16.701 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:11:16.766 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:16.767 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:16.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.794+0000 7f7227732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:16.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.794+0000 7f7227732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:16.795 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:11:16.798+0000 7f70e27fc640 20 reqs_thread_entry: start 2024-09-14T11:11:16.811 INFO:teuthology.orchestra.run.smithi130.stdout:{"id":"a588039c-1457-497f-adbd-8890a12279b7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:11:16.811 DEBUG:tasks.util.rgw: json result: {'id': 'a588039c-1457-497f-adbd-8890a12279b7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:11:16.812 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:11:16.812 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-14T11:11:16.812 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:11:16.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo echo -n https://smithi130.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:11:16.852 INFO:teuthology.orchestra.run.smithi130.stdout:https://smithi130.front.sepia.ceph.com:443 2024-09-14T11:11:16.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:11:16.931 DEBUG:teuthology.orchestra.run.smithi130:> sudo keytool -import -alias smithi130.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T11:11:17.127 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T11:11:17.259 INFO:teuthology.orchestra.run.smithi130.stderr:Certificate was added to keystore 2024-09-14T11:11:17.282 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:11:17.282 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:11:17.284 INFO:tasks.rgw.client.0:Started 2024-09-14T11:11:17.284 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi130.front.sepia.ceph.com:443/ 2024-09-14T11:11:17.284 DEBUG:teuthology.orchestra.run.smithi130:> curl https://smithi130.front.sepia.ceph.com:443/ 2024-09-14T11:11:17.326 INFO:teuthology.orchestra.run.smithi130.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:17.326 INFO:teuthology.orchestra.run.smithi130.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:17.326 INFO:teuthology.orchestra.run.smithi130.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:11:17.327 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:11:17.327 INFO:teuthology.orchestra.run.smithi130.stderr:curl: (7) Failed to connect to smithi130.front.sepia.ceph.com port 443: Connection refused 2024-09-14T11:11:17.710 INFO:tasks.rgw.client.0.smithi130.stdout:2024-09-14T11:11:17.712+0000 7f6429e6c880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T11:11:18.329 DEBUG:teuthology.orchestra.run.smithi130:> curl https://smithi130.front.sepia.ceph.com:443/ 2024-09-14T11:11:18.362 INFO:teuthology.orchestra.run.smithi130.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:11:18.362 INFO:teuthology.orchestra.run.smithi130.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:11:18.414 INFO:teuthology.orchestra.run.smithi130.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3596 0 --:--:-- --:--:-- --:--:-- 3596 2024-09-14T11:11:18.415 INFO:teuthology.orchestra.run.smithi130.stdout:anonymous 2024-09-14T11:11:18.415 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:11:18.426 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:11:18.427 DEBUG:teuthology.orchestra.run.smithi130:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:11:20.717 DEBUG:teuthology.orchestra.run.smithi130:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:11:21.231 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting tox==3.15.0 2024-09-14T11:11:21.282 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:11:21.413 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:11:21.428 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:11:21.509 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:11:21.523 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:11:21.603 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting toml>=0.9.4 2024-09-14T11:11:21.617 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:11:21.875 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:11:21.890 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:11:22.132 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting packaging>=14 2024-09-14T11:11:22.146 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:11:22.232 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:11:22.246 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:11:22.356 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:11:22.370 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:11:22.516 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:11:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:11:22.619 INFO:teuthology.orchestra.run.smithi130.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:11:22.633 INFO:teuthology.orchestra.run.smithi130.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:11:22.766 INFO:teuthology.orchestra.run.smithi130.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T11:11:23.584 INFO:teuthology.orchestra.run.smithi130.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:11:23.782 INFO:teuthology.orchestra.run.smithi130.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T11:11:23.782 INFO:teuthology.orchestra.run.smithi130.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T11:11:23.846 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:11:23.859 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:23.859 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:11:23.860 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:23.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:11:23.889 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:11:23.889 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:23.957 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:23.957 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:11:24.026 INFO:tasks.workunit:timeout=3h 2024-09-14T11:11:24.026 INFO:tasks.workunit:cleanup=True 2024-09-14T11:11:24.027 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:11:24.096 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:12:21.330 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:12:21.331 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:12:21.332 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:12:21.332 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:12:21.493 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:12:21.495 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:21.495 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:12:22.083 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:12:22.157 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:12:22.197 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:12:22.199 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:22.199 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:12:22.237 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:12:22.241 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:12:22.241 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:12:22.270 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T11:12:22.273 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T11:12:22.273 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:12:22.344 INFO:tasks.workunit.client.0.smithi130.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T11:12:22.344 INFO:tasks.workunit.client.0.smithi130.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:22.345 INFO:tasks.workunit.client.0.smithi130.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ deactivate nondestructive 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:12:24.604 INFO:tasks.workunit.client.0.smithi130.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:12:24.605 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:12:24.605 INFO:tasks.workunit.client.0.smithi130.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:12:24.605 INFO:tasks.workunit.client.0.smithi130.stderr:++ export VIRTUAL_ENV 2024-09-14T11:12:24.605 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PATH 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -z '' ']' 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ PS1='(rgw) ' 2024-09-14T11:12:24.606 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PS1 2024-09-14T11:12:24.607 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:24.607 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:12:24.607 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install pip --upgrade 2024-09-14T11:12:24.838 INFO:tasks.workunit.client.0.smithi130.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:12:25.019 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting pip 2024-09-14T11:12:25.070 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:12:25.227 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: pip 2024-09-14T11:12:25.227 INFO:tasks.workunit.client.0.smithi130.stdout: Attempting uninstall: pip 2024-09-14T11:12:25.228 INFO:tasks.workunit.client.0.smithi130.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:12:25.375 INFO:tasks.workunit.client.0.smithi130.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:12:25.380 INFO:tasks.workunit.client.0.smithi130.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:12:26.104 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed pip-24.2 2024-09-14T11:12:26.341 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install configobj 2024-09-14T11:12:26.719 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting configobj 2024-09-14T11:12:26.760 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T11:12:26.884 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting six (from configobj) 2024-09-14T11:12:26.898 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:12:26.961 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T11:12:27.035 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:12:27.098 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: six, configobj 2024-09-14T11:12:27.224 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T11:12:27.270 INFO:tasks.workunit.client.0.smithi130.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T11:12:27.303 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:12:27.304 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T11:12:27.354 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:27.354 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 44619/radosgw \ntcp6 0 0 :::443 :::* LISTEN 44619/radosgw \n' 2024-09-14T11:12:27.354 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:radosgw port: 443 2024-09-14T11:12:27.354 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T11:12:27.354 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T11:12:27.376 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:27.377 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'' 2024-09-14T11:12:27.377 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T11:12:27.725 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T11:12:27.699928Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T11:12:27.699918Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T11:12:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:Creating s3cmd config... 2024-09-14T11:12:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:proto for s3cmd config is https 2024-09-14T11:12:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:s3cmd config written 2024-09-14T11:12:27.726 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T11:12:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T11:12:27.931 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T11:12:28.366 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:28.366 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.3 seconds, 27.44 MB/s) [1 of 1]\n" 2024-09-14T11:12:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.0 seconds, 168.82 MB/s)\n" 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T11:12:28.902 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:28.902 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7342274,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zlib",\n "orig_size": 7340032,\n "compressor_message": -15,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4195585\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4195585,\n "len": 3146689\n }\n ]\n },\n "etag": "fe9a41835fa26603597e85249cc1b271",\n "tag": "a588039c-1457-497f-adbd-8890a12279b7.4508.14807275177689237150",\n "manifest": {\n "objs": [],\n "obj_size": 7342274,\n "explicit_objs": false,\n "head_size": 4190208,\n "max_head_size": 4190208,\n "prefix": ".EQq6oLgA9aI9n_kHvaEIWIwJDNFq8Qr_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 4190208,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "bucket_id": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "bucket_id": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": "7M.dat",\n "instance": "",\n "ns": ""\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 4190208,\n "stripe_ofs": 4190208,\n "ofs": 7342274,\n "stripe_size": 3152066,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "bucket_id": "a588039c-1457-497f-adbd-8890a12279b7.4508.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".EQq6oLgA9aI9n_kHvaEIWIwJDNFq8Qr_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T11:12:28.335051Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "a588039c-1457-497f-adbd-8890a12279b7.4508.14807275177689237150",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726312347/ctime:1726312347/gid:1333/gname:ubuntu/md5:fe9a41835fa26603597e85249cc1b271/mode:33188/mtime:1726312347/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T11:12:28.902 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:Cached object name is: .EQq6oLgA9aI9n_kHvaEIWIwJDNFq8Qr_ 2024-09-14T11:12:28.902 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T11:12:28.919 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:command succeeded 2024-09-14T11:12:28.920 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:b'0\n' 2024-09-14T11:12:28.920 INFO:tasks.workunit.client.0.smithi130.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T11:12:28.920 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T11:12:28.920 INFO:tasks.workunit.client.0.smithi130.stderr:INFO:root:Completed Datacache tests 2024-09-14T11:12:28.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ deactivate 2024-09-14T11:12:28.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:12:28.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:12:28.925 INFO:tasks.workunit.client.0.smithi130.stderr:+ export PATH 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ hash -r 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset -f deactivate 2024-09-14T11:12:28.926 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo OK. 2024-09-14T11:12:28.927 INFO:tasks.workunit.client.0.smithi130.stdout:OK. 2024-09-14T11:12:28.927 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:12:28.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:12:29.009 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T11:12:29.009 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:12:29.337 DEBUG:teuthology.parallel:result is None 2024-09-14T11:12:29.338 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:29.377 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:29.377 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:29.457 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:12:29.457 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:12:29.468 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:29.468 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:12:29.469 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:29.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:12:29.528 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:12:29.529 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:29.597 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:29.597 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:12:29.667 INFO:tasks.workunit:timeout=3h 2024-09-14T11:12:29.667 INFO:tasks.workunit:cleanup=True 2024-09-14T11:12:29.668 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:29.738 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:13:25.527 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:13:25.529 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:13:25.596 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:13:25.598 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:25.598 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:13:25.646 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:13:25.695 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:13:25.733 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:25.735 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:25.735 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:13:25.773 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:25.776 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:13:25.776 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:13:25.846 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:13:25.847 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:13:25.848 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:13:25.921 INFO:tasks.workunit.client.0.smithi130.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:13:25.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:25.922 INFO:tasks.workunit.client.0.smithi130.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:28.207 INFO:tasks.workunit.client.0.smithi130.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:13:28.207 INFO:tasks.workunit.client.0.smithi130.stderr:++ deactivate nondestructive 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ export VIRTUAL_ENV 2024-09-14T11:13:28.208 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:28.209 INFO:tasks.workunit.client.0.smithi130.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:28.209 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PATH 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -z '' ']' 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ PS1='(rgw) ' 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PS1 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:13:28.210 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install pip --upgrade 2024-09-14T11:13:28.434 INFO:tasks.workunit.client.0.smithi130.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:13:28.615 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting pip 2024-09-14T11:13:28.621 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:13:28.669 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: pip 2024-09-14T11:13:28.669 INFO:tasks.workunit.client.0.smithi130.stdout: Attempting uninstall: pip 2024-09-14T11:13:28.669 INFO:tasks.workunit.client.0.smithi130.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:13:28.821 INFO:tasks.workunit.client.0.smithi130.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:13:28.826 INFO:tasks.workunit.client.0.smithi130.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:13:29.558 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed pip-24.2 2024-09-14T11:13:29.607 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install boto3 2024-09-14T11:13:30.440 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting boto3 2024-09-14T11:13:30.481 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:13:31.103 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:13:31.117 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:13:31.263 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:13:31.277 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:13:31.369 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:13:31.383 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:13:31.513 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:31.526 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:13:31.681 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:31.696 INFO:tasks.workunit.client.0.smithi130.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:13:31.953 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:31.954 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:13:31.972 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:13:32.055 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:13:32.276 INFO:tasks.workunit.client.0.smithi130.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 59.0 MB/s eta 0:00:00 2024-09-14T11:13:32.291 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:13:32.354 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:13:32.422 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:13:32.489 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:13:32.535 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:13:32.608 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:13:33.597 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:13:33.717 INFO:tasks.workunit.client.0.smithi130.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:13:33.843 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:13:33.879 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:33.880 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:33.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.918+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 realm 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:33.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:33.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.920+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:33.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.921+0000 7f0a0472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:33.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.921+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:33.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.922+0000 7f0a0472e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:33.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.922+0000 7f0a0472e800 20 searching for the correct realm 2024-09-14T11:13:33.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:33.923+0000 7f0a00364640 0 -- 172.21.15.130:0/2378483771 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f09e8003c90 msgr2=0x7f09f8018420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:34.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.128+0000 7f09ffb63640 0 -- 172.21.15.130:0/2378483771 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f09f0061040 msgr2=0x7f09f00abad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:34.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:34.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:34.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:34.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:34.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:34.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:34.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.135+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:34.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:34.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 zone default found 2024-09-14T11:13:34.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 4 Realm: () 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 zonegroup default 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.136+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 started sync module instance, tier type = 2024-09-14T11:13:34.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.137+0000 7f0a0472e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:34.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=0 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=1 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=2 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=3 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=4 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=5 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.151+0000 7f0a0472e800 20 add_watcher() i=6 2024-09-14T11:13:34.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.152+0000 7f0a0472e800 20 add_watcher() i=7 2024-09-14T11:13:34.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.152+0000 7f0a0472e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:34.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.154+0000 7f08b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:34.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:34.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:34.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 5 note: GC not initialized 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f08b5fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 20 Filter name: none 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.155+0000 7f08277fe640 20 reqs_thread_entry: start 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:13:34.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.156+0000 7f0a0472e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:13:34.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.160+0000 7f0a0472e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:13:34.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.160+0000 7f0a0472e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:13:34.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.160+0000 7f0a0472e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:13:34.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.161+0000 7f08d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724545 cookie 94385635894304 notifier 4559 bl.length()=593 2024-09-14T11:13:34.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.161+0000 7f08d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:13:34.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.161+0000 7f08d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:13:34.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f0a0472e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:13:34.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f0a0472e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:13:34.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f0a0472e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:13:34.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f08d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94385635885712 notifier 4559 bl.length()=186 2024-09-14T11:13:34.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f08d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:13:34.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.163+0000 7f08d77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:13:34.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.164+0000 7f08b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:34.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.167+0000 7f0a0472e800 20 remove_watcher() i=0 2024-09-14T11:13:34.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.167+0000 7f0a0472e800 2 removed watcher, disabling cache 2024-09-14T11:13:34.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.168+0000 7f0a0472e800 20 remove_watcher() i=1 2024-09-14T11:13:34.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.169+0000 7f0a0472e800 20 remove_watcher() i=2 2024-09-14T11:13:34.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.170+0000 7f0a0472e800 20 remove_watcher() i=3 2024-09-14T11:13:34.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.171+0000 7f0a0472e800 20 remove_watcher() i=4 2024-09-14T11:13:34.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.172+0000 7f0a0472e800 20 remove_watcher() i=5 2024-09-14T11:13:34.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.173+0000 7f0a0472e800 20 remove_watcher() i=6 2024-09-14T11:13:34.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.174+0000 7f0a0472e800 20 remove_watcher() i=7 2024-09-14T11:13:34.336 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.336 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.382 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.382 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.427 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.427 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.439 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.439 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.448 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.449 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.452 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.452 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.459 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.462 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.462 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.466 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.482 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.482 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.486 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.486 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.504 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.504 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.507 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.507 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.525 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.525 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.528 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.528 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.546 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:34.546 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:34.549 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:13:34.549 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:34.550 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:13:34.580 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:34.580 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:34.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.617+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 realm 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.619+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.620+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:34.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.620+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.621+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:34.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.621+0000 7f849ac98800 20 searching for the correct realm 2024-09-14T11:13:34.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.623+0000 7f8498f8a640 0 -- 172.21.15.130:0/210124482 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f848008fb80 msgr2=0x7f8480086450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:34.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.829+0000 7f8498f8a640 0 -- 172.21.15.130:0/210124482 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f848008fb80 msgr2=0x7f8480086450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.833+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 zone default found 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 4 Realm: () 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 zonegroup default 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.834+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.835+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.835+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.835+0000 7f849ac98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.835+0000 7f849ac98800 20 started sync module instance, tier type = 2024-09-14T11:13:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.835+0000 7f849ac98800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:34.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=0 2024-09-14T11:13:34.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=1 2024-09-14T11:13:34.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=2 2024-09-14T11:13:34.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=3 2024-09-14T11:13:34.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=4 2024-09-14T11:13:34.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=5 2024-09-14T11:13:34.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.846+0000 7f849ac98800 20 add_watcher() i=6 2024-09-14T11:13:34.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.849+0000 7f849ac98800 20 add_watcher() i=7 2024-09-14T11:13:34.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.849+0000 7f849ac98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:34.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f834efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:34.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:34.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:34.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 5 note: GC not initialized 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f834dfdb640 20 reqs_thread_entry: start 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 20 Filter name: none 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f82bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.851+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.852+0000 7f849ac98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.853+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.853+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.854+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.854+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.854+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.855+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:34.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.856+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:34.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.856+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:34.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.857+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:34.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.857+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:34.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.858+0000 7f849ac98800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:34.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.864+0000 7f834efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:34.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.867+0000 7f849ac98800 20 remove_watcher() i=0 2024-09-14T11:13:34.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.867+0000 7f849ac98800 2 removed watcher, disabling cache 2024-09-14T11:13:34.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.868+0000 7f849ac98800 20 remove_watcher() i=1 2024-09-14T11:13:34.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.869+0000 7f849ac98800 20 remove_watcher() i=2 2024-09-14T11:13:34.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.870+0000 7f849ac98800 20 remove_watcher() i=3 2024-09-14T11:13:34.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.871+0000 7f849ac98800 20 remove_watcher() i=4 2024-09-14T11:13:34.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.872+0000 7f849ac98800 20 remove_watcher() i=5 2024-09-14T11:13:34.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.873+0000 7f849ac98800 20 remove_watcher() i=6 2024-09-14T11:13:34.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.874+0000 7f849ac98800 20 remove_watcher() i=7 2024-09-14T11:13:34.884 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:13:34.913 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:34.913 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:34.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.951+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.952+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 realm 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:34.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.953+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.954+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:34.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.954+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:34.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.954+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:34.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.954+0000 7f7164215800 20 searching for the correct realm 2024-09-14T11:13:34.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.956+0000 7f715f191640 0 -- 172.21.15.130:0/3263821028 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f7150054040 msgr2=0x7f7150055430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:34.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:34.960+0000 7f715f992640 0 -- 172.21.15.130:0/3263821028 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f715808b910 msgr2=0x7f715807d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:35.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:35.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:35.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:35.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.167+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 zone default found 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 4 Realm: () 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 zonegroup default 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.168+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.169+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.169+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.169+0000 7f7164215800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.169+0000 7f7164215800 20 started sync module instance, tier type = 2024-09-14T11:13:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.169+0000 7f7164215800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:35.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=0 2024-09-14T11:13:35.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=1 2024-09-14T11:13:35.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=2 2024-09-14T11:13:35.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=3 2024-09-14T11:13:35.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=4 2024-09-14T11:13:35.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=5 2024-09-14T11:13:35.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.182+0000 7f7164215800 20 add_watcher() i=6 2024-09-14T11:13:35.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.184+0000 7f7164215800 20 add_watcher() i=7 2024-09-14T11:13:35.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.184+0000 7f7164215800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:35.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.186+0000 7f7015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.186+0000 7f7164215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:35.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.186+0000 7f7164215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:35.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.186+0000 7f7164215800 5 note: GC not initialized 2024-09-14T11:13:35.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7014fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:35.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7164215800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:35.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7164215800 20 Filter name: none 2024-09-14T11:13:35.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f6f8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:35.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.187+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:35.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.188+0000 7f7164215800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:35.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.190+0000 7f7015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.192+0000 7f7164215800 20 remove_watcher() i=0 2024-09-14T11:13:35.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.192+0000 7f7164215800 2 removed watcher, disabling cache 2024-09-14T11:13:35.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.193+0000 7f7164215800 20 remove_watcher() i=1 2024-09-14T11:13:35.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.194+0000 7f7164215800 20 remove_watcher() i=2 2024-09-14T11:13:35.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.196+0000 7f7164215800 20 remove_watcher() i=3 2024-09-14T11:13:35.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.197+0000 7f7164215800 20 remove_watcher() i=4 2024-09-14T11:13:35.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.198+0000 7f7164215800 20 remove_watcher() i=5 2024-09-14T11:13:35.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.199+0000 7f7164215800 20 remove_watcher() i=6 2024-09-14T11:13:35.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.200+0000 7f7164215800 20 remove_watcher() i=7 2024-09-14T11:13:35.209 INFO:tasks.workunit.client.0.smithi130.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 75, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:13:35.209 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:13:35.210 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:35.211 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:13:35.244 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:35.244 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:35.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.282+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.283+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.283+0000 7fa60fb44800 20 realm 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.283+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.284+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.284+0000 7fa60fb44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.284+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.284+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.284+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.485+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:35.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.485+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.486+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:35.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.486+0000 7fa60fb44800 20 searching for the correct realm 2024-09-14T11:13:35.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.488+0000 7fa60de2f640 0 -- 172.21.15.130:0/1132453179 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fa5f80ac150 msgr2=0x7fa5f80b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:35.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.694+0000 7fa60de2f640 0 -- 172.21.15.130:0/1132453179 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fa5f80ac150 msgr2=0x7fa5f80b6750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:35.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:35.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:35.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:35.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:35.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:35.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:35.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.698+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:35.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:35.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 zone default found 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 4 Realm: () 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 zonegroup default 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.699+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 started sync module instance, tier type = 2024-09-14T11:13:35.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.700+0000 7fa60fb44800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=0 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=1 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=2 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=3 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=4 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=5 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.711+0000 7fa60fb44800 20 add_watcher() i=6 2024-09-14T11:13:35.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.712+0000 7fa60fb44800 20 add_watcher() i=7 2024-09-14T11:13:35.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.712+0000 7fa60fb44800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:35.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa4c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:35.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:35.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 5 note: GC not initialized 2024-09-14T11:13:35.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa4c27e4640 20 reqs_thread_entry: start 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 20 Filter name: none 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa433fff640 20 reqs_thread_entry: start 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.714+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:35.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.715+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.716+0000 7fa60fb44800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.716+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.716+0000 7fa60fb44800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.716+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.717+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.718+0000 7fa60fb44800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:13:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.718+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.718+0000 7fa60fb44800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:13:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.718+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.719+0000 7fa60fb44800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:13:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.719+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.720+0000 7fa60fb44800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.720+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.720+0000 7fa60fb44800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.720+0000 7fa60fb44800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.721+0000 7fa60fb44800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.721+0000 7fa60fb44800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:13:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.722+0000 7fa4c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.724+0000 7fa60fb44800 20 remove_watcher() i=0 2024-09-14T11:13:35.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.724+0000 7fa60fb44800 2 removed watcher, disabling cache 2024-09-14T11:13:35.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.726+0000 7fa60fb44800 20 remove_watcher() i=1 2024-09-14T11:13:35.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.727+0000 7fa60fb44800 20 remove_watcher() i=2 2024-09-14T11:13:35.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.729+0000 7fa60fb44800 20 remove_watcher() i=3 2024-09-14T11:13:35.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.730+0000 7fa60fb44800 20 remove_watcher() i=4 2024-09-14T11:13:35.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.731+0000 7fa60fb44800 20 remove_watcher() i=5 2024-09-14T11:13:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.732+0000 7fa60fb44800 20 remove_watcher() i=6 2024-09-14T11:13:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:35.733+0000 7fa60fb44800 20 remove_watcher() i=7 2024-09-14T11:13:35.743 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:13:36.133 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:13:37.521 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.521 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:37.572 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:37.574 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:37.607 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:37.608 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:37.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.649+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 realm 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.651+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.652+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.652+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.653+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:37.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.653+0000 7f4c3092e800 20 searching for the correct realm 2024-09-14T11:13:37.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.655+0000 7f4c23edc640 0 -- 172.21.15.130:0/395733677 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f4c1c068e30 msgr2=0x7f4c1c068820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:37.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.659+0000 7f4c2c6dd640 0 -- 172.21.15.130:0/395733677 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f4c2406a120 msgr2=0x7f4c24001a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:37.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:37.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.867+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 zone default found 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 4 Realm: () 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:37.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 zonegroup default 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.868+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.869+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.869+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.869+0000 7f4c3092e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.869+0000 7f4c3092e800 20 started sync module instance, tier type = 2024-09-14T11:13:37.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.869+0000 7f4c3092e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=0 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=1 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=2 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=3 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=4 2024-09-14T11:13:37.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=5 2024-09-14T11:13:37.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.890+0000 7f4c3092e800 20 add_watcher() i=6 2024-09-14T11:13:37.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.893+0000 7f4c3092e800 20 add_watcher() i=7 2024-09-14T11:13:37.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.893+0000 7f4c3092e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:37.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4ae2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4c3092e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:37.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4c3092e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:37.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4c3092e800 5 note: GC not initialized 2024-09-14T11:13:37.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4ae1fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:37.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.896+0000 7f4c3092e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:37.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 Filter name: none 2024-09-14T11:13:37.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4a537fe640 20 reqs_thread_entry: start 2024-09-14T11:13:37.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 INFO: main: starting shard=0 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.897+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 INFO: main: starting shard=1 2024-09-14T11:13:37.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:37.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 INFO: main: starting shard=2 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.898+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 INFO: main: starting shard=3 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 INFO: main: starting shard=4 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.899+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 INFO: main: starting shard=5 2024-09-14T11:13:37.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 INFO: main: starting shard=6 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.900+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 INFO: main: starting shard=7 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:37.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 INFO: main: starting shard=8 2024-09-14T11:13:37.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.901+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:37.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.902+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:37.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.902+0000 7f4c3092e800 20 INFO: main: starting shard=9 2024-09-14T11:13:37.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.902+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:37.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.903+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.903+0000 7f4c3092e800 20 INFO: main: starting shard=10 2024-09-14T11:13:37.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.903+0000 7f4c3092e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:37.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.903+0000 7f4c3092e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:37.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.903+0000 7f4c3092e800 20 INFO: main: done 2024-09-14T11:13:37.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.904+0000 7f4ae2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.907+0000 7f4c3092e800 20 remove_watcher() i=0 2024-09-14T11:13:37.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.907+0000 7f4c3092e800 2 removed watcher, disabling cache 2024-09-14T11:13:37.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.908+0000 7f4c3092e800 20 remove_watcher() i=1 2024-09-14T11:13:37.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.911+0000 7f4c3092e800 20 remove_watcher() i=2 2024-09-14T11:13:37.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.912+0000 7f4c3092e800 20 remove_watcher() i=3 2024-09-14T11:13:37.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.913+0000 7f4c3092e800 20 remove_watcher() i=4 2024-09-14T11:13:37.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.914+0000 7f4c3092e800 20 remove_watcher() i=5 2024-09-14T11:13:37.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.916+0000 7f4c3092e800 20 remove_watcher() i=6 2024-09-14T11:13:37.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:37.917+0000 7f4c3092e800 20 remove_watcher() i=7 2024-09-14T11:13:37.929 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.929 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:37.935 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.935 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:37.986 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:37.987 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:38.018 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.018 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.056+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 realm 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.058+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.059+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.059+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.060+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.060+0000 7f5169f25800 20 searching for the correct realm 2024-09-14T11:13:38.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.063+0000 7f5165ca2640 0 -- 172.21.15.130:0/1709963883 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f5160023040 msgr2=0x7f51600079d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.067+0000 7f5165ca2640 0 -- 172.21.15.130:0/1709963883 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f5030084e10 msgr2=0x7f5030087240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:38.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:38.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:38.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:38.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:38.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:38.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:38.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.070+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 zone default found 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 4 Realm: () 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:38.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 zonegroup default 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.071+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.072+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.072+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.072+0000 7f5169f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.072+0000 7f5169f25800 20 started sync module instance, tier type = 2024-09-14T11:13:38.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.072+0000 7f5169f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=0 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=1 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=2 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=3 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=4 2024-09-14T11:13:38.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=5 2024-09-14T11:13:38.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.086+0000 7f5169f25800 20 add_watcher() i=6 2024-09-14T11:13:38.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.087+0000 7f5169f25800 20 add_watcher() i=7 2024-09-14T11:13:38.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.087+0000 7f5169f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:38.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.089+0000 7f50177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.089+0000 7f5169f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.089+0000 7f5169f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 5 note: GC not initialized 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f50167fc640 20 reqs_thread_entry: start 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 20 Filter name: none 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f4f87fff640 20 reqs_thread_entry: start 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:38.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.090+0000 7f5169f25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:38.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:38.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:38.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 INFO: main: starting shard=0 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 INFO: main: starting shard=1 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.091+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 INFO: main: starting shard=2 2024-09-14T11:13:38.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 INFO: main: starting shard=3 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.092+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 INFO: main: starting shard=4 2024-09-14T11:13:38.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 INFO: main: starting shard=5 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.093+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.094+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.094+0000 7f5169f25800 20 INFO: main: starting shard=6 2024-09-14T11:13:38.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.094+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:38.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 INFO: main: starting shard=7 2024-09-14T11:13:38.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:38.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 INFO: main: starting shard=8 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.095+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: starting shard=9 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: starting shard=10 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.096+0000 7f5169f25800 20 INFO: main: done 2024-09-14T11:13:38.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.097+0000 7f50177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.100+0000 7f5169f25800 20 remove_watcher() i=0 2024-09-14T11:13:38.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.100+0000 7f5169f25800 2 removed watcher, disabling cache 2024-09-14T11:13:38.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.101+0000 7f5169f25800 20 remove_watcher() i=1 2024-09-14T11:13:38.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.102+0000 7f5169f25800 20 remove_watcher() i=2 2024-09-14T11:13:38.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.103+0000 7f5169f25800 20 remove_watcher() i=3 2024-09-14T11:13:38.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.104+0000 7f5169f25800 20 remove_watcher() i=4 2024-09-14T11:13:38.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.105+0000 7f5169f25800 20 remove_watcher() i=5 2024-09-14T11:13:38.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.106+0000 7f5169f25800 20 remove_watcher() i=6 2024-09-14T11:13:38.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.107+0000 7f5169f25800 20 remove_watcher() i=7 2024-09-14T11:13:38.118 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.118 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.122 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.122 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.125 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.125 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.175 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:38.176 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:13:38.206 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.206 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.245+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 realm 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.247+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.248+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.248+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.249+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.249+0000 7fea1791f800 20 searching for the correct realm 2024-09-14T11:13:38.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.251+0000 7fea13ea3640 0 -- 172.21.15.130:0/1247424736 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fea08048e60 msgr2=0x7fea080a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.457+0000 7fea13ea3640 0 -- 172.21.15.130:0/1247424736 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fea08048e60 msgr2=0x7fea080a2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:38.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.462+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 zone default found 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 4 Realm: () 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 zonegroup default 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.463+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.464+0000 7fea1791f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.464+0000 7fea1791f800 20 started sync module instance, tier type = 2024-09-14T11:13:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.464+0000 7fea1791f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=0 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=1 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=2 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=3 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=4 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=5 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.475+0000 7fea1791f800 20 add_watcher() i=6 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.476+0000 7fea1791f800 20 add_watcher() i=7 2024-09-14T11:13:38.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.476+0000 7fea1791f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fe8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 5 note: GC not initialized 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fe8c8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 20 Filter name: none 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fe8427fc640 20 reqs_thread_entry: start 2024-09-14T11:13:38.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.478+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:38.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 INFO: main: starting shard=0 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.479+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 INFO: main: starting shard=1 2024-09-14T11:13:38.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 INFO: main: starting shard=2 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.480+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 INFO: main: starting shard=3 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:38.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 INFO: main: starting shard=4 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.481+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: starting shard=5 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: starting shard=6 2024-09-14T11:13:38.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:38.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 INFO: main: starting shard=7 2024-09-14T11:13:38.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.482+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:38.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.483+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.483+0000 7fea1791f800 20 INFO: main: starting shard=8 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.483+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: starting shard=9 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: starting shard=10 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.484+0000 7fea1791f800 20 INFO: main: done 2024-09-14T11:13:38.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.485+0000 7fe8c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.488+0000 7fea1791f800 20 remove_watcher() i=0 2024-09-14T11:13:38.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.488+0000 7fea1791f800 2 removed watcher, disabling cache 2024-09-14T11:13:38.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.490+0000 7fea1791f800 20 remove_watcher() i=1 2024-09-14T11:13:38.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.491+0000 7fea1791f800 20 remove_watcher() i=2 2024-09-14T11:13:38.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.492+0000 7fea1791f800 20 remove_watcher() i=3 2024-09-14T11:13:38.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.493+0000 7fea1791f800 20 remove_watcher() i=4 2024-09-14T11:13:38.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.494+0000 7fea1791f800 20 remove_watcher() i=5 2024-09-14T11:13:38.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.496+0000 7fea1791f800 20 remove_watcher() i=6 2024-09-14T11:13:38.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.497+0000 7fea1791f800 20 remove_watcher() i=7 2024-09-14T11:13:38.509 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.509 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.513 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.513 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.565 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:38.566 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:13:38.596 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.597 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.634+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 realm 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.636+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.637+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.637+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.638+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.638+0000 7f96b032c800 20 searching for the correct realm 2024-09-14T11:13:38.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.640+0000 7f96ac850640 0 -- 172.21.15.130:0/1564885433 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f96a0088070 msgr2=0x7f96a00b1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:38.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.645+0000 7f96ac850640 0 -- 172.21.15.130:0/1564885433 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9574084e40 msgr2=0x7f9574087270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:38.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:38.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 zone default found 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 4 Realm: () 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 zonegroup default 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.649+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 started sync module instance, tier type = 2024-09-14T11:13:38.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.650+0000 7f96b032c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:38.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=0 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=1 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=2 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=3 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=4 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=5 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.661+0000 7f96b032c800 20 add_watcher() i=6 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.662+0000 7f96b032c800 20 add_watcher() i=7 2024-09-14T11:13:38.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.662+0000 7f96b032c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:38.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.663+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 5 note: GC not initialized 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f95617e2640 20 reqs_thread_entry: start 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 20 Filter name: none 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f94d2ffd640 20 reqs_thread_entry: start 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.664+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 INFO: main: starting shard=0 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.665+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: starting shard=1 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: starting shard=2 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 INFO: main: starting shard=3 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.666+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 INFO: main: starting shard=4 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 INFO: main: starting shard=5 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.667+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 INFO: main: starting shard=6 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:38.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 INFO: main: starting shard=7 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.668+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 INFO: main: starting shard=8 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 INFO: main: starting shard=9 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.669+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.670+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.670+0000 7f96b032c800 20 INFO: main: starting shard=10 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.670+0000 7f96b032c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:38.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.670+0000 7f96b032c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:38.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.670+0000 7f96b032c800 20 INFO: main: done 2024-09-14T11:13:38.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.671+0000 7f95627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.674+0000 7f96b032c800 20 remove_watcher() i=0 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.674+0000 7f96b032c800 2 removed watcher, disabling cache 2024-09-14T11:13:38.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.675+0000 7f96b032c800 20 remove_watcher() i=1 2024-09-14T11:13:38.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.676+0000 7f96b032c800 20 remove_watcher() i=2 2024-09-14T11:13:38.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.677+0000 7f96b032c800 20 remove_watcher() i=3 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.678+0000 7f96b032c800 20 remove_watcher() i=4 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.679+0000 7f96b032c800 20 remove_watcher() i=5 2024-09-14T11:13:38.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.680+0000 7f96b032c800 20 remove_watcher() i=6 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:38.681+0000 7f96b032c800 20 remove_watcher() i=7 2024-09-14T11:13:38.693 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.693 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:38.697 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:13:39.086 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:13:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:13:39.479 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:39.480 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:13:39.513 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.513 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:39.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.551+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 realm 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.553+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.554+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.554+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.555+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:39.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.555+0000 7f4ee1122800 20 searching for the correct realm 2024-09-14T11:13:39.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.557+0000 7f4edd669640 0 -- 172.21.15.130:0/3694883658 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4ec408b030 msgr2=0x7f4ec408d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:39.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.763+0000 7f4edd669640 0 -- 172.21.15.130:0/3694883658 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4ec408b030 msgr2=0x7f4ec408d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:39.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:39.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:39.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:39.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:39.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:39.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.767+0000 7f4ee1122800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:39.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 zone default found 2024-09-14T11:13:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 4 Realm: () 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 zonegroup default 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.768+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 started sync module instance, tier type = 2024-09-14T11:13:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.769+0000 7f4ee1122800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:39.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=0 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=1 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=2 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=3 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=4 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=5 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.785+0000 7f4ee1122800 20 add_watcher() i=6 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.786+0000 7f4ee1122800 20 add_watcher() i=7 2024-09-14T11:13:39.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.786+0000 7f4ee1122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:39.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4d92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4ee1122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4ee1122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4ee1122800 5 note: GC not initialized 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4d91fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4ee1122800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.788+0000 7f4ee1122800 20 Filter name: none 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4d037fe640 20 reqs_thread_entry: start 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:39.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:39.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.789+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.790+0000 7f4ee1122800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.790+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.790+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.791+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.792+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.792+0000 7f4ee1122800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.792+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.793+0000 7f4ee1122800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.793+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.794+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:39.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.794+0000 7f4ee1122800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:13:39.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.794+0000 7f4ee1122800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:39.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.795+0000 7f4ee1122800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:13:39.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.795+0000 7f4ee1122800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:13:39.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.795+0000 7f4ee1122800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.795+0000 7f4ee1122800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.795+0000 7f4ee1122800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.796+0000 7f4d92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.799+0000 7f4ee1122800 20 remove_watcher() i=0 2024-09-14T11:13:39.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.799+0000 7f4ee1122800 2 removed watcher, disabling cache 2024-09-14T11:13:39.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.800+0000 7f4ee1122800 20 remove_watcher() i=1 2024-09-14T11:13:39.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.801+0000 7f4ee1122800 20 remove_watcher() i=2 2024-09-14T11:13:39.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.802+0000 7f4ee1122800 20 remove_watcher() i=3 2024-09-14T11:13:39.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.803+0000 7f4ee1122800 20 remove_watcher() i=4 2024-09-14T11:13:39.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.804+0000 7f4ee1122800 20 remove_watcher() i=5 2024-09-14T11:13:39.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.807+0000 7f4ee1122800 20 remove_watcher() i=6 2024-09-14T11:13:39.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.808+0000 7f4ee1122800 20 remove_watcher() i=7 2024-09-14T11:13:39.817 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: unlinked entries are not listable 2024-09-14T11:13:39.817 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:39.820 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.820 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:39.824 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:13:39.824 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:39.826 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.826 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:39.870 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.870 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:39.913 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:13:39.913 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:39.914 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:39.948 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.948 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:39.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.989+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 20 realm 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:39.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.991+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.992+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.992+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.992+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.992+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.993+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:39.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.993+0000 7f69f77a2800 20 searching for the correct realm 2024-09-14T11:13:39.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:39.993+0000 7f69f5a8d640 0 -- 172.21.15.130:0/3784709549 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55f089ff8170 msgr2=0x55f089ffa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.197+0000 7f69f5a8d640 0 -- 172.21.15.130:0/3784709549 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55f089ff8170 msgr2=0x55f089ffa630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.204+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 zone default found 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 4 Realm: () 2024-09-14T11:13:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 zonegroup default 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.205+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 started sync module instance, tier type = 2024-09-14T11:13:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.206+0000 7f69f77a2800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:40.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=0 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=1 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=2 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=3 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=4 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.224+0000 7f69f77a2800 20 add_watcher() i=5 2024-09-14T11:13:40.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.225+0000 7f69f77a2800 20 add_watcher() i=6 2024-09-14T11:13:40.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.225+0000 7f69f77a2800 20 add_watcher() i=7 2024-09-14T11:13:40.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.225+0000 7f69f77a2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.228+0000 7f68a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.228+0000 7f69f77a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.228+0000 7f69f77a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.228+0000 7f69f77a2800 5 note: GC not initialized 2024-09-14T11:13:40.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.228+0000 7f68a67e4640 20 reqs_thread_entry: start 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 Filter name: none 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f6817fff640 20 reqs_thread_entry: start 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:40.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.229+0000 7f69f77a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.230+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.230+0000 7f69f77a2800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.230+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.230+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.231+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.232+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.233+0000 7f69f77a2800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.233+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.233+0000 7f69f77a2800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:13:40.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.233+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.234+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:40.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.234+0000 7f69f77a2800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:13:40.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.234+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.235+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.235+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d6f300 obj=check-bucket:e state=0x55f08a025458 s->prefetch_data=0 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.235+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.235+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d97710 obj=check-bucket:d state=0x55f08a02bf38 s->prefetch_data=0 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a025dd0 obj=check-bucket:c state=0x55f08a029b18 s->prefetch_data=0 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a0278f0 obj=check-bucket:f state=0x55f08a0c5f38 s->prefetch_data=0 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to htqccnrsx1jjylpeyintpkarp2kfabiy 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state_impl: setting s->olh_tag to vrt168qr8nnc53n1xp2uqj3hmg28hd9i 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vrt168qr8nnc53n1xp2uqj3hmg28hd9i 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to 8mn3x58w3v3i1f130lql15mllzjls174 2024-09-14T11:13:40.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state_impl: setting s->olh_tag to c42j9kde9m6m7wlo41iso5idqn0to49k 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c42j9kde9m6m7wlo41iso5idqn0to49k 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to nxudjsbblehlfol6aqluopb7ora1whci 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 get_obj_state_impl: setting s->olh_tag to 7xjywcjf9kh3wx3s87lci8kczf8gty0s 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.236+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7xjywcjf9kh3wx3s87lci8kczf8gty0s 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.237+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to rj97bzocaw4xg5dmxto3b40vt1d2sypp 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.237+0000 7f69f77a2800 20 get_obj_state_impl: setting s->olh_tag to j225h0rgl52epop3odeyk14utocd8ylj 2024-09-14T11:13:40.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.237+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=j225h0rgl52epop3odeyk14utocd8ylj 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.241+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.241+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.243+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.243+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.243+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 olh_log_entry: epoch=3 op=3 key=d[vrk1eQlbGEtKXpR1uqdD0kFtQVWXgK5] 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d97710 obj=check-bucket:_:vrk1eQlbGEtKXpR1uqdD0kFtQVWXgK5_d state=0x55f08a0dfc68 s->prefetch_data=0 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 10 manifest: total_size = 11 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.14413987453041379291 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d97710 obj=check-bucket:_:vrk1eQlbGEtKXpR1uqdD0kFtQVWXgK5_d state=0x55f08a0dfc68 s->prefetch_data=0 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f08a0dfc68 2024-09-14T11:13:40.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.244+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.246+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.246+0000 7f69f77a2800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:13:40.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.246+0000 7f69f77a2800 20 olh_log_entry: epoch=2 op=3 key=e[2Me0-c8jVCRBLr4hZmFJ9AlLgySXnEY] 2024-09-14T11:13:40.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.246+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d6f300 obj=check-bucket:_:2Me0-c8jVCRBLr4hZmFJ9AlLgySXnEY_e state=0x55f08a0e7ad8 s->prefetch_data=0 2024-09-14T11:13:40.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.247+0000 7f69f77a2800 10 manifest: total_size = 12 2024-09-14T11:13:40.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.247+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.15571860883774994300 2024-09-14T11:13:40.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.247+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d6f300 obj=check-bucket:_:2Me0-c8jVCRBLr4hZmFJ9AlLgySXnEY_e state=0x55f08a0e7ad8 s->prefetch_data=0 2024-09-14T11:13:40.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.247+0000 7f69f77a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f08a0e7ad8 2024-09-14T11:13:40.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.247+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.249+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.249+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.249+0000 7f69f77a2800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:13:40.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.249+0000 7f69f77a2800 20 olh_log_entry: epoch=2 op=3 key=f[hsCyiKgQeNNoqsHQ4SfUu6fKZ0jemB0] 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.249+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a0278f0 obj=check-bucket:_:hsCyiKgQeNNoqsHQ4SfUu6fKZ0jemB0_f state=0x55f08a0efae8 s->prefetch_data=0 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 olh_log_entry: epoch=3 op=3 key=c[NLzWMs-7m7wUGDY8GH5C-7GnXlCLrQm] 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a025dd0 obj=check-bucket:_:NLzWMs-7m7wUGDY8GH5C-7GnXlCLrQm_c state=0x55f08a0f5698 s->prefetch_data=0 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 10 manifest: total_size = 9 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.9559108211806647348 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a0278f0 obj=check-bucket:_:hsCyiKgQeNNoqsHQ4SfUu6fKZ0jemB0_f state=0x55f08a0efae8 s->prefetch_data=0 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f08a0efae8 2024-09-14T11:13:40.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 10 manifest: total_size = 22 2024-09-14T11:13:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.8266747030468042795 2024-09-14T11:13:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a025dd0 obj=check-bucket:_:NLzWMs-7m7wUGDY8GH5C-7GnXlCLrQm_c state=0x55f08a0f5698 s->prefetch_data=0 2024-09-14T11:13:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 prepare_atomic_modification: state is not atomic. state=0x55f08a0f5698 2024-09-14T11:13:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.250+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.254+0000 7f68c7fff640 20 handle_completion(): completion ok for obj=d[vrk1eQlbGEtKXpR1uqdD0kFtQVWXgK5] 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.254+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.254+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.257+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.257+0000 7f69f77a2800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f68c7fff640 20 handle_completion(): completion ok for obj=e[2Me0-c8jVCRBLr4hZmFJ9AlLgySXnEY] 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f68d8ff9640 20 handle_completion(): completion ok for obj=c[NLzWMs-7m7wUGDY8GH5C-7GnXlCLrQm] 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f68d8ff9640 20 handle_completion(): completion ok for obj=f[hsCyiKgQeNNoqsHQ4SfUu6fKZ0jemB0] 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 get_obj_state: octx=0x55f089d6f300 obj=check-bucket:e state=0x55f08a025458 s->prefetch_data=0 2024-09-14T11:13:40.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vrt168qr8nnc53n1xp2uqj3hmg28hd9i 2024-09-14T11:13:40.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 get_obj_state: octx=0x55f08a0278f0 obj=check-bucket:f state=0x55f08a0c5f38 s->prefetch_data=0 2024-09-14T11:13:40.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.260+0000 7f69f77a2800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=j225h0rgl52epop3odeyk14utocd8ylj 2024-09-14T11:13:40.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.265+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.265+0000 7f69f77a2800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:13:40.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.271+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.273+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.276+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.276+0000 7f69f77a2800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:13:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.277+0000 7f69f77a2800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.277+0000 7f69f77a2800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:13:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.277+0000 7f69f77a2800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:13:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.277+0000 7f68a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.280+0000 7f69f77a2800 20 remove_watcher() i=0 2024-09-14T11:13:40.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.280+0000 7f69f77a2800 2 removed watcher, disabling cache 2024-09-14T11:13:40.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.281+0000 7f69f77a2800 20 remove_watcher() i=1 2024-09-14T11:13:40.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.282+0000 7f69f77a2800 20 remove_watcher() i=2 2024-09-14T11:13:40.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.283+0000 7f69f77a2800 20 remove_watcher() i=3 2024-09-14T11:13:40.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.284+0000 7f69f77a2800 20 remove_watcher() i=4 2024-09-14T11:13:40.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.285+0000 7f69f77a2800 20 remove_watcher() i=5 2024-09-14T11:13:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.286+0000 7f69f77a2800 20 remove_watcher() i=6 2024-09-14T11:13:40.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.287+0000 7f69f77a2800 20 remove_watcher() i=7 2024-09-14T11:13:40.298 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.299 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.301 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.301 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.304 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.304 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.306 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.306 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.308 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:13:40.308 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:40.309 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.309 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.354 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.354 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.357 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.357 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.360 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.360 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.363 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.363 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.365 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:13:40.365 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:40.366 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:13:40.398 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:40.398 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.437+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 realm 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.438+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.439+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.439+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.440+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.440+0000 7fd15f098800 20 searching for the correct realm 2024-09-14T11:13:40.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.442+0000 7fd15d38a640 0 -- 172.21.15.130:0/1008791451 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd14802c940 msgr2=0x7fd14802b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.648+0000 7fd15d38a640 0 -- 172.21.15.130:0/1008791451 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd14802c940 msgr2=0x7fd14802b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.652+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 zone default found 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 4 Realm: () 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 zonegroup default 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.653+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 started sync module instance, tier type = 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.654+0000 7fd15f098800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=0 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=1 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=2 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=3 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=4 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=5 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.664+0000 7fd15f098800 20 add_watcher() i=6 2024-09-14T11:13:40.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.665+0000 7fd15f098800 20 add_watcher() i=7 2024-09-14T11:13:40.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.665+0000 7fd15f098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd0137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd15f098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd15f098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd15f098800 5 note: GC not initialized 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd0127e4640 20 reqs_thread_entry: start 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd15f098800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd15f098800 20 Filter name: none 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.667+0000 7fd00bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.668+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.669+0000 7fd15f098800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.669+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.669+0000 7fd15f098800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:13:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.669+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.670+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.671+0000 7fd15f098800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.671+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.671+0000 7fd15f098800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.671+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.672+0000 7fd15f098800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:13:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.672+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.672+0000 7fd15f098800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:13:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.672+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.673+0000 7fd15f098800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:13:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.673+0000 7fd15f098800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.673+0000 7fd15f098800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:13:40.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.673+0000 7fd15f098800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:13:40.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.674+0000 7fd0137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.676+0000 7fd15f098800 20 remove_watcher() i=0 2024-09-14T11:13:40.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.676+0000 7fd15f098800 2 removed watcher, disabling cache 2024-09-14T11:13:40.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.677+0000 7fd15f098800 20 remove_watcher() i=1 2024-09-14T11:13:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.678+0000 7fd15f098800 20 remove_watcher() i=2 2024-09-14T11:13:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.679+0000 7fd15f098800 20 remove_watcher() i=3 2024-09-14T11:13:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.680+0000 7fd15f098800 20 remove_watcher() i=4 2024-09-14T11:13:40.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.682+0000 7fd15f098800 20 remove_watcher() i=5 2024-09-14T11:13:40.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.682+0000 7fd15f098800 20 remove_watcher() i=6 2024-09-14T11:13:40.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.683+0000 7fd15f098800 20 remove_watcher() i=7 2024-09-14T11:13:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:40.724 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.792+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 realm 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.794+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.795+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.795+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.796+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.796+0000 7f4def136800 20 searching for the correct realm 2024-09-14T11:13:40.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:40.798+0000 7f4deb6b8640 0 -- 172.21.15.130:0/3948216973 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4dd401c040 msgr2=0x7f4dd4044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.004+0000 7f4deb6b8640 0 -- 172.21.15.130:0/3948216973 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4dd401c040 msgr2=0x7f4dd4044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.008+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 zone default found 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 4 Realm: () 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 zonegroup default 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.009+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.010+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.010+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.010+0000 7f4def136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.010+0000 7f4def136800 20 started sync module instance, tier type = 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.010+0000 7f4def136800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=0 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=1 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=2 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=3 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=4 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=5 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.022+0000 7f4def136800 20 add_watcher() i=6 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.025+0000 7f4def136800 20 add_watcher() i=7 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.025+0000 7f4def136800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 5 note: GC not initialized 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4c1bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 20 Filter name: none 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4c19ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.028+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 INFO: main: starting shard=0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.029+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: starting shard=1 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: starting shard=2 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 INFO: main: starting shard=3 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.030+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 INFO: main: starting shard=4 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 INFO: main: starting shard=5 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.031+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 INFO: main: starting shard=6 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 INFO: main: starting shard=7 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.032+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.033+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.033+0000 7f4def136800 20 INFO: main: starting shard=8 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.033+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 INFO: main: starting shard=9 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 INFO: main: starting shard=10 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.034+0000 7f4def136800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.035+0000 7f4def136800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.035+0000 7f4def136800 20 INFO: main: done 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.035+0000 7f4ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.038+0000 7f4def136800 20 remove_watcher() i=0 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.038+0000 7f4def136800 2 removed watcher, disabling cache 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.039+0000 7f4def136800 20 remove_watcher() i=1 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.041+0000 7f4def136800 20 remove_watcher() i=2 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.043+0000 7f4def136800 20 remove_watcher() i=3 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.047+0000 7f4def136800 20 remove_watcher() i=4 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.048+0000 7f4def136800 20 remove_watcher() i=5 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.049+0000 7f4def136800 20 remove_watcher() i=6 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.050+0000 7f4def136800 20 remove_watcher() i=7 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.128+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 realm 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.130+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.131+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.131+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.132+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.132+0000 7fae4e83e800 20 searching for the correct realm 2024-09-14T11:13:41.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.134+0000 7fae4cb29640 0 -- 172.21.15.130:0/4181961999 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fae40048d50 msgr2=0x7fae40061a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.340+0000 7fae4cb29640 0 -- 172.21.15.130:0/4181961999 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fae40048d50 msgr2=0x7fae40061a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.344+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 zone default found 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 4 Realm: () 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 zonegroup default 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 started sync module instance, tier type = 2024-09-14T11:13:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.345+0000 7fae4e83e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:41.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=0 2024-09-14T11:13:41.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=1 2024-09-14T11:13:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=2 2024-09-14T11:13:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=3 2024-09-14T11:13:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=4 2024-09-14T11:13:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=5 2024-09-14T11:13:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.358+0000 7fae4e83e800 20 add_watcher() i=6 2024-09-14T11:13:41.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.360+0000 7fae4e83e800 20 add_watcher() i=7 2024-09-14T11:13:41.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.360+0000 7fae4e83e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.362+0000 7fad02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.362+0000 7fae4e83e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.362+0000 7fae4e83e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.362+0000 7fae4e83e800 5 note: GC not initialized 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.362+0000 7fad01fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fae4e83e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fae4e83e800 20 Filter name: none 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fac737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:41.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.363+0000 7fae4e83e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 INFO: main: starting shard=0 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 INFO: main: starting shard=1 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.364+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: starting shard=2 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: starting shard=3 2024-09-14T11:13:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 INFO: main: starting shard=4 2024-09-14T11:13:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.365+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.366+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.366+0000 7fae4e83e800 20 INFO: main: starting shard=5 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.366+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: starting shard=6 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: starting shard=7 2024-09-14T11:13:41.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 INFO: main: starting shard=8 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.367+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 INFO: main: starting shard=9 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 INFO: main: starting shard=10 2024-09-14T11:13:41.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.368+0000 7fae4e83e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:41.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.369+0000 7fae4e83e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:41.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.369+0000 7fae4e83e800 20 INFO: main: done 2024-09-14T11:13:41.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.370+0000 7fad02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.373+0000 7fae4e83e800 20 remove_watcher() i=0 2024-09-14T11:13:41.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.373+0000 7fae4e83e800 2 removed watcher, disabling cache 2024-09-14T11:13:41.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.374+0000 7fae4e83e800 20 remove_watcher() i=1 2024-09-14T11:13:41.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.375+0000 7fae4e83e800 20 remove_watcher() i=2 2024-09-14T11:13:41.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.376+0000 7fae4e83e800 20 remove_watcher() i=3 2024-09-14T11:13:41.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.377+0000 7fae4e83e800 20 remove_watcher() i=4 2024-09-14T11:13:41.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.380+0000 7fae4e83e800 20 remove_watcher() i=5 2024-09-14T11:13:41.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.381+0000 7fae4e83e800 20 remove_watcher() i=6 2024-09-14T11:13:41.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.382+0000 7fae4e83e800 20 remove_watcher() i=7 2024-09-14T11:13:41.391 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:13:41.391 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:41.392 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:13:41.423 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.424 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.461+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 realm 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.463+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.464+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.464+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.465+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.465+0000 7fd0ed346800 20 searching for the correct realm 2024-09-14T11:13:41.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.467+0000 7fd0ea636640 0 -- 172.21.15.130:0/3829846165 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd0dc07d070 msgr2=0x7fd0dc09c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.470+0000 7fd0eae37640 0 -- 172.21.15.130:0/3829846165 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd0e403cb60 msgr2=0x7fd0e407d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.676+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 zone default found 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 4 Realm: () 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 zonegroup default 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.677+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 started sync module instance, tier type = 2024-09-14T11:13:41.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.678+0000 7fd0ed346800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=0 2024-09-14T11:13:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=1 2024-09-14T11:13:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=2 2024-09-14T11:13:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=3 2024-09-14T11:13:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=4 2024-09-14T11:13:41.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=5 2024-09-14T11:13:41.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.690+0000 7fd0ed346800 20 add_watcher() i=6 2024-09-14T11:13:41.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.693+0000 7fd0ed346800 20 add_watcher() i=7 2024-09-14T11:13:41.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.693+0000 7fd0ed346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.695+0000 7fcfa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.695+0000 7fd0ed346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.695+0000 7fd0ed346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.695+0000 7fd0ed346800 5 note: GC not initialized 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.695+0000 7fcf1bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 Filter name: none 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fcf19ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.696+0000 7fd0ed346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.697+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.697+0000 7fd0ed346800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.697+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:41.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:13:41.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:41.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:13:41.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.698+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.699+0000 7fd0ed346800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.699+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.699+0000 7fd0ed346800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.699+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.700+0000 7fd0ed346800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.700+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.701+0000 7fd0ed346800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:13:41.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.701+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:41.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.701+0000 7fd0ed346800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:13:41.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.701+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:41.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.702+0000 7fd0ed346800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:13:41.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.702+0000 7fd0ed346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:41.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.702+0000 7fd0ed346800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:13:41.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.702+0000 7fd0ed346800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:13:41.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.703+0000 7fcfa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.706+0000 7fd0ed346800 20 remove_watcher() i=0 2024-09-14T11:13:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.706+0000 7fd0ed346800 2 removed watcher, disabling cache 2024-09-14T11:13:41.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.707+0000 7fd0ed346800 20 remove_watcher() i=1 2024-09-14T11:13:41.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.708+0000 7fd0ed346800 20 remove_watcher() i=2 2024-09-14T11:13:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.709+0000 7fd0ed346800 20 remove_watcher() i=3 2024-09-14T11:13:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.710+0000 7fd0ed346800 20 remove_watcher() i=4 2024-09-14T11:13:41.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.711+0000 7fd0ed346800 20 remove_watcher() i=5 2024-09-14T11:13:41.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.712+0000 7fd0ed346800 20 remove_watcher() i=6 2024-09-14T11:13:41.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.713+0000 7fd0ed346800 20 remove_watcher() i=7 2024-09-14T11:13:41.722 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:13:41.723 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:41.724 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:41.757 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.758 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.796+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 realm 2024-09-14T11:13:41.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.797+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.798+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.798+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.799+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.799+0000 7ff70112e800 20 searching for the correct realm 2024-09-14T11:13:41.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:41.801+0000 7ff6fd565640 0 -- 172.21.15.130:0/2690773373 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff6e8045920 msgr2=0x7ff6e80343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:42.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.007+0000 7ff6fd565640 0 -- 172.21.15.130:0/2690773373 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff6e8045920 msgr2=0x7ff6e80343b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.011+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 zone default found 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 4 Realm: () 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 zonegroup default 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.012+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.013+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.013+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.013+0000 7ff70112e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.013+0000 7ff70112e800 20 started sync module instance, tier type = 2024-09-14T11:13:42.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.013+0000 7ff70112e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:42.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=0 2024-09-14T11:13:42.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=1 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=2 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=3 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=4 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=5 2024-09-14T11:13:42.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.026+0000 7ff70112e800 20 add_watcher() i=6 2024-09-14T11:13:42.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.028+0000 7ff70112e800 20 add_watcher() i=7 2024-09-14T11:13:42.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.028+0000 7ff70112e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.031+0000 7ff5b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.031+0000 7ff70112e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.031+0000 7ff70112e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 5 note: GC not initialized 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff5b27e4640 20 reqs_thread_entry: start 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 20 Filter name: none 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff5ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:42.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.032+0000 7ff70112e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:13:42.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.033+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:13:42.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.034+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.035+0000 7ff70112e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.035+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.036+0000 7ff70112e800 20 get_obj_state: octx=0x5574a65532e0 obj=check-bucket:d state=0x5574a6820ff8 s->prefetch_data=0 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.036+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.036+0000 7ff70112e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:13:42.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.036+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.037+0000 7ff70112e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.037+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.037+0000 7ff70112e800 20 get_obj_state: octx=0x5574a657b6f0 obj=check-bucket:c state=0x5574a6824058 s->prefetch_data=0 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.037+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:13:42.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 get_obj_state: setting s->obj_tag to 8mn3x58w3v3i1f130lql15mllzjls174 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 get_obj_state_impl: setting s->olh_tag to c42j9kde9m6m7wlo41iso5idqn0to49k 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 get_obj_state: setting s->obj_tag to nxudjsbblehlfol6aqluopb7ora1whci 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 get_obj_state_impl: setting s->olh_tag to 7xjywcjf9kh3wx3s87lci8kczf8gty0s 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.038+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 olh_log_entry: epoch=4 op=3 key=d[HMgPVcBXopL2spd.JwsnxZPNNLTrxI-] 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 get_obj_state: octx=0x5574a6858fb0 obj=check-bucket:_:HMgPVcBXopL2spd.JwsnxZPNNLTrxI-_d state=0x5574a687eed8 s->prefetch_data=0 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:13:42.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 olh_log_entry: epoch=4 op=3 key=c[CpNdOyJEDAaChEDV7bv33lQDh4Qjtvd] 2024-09-14T11:13:42.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.039+0000 7ff70112e800 20 get_obj_state: octx=0x5574a6878fb0 obj=check-bucket:_:CpNdOyJEDAaChEDV7bv33lQDh4Qjtvd_c state=0x5574a6887598 s->prefetch_data=0 2024-09-14T11:13:42.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.041+0000 7ff70112e800 20 get_obj_state: octx=0x5574a6858fb0 obj=check-bucket:d state=0x5574a6879e88 s->prefetch_data=0 2024-09-14T11:13:42.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.041+0000 7ff70112e800 20 get_obj_state: setting s->obj_tag to 8mn3x58w3v3i1f130lql15mllzjls174 2024-09-14T11:13:42.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.041+0000 7ff70112e800 20 get_obj_state_impl: setting s->olh_tag to c42j9kde9m6m7wlo41iso5idqn0to49k 2024-09-14T11:13:42.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.041+0000 7ff70112e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c42j9kde9m6m7wlo41iso5idqn0to49k 2024-09-14T11:13:42.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.041+0000 7ff70112e800 20 get_obj_state: octx=0x5574a6878fb0 obj=check-bucket:c state=0x5574a681d028 s->prefetch_data=0 2024-09-14T11:13:42.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.042+0000 7ff70112e800 20 get_obj_state: setting s->obj_tag to nxudjsbblehlfol6aqluopb7ora1whci 2024-09-14T11:13:42.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.042+0000 7ff70112e800 20 get_obj_state_impl: setting s->olh_tag to 7xjywcjf9kh3wx3s87lci8kczf8gty0s 2024-09-14T11:13:42.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.042+0000 7ff70112e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7xjywcjf9kh3wx3s87lci8kczf8gty0s 2024-09-14T11:13:42.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.052+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:42.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.052+0000 7ff70112e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:42.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.053+0000 7ff70112e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:13:42.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.054+0000 7ff70112e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:13:42.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.054+0000 7ff70112e800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:13:42.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.055+0000 7ff5b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.058+0000 7ff70112e800 20 remove_watcher() i=0 2024-09-14T11:13:42.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.058+0000 7ff70112e800 2 removed watcher, disabling cache 2024-09-14T11:13:42.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.059+0000 7ff70112e800 20 remove_watcher() i=1 2024-09-14T11:13:42.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.060+0000 7ff70112e800 20 remove_watcher() i=2 2024-09-14T11:13:42.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.061+0000 7ff70112e800 20 remove_watcher() i=3 2024-09-14T11:13:42.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.062+0000 7ff70112e800 20 remove_watcher() i=4 2024-09-14T11:13:42.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.063+0000 7ff70112e800 20 remove_watcher() i=5 2024-09-14T11:13:42.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.064+0000 7ff70112e800 20 remove_watcher() i=6 2024-09-14T11:13:42.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.065+0000 7ff70112e800 20 remove_watcher() i=7 2024-09-14T11:13:42.075 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:42.106 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.107 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.144+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 realm 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.146+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.147+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.147+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.148+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.148+0000 7f6850e14800 20 searching for the correct realm 2024-09-14T11:13:42.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.150+0000 7f684cccc640 0 -- 172.21.15.130:0/1668413349 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f684001a040 msgr2=0x7f6840017930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.356+0000 7f684cccc640 0 -- 172.21.15.130:0/1668413349 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f684001a040 msgr2=0x7f6840017930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.360+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 zone default found 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 4 Realm: () 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:42.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 zonegroup default 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.361+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.362+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.362+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.362+0000 7f6850e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.362+0000 7f6850e14800 20 started sync module instance, tier type = 2024-09-14T11:13:42.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.362+0000 7f6850e14800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=0 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=1 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=2 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=3 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=4 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=5 2024-09-14T11:13:42.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.375+0000 7f6850e14800 20 add_watcher() i=6 2024-09-14T11:13:42.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.376+0000 7f6850e14800 20 add_watcher() i=7 2024-09-14T11:13:42.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.376+0000 7f6850e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f67027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6850e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6850e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6850e14800 5 note: GC not initialized 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f67017e2640 20 reqs_thread_entry: start 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6850e14800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6850e14800 20 Filter name: none 2024-09-14T11:13:42.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.379+0000 7f6672ffd640 20 reqs_thread_entry: start 2024-09-14T11:13:42.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 INFO: main: starting shard=0 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.380+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 INFO: main: starting shard=1 2024-09-14T11:13:42.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 INFO: main: starting shard=2 2024-09-14T11:13:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.381+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 INFO: main: starting shard=3 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 INFO: main: starting shard=4 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.382+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.383+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.383+0000 7f6850e14800 20 INFO: main: starting shard=5 2024-09-14T11:13:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.383+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 INFO: main: starting shard=6 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 INFO: main: starting shard=7 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.384+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 INFO: main: starting shard=8 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 INFO: main: starting shard=9 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.385+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.386+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.386+0000 7f6850e14800 20 INFO: main: starting shard=10 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.386+0000 7f6850e14800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.386+0000 7f6850e14800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.386+0000 7f6850e14800 20 INFO: main: done 2024-09-14T11:13:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.387+0000 7f67027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.389+0000 7f6850e14800 20 remove_watcher() i=0 2024-09-14T11:13:42.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.389+0000 7f6850e14800 2 removed watcher, disabling cache 2024-09-14T11:13:42.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.390+0000 7f6850e14800 20 remove_watcher() i=1 2024-09-14T11:13:42.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.392+0000 7f6850e14800 20 remove_watcher() i=2 2024-09-14T11:13:42.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.393+0000 7f6850e14800 20 remove_watcher() i=3 2024-09-14T11:13:42.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.394+0000 7f6850e14800 20 remove_watcher() i=4 2024-09-14T11:13:42.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.395+0000 7f6850e14800 20 remove_watcher() i=5 2024-09-14T11:13:42.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.396+0000 7f6850e14800 20 remove_watcher() i=6 2024-09-14T11:13:42.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.397+0000 7f6850e14800 20 remove_watcher() i=7 2024-09-14T11:13:42.407 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:42.438 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.438 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.476+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 realm 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.478+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.479+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.479+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.480+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.480+0000 7f07edb26800 20 searching for the correct realm 2024-09-14T11:13:42.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.482+0000 7f07e9fda640 0 -- 172.21.15.130:0/1264207236 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f07d4038b60 msgr2=0x7f07d401b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.688+0000 7f07e9fda640 0 -- 172.21.15.130:0/1264207236 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f07d4038b60 msgr2=0x7f07d401b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.692+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 zone default found 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 4 Realm: () 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 zonegroup default 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.693+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.694+0000 7f07edb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.694+0000 7f07edb26800 20 started sync module instance, tier type = 2024-09-14T11:13:42.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.694+0000 7f07edb26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=0 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=1 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=2 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=3 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=4 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=5 2024-09-14T11:13:42.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.704+0000 7f07edb26800 20 add_watcher() i=6 2024-09-14T11:13:42.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.705+0000 7f07edb26800 20 add_watcher() i=7 2024-09-14T11:13:42.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.705+0000 7f07edb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:42.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f069ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:42.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:42.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 5 note: GC not initialized 2024-09-14T11:13:42.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f069efe5640 20 reqs_thread_entry: start 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 20 Filter name: none 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f069cfe1640 20 reqs_thread_entry: start 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.708+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:42.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:42.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:42.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:42.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 INFO: main: starting shard=0 2024-09-14T11:13:42.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.709+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: starting shard=1 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: starting shard=2 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 INFO: main: starting shard=3 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.710+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 INFO: main: starting shard=4 2024-09-14T11:13:42.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:42.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 INFO: main: starting shard=5 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.711+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 INFO: main: starting shard=6 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 INFO: main: starting shard=7 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.712+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:42.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 INFO: main: starting shard=8 2024-09-14T11:13:42.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:42.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 INFO: main: starting shard=9 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.713+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.714+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.714+0000 7f07edb26800 20 INFO: main: starting shard=10 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.714+0000 7f07edb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.714+0000 7f07edb26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.714+0000 7f07edb26800 20 INFO: main: done 2024-09-14T11:13:42.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.715+0000 7f069ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:42.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.718+0000 7f07edb26800 20 remove_watcher() i=0 2024-09-14T11:13:42.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.718+0000 7f07edb26800 2 removed watcher, disabling cache 2024-09-14T11:13:42.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.719+0000 7f07edb26800 20 remove_watcher() i=1 2024-09-14T11:13:42.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.720+0000 7f07edb26800 20 remove_watcher() i=2 2024-09-14T11:13:42.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.723+0000 7f07edb26800 20 remove_watcher() i=3 2024-09-14T11:13:42.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.725+0000 7f07edb26800 20 remove_watcher() i=4 2024-09-14T11:13:42.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.726+0000 7f07edb26800 20 remove_watcher() i=5 2024-09-14T11:13:42.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.727+0000 7f07edb26800 20 remove_watcher() i=6 2024-09-14T11:13:42.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.728+0000 7f07edb26800 20 remove_watcher() i=7 2024-09-14T11:13:42.736 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:13:42.736 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:42.737 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:13:42.769 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:42.769 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:42.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.807+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 realm 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:42.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.809+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.810+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:42.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.810+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:42.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.811+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:42.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.811+0000 7f1250531800 20 searching for the correct realm 2024-09-14T11:13:42.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:42.813+0000 7f124c99a640 0 -- 172.21.15.130:0/1361243534 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f123404d4b0 msgr2=0x7f1234084a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:43.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.019+0000 7f124c99a640 0 -- 172.21.15.130:0/1361243534 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f123404d4b0 msgr2=0x7f1234084a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:43.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.023+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 zone default found 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 4 Realm: () 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 zonegroup default 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.024+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.025+0000 7f1250531800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:43.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.025+0000 7f1250531800 20 started sync module instance, tier type = 2024-09-14T11:13:43.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.025+0000 7f1250531800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:43.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=0 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=1 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=2 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=3 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=4 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=5 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.043+0000 7f1250531800 20 add_watcher() i=6 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.044+0000 7f1250531800 20 add_watcher() i=7 2024-09-14T11:13:43.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.044+0000 7f1250531800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:43.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1250531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:43.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1250531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1250531800 5 note: GC not initialized 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1101fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1250531800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f1250531800 20 Filter name: none 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.046+0000 7f10737fe640 20 reqs_thread_entry: start 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:43.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 20 rados->read ofs=0 len=0 2024-09-14T11:13:43.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:43.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:43.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:43.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:43.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.047+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.048+0000 7f1250531800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.048+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.048+0000 7f1250531800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.048+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:13:43.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.049+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.050+0000 7f1250531800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.050+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.050+0000 7f1250531800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:13:43.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.050+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:43.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.051+0000 7f1250531800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:13:43.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.051+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:43.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.051+0000 7f1250531800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:13:43.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.051+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:43.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.052+0000 7f1250531800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:13:43.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.052+0000 7f1250531800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:43.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.052+0000 7f1250531800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:13:43.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.052+0000 7f1250531800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:13:43.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.053+0000 7f1102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:43.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.056+0000 7f1250531800 20 remove_watcher() i=0 2024-09-14T11:13:43.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.056+0000 7f1250531800 2 removed watcher, disabling cache 2024-09-14T11:13:43.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.057+0000 7f1250531800 20 remove_watcher() i=1 2024-09-14T11:13:43.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.059+0000 7f1250531800 20 remove_watcher() i=2 2024-09-14T11:13:43.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.060+0000 7f1250531800 20 remove_watcher() i=3 2024-09-14T11:13:43.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.061+0000 7f1250531800 20 remove_watcher() i=4 2024-09-14T11:13:43.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.062+0000 7f1250531800 20 remove_watcher() i=5 2024-09-14T11:13:43.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.064+0000 7f1250531800 20 remove_watcher() i=6 2024-09-14T11:13:43.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:43.065+0000 7f1250531800 20 remove_watcher() i=7 2024-09-14T11:13:43.075 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:13:43.075 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:43.077 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.077 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.080 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.081 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.084 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.084 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:13:43.127 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:13:43.128 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.128 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.173 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.222 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.237 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.256 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.259 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.273 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.273 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.276 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.276 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.290 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.293 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.293 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.305 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.305 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.308 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.308 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.320 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:43.321 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:43.324 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:13:43.715 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:13:45.107 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.107 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.156 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:45.157 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:13:45.192 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:45.192 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:45.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.231+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 realm 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.233+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.234+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.234+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.235+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:45.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.235+0000 7f1e85d46800 20 searching for the correct realm 2024-09-14T11:13:45.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.237+0000 7f1e83036640 0 -- 172.21.15.130:0/387255230 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f1e7c03a070 msgr2=0x7f1e7c0840c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:45.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.242+0000 7f1e83837640 0 -- 172.21.15.130:0/387255230 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f1e740b3a30 msgr2=0x7f1e740ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.449+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 zone default found 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 4 Realm: () 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 zonegroup default 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.450+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.451+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.451+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.451+0000 7f1e85d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.451+0000 7f1e85d46800 20 started sync module instance, tier type = 2024-09-14T11:13:45.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.451+0000 7f1e85d46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:45.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=0 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=1 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=2 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=3 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=4 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=5 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.462+0000 7f1e85d46800 20 add_watcher() i=6 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.463+0000 7f1e85d46800 20 add_watcher() i=7 2024-09-14T11:13:45.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.463+0000 7f1e85d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:45.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.464+0000 7f1d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 5 note: GC not initialized 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1d38fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 20 Filter name: none 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1cb27fc640 20 reqs_thread_entry: start 2024-09-14T11:13:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.465+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 INFO: main: starting shard=0 2024-09-14T11:13:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:45.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 INFO: main: starting shard=1 2024-09-14T11:13:45.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.466+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:45.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 INFO: main: starting shard=2 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 INFO: main: starting shard=3 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.467+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 INFO: main: starting shard=4 2024-09-14T11:13:45.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 INFO: main: starting shard=5 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.468+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 INFO: main: starting shard=6 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 INFO: main: starting shard=7 2024-09-14T11:13:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.469+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.470+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.470+0000 7f1e85d46800 20 INFO: main: starting shard=8 2024-09-14T11:13:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.470+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 INFO: main: starting shard=9 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 INFO: main: starting shard=10 2024-09-14T11:13:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.471+0000 7f1e85d46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:45.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.472+0000 7f1e85d46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.472+0000 7f1e85d46800 20 INFO: main: done 2024-09-14T11:13:45.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.473+0000 7f1d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.475+0000 7f1e85d46800 20 remove_watcher() i=0 2024-09-14T11:13:45.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.475+0000 7f1e85d46800 2 removed watcher, disabling cache 2024-09-14T11:13:45.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.477+0000 7f1e85d46800 20 remove_watcher() i=1 2024-09-14T11:13:45.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.478+0000 7f1e85d46800 20 remove_watcher() i=2 2024-09-14T11:13:45.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.479+0000 7f1e85d46800 20 remove_watcher() i=3 2024-09-14T11:13:45.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.480+0000 7f1e85d46800 20 remove_watcher() i=4 2024-09-14T11:13:45.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.481+0000 7f1e85d46800 20 remove_watcher() i=5 2024-09-14T11:13:45.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.483+0000 7f1e85d46800 20 remove_watcher() i=6 2024-09-14T11:13:45.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.484+0000 7f1e85d46800 20 remove_watcher() i=7 2024-09-14T11:13:45.496 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.496 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.499 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.499 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.501 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.502 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.556 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:45.557 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:13:45.589 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:45.589 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:45.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.815+0000 7f8a3e546640 0 --2- 172.21.15.130:0/2422215194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x562edf4dc1c0 0x562edf5d7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:13:45.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.829+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 realm 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.831+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.832+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.832+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.833+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:45.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.833+0000 7f8a4212c800 20 searching for the correct realm 2024-09-14T11:13:45.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.835+0000 7f8a3dd45640 0 -- 172.21.15.130:0/557269463 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f8a38069290 msgr2=0x7f8a38084ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:45.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.838+0000 7f8a3d544640 0 -- 172.21.15.130:0/557269463 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f8a300c3070 msgr2=0x7f8a3008e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:45.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.844+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 zone default found 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 4 Realm: () 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 zonegroup default 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 started sync module instance, tier type = 2024-09-14T11:13:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.845+0000 7f8a4212c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=0 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=1 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=2 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=3 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=4 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=5 2024-09-14T11:13:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.858+0000 7f8a4212c800 20 add_watcher() i=6 2024-09-14T11:13:45.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.859+0000 7f8a4212c800 20 add_watcher() i=7 2024-09-14T11:13:45.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.859+0000 7f8a4212c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:45.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f88ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f8a4212c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f8a4212c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f8a4212c800 5 note: GC not initialized 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f88ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f8a4212c800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f8a4212c800 20 Filter name: none 2024-09-14T11:13:45.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.861+0000 7f885ffff640 20 reqs_thread_entry: start 2024-09-14T11:13:45.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:45.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:45.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:45.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 INFO: main: starting shard=0 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.862+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: starting shard=1 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: starting shard=2 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 INFO: main: starting shard=3 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.863+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 INFO: main: starting shard=4 2024-09-14T11:13:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 INFO: main: starting shard=5 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.864+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 INFO: main: starting shard=6 2024-09-14T11:13:45.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 INFO: main: starting shard=7 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.865+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.866+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.866+0000 7f8a4212c800 20 INFO: main: starting shard=8 2024-09-14T11:13:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.866+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 INFO: main: starting shard=9 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 INFO: main: starting shard=10 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.867+0000 7f8a4212c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.868+0000 7f8a4212c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:45.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.868+0000 7f8a4212c800 20 INFO: main: done 2024-09-14T11:13:45.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.868+0000 7f88ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:45.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.871+0000 7f8a4212c800 20 remove_watcher() i=0 2024-09-14T11:13:45.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.871+0000 7f8a4212c800 2 removed watcher, disabling cache 2024-09-14T11:13:45.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.872+0000 7f8a4212c800 20 remove_watcher() i=1 2024-09-14T11:13:45.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.873+0000 7f8a4212c800 20 remove_watcher() i=2 2024-09-14T11:13:45.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.874+0000 7f8a4212c800 20 remove_watcher() i=3 2024-09-14T11:13:45.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.875+0000 7f8a4212c800 20 remove_watcher() i=4 2024-09-14T11:13:45.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.876+0000 7f8a4212c800 20 remove_watcher() i=5 2024-09-14T11:13:45.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.878+0000 7f8a4212c800 20 remove_watcher() i=6 2024-09-14T11:13:45.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:45.879+0000 7f8a4212c800 20 remove_watcher() i=7 2024-09-14T11:13:45.890 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.891 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.894 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.894 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.896 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:45.897 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:45.948 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:45.949 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:13:45.979 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:45.979 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:46.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.017+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.018+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.018+0000 7f226d72c800 20 realm 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.018+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.019+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.019+0000 7f226d72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.019+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.019+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.019+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.020+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.020+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.020+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:46.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.020+0000 7f226d72c800 20 searching for the correct realm 2024-09-14T11:13:46.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.022+0000 7f2269c50640 0 -- 172.21.15.130:0/1568942100 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f22600618d0 msgr2=0x7f2260060340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:46.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.229+0000 7f2269c50640 0 -- 172.21.15.130:0/1568942100 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f22600618d0 msgr2=0x7f2260060340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.233+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 zone default found 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 4 Realm: () 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 zonegroup default 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.234+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.235+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.235+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.235+0000 7f226d72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.235+0000 7f226d72c800 20 started sync module instance, tier type = 2024-09-14T11:13:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.235+0000 7f226d72c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:46.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=0 2024-09-14T11:13:46.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=1 2024-09-14T11:13:46.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=2 2024-09-14T11:13:46.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=3 2024-09-14T11:13:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=4 2024-09-14T11:13:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=5 2024-09-14T11:13:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.251+0000 7f226d72c800 20 add_watcher() i=6 2024-09-14T11:13:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.252+0000 7f226d72c800 20 add_watcher() i=7 2024-09-14T11:13:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.252+0000 7f226d72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:46.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.254+0000 7f211f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 5 note: GC not initialized 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f211e7e4640 20 reqs_thread_entry: start 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 20 Filter name: none 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f208ffff640 20 reqs_thread_entry: start 2024-09-14T11:13:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.255+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 INFO: main: starting shard=0 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.256+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 INFO: main: starting shard=1 2024-09-14T11:13:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:46.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 INFO: main: starting shard=2 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.257+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 INFO: main: starting shard=3 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 INFO: main: starting shard=4 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.258+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 INFO: main: starting shard=5 2024-09-14T11:13:46.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 INFO: main: starting shard=6 2024-09-14T11:13:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.259+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 INFO: main: starting shard=7 2024-09-14T11:13:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 INFO: main: starting shard=8 2024-09-14T11:13:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.260+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 INFO: main: starting shard=9 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 INFO: main: starting shard=10 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.261+0000 7f226d72c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.262+0000 7f226d72c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.262+0000 7f226d72c800 20 INFO: main: done 2024-09-14T11:13:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.263+0000 7f211f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.265+0000 7f226d72c800 20 remove_watcher() i=0 2024-09-14T11:13:46.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.265+0000 7f226d72c800 2 removed watcher, disabling cache 2024-09-14T11:13:46.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.266+0000 7f226d72c800 20 remove_watcher() i=1 2024-09-14T11:13:46.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.268+0000 7f226d72c800 20 remove_watcher() i=2 2024-09-14T11:13:46.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.269+0000 7f226d72c800 20 remove_watcher() i=3 2024-09-14T11:13:46.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.270+0000 7f226d72c800 20 remove_watcher() i=4 2024-09-14T11:13:46.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.271+0000 7f226d72c800 20 remove_watcher() i=5 2024-09-14T11:13:46.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.272+0000 7f226d72c800 20 remove_watcher() i=6 2024-09-14T11:13:46.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.272+0000 7f226d72c800 20 remove_watcher() i=7 2024-09-14T11:13:46.285 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.285 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:46.288 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.288 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:46.337 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:13:46.338 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:13:46.370 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:46.370 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:46.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.409+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 20 realm 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.411+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.412+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.412+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.412+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.412+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.413+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:46.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.413+0000 7f4f70d42800 20 searching for the correct realm 2024-09-14T11:13:46.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.413+0000 7f4f6d287640 0 -- 172.21.15.130:0/107356461 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55c65a0ade40 msgr2=0x55c65a0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:46.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.618+0000 7f4f6d287640 0 -- 172.21.15.130:0/107356461 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55c65a0ade40 msgr2=0x55c65a0b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:46.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:46.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:46.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:46.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:46.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:46.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:46.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.625+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 zone default found 2024-09-14T11:13:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 4 Realm: () 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 zonegroup default 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.626+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 started sync module instance, tier type = 2024-09-14T11:13:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.627+0000 7f4f70d42800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=0 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=1 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=2 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=3 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=4 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=5 2024-09-14T11:13:46.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.637+0000 7f4f70d42800 20 add_watcher() i=6 2024-09-14T11:13:46.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.638+0000 7f4f70d42800 20 add_watcher() i=7 2024-09-14T11:13:46.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.638+0000 7f4f70d42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:46.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4e1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4f70d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4f70d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4f70d42800 5 note: GC not initialized 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4e1dfe3640 20 reqs_thread_entry: start 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4f70d42800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.640+0000 7f4f70d42800 20 Filter name: none 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4d8f7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 rados->read ofs=0 len=0 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 INFO: main: starting shard=0 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.641+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 INFO: main: starting shard=1 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 INFO: main: starting shard=2 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.642+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: starting shard=3 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: starting shard=4 2024-09-14T11:13:46.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:46.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 INFO: main: starting shard=5 2024-09-14T11:13:46.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.643+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:46.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.644+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.644+0000 7f4f70d42800 20 INFO: main: starting shard=6 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.644+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 INFO: main: starting shard=7 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 INFO: main: starting shard=8 2024-09-14T11:13:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.645+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 INFO: main: starting shard=9 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 INFO: main: starting shard=10 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.646+0000 7f4f70d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.647+0000 7f4f70d42800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:13:46.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.647+0000 7f4f70d42800 20 INFO: main: done 2024-09-14T11:13:46.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.648+0000 7f4e1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:46.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.650+0000 7f4f70d42800 20 remove_watcher() i=0 2024-09-14T11:13:46.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.650+0000 7f4f70d42800 2 removed watcher, disabling cache 2024-09-14T11:13:46.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.651+0000 7f4f70d42800 20 remove_watcher() i=1 2024-09-14T11:13:46.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.652+0000 7f4f70d42800 20 remove_watcher() i=2 2024-09-14T11:13:46.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.654+0000 7f4f70d42800 20 remove_watcher() i=3 2024-09-14T11:13:46.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.655+0000 7f4f70d42800 20 remove_watcher() i=4 2024-09-14T11:13:46.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.656+0000 7f4f70d42800 20 remove_watcher() i=5 2024-09-14T11:13:46.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.657+0000 7f4f70d42800 20 remove_watcher() i=6 2024-09-14T11:13:46.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:46.658+0000 7f4f70d42800 20 remove_watcher() i=7 2024-09-14T11:13:46.670 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:46.670 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:46.674 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:13:47.067 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:13:47.459 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:13:47.488 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:47.488 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:47.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.526+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 realm 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.527+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.528+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.528+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.529+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.529+0000 7f997300f800 20 searching for the correct realm 2024-09-14T11:13:47.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.531+0000 7f99712fa640 0 -- 172.21.15.130:0/2114637753 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f995802a070 msgr2=0x7f9958074e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.738+0000 7f99712fa640 0 -- 172.21.15.130:0/2114637753 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f995802a070 msgr2=0x7f9958074e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.742+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 zone default found 2024-09-14T11:13:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 4 Realm: () 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 zonegroup default 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.743+0000 7f997300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.744+0000 7f997300f800 20 started sync module instance, tier type = 2024-09-14T11:13:47.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.744+0000 7f997300f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:47.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=0 2024-09-14T11:13:47.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=1 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=2 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=3 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=4 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=5 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.755+0000 7f997300f800 20 add_watcher() i=6 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.756+0000 7f997300f800 20 add_watcher() i=7 2024-09-14T11:13:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.756+0000 7f997300f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f9826fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f997300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f997300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f997300f800 5 note: GC not initialized 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f9825fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f997300f800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f997300f800 20 Filter name: none 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.758+0000 7f97977fe640 20 reqs_thread_entry: start 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.759+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.760+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.761+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.761+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:47.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.761+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:47.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.762+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.763+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:47.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.763+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:47.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.764+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.764+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:47.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.765+0000 7f997300f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.770+0000 7f9826fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.772+0000 7f997300f800 20 remove_watcher() i=0 2024-09-14T11:13:47.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.772+0000 7f997300f800 2 removed watcher, disabling cache 2024-09-14T11:13:47.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.774+0000 7f997300f800 20 remove_watcher() i=1 2024-09-14T11:13:47.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.775+0000 7f997300f800 20 remove_watcher() i=2 2024-09-14T11:13:47.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.776+0000 7f997300f800 20 remove_watcher() i=3 2024-09-14T11:13:47.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.777+0000 7f997300f800 20 remove_watcher() i=4 2024-09-14T11:13:47.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.778+0000 7f997300f800 20 remove_watcher() i=5 2024-09-14T11:13:47.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.778+0000 7f997300f800 20 remove_watcher() i=6 2024-09-14T11:13:47.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.779+0000 7f997300f800 20 remove_watcher() i=7 2024-09-14T11:13:47.790 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:13:47.825 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:47.825 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:47.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.863+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 realm 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.865+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.866+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.866+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.867+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:47.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.867+0000 7fddcdd3e800 20 searching for the correct realm 2024-09-14T11:13:47.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.869+0000 7fddca2ee640 0 -- 172.21.15.130:0/3418135583 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fddb4094c00 msgr2=0x7fddb4056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.873+0000 7fddc12ec640 0 -- 172.21.15.130:0/3418135583 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x55a38d8afd70 msgr2=0x55a38d8b2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:47.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.877+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 zone default found 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 4 Realm: () 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 zonegroup default 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 started sync module instance, tier type = 2024-09-14T11:13:47.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.878+0000 7fddcdd3e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=0 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=1 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=2 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=3 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=4 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=5 2024-09-14T11:13:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.889+0000 7fddcdd3e800 20 add_watcher() i=6 2024-09-14T11:13:47.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.892+0000 7fddcdd3e800 20 add_watcher() i=7 2024-09-14T11:13:47.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.892+0000 7fddcdd3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.893+0000 7fdc7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.893+0000 7fddcdd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.893+0000 7fddcdd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.893+0000 7fddcdd3e800 5 note: GC not initialized 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fdc7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 20 Filter name: none 2024-09-14T11:13:47.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fdbebfff640 20 reqs_thread_entry: start 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 : miss 2024-09-14T11:13:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.894+0000 7fddcdd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 info.flags=0x17 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 to cache LRU end 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.2 2024-09-14T11:13:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.0 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.895+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.896+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.2 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.896+0000 7fddcdd3e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.896+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.3 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.896+0000 7fddcdd3e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:13:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.896+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.4 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.897+0000 7fddcdd3e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.897+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.898+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.6 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.898+0000 7fddcdd3e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.898+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.7 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.898+0000 7fddcdd3e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:13:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.898+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.899+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.9 2024-09-14T11:13:47.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.899+0000 7fddcdd3e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:13:47.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.899+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.900+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.900+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d61d300 obj=check-bucket:e state=0x55a38d8e2dd8 s->prefetch_data=0 2024-09-14T11:13:47.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.900+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.900+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d645710 obj=check-bucket:d state=0x55a38d8e3e28 s->prefetch_data=0 2024-09-14T11:13:47.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d8e6a60 obj=check-bucket:c state=0x55a38d8ec2e8 s->prefetch_data=0 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d981df0 obj=check-bucket:f state=0x55a38d983568 s->prefetch_data=0 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to nc13k3b3r1orpxd38w3j6xi9xcmr006c 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state_impl: setting s->olh_tag to 4h0upk5t6vjygsm9zd7cs6gwpork44gr 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4h0upk5t6vjygsm9zd7cs6gwpork44gr 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to vqh7ncutv0y9owldczrjyfdcohzrzna0 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state_impl: setting s->olh_tag to gneuf15xu0o5safa16wvaizk270e7146 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gneuf15xu0o5safa16wvaizk270e7146 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to 8ml4jn727l52mabqf6bfgzir6460n6cz 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 get_obj_state_impl: setting s->olh_tag to zeres38kyhixs7guco4omejvenw4f7av 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.901+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zeres38kyhixs7guco4omejvenw4f7av 2024-09-14T11:13:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.902+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to psf60derx9xa23tci2cog2n6ll2d96kb 2024-09-14T11:13:47.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.902+0000 7fddcdd3e800 20 get_obj_state_impl: setting s->olh_tag to 963moxokwhklke1h2r3u97pd1qfn875x 2024-09-14T11:13:47.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.902+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=963moxokwhklke1h2r3u97pd1qfn875x 2024-09-14T11:13:47.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.903+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.904+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.904+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.904+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=2 op=3 key=f[utP4.EqTTYkGEd9SjJu4TDSBxfrcKR4] 2024-09-14T11:13:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d981df0 obj=check-bucket:_:utP4.EqTTYkGEd9SjJu4TDSBxfrcKR4_f state=0x55a38d992e88 s->prefetch_data=0 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=3 op=3 key=d[GsLghWSoX1-1v3U4C7MwdWXooC51S8p] 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d645710 obj=check-bucket:_:GsLghWSoX1-1v3U4C7MwdWXooC51S8p_d state=0x55a38d99d1b8 s->prefetch_data=0 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=3 op=3 key=c[JiwXs.kxSdLDTLbImzMPPejO0QRn-k.] 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d8e6a60 obj=check-bucket:_:JiwXs.kxSdLDTLbImzMPPejO0QRn-k._c state=0x55a38d9a5d38 s->prefetch_data=0 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 olh_log_entry: epoch=2 op=3 key=e[YHXHusM0XC1biBwKDLBNDQjxvQ95HQH] 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d61d300 obj=check-bucket:_:YHXHusM0XC1biBwKDLBNDQjxvQ95HQH_e state=0x55a38d9ae7c8 s->prefetch_data=0 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 10 manifest: total_size = 22 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.16347656299558566113 2024-09-14T11:13:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d981df0 obj=check-bucket:_:utP4.EqTTYkGEd9SjJu4TDSBxfrcKR4_f state=0x55a38d992e88 s->prefetch_data=0 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 prepare_atomic_modification: state is not atomic. state=0x55a38d992e88 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 10 manifest: total_size = 9 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.6404728651799417509 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d645710 obj=check-bucket:_:GsLghWSoX1-1v3U4C7MwdWXooC51S8p_d state=0x55a38d99d1b8 s->prefetch_data=0 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 prepare_atomic_modification: state is not atomic. state=0x55a38d99d1b8 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 10 manifest: total_size = 11 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.13909036514554634659 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d8e6a60 obj=check-bucket:_:JiwXs.kxSdLDTLbImzMPPejO0QRn-k._c state=0x55a38d9a5d38 s->prefetch_data=0 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 prepare_atomic_modification: state is not atomic. state=0x55a38d9a5d38 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.909+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.910+0000 7fddcdd3e800 10 manifest: total_size = 12 2024-09-14T11:13:47.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.910+0000 7fddcdd3e800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.11493935458723240942 2024-09-14T11:13:47.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.910+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d61d300 obj=check-bucket:_:YHXHusM0XC1biBwKDLBNDQjxvQ95HQH_e state=0x55a38d9ae7c8 s->prefetch_data=0 2024-09-14T11:13:47.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.910+0000 7fddcdd3e800 20 prepare_atomic_modification: state is not atomic. state=0x55a38d9ae7c8 2024-09-14T11:13:47.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.910+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.920+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.920+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.920+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.920+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.921+0000 7fdcacff9640 20 handle_completion(): completion ok for obj=c[JiwXs.kxSdLDTLbImzMPPejO0QRn-k.] 2024-09-14T11:13:47.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.923+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.8 2024-09-14T11:13:47.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.923+0000 7fddcdd3e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:13:47.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.924+0000 7fdcad7fa640 20 handle_completion(): completion ok for obj=e[YHXHusM0XC1biBwKDLBNDQjxvQ95HQH] 2024-09-14T11:13:47.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.924+0000 7fdcacff9640 20 handle_completion(): completion ok for obj=d[GsLghWSoX1-1v3U4C7MwdWXooC51S8p] 2024-09-14T11:13:47.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.924+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d61d300 obj=check-bucket:e state=0x55a38d8e2dd8 s->prefetch_data=0 2024-09-14T11:13:47.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.924+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4h0upk5t6vjygsm9zd7cs6gwpork44gr 2024-09-14T11:13:47.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.928+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.5 2024-09-14T11:13:47.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.928+0000 7fddcdd3e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:13:47.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.929+0000 7fdcad7fa640 20 handle_completion(): completion ok for obj=f[utP4.EqTTYkGEd9SjJu4TDSBxfrcKR4] 2024-09-14T11:13:47.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.929+0000 7fddcdd3e800 20 get_obj_state: octx=0x55a38d981df0 obj=check-bucket:f state=0x55a38d983568 s->prefetch_data=0 2024-09-14T11:13:47.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.929+0000 7fddcdd3e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=963moxokwhklke1h2r3u97pd1qfn875x 2024-09-14T11:13:47.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.933+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.938+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.1 2024-09-14T11:13:47.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.938+0000 7fddcdd3e800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:13:47.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.940+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.946+0000 7fddcdd3e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.2.10 2024-09-14T11:13:47.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.946+0000 7fddcdd3e800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:13:47.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.946+0000 7fddcdd3e800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:13:47.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.947+0000 7fdc7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:47.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.949+0000 7fddcdd3e800 20 remove_watcher() i=0 2024-09-14T11:13:47.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.949+0000 7fddcdd3e800 2 removed watcher, disabling cache 2024-09-14T11:13:47.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.950+0000 7fddcdd3e800 20 remove_watcher() i=1 2024-09-14T11:13:47.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.951+0000 7fddcdd3e800 20 remove_watcher() i=2 2024-09-14T11:13:47.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.952+0000 7fddcdd3e800 20 remove_watcher() i=3 2024-09-14T11:13:47.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.953+0000 7fddcdd3e800 20 remove_watcher() i=4 2024-09-14T11:13:47.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.954+0000 7fddcdd3e800 20 remove_watcher() i=5 2024-09-14T11:13:47.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.955+0000 7fddcdd3e800 20 remove_watcher() i=6 2024-09-14T11:13:47.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:47.956+0000 7fddcdd3e800 20 remove_watcher() i=7 2024-09-14T11:13:47.967 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:47.967 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:47.973 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:48.023 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:13:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:48.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.089+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 realm 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.091+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.092+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:48.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.092+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.093+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:48.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.093+0000 7fd0d8abb800 20 searching for the correct realm 2024-09-14T11:13:48.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.094+0000 7fd0cdda4640 0 -- 172.21.15.130:0/4075160413 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fcfa0084e10 msgr2=0x7fcfa0087240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:48.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.299+0000 7fd0d65a5640 0 -- 172.21.15.130:0/4075160413 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd0d0092950 msgr2=0x7fd0d0086410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:48.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.505+0000 7fd0d8abb800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:48.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 zone default found 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 4 Realm: () 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 zonegroup default 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.506+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:48.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 started sync module instance, tier type = 2024-09-14T11:13:48.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.507+0000 7fd0d8abb800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:13:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=0 2024-09-14T11:13:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=1 2024-09-14T11:13:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=2 2024-09-14T11:13:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=3 2024-09-14T11:13:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=4 2024-09-14T11:13:48.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=5 2024-09-14T11:13:48.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.523+0000 7fd0d8abb800 20 add_watcher() i=6 2024-09-14T11:13:48.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.524+0000 7fd0d8abb800 20 add_watcher() i=7 2024-09-14T11:13:48.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.524+0000 7fd0d8abb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:48.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.526+0000 7fcf8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:48.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:48.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:48.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 5 note: GC not initialized 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fcf077fe640 20 reqs_thread_entry: start 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 20 init_complete bucket index max shards: 11 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 20 Filter name: none 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fcf057fa640 20 reqs_thread_entry: start 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.527+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:48.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:48.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:13:48.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.528+0000 7fd0d8abb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:48.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.529+0000 7fd0d8abb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:13:48.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.529+0000 7fd0d8abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:48.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.530+0000 7fcf8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:48.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.533+0000 7fd0d8abb800 20 remove_watcher() i=0 2024-09-14T11:13:48.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.533+0000 7fd0d8abb800 2 removed watcher, disabling cache 2024-09-14T11:13:48.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.534+0000 7fd0d8abb800 20 remove_watcher() i=1 2024-09-14T11:13:48.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.535+0000 7fd0d8abb800 20 remove_watcher() i=2 2024-09-14T11:13:48.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.536+0000 7fd0d8abb800 20 remove_watcher() i=3 2024-09-14T11:13:48.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.537+0000 7fd0d8abb800 20 remove_watcher() i=4 2024-09-14T11:13:48.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.538+0000 7fd0d8abb800 20 remove_watcher() i=5 2024-09-14T11:13:48.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.539+0000 7fd0d8abb800 20 remove_watcher() i=6 2024-09-14T11:13:48.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:13:48.540+0000 7fd0d8abb800 20 remove_watcher() i=7 2024-09-14T11:13:48.549 INFO:tasks.workunit.client.0.smithi130.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:13:48.550 INFO:tasks.workunit.client.0.smithi130.stderr:Deleting bucket check-bucket 2024-09-14T11:13:48.551 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:48.551 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:48.556 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:48.556 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:13:48.583 INFO:tasks.workunit.client.0.smithi130.stderr:Completed bucket check tests 2024-09-14T11:13:48.584 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:13:48.584 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:13:48.584 INFO:tasks.workunit.client.0.smithi130.stdout:connected to https://localhost:443 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ deactivate 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ export PATH 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ hash -r 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:13:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:13:48.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:13:48.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset -f deactivate 2024-09-14T11:13:48.650 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo OK. 2024-09-14T11:13:48.651 INFO:tasks.workunit.client.0.smithi130.stdout:OK. 2024-09-14T11:13:48.651 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:13:48.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:13:48.730 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:13:48.730 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:13:49.101 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:49.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:49.140 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:49.140 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:49.208 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:49.208 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:13:49.218 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:49.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:13:49.218 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:49.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:13:49.276 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:13:49.276 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:49.345 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:49.345 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:13:49.413 INFO:tasks.workunit:timeout=3h 2024-09-14T11:13:49.413 INFO:tasks.workunit:cleanup=True 2024-09-14T11:13:49.413 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:49.482 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:14:45.089 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:14:45.091 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:14:45.159 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:14:45.162 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:45.162 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:14:45.210 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:14:45.259 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:14:45.298 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:45.300 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:45.300 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:14:45.338 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:45.341 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:14:45.341 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:14:45.411 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:14:45.412 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:14:45.413 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:14:45.495 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:14:45.495 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:14:45.495 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:14:45.495 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:14:45.495 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:14:46.720 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:46.720 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: exclusive 2024-09-14T11:14:46.720 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:46.720 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:46.720 INFO:tasks.workunit.client.0.smithi130.stdout: client.5199 expiration=2024-09-14T11:16:46.719173+0000 addr=v1:172.21.15.130:0/2198320674 cookie= 2024-09-14T11:14:46.723 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:46.724 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: shared 2024-09-14T11:14:46.724 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:46.724 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:46.724 INFO:tasks.workunit.client.0.smithi130.stdout: client.5199 expiration=2024-09-14T11:16:46.725330+0000 addr=v1:172.21.15.130:0/2198320674 cookie= 2024-09-14T11:14:46.724 INFO:tasks.workunit.client.0.smithi130.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.130:0/3774871104 cookie= 2024-09-14T11:14:46.725 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:46.725 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: shared 2024-09-14T11:14:46.725 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:46.725 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:46.725 INFO:tasks.workunit.client.0.smithi130.stdout: client.5205 expiration=0.000000 addr=v1:172.21.15.130:0/3774871104 cookie= 2024-09-14T11:14:47.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestMultiLocking (2191 ms) 2024-09-14T11:14:47.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:14:49.950 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:49.950 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: shared 2024-09-14T11:14:49.950 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:49.951 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:49.951 INFO:tasks.workunit.client.0.smithi130.stdout: client.5214 expiration=0.000000 addr=v1:172.21.15.130:0/1354714177 cookie= 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: exclusive 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi130.stdout: tag: new_tag 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi130.stdout: client.5208 expiration=0.000000 addr=v1:172.21.15.130:0/3860638483 cookie= 2024-09-14T11:14:50.715 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestMeta (3029 ms) 2024-09-14T11:14:50.715 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:14:52.749 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:52.749 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: exclusive 2024-09-14T11:14:52.749 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:52.749 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout:lock: mylock 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout: lock_type: shared 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout: tag: 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout: lockers: 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.130:0/3412981706 cookie= 2024-09-14T11:14:52.751 INFO:tasks.workunit.client.0.smithi130.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.130:0/3412981706 cookie=new cookie 2024-09-14T11:14:53.733 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestCookie (3018 ms) 2024-09-14T11:14:53.733 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:14:56.756 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestMultipleLocks (3023 ms) 2024-09-14T11:14:56.756 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:15:04.782 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestLockDuration (8025 ms) 2024-09-14T11:15:04.782 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:15:07.796 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestAssertLocked (3014 ms) 2024-09-14T11:15:07.796 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:15:10.818 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestSetCookie (3023 ms) 2024-09-14T11:15:10.818 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:15:31.891 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestRenew (21072 ms) 2024-09-14T11:15:31.892 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:15:37.991 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6101 ms) 2024-09-14T11:15:37.991 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:15:45.268 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7275 ms) 2024-09-14T11:15:45.268 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8039 ms) 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from ClsLock (67810 ms total) 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 11 tests from 1 test suite ran. (67810 ms total) 2024-09-14T11:15:53.306 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 11 tests. 2024-09-14T11:15:53.309 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:53.309 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:53.391 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:15:53.392 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:15:53.393 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:15:53.478 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:53.478 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:15:53.478 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:53.478 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from cls_log 2024-09-14T11:15:53.478 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:15:56.342 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_log.test_log_add_same_time (2864 ms) 2024-09-14T11:15:56.342 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_log.test_log_add_different_time (3015 ms) 2024-09-14T11:15:59.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:16:02.389 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_log.trim_by_time (3032 ms) 2024-09-14T11:16:02.389 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:16:05.397 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_log.trim_by_marker (3008 ms) 2024-09-14T11:16:05.397 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from cls_log (11919 ms total) 2024-09-14T11:16:05.397 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:16:05.398 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:16:05.398 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 4 tests from 1 test suite ran. (11919 ms total) 2024-09-14T11:16:05.398 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 4 tests. 2024-09-14T11:16:05.400 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:16:05.400 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:16:05.442 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:16:05.443 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:16:05.444 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:16:05.528 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:16:05.528 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:16:05.528 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:16:05.529 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:16:05.529 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:16:08.425 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_implicit (2896 ms) 2024-09-14T11:16:08.425 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:16:11.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3028 ms) 2024-09-14T11:16:11.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:16:20.507 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_put_snap (9053 ms) 2024-09-14T11:16:20.507 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:16:23.527 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_explicit (3021 ms) 2024-09-14T11:16:23.527 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:16:26.560 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.set (3033 ms) 2024-09-14T11:16:26.560 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:16:33.584 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_implicit_ec (7024 ms) 2024-09-14T11:16:33.584 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:16:40.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7016 ms) 2024-09-14T11:16:40.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:16:53.681 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_put_snap_ec (13081 ms) 2024-09-14T11:16:53.681 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:17:00.725 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.test_explicit_ec (7044 ms) 2024-09-14T11:17:00.725 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:17:07.784 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_refcount.set_ec (7059 ms) 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 10 tests from cls_refcount (62255 ms total) 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 10 tests from 1 test suite ran. (62255 ms total) 2024-09-14T11:17:07.785 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 10 tests. 2024-09-14T11:17:07.787 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:07.787 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:07.829 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:17:07.831 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:17:07.831 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:17:07.917 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:07.917 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:17:07.917 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:07.917 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:17:09.810 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:17:09.844 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_basic (34 ms) 2024-09-14T11:17:09.844 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:17:09.873 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (30 ms) 2024-09-14T11:17:09.873 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:17:09.919 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_remove_object (46 ms) 2024-09-14T11:17:09.920 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:17:11.375 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_suggest (1455 ms) 2024-09-14T11:17:11.375 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:17:11.382 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-14T11:17:11.382 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:17:11.411 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_list (29 ms) 2024-09-14T11:17:11.411 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:17:30.551 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_list_delimited (19139 ms) 2024-09-14T11:17:30.551 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:17:30.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.bi_list (73 ms) 2024-09-14T11:17:30.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:17:30.634 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-14T11:17:30.634 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:17:30.644 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-14T11:17:30.644 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:17:37.880 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.gc_defer (7234 ms) 2024-09-14T11:17:37.880 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:17:37.976 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.usage_basic (97 ms) 2024-09-14T11:17:37.976 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:17:37.977 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-14T11:17:37.977 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:17:38.085 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.usage_clear (108 ms) 2024-09-14T11:17:38.085 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:17:38.126 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.bi_log_trim (41 ms) 2024-09-14T11:17:38.126 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:17:38.142 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.index_racing_removes (17 ms) 2024-09-14T11:17:38.143 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:17:38.155 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.reshardlog_list (13 ms) 2024-09-14T11:17:38.155 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:17:38.165 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-14T11:17:38.895 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 18 tests from cls_rgw (28356 ms total) 2024-09-14T11:17:38.895 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:17:38.895 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:38.895 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 18 tests from 1 test suite ran. (30978 ms total) 2024-09-14T11:17:38.895 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 18 tests. 2024-09-14T11:17:38.897 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:38.898 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:38.938 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:17:38.939 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:17:38.940 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:17:39.023 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:39.023 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:17:39.023 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:39.023 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:17:39.024 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:17:40.898 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.init (1874 ms) 2024-09-14T11:17:40.899 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:17:40.913 INFO:tasks.workunit.client.0.smithi130.stderr:[ ] list info tag = chain-0 2024-09-14T11:17:40.913 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (15 ms) 2024-09-14T11:17:40.913 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:17:40.919 INFO:tasks.workunit.client.0.smithi130.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:17:40.920 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-14T11:17:40.920 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (10 ms) 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:17:41.115 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (185 ms) 2024-09-14T11:17:41.115 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:17:41.124 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (10 ms) 2024-09-14T11:17:41.125 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:17:41.132 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (7 ms) 2024-09-14T11:17:41.132 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:17:41.140 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-14T11:17:41.140 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:17:41.904 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_gc.finalize (763 ms) 2024-09-14T11:17:41.904 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from cls_rgw_gc (2879 ms total) 2024-09-14T11:17:41.904 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:17:41.904 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:41.905 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 9 tests from 1 test suite ran. (2879 ms total) 2024-09-14T11:17:41.905 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 9 tests. 2024-09-14T11:17:41.906 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:41.907 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:41.950 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:17:41.951 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:17:41.951 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:17:42.044 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:42.044 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:42.044 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:17:42.045 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:43.917 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:17:43.917 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:17:43.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.937+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=LMBAIBSZW280 type=del size=1742831 2024-09-14T11:17:43.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.938+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=VMU0M8KCAGWN type=del size=3700094 2024-09-14T11:17:43.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.941+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~1NVFQLO4910G.0 size=576018 2024-09-14T11:17:43.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.941+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=1NVFQLO4910G tag=F0KN0XJ2SO5D type=write size=1624594 2024-09-14T11:17:43.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.942+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=K0737MY2QTA1 type=del size=3926924 2024-09-14T11:17:43.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.945+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~C03O761IMXWV.0 size=127975 2024-09-14T11:17:43.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.945+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=C03O761IMXWV tag=F5D4CZS8DW9H type=write size=1176551 2024-09-14T11:17:43.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.947+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~P62AXESZ1XAN.0 size=500254 2024-09-14T11:17:43.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.947+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=P62AXESZ1XAN tag=MSE1ZUUA3EQU type=write size=1548830 2024-09-14T11:17:43.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.948+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=K36HO9AIE5FA type=write size=471300 2024-09-14T11:17:43.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.950+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=12B0Q1HOPWNJ type=del size=2862786 2024-09-14T11:17:43.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.951+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=037JKJDL8FHR type=del size=3464486 2024-09-14T11:17:43.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.952+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=ADBYXGQV02PU type=del size=414049 2024-09-14T11:17:43.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.954+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=72HKSQ9O3TTF type=del size=1415911 2024-09-14T11:17:43.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.955+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=PJ0EFXD866YC type=del size=1398528 2024-09-14T11:17:43.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.956+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=O185YGGYUR5Z type=del size=2883800 2024-09-14T11:17:43.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.957+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=QQ00KBQ9VIKK type=del size=2442841 2024-09-14T11:17:43.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.959+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=TOD7A0IWTF6M type=del size=1560973 2024-09-14T11:17:43.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.960+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=I6MG6E50R70H type=del size=4040615 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.961+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=LMBAIBSZW280 type=del 2024-09-14T11:17:43.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.964+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~1OZNJRUQE2OP.0 size=1048576 2024-09-14T11:17:43.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.965+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~1OZNJRUQE2OP.1 size=591039 2024-09-14T11:17:43.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.965+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=1OZNJRUQE2OP tag=O11CVR23N2CL type=write size=2688191 2024-09-14T11:17:43.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.966+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=VMU0M8KCAGWN type=del 2024-09-14T11:17:43.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.968+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~VTV1Z0ZNTH2N.0 size=261615 2024-09-14T11:17:43.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.968+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=VTV1Z0ZNTH2N tag=OA4BZTRUO1WD type=write size=1310191 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.970+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~1NVFQLO4910G.0 size=576018 2024-09-14T11:17:43.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.972+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=1NVFQLO4910G tag=F0KN0XJ2SO5D type=write size=1624594 2024-09-14T11:17:43.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.973+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=YQ05BNYTKYKY type=del size=3711433 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.974+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=K0737MY2QTA1 type=del size=3926924 2024-09-14T11:17:43.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.976+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~EFGFS2JH2HCQ.0 size=822132 2024-09-14T11:17:43.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.976+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=EFGFS2JH2HCQ tag=IPEZRDO7108V type=write size=1870708 2024-09-14T11:17:43.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.978+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~C03O761IMXWV.0 size=127975 2024-09-14T11:17:43.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.980+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=C03O761IMXWV tag=F5D4CZS8DW9H type=write size=1176551 2024-09-14T11:17:43.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.981+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=OMWM4WN9VEZ3 type=del size=3402367 2024-09-14T11:17:43.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.982+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~P62AXESZ1XAN.0 size=500254 2024-09-14T11:17:43.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.985+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=P62AXESZ1XAN tag=MSE1ZUUA3EQU type=write size=1548830 2024-09-14T11:17:43.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.986+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=03A4856S79EM type=del size=3582861 2024-09-14T11:17:43.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.987+0000 7f1be8076780 1 < completed write operation key=CQDRZMJAJ7FZ tag=K36HO9AIE5FA type=write size=471300 2024-09-14T11:17:43.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.989+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=6H968E95WSFJ type=write size=330416 2024-09-14T11:17:43.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.990+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=12B0Q1HOPWNJ type=del 2024-09-14T11:17:43.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.991+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=OLXRCQ4S5UMS type=del size=2514915 2024-09-14T11:17:43.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.993+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=037JKJDL8FHR type=del 2024-09-14T11:17:43.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.995+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~X1GMNSN3NKKZ.0 size=89307 2024-09-14T11:17:43.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.995+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=X1GMNSN3NKKZ tag=VVSVJQ93EZ82 type=write size=1137883 2024-09-14T11:17:43.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.996+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=ADBYXGQV02PU type=del 2024-09-14T11:17:43.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:43.999+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~N507D6LFER7B.0 size=1048576 2024-09-14T11:17:43.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.000+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~N507D6LFER7B.1 size=1003499 2024-09-14T11:17:43.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.000+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=N507D6LFER7B tag=1YR0RXP1GCR2 type=write size=3100651 2024-09-14T11:17:44.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.002+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=72HKSQ9O3TTF type=del 2024-09-14T11:17:44.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.003+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=ZVQ7D2HZWKWD type=del size=2235260 2024-09-14T11:17:44.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.005+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=PJ0EFXD866YC type=del 2024-09-14T11:17:44.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.006+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=4C1JESQJNB8V type=del size=2310553 2024-09-14T11:17:44.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.007+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=O185YGGYUR5Z type=del 2024-09-14T11:17:44.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.009+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=6ACK9Z39Y49T type=del size=3691588 2024-09-14T11:17:44.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.010+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=QQ00KBQ9VIKK type=del 2024-09-14T11:17:44.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.013+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~W91R0AIFHT20.0 size=751337 2024-09-14T11:17:44.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.013+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=W91R0AIFHT20 tag=ENLNTV5QTDUX type=write size=1799913 2024-09-14T11:17:44.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.014+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=TOD7A0IWTF6M type=del 2024-09-14T11:17:44.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.016+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~5L2YMLN51HND.0 size=682231 2024-09-14T11:17:44.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.016+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=5L2YMLN51HND tag=XVMXZ6JJD1AO type=write size=1730807 2024-09-14T11:17:44.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.017+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=I6MG6E50R70H type=del 2024-09-14T11:17:44.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.020+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.0 size=1048576 2024-09-14T11:17:44.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.021+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.1 size=1048576 2024-09-14T11:17:44.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.021+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.2 size=243900 2024-09-14T11:17:44.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.021+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=ROB3R1O0BJ8Q tag=0XUBMSG5E03F type=write size=3389628 2024-09-14T11:17:44.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.022+0000 7f1be8076780 1 < canceled part key=_multipart_26WW5JFVB36U.2~1OZNJRUQE2OP.0 size=1048576 2024-09-14T11:17:44.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.023+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~1OZNJRUQE2OP.1 size=591039 2024-09-14T11:17:44.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.025+0000 7f1be8076780 1 < canceled multipart upload key=26WW5JFVB36U upload=1OZNJRUQE2OP tag=O11CVR23N2CL type=write size=2688191 2024-09-14T11:17:44.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.026+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=4Y6JIARWQG02 type=del size=3689221 2024-09-14T11:17:44.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.027+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~VTV1Z0ZNTH2N.0 size=261615 2024-09-14T11:17:44.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.029+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=VTV1Z0ZNTH2N tag=OA4BZTRUO1WD type=write size=1310191 2024-09-14T11:17:44.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.030+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=TLUU0SPUC927 type=del size=268070 2024-09-14T11:17:44.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.032+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=YQ05BNYTKYKY type=del size=3711433 2024-09-14T11:17:44.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.033+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=MIFZTMROWWBU type=del size=2751775 2024-09-14T11:17:44.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.034+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~EFGFS2JH2HCQ.0 size=822132 2024-09-14T11:17:44.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.036+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=EFGFS2JH2HCQ tag=IPEZRDO7108V type=write size=1870708 2024-09-14T11:17:44.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.037+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=W2YW73H5ING5 type=del size=3878757 2024-09-14T11:17:44.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.039+0000 7f1be8076780 1 < suggested remove operation key=KQ479IOZ0108 tag=OMWM4WN9VEZ3 type=del 2024-09-14T11:17:44.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.041+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=9U2JQUQS2UWB type=write size=555734 2024-09-14T11:17:44.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.042+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=03A4856S79EM type=del 2024-09-14T11:17:44.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.044+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=GEAD0HYAZL16 type=del size=2134194 2024-09-14T11:17:44.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.046+0000 7f1be8076780 1 < suggested remove operation key=WQC5TVD66R0W tag=6H968E95WSFJ type=write 2024-09-14T11:17:44.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.048+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=UPTH9H4TKT2Y type=write size=780669 2024-09-14T11:17:44.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.050+0000 7f1be8076780 1 < suggested update operation key=4AY6ZXFKO1YQ tag=OLXRCQ4S5UMS type=del size=2514915 2024-09-14T11:17:44.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.053+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.0 size=1048576 2024-09-14T11:17:44.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.054+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.1 size=1048576 2024-09-14T11:17:44.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.055+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.2 size=588973 2024-09-14T11:17:44.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.055+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=D6E3DV190COM tag=7GV26EG7HQX6 type=write size=3734701 2024-09-14T11:17:44.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.055+0000 7f1be8076780 1 < canceled part key=_multipart_4ADXXTIO715C.2~X1GMNSN3NKKZ.0 size=89307 2024-09-14T11:17:44.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.057+0000 7f1be8076780 1 < canceled multipart upload key=4ADXXTIO715C upload=X1GMNSN3NKKZ tag=VVSVJQ93EZ82 type=write size=1137883 2024-09-14T11:17:44.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.059+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.0 size=1048576 2024-09-14T11:17:44.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.061+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.1 size=1048576 2024-09-14T11:17:44.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.062+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.2 size=341392 2024-09-14T11:17:44.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.062+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=R19Q3BPFFPU1 tag=9F7WHOMF7GXG type=write size=3487120 2024-09-14T11:17:44.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.063+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~N507D6LFER7B.0 size=1048576 2024-09-14T11:17:44.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.064+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~N507D6LFER7B.1 size=1003499 2024-09-14T11:17:44.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.066+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=N507D6LFER7B tag=1YR0RXP1GCR2 type=write size=3100651 2024-09-14T11:17:44.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.067+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=1R1L1MLMPJVR type=del size=2385365 2024-09-14T11:17:44.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.068+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=ZVQ7D2HZWKWD type=del 2024-09-14T11:17:44.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.070+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=FK4H265OFKX3 type=del size=3337079 2024-09-14T11:17:44.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.071+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=4C1JESQJNB8V type=del 2024-09-14T11:17:44.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.075+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~KHX8GF17X8M2.0 size=122689 2024-09-14T11:17:44.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.075+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=KHX8GF17X8M2 tag=PGQPYAVD9YAQ type=write size=1171265 2024-09-14T11:17:44.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.077+0000 7f1be8076780 1 < suggested remove operation key=3YIK6B6Y2EU1 tag=6ACK9Z39Y49T type=del 2024-09-14T11:17:44.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.078+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=CEUHS9WZOJS6 type=del size=904539 2024-09-14T11:17:44.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.079+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~W91R0AIFHT20.0 size=751337 2024-09-14T11:17:44.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.082+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=W91R0AIFHT20 tag=ENLNTV5QTDUX type=write size=1799913 2024-09-14T11:17:44.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.083+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=ZBA0BTJPZ67E type=del size=781121 2024-09-14T11:17:44.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.084+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~5L2YMLN51HND.0 size=682231 2024-09-14T11:17:44.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.086+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=5L2YMLN51HND tag=XVMXZ6JJD1AO type=write size=1730807 2024-09-14T11:17:44.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.087+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=FZCILA1VHYC7 type=del size=3100995 2024-09-14T11:17:44.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.088+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.0 size=1048576 2024-09-14T11:17:44.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.089+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.1 size=1048576 2024-09-14T11:17:44.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.090+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~ROB3R1O0BJ8Q.2 size=243900 2024-09-14T11:17:44.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.092+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=ROB3R1O0BJ8Q tag=0XUBMSG5E03F type=write size=3389628 2024-09-14T11:17:44.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.093+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=AMMRXSZKKVKW type=del size=754580 2024-09-14T11:17:44.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.094+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=4Y6JIARWQG02 type=del 2024-09-14T11:17:44.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.096+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=OMBGD2NIPNJ7 type=del size=2374882 2024-09-14T11:17:44.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.097+0000 7f1be8076780 -1 < failed to complete operation key=3YIK6B6Y2EU1 tag=TLUU0SPUC927 type=del size=268070: (22) Invalid argument 2024-09-14T11:17:44.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.098+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=F2WLEFA8HGVA type=write size=885990 2024-09-14T11:17:44.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.099+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=MIFZTMROWWBU type=del 2024-09-14T11:17:44.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.101+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.0 size=1048576 2024-09-14T11:17:44.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.102+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.1 size=1048576 2024-09-14T11:17:44.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.103+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.2 size=454749 2024-09-14T11:17:44.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.103+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=6F1H2EL9OOFI tag=C0PDR0TBUAE6 type=write size=3600477 2024-09-14T11:17:44.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.105+0000 7f1be8076780 1 < suggested remove operation key=UB0SEYZ7ITU1 tag=W2YW73H5ING5 type=del 2024-09-14T11:17:44.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.106+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=7L0R9S2R75TY type=del size=759708 2024-09-14T11:17:44.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.109+0000 7f1be8076780 1 < suggested remove operation key=MX5J0P18BM0D tag=9U2JQUQS2UWB type=write 2024-09-14T11:17:44.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.111+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~ZG6W5ORCL4CJ.0 size=188237 2024-09-14T11:17:44.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.111+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=ZG6W5ORCL4CJ tag=GUZJKSEDXWFD type=write size=1236813 2024-09-14T11:17:44.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.112+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=GEAD0HYAZL16 type=del 2024-09-14T11:17:44.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.113+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=V0MZBQJE2OPK type=del size=413385 2024-09-14T11:17:44.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.115+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=UPTH9H4TKT2Y type=write 2024-09-14T11:17:44.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.118+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.0 size=1048576 2024-09-14T11:17:44.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.119+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.1 size=1048576 2024-09-14T11:17:44.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.120+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.2 size=114598 2024-09-14T11:17:44.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.120+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=QE3B9WGX6EOX tag=D11UJELKZ16F type=write size=3260326 2024-09-14T11:17:44.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.121+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.0 size=1048576 2024-09-14T11:17:44.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.122+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.1 size=1048576 2024-09-14T11:17:44.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.123+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~D6E3DV190COM.2 size=588973 2024-09-14T11:17:44.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.125+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=D6E3DV190COM tag=7GV26EG7HQX6 type=write size=3734701 2024-09-14T11:17:44.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.126+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=V623ZQ029VQ0 type=del size=3499984 2024-09-14T11:17:44.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.127+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.0 size=1048576 2024-09-14T11:17:44.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.128+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.1 size=1048576 2024-09-14T11:17:44.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.129+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~R19Q3BPFFPU1.2 size=341392 2024-09-14T11:17:44.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.131+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=R19Q3BPFFPU1 tag=9F7WHOMF7GXG type=write size=3487120 2024-09-14T11:17:44.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.133+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.0 size=1048576 2024-09-14T11:17:44.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.134+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.1 size=1048576 2024-09-14T11:17:44.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.137+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.2 size=368994 2024-09-14T11:17:44.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.137+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=TQM970FJJG35 tag=BIJ698I0JCIS type=write size=3514722 2024-09-14T11:17:44.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.138+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=1R1L1MLMPJVR type=del 2024-09-14T11:17:44.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.139+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=C4XRED3S6KMF type=del size=474207 2024-09-14T11:17:44.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.140+0000 7f1be8076780 -1 < failed to complete operation key=MX5J0P18BM0D tag=FK4H265OFKX3 type=del size=3337079: (22) Invalid argument 2024-09-14T11:17:44.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.142+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~R58EXB1I1P7O.0 size=769183 2024-09-14T11:17:44.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.142+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=R58EXB1I1P7O tag=S04CDH57VMGG type=write size=1817759 2024-09-14T11:17:44.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.143+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~KHX8GF17X8M2.0 size=122689 2024-09-14T11:17:44.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.145+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=KHX8GF17X8M2 tag=PGQPYAVD9YAQ type=write size=1171265 2024-09-14T11:17:44.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.146+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=CJMLQK057PWF type=del size=1244478 2024-09-14T11:17:44.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.147+0000 7f1be8076780 -1 < failed to complete operation key=UB0SEYZ7ITU1 tag=CEUHS9WZOJS6 type=del size=904539: (22) Invalid argument 2024-09-14T11:17:44.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.149+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=RMPXY09H5QJ6 type=del size=74736 2024-09-14T11:17:44.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.150+0000 7f1be8076780 -1 < failed to complete operation key=JQZ7C562TQ8D tag=ZBA0BTJPZ67E type=del size=781121: (22) Invalid argument 2024-09-14T11:17:44.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.152+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9WA41FNFGIIN.0 size=1048576 2024-09-14T11:17:44.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.153+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9WA41FNFGIIN.1 size=1017348 2024-09-14T11:17:44.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.153+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=9WA41FNFGIIN tag=2BQTHG68T1L2 type=write size=3114500 2024-09-14T11:17:44.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.154+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=FZCILA1VHYC7 type=del 2024-09-14T11:17:44.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.156+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.0 size=1048576 2024-09-14T11:17:44.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.157+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.1 size=1048576 2024-09-14T11:17:44.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.158+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.2 size=1042080 2024-09-14T11:17:44.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.158+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=3YOXRDY29QF7 tag=BUJN9W3UNSJW type=write size=4187808 2024-09-14T11:17:44.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.161+0000 7f1be8076780 1 < suggested update operation key=INU0TV92GXSP tag=AMMRXSZKKVKW type=del size=754580 2024-09-14T11:17:44.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.162+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=ENJ3KZDSUGC6 type=del size=1761680 2024-09-14T11:17:44.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.163+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=OMBGD2NIPNJ7 type=del 2024-09-14T11:17:44.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.164+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=0HL4P9FF4SJ7 type=del size=1590931 2024-09-14T11:17:44.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.165+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=F2WLEFA8HGVA type=write size=885990 2024-09-14T11:17:44.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.168+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.0 size=1048576 2024-09-14T11:17:44.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.169+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.1 size=1048576 2024-09-14T11:17:44.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.170+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.2 size=697536 2024-09-14T11:17:44.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.170+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=XS2UR9GEX596 tag=U1B0SHGFSP8W type=write size=3843264 2024-09-14T11:17:44.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.171+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.0 size=1048576 2024-09-14T11:17:44.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.172+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.1 size=1048576 2024-09-14T11:17:44.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.173+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6F1H2EL9OOFI.2 size=454749 2024-09-14T11:17:44.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.175+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=6F1H2EL9OOFI tag=C0PDR0TBUAE6 type=write size=3600477 2024-09-14T11:17:44.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.176+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=MM8B39DYONDE type=write size=244699 2024-09-14T11:17:44.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.178+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=7L0R9S2R75TY type=del 2024-09-14T11:17:44.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.180+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.0 size=1048576 2024-09-14T11:17:44.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.181+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.1 size=1048576 2024-09-14T11:17:44.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.183+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.2 size=559205 2024-09-14T11:17:44.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.183+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=QXUE3WUEN2U4 tag=G1T1B03WFT4U type=write size=3704933 2024-09-14T11:17:44.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.183+0000 7f1be8076780 1 < canceled part key=_multipart_26WW5JFVB36U.2~ZG6W5ORCL4CJ.0 size=188237 2024-09-14T11:17:44.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.185+0000 7f1be8076780 1 < canceled multipart upload key=26WW5JFVB36U upload=ZG6W5ORCL4CJ tag=GUZJKSEDXWFD type=write size=1236813 2024-09-14T11:17:44.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.188+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.0 size=1048576 2024-09-14T11:17:44.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.189+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.1 size=1048576 2024-09-14T11:17:44.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.190+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.2 size=937428 2024-09-14T11:17:44.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.190+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=5SGNDSTYTP6T tag=YK6KYH8B19IN type=write size=4083156 2024-09-14T11:17:44.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.191+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=V0MZBQJE2OPK type=del 2024-09-14T11:17:44.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.193+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ACLZQTPXDYB5.0 size=1048576 2024-09-14T11:17:44.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.194+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ACLZQTPXDYB5.1 size=422282 2024-09-14T11:17:44.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.194+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=ACLZQTPXDYB5 tag=J719AFLEPM9N type=write size=2519434 2024-09-14T11:17:44.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.195+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.0 size=1048576 2024-09-14T11:17:44.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.196+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.1 size=1048576 2024-09-14T11:17:44.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.197+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~QE3B9WGX6EOX.2 size=114598 2024-09-14T11:17:44.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.199+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=QE3B9WGX6EOX tag=D11UJELKZ16F type=write size=3260326 2024-09-14T11:17:44.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.201+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~X2ZP3U0VUBQN.0 size=1048576 2024-09-14T11:17:44.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.202+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~X2ZP3U0VUBQN.1 size=134327 2024-09-14T11:17:44.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.202+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=X2ZP3U0VUBQN tag=NMXS4ZZQTX5F type=write size=2231479 2024-09-14T11:17:44.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.205+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=V623ZQ029VQ0 type=del 2024-09-14T11:17:44.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.206+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=IAS4TFQUYLUK type=write size=841652 2024-09-14T11:17:44.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.207+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.0 size=1048576 2024-09-14T11:17:44.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.209+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.1 size=1048576 2024-09-14T11:17:44.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.210+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~TQM970FJJG35.2 size=368994 2024-09-14T11:17:44.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.212+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=TQM970FJJG35 tag=BIJ698I0JCIS type=write size=3514722 2024-09-14T11:17:44.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.213+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=EY7Q1EDGX8EC type=del size=2344039 2024-09-14T11:17:44.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.214+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=C4XRED3S6KMF type=del 2024-09-14T11:17:44.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.215+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=0CP3VFQXYKYM type=del size=1358733 2024-09-14T11:17:44.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.217+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~R58EXB1I1P7O.0 size=769183 2024-09-14T11:17:44.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.219+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=R58EXB1I1P7O tag=S04CDH57VMGG type=write size=1817759 2024-09-14T11:17:44.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.221+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.0 size=1048576 2024-09-14T11:17:44.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.221+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.1 size=1048576 2024-09-14T11:17:44.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.222+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.2 size=104440 2024-09-14T11:17:44.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.222+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=76CR9I1W16E4 tag=IGSPF3HSTOKV type=write size=3250168 2024-09-14T11:17:44.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.223+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=CJMLQK057PWF type=del 2024-09-14T11:17:44.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.225+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=I373H2TGAIHJ type=write size=848456 2024-09-14T11:17:44.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.229+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=RMPXY09H5QJ6 type=del 2024-09-14T11:17:44.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.230+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=L11ZAUR4DQ5U type=del size=3902568 2024-09-14T11:17:44.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.231+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9WA41FNFGIIN.0 size=1048576 2024-09-14T11:17:44.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.232+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9WA41FNFGIIN.1 size=1017348 2024-09-14T11:17:44.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.234+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=9WA41FNFGIIN tag=2BQTHG68T1L2 type=write size=3114500 2024-09-14T11:17:44.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.235+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=GFLNYFGALH65 type=del size=4032271 2024-09-14T11:17:44.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.236+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.0 size=1048576 2024-09-14T11:17:44.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.237+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.1 size=1048576 2024-09-14T11:17:44.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.238+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~3YOXRDY29QF7.2 size=1042080 2024-09-14T11:17:44.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.240+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=3YOXRDY29QF7 tag=BUJN9W3UNSJW type=write size=4187808 2024-09-14T11:17:44.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.241+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=SBNNM9CE7XA1 type=del size=2621617 2024-09-14T11:17:44.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.242+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=ENJ3KZDSUGC6 type=del 2024-09-14T11:17:44.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.244+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=IP2LY7O4P7WG type=write size=847011 2024-09-14T11:17:44.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.245+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=0HL4P9FF4SJ7 type=del 2024-09-14T11:17:44.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.246+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=6KFX8ZKLJ03N type=del size=1714245 2024-09-14T11:17:44.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.247+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.0 size=1048576 2024-09-14T11:17:44.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.248+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.1 size=1048576 2024-09-14T11:17:44.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.249+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~XS2UR9GEX596.2 size=697536 2024-09-14T11:17:44.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.251+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=XS2UR9GEX596 tag=U1B0SHGFSP8W type=write size=3843264 2024-09-14T11:17:44.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.252+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=17FBDIHU9COA type=del size=2806609 2024-09-14T11:17:44.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.253+0000 7f1be8076780 1 < completed write operation key=XB3M4CI0ERWP tag=MM8B39DYONDE type=write size=244699 2024-09-14T11:17:44.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.255+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=O8NAMCUAZ49F type=write size=204364 2024-09-14T11:17:44.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.256+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.0 size=1048576 2024-09-14T11:17:44.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.257+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.1 size=1048576 2024-09-14T11:17:44.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.258+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~QXUE3WUEN2U4.2 size=559205 2024-09-14T11:17:44.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.260+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=QXUE3WUEN2U4 tag=G1T1B03WFT4U type=write size=3704933 2024-09-14T11:17:44.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.261+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=2ZBBN8S74LP2 type=del size=1309115 2024-09-14T11:17:44.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.262+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.0 size=1048576 2024-09-14T11:17:44.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.262+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.1 size=1048576 2024-09-14T11:17:44.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.263+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~5SGNDSTYTP6T.2 size=937428 2024-09-14T11:17:44.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.265+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=5SGNDSTYTP6T tag=YK6KYH8B19IN type=write size=4083156 2024-09-14T11:17:44.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.266+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=074ALG8X7STJ type=write size=763793 2024-09-14T11:17:44.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.268+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ACLZQTPXDYB5.0 size=1048576 2024-09-14T11:17:44.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.269+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ACLZQTPXDYB5.1 size=422282 2024-09-14T11:17:44.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.271+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=ACLZQTPXDYB5 tag=J719AFLEPM9N type=write size=2519434 2024-09-14T11:17:44.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.272+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=WIQ7BVT235JJ type=del size=2047614 2024-09-14T11:17:44.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.273+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~X2ZP3U0VUBQN.0 size=1048576 2024-09-14T11:17:44.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.274+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~X2ZP3U0VUBQN.1 size=134327 2024-09-14T11:17:44.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.276+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=X2ZP3U0VUBQN tag=NMXS4ZZQTX5F type=write size=2231479 2024-09-14T11:17:44.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.277+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=AI8AREAGQ8HA type=del size=1722987 2024-09-14T11:17:44.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.278+0000 7f1be8076780 1 < completed write operation key=T70EFGHRQZQ7 tag=IAS4TFQUYLUK type=write size=841652 2024-09-14T11:17:44.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.279+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=UEF7AMNNT8WR type=del size=374114 2024-09-14T11:17:44.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.280+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=AUCQC0OBQP7Z tag=EY7Q1EDGX8EC type=del size=2344039: (2) No such file or directory 2024-09-14T11:17:44.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.281+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=NB7PFRFNVUX2 type=del size=2868646 2024-09-14T11:17:44.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.282+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=0CP3VFQXYKYM type=del 2024-09-14T11:17:44.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.284+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~A1L5ZWYT8E5P.0 size=503536 2024-09-14T11:17:44.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.284+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=A1L5ZWYT8E5P tag=IK1CUMUGF5EQ type=write size=1552112 2024-09-14T11:17:44.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.285+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.0 size=1048576 2024-09-14T11:17:44.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.287+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.1 size=1048576 2024-09-14T11:17:44.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.287+0000 7f1be8076780 1 < canceled part key=_multipart_T70EFGHRQZQ7.2~76CR9I1W16E4.2 size=104440 2024-09-14T11:17:44.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.290+0000 7f1be8076780 1 < canceled multipart upload key=T70EFGHRQZQ7 upload=76CR9I1W16E4 tag=IGSPF3HSTOKV type=write size=3250168 2024-09-14T11:17:44.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.291+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=V8D23X4QZXYG type=del size=658885 2024-09-14T11:17:44.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.292+0000 7f1be8076780 1 < canceled operation key=0BX70Q8C1QL0 tag=I373H2TGAIHJ type=write size=848456 2024-09-14T11:17:44.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.294+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=I6BL50JIGFJC type=del size=2432852 2024-09-14T11:17:44.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.295+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=L11ZAUR4DQ5U type=del 2024-09-14T11:17:44.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.297+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~JE2MVB9LY3MK.0 size=1048576 2024-09-14T11:17:44.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.298+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~JE2MVB9LY3MK.1 size=678855 2024-09-14T11:17:44.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.298+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=JE2MVB9LY3MK tag=FAMB35LSGCKR type=write size=2776007 2024-09-14T11:17:44.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.299+0000 7f1be8076780 1 < canceled operation key=1RUE5J1DYH2C tag=GFLNYFGALH65 type=del size=4032271 2024-09-14T11:17:44.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.301+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=VTYXJNB918FC type=write size=3773 2024-09-14T11:17:44.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.302+0000 7f1be8076780 1 < canceled operation key=INU0TV92GXSP tag=SBNNM9CE7XA1 type=del size=2621617 2024-09-14T11:17:44.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.304+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~QRX3JKF9I2Y4.0 size=1048576 2024-09-14T11:17:44.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.305+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~QRX3JKF9I2Y4.1 size=503417 2024-09-14T11:17:44.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.305+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=QRX3JKF9I2Y4 tag=ZDPL0HR4CNON type=write size=2600569 2024-09-14T11:17:44.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.306+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=IP2LY7O4P7WG type=write size=847011 2024-09-14T11:17:44.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.308+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.0 size=1048576 2024-09-14T11:17:44.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.309+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.1 size=1048576 2024-09-14T11:17:44.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.310+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.2 size=555209 2024-09-14T11:17:44.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.310+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=I4VW0ECZ78C2 tag=0KWV5589N9F9 type=write size=3700937 2024-09-14T11:17:44.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.311+0000 7f1be8076780 1 < canceled operation key=JIWPGHQ3GEZB tag=6KFX8ZKLJ03N type=del size=1714245 2024-09-14T11:17:44.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.314+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~NK2T5SQYC64A.0 size=1048576 2024-09-14T11:17:44.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.314+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~NK2T5SQYC64A.1 size=100454 2024-09-14T11:17:44.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.315+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=NK2T5SQYC64A tag=4MCYZXBG438K type=write size=2197606 2024-09-14T11:17:44.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.316+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=17FBDIHU9COA type=del 2024-09-14T11:17:44.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.317+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=0F1DQQ9IJ9HQ type=del size=4007928 2024-09-14T11:17:44.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.318+0000 7f1be8076780 1 < completed write operation key=0BX70Q8C1QL0 tag=O8NAMCUAZ49F type=write size=204364 2024-09-14T11:17:44.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.319+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=2L0MGTEPIR6L type=del size=3305409 2024-09-14T11:17:44.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.321+0000 7f1be8076780 1 < suggested remove operation key=3Z71PEWG5UMA tag=2ZBBN8S74LP2 type=del 2024-09-14T11:17:44.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.323+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=XM519EQDXBKR type=del size=1445588 2024-09-14T11:17:44.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.325+0000 7f1be8076780 1 < suggested remove operation key=KQ479IOZ0108 tag=074ALG8X7STJ type=write 2024-09-14T11:17:44.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.326+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=OF6S8HE9YIOW type=write size=845514 2024-09-14T11:17:44.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.327+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=WIQ7BVT235JJ type=del 2024-09-14T11:17:44.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.329+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=8AE1ETPV68B8 type=del size=113648 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.330+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=AI8AREAGQ8HA type=del 2024-09-14T11:17:44.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.332+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.0 size=1048576 2024-09-14T11:17:44.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.333+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.1 size=1048576 2024-09-14T11:17:44.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.334+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.2 size=908594 2024-09-14T11:17:44.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.334+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=HZK8FG2R7KQW tag=2OUCJ7SF07V9 type=write size=4054322 2024-09-14T11:17:44.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.335+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=UEF7AMNNT8WR type=del 2024-09-14T11:17:44.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.337+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~XEROZ4SG531Z.0 size=278233 2024-09-14T11:17:44.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.337+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=XEROZ4SG531Z tag=FTUPFQ1GAR1T type=write size=1326809 2024-09-14T11:17:44.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.339+0000 7f1be8076780 1 < suggested remove operation key=XB3M4CI0ERWP tag=NB7PFRFNVUX2 type=del 2024-09-14T11:17:44.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.341+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~CEC9VUMJSGX8.0 size=1048576 2024-09-14T11:17:44.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.342+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~CEC9VUMJSGX8.1 size=608315 2024-09-14T11:17:44.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.342+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=CEC9VUMJSGX8 tag=FN27T8GY79A6 type=write size=2705467 2024-09-14T11:17:44.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.344+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~A1L5ZWYT8E5P.0 size=503536 2024-09-14T11:17:44.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.346+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=A1L5ZWYT8E5P tag=IK1CUMUGF5EQ type=write size=1552112 2024-09-14T11:17:44.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.348+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~15HQ8FHV7IZ1.0 size=939081 2024-09-14T11:17:44.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.348+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=15HQ8FHV7IZ1 tag=TRKLWJWFED5U type=write size=1987657 2024-09-14T11:17:44.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.350+0000 7f1be8076780 1 < suggested update operation key=SJES17ZIGRZE tag=V8D23X4QZXYG type=del size=658885 2024-09-14T11:17:44.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.352+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=9ZOMGTBSJ1M6 type=del size=3594630 2024-09-14T11:17:44.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.353+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=I6BL50JIGFJC type=del 2024-09-14T11:17:44.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.354+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=GIG0E84LEEFZ type=del size=3889244 2024-09-14T11:17:44.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.355+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~JE2MVB9LY3MK.0 size=1048576 2024-09-14T11:17:44.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.356+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~JE2MVB9LY3MK.1 size=678855 2024-09-14T11:17:44.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.358+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=JE2MVB9LY3MK tag=FAMB35LSGCKR type=write size=2776007 2024-09-14T11:17:44.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.360+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=4JRC7QGQODAH type=del size=3806171 2024-09-14T11:17:44.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.361+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=VTYXJNB918FC type=write size=3773 2024-09-14T11:17:44.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.363+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~TW8Y4YVZ5WMM.0 size=1048576 2024-09-14T11:17:44.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.364+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~TW8Y4YVZ5WMM.1 size=418473 2024-09-14T11:17:44.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.364+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=TW8Y4YVZ5WMM tag=BL3SSEC9ITVA type=write size=2515625 2024-09-14T11:17:44.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.365+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~QRX3JKF9I2Y4.0 size=1048576 2024-09-14T11:17:44.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.366+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~QRX3JKF9I2Y4.1 size=503417 2024-09-14T11:17:44.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.368+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=QRX3JKF9I2Y4 tag=ZDPL0HR4CNON type=write size=2600569 2024-09-14T11:17:44.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.369+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=6WE5TD5NE1B7 type=del size=1280755 2024-09-14T11:17:44.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.370+0000 7f1be8076780 1 < canceled part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.0 size=1048576 2024-09-14T11:17:44.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.371+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.1 size=1048576 2024-09-14T11:17:44.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.372+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~I4VW0ECZ78C2.2 size=555209 2024-09-14T11:17:44.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.374+0000 7f1be8076780 1 < canceled multipart upload key=CQDRZMJAJ7FZ upload=I4VW0ECZ78C2 tag=0KWV5589N9F9 type=write size=3700937 2024-09-14T11:17:44.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.375+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=CNRYW78IZHWU type=del size=630937 2024-09-14T11:17:44.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.376+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~NK2T5SQYC64A.0 size=1048576 2024-09-14T11:17:44.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.377+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~NK2T5SQYC64A.1 size=100454 2024-09-14T11:17:44.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.379+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=NK2T5SQYC64A tag=4MCYZXBG438K type=write size=2197606 2024-09-14T11:17:44.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.380+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=FI0GE5EF6O66 type=write size=1026335 2024-09-14T11:17:44.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.381+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=0F1DQQ9IJ9HQ type=del 2024-09-14T11:17:44.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.382+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=IBZDT69F6PKV type=del size=181967 2024-09-14T11:17:44.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.383+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=2L0MGTEPIR6L type=del 2024-09-14T11:17:44.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.385+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.0 size=1048576 2024-09-14T11:17:44.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.386+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.1 size=1048576 2024-09-14T11:17:44.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.387+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.2 size=792315 2024-09-14T11:17:44.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.387+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=FA2DPRRIIX3O tag=A6NRCUNE523T type=write size=3938043 2024-09-14T11:17:44.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.388+0000 7f1be8076780 -1 < failed to complete operation key=KQ479IOZ0108 tag=XM519EQDXBKR type=del size=1445588: (22) Invalid argument 2024-09-14T11:17:44.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.390+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=9Q5GVIVUVSIH type=del size=2622755 2024-09-14T11:17:44.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.392+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=OF6S8HE9YIOW type=write size=845514 2024-09-14T11:17:44.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.394+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~2EHV178CR9SN.0 size=900604 2024-09-14T11:17:44.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.394+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=2EHV178CR9SN tag=N0JSFFRS9PII type=write size=1949180 2024-09-14T11:17:44.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.395+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=8AE1ETPV68B8 type=del 2024-09-14T11:17:44.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.396+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=LK6JZOGUM3FP type=del size=4172344 2024-09-14T11:17:44.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.397+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.0 size=1048576 2024-09-14T11:17:44.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.398+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.1 size=1048576 2024-09-14T11:17:44.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.399+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~HZK8FG2R7KQW.2 size=908594 2024-09-14T11:17:44.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.401+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=HZK8FG2R7KQW tag=2OUCJ7SF07V9 type=write size=4054322 2024-09-14T11:17:44.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.403+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~HDHZ8E2619C7.0 size=1048576 2024-09-14T11:17:44.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.404+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~HDHZ8E2619C7.1 size=391228 2024-09-14T11:17:44.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.404+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=HDHZ8E2619C7 tag=1GRZM6OMOXV7 type=write size=2488380 2024-09-14T11:17:44.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.406+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~XEROZ4SG531Z.0 size=278233 2024-09-14T11:17:44.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.408+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=XEROZ4SG531Z tag=FTUPFQ1GAR1T type=write size=1326809 2024-09-14T11:17:44.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.410+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~2S244F43OM39.0 size=1048576 2024-09-14T11:17:44.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.411+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~2S244F43OM39.1 size=415102 2024-09-14T11:17:44.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.411+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=2S244F43OM39 tag=V12KISH09800 type=write size=2512254 2024-09-14T11:17:44.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.413+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~CEC9VUMJSGX8.0 size=1048576 2024-09-14T11:17:44.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.413+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~CEC9VUMJSGX8.1 size=608315 2024-09-14T11:17:44.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.415+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=CEC9VUMJSGX8 tag=FN27T8GY79A6 type=write size=2705467 2024-09-14T11:17:44.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.417+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=RBAC8PU52PPM type=del size=93429 2024-09-14T11:17:44.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.418+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~15HQ8FHV7IZ1.0 size=939081 2024-09-14T11:17:44.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.420+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=15HQ8FHV7IZ1 tag=TRKLWJWFED5U type=write size=1987657 2024-09-14T11:17:44.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.421+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=QI5IZQ56Z0FT type=del size=2292617 2024-09-14T11:17:44.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.422+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=9ZOMGTBSJ1M6 type=del 2024-09-14T11:17:44.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.424+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HVS7WBX1SQJ5.0 size=1048576 2024-09-14T11:17:44.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.425+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HVS7WBX1SQJ5.1 size=224578 2024-09-14T11:17:44.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.425+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=HVS7WBX1SQJ5 tag=0M0PNPGG6DWI type=write size=2321730 2024-09-14T11:17:44.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.427+0000 7f1be8076780 1 < suggested remove operation key=4AY6ZXFKO1YQ tag=GIG0E84LEEFZ type=del 2024-09-14T11:17:44.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.429+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=P1KP38773HLV type=del size=1074563 2024-09-14T11:17:44.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.430+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=4JRC7QGQODAH type=del 2024-09-14T11:17:44.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.431+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=DJKR1HW9H86T type=del size=381171 2024-09-14T11:17:44.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.432+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~TW8Y4YVZ5WMM.0 size=1048576 2024-09-14T11:17:44.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.433+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~TW8Y4YVZ5WMM.1 size=418473 2024-09-14T11:17:44.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.435+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=TW8Y4YVZ5WMM tag=BL3SSEC9ITVA type=write size=2515625 2024-09-14T11:17:44.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.436+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=RKM0SO2V16HZ type=del size=3280294 2024-09-14T11:17:44.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.438+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=6WE5TD5NE1B7 type=del 2024-09-14T11:17:44.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.439+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=LFRPGL7QHIIC type=del size=297619 2024-09-14T11:17:44.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.441+0000 7f1be8076780 1 < suggested remove operation key=UB0SEYZ7ITU1 tag=CNRYW78IZHWU type=del 2024-09-14T11:17:44.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.444+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~DIKFM858J82C.0 size=1048576 2024-09-14T11:17:44.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.444+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~DIKFM858J82C.1 size=990863 2024-09-14T11:17:44.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.444+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=DIKFM858J82C tag=EFBKDMT63NJN type=write size=3088015 2024-09-14T11:17:44.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.446+0000 7f1be8076780 1 < completed write operation key=JQZ7C562TQ8D tag=FI0GE5EF6O66 type=write size=1026335 2024-09-14T11:17:44.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.448+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~RMZITBFWE540.0 size=1048576 2024-09-14T11:17:44.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.449+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~RMZITBFWE540.1 size=582622 2024-09-14T11:17:44.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.449+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=RMZITBFWE540 tag=WD958E2Y44FQ type=write size=2679774 2024-09-14T11:17:44.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.451+0000 7f1be8076780 1 < suggested update operation key=T70EFGHRQZQ7 tag=IBZDT69F6PKV type=del size=181967 2024-09-14T11:17:44.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.452+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=WSJ23UMZS3FM type=del size=1537016 2024-09-14T11:17:44.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.453+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.0 size=1048576 2024-09-14T11:17:44.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.454+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.1 size=1048576 2024-09-14T11:17:44.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.454+0000 7f1be8076780 1 < canceled part key=_multipart_4ADXXTIO715C.2~FA2DPRRIIX3O.2 size=792315 2024-09-14T11:17:44.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.456+0000 7f1be8076780 1 < canceled multipart upload key=4ADXXTIO715C upload=FA2DPRRIIX3O tag=A6NRCUNE523T type=write size=3938043 2024-09-14T11:17:44.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.459+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~L3HFGWE0198H.0 size=1048576 2024-09-14T11:17:44.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.459+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~L3HFGWE0198H.1 size=259252 2024-09-14T11:17:44.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.459+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=L3HFGWE0198H tag=71I70OAGJOQN type=write size=2356404 2024-09-14T11:17:44.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.461+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=9Q5GVIVUVSIH type=del 2024-09-14T11:17:44.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.462+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=BK19Z7P3QD58 type=del size=2539903 2024-09-14T11:17:44.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.463+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~2EHV178CR9SN.0 size=900604 2024-09-14T11:17:44.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.465+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=2EHV178CR9SN tag=N0JSFFRS9PII type=write size=1949180 2024-09-14T11:17:44.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.467+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.0 size=1048576 2024-09-14T11:17:44.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.468+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.1 size=1048576 2024-09-14T11:17:44.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.469+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.2 size=460227 2024-09-14T11:17:44.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.469+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=GSQZB1WVVGWF tag=BSMUOY2SMGBA type=write size=3605955 2024-09-14T11:17:44.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.471+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=LK6JZOGUM3FP type=del 2024-09-14T11:17:44.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.472+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=NLASBURX78GL type=del size=284786 2024-09-14T11:17:44.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.474+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~HDHZ8E2619C7.0 size=1048576 2024-09-14T11:17:44.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.475+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~HDHZ8E2619C7.1 size=391228 2024-09-14T11:17:44.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.477+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=HDHZ8E2619C7 tag=1GRZM6OMOXV7 type=write size=2488380 2024-09-14T11:17:44.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.478+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=F30KQYTV3NP3 type=write size=25323 2024-09-14T11:17:44.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.479+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~2S244F43OM39.0 size=1048576 2024-09-14T11:17:44.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.480+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~2S244F43OM39.1 size=415102 2024-09-14T11:17:44.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.482+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=2S244F43OM39 tag=V12KISH09800 type=write size=2512254 2024-09-14T11:17:44.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.483+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=2HWHT27AXP6O type=del size=754289 2024-09-14T11:17:44.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.485+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=RBAC8PU52PPM type=del 2024-09-14T11:17:44.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.486+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=EKTN2CNFJB6B type=del size=2730938 2024-09-14T11:17:44.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.487+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=QI5IZQ56Z0FT type=del 2024-09-14T11:17:44.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.488+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=H3VKOCCZ4AL6 type=del size=2569799 2024-09-14T11:17:44.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.490+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HVS7WBX1SQJ5.0 size=1048576 2024-09-14T11:17:44.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.491+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HVS7WBX1SQJ5.1 size=224578 2024-09-14T11:17:44.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.493+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=HVS7WBX1SQJ5 tag=0M0PNPGG6DWI type=write size=2321730 2024-09-14T11:17:44.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.495+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.0 size=1048576 2024-09-14T11:17:44.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.496+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.1 size=1048576 2024-09-14T11:17:44.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.497+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.2 size=205693 2024-09-14T11:17:44.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.497+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=5LZHUKM064DW tag=VT6O4U3E6XLX type=write size=3351421 2024-09-14T11:17:44.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.499+0000 7f1be8076780 1 < suggested remove operation key=9DRSDTGM7Y3F tag=P1KP38773HLV type=del 2024-09-14T11:17:44.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.501+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=FMNRPLQDVDNF type=del size=1572095 2024-09-14T11:17:44.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.503+0000 7f1be8076780 1 < suggested remove operation key=1X2EWK1Y2GE0 tag=DJKR1HW9H86T type=del 2024-09-14T11:17:44.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.505+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.0 size=1048576 2024-09-14T11:17:44.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.506+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.1 size=1048576 2024-09-14T11:17:44.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.507+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.2 size=312898 2024-09-14T11:17:44.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.507+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=HZAM8VV8UVHZ tag=G25UQZWJN5WS type=write size=3458626 2024-09-14T11:17:44.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.509+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=RKM0SO2V16HZ type=del 2024-09-14T11:17:44.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.511+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~H4RUS2O7PG1X.0 size=1048576 2024-09-14T11:17:44.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.512+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~H4RUS2O7PG1X.1 size=105929 2024-09-14T11:17:44.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.512+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=H4RUS2O7PG1X tag=V0K70PTQKO37 type=write size=2203081 2024-09-14T11:17:44.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.513+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=LFRPGL7QHIIC type=del 2024-09-14T11:17:44.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.514+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=MDYT6K5CXGOU type=del size=537340 2024-09-14T11:17:44.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.516+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~DIKFM858J82C.0 size=1048576 2024-09-14T11:17:44.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.516+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~DIKFM858J82C.1 size=990863 2024-09-14T11:17:44.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.518+0000 7f1be8076780 1 < canceled multipart upload key=0BX70Q8C1QL0 upload=DIKFM858J82C tag=EFBKDMT63NJN type=write size=3088015 2024-09-14T11:17:44.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.521+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.0 size=1048576 2024-09-14T11:17:44.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.522+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.1 size=1048576 2024-09-14T11:17:44.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.523+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.2 size=154920 2024-09-14T11:17:44.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.523+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=Q1QKFM6UN2P7 tag=A6DACGEGGIX5 type=write size=3300648 2024-09-14T11:17:44.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.524+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~RMZITBFWE540.0 size=1048576 2024-09-14T11:17:44.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.525+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~RMZITBFWE540.1 size=582622 2024-09-14T11:17:44.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.527+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=RMZITBFWE540 tag=WD958E2Y44FQ type=write size=2679774 2024-09-14T11:17:44.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.528+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=8Q5WMBJ1EQBE type=del size=3217577 2024-09-14T11:17:44.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.529+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=WSJ23UMZS3FM type=del 2024-09-14T11:17:44.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.531+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~OEERI8GNW5XK.0 size=1048576 2024-09-14T11:17:44.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.532+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~OEERI8GNW5XK.1 size=467163 2024-09-14T11:17:44.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.532+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=OEERI8GNW5XK tag=OHQ6VRE7XDW0 type=write size=2564315 2024-09-14T11:17:44.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.533+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~L3HFGWE0198H.0 size=1048576 2024-09-14T11:17:44.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.534+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~L3HFGWE0198H.1 size=259252 2024-09-14T11:17:44.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.536+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=L3HFGWE0198H tag=71I70OAGJOQN type=write size=2356404 2024-09-14T11:17:44.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.537+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=658CPOF80VW2 type=del size=2771502 2024-09-14T11:17:44.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.539+0000 7f1be8076780 -1 < failed to complete operation key=AUCQC0OBQP7Z tag=BK19Z7P3QD58 type=del size=2539903: (22) Invalid argument 2024-09-14T11:17:44.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.541+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~BID2C0ZJH4D0.0 size=528776 2024-09-14T11:17:44.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.541+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=BID2C0ZJH4D0 tag=BRVMD9KB4AWI type=write size=1577352 2024-09-14T11:17:44.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.542+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.0 size=1048576 2024-09-14T11:17:44.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.543+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.1 size=1048576 2024-09-14T11:17:44.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.544+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~GSQZB1WVVGWF.2 size=460227 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.546+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=GSQZB1WVVGWF tag=BSMUOY2SMGBA type=write size=3605955 2024-09-14T11:17:44.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.547+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=FPED41F181YV type=del size=2001347 2024-09-14T11:17:44.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.548+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=NLASBURX78GL type=del 2024-09-14T11:17:44.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.549+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=BJ5XA11VZX3H type=write size=1028974 2024-09-14T11:17:44.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.552+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=F30KQYTV3NP3 type=write size=25323 2024-09-14T11:17:44.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.554+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.0 size=1048576 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.555+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.1 size=1048576 2024-09-14T11:17:44.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.556+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.2 size=903045 2024-09-14T11:17:44.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.556+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=6UAE12M1S6FF tag=YUFT0DE4BHP2 type=write size=4048773 2024-09-14T11:17:44.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.558+0000 7f1be8076780 1 < suggested update operation key=MX5J0P18BM0D tag=2HWHT27AXP6O type=del size=754289 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.560+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~G9AMCZWPNGDJ.0 size=945757 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.560+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=G9AMCZWPNGDJ tag=WT1EWRJQ42B4 type=write size=1994333 2024-09-14T11:17:44.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.561+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=EKTN2CNFJB6B type=del 2024-09-14T11:17:44.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.563+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~LZKXIIAC4RSW.0 size=1048576 2024-09-14T11:17:44.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.564+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~LZKXIIAC4RSW.1 size=167911 2024-09-14T11:17:44.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.564+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=LZKXIIAC4RSW tag=KLM89GTIUO32 type=write size=2265063 2024-09-14T11:17:44.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.565+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=H3VKOCCZ4AL6 type=del 2024-09-14T11:17:44.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.567+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~G3C43MMBDANZ.0 size=1048576 2024-09-14T11:17:44.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.568+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~G3C43MMBDANZ.1 size=823510 2024-09-14T11:17:44.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.568+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=G3C43MMBDANZ tag=SG0306G3E09V type=write size=2920662 2024-09-14T11:17:44.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.569+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.0 size=1048576 2024-09-14T11:17:44.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.570+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.1 size=1048576 2024-09-14T11:17:44.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.571+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~5LZHUKM064DW.2 size=205693 2024-09-14T11:17:44.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.572+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=5LZHUKM064DW tag=VT6O4U3E6XLX type=write size=3351421 2024-09-14T11:17:44.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.575+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~KXTMOXK4WAUI.0 size=1048576 2024-09-14T11:17:44.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.575+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~KXTMOXK4WAUI.1 size=71056 2024-09-14T11:17:44.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.575+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=KXTMOXK4WAUI tag=0P2KYGHZA6CQ type=write size=2168208 2024-09-14T11:17:44.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.578+0000 7f1be8076780 1 < suggested remove operation key=9DRSDTGM7Y3F tag=FMNRPLQDVDNF type=del 2024-09-14T11:17:44.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.579+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=J9C8OWB40HXD type=write size=926358 2024-09-14T11:17:44.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.580+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.0 size=1048576 2024-09-14T11:17:44.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.580+0000 7f1be8076780 1 < canceled part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.1 size=1048576 2024-09-14T11:17:44.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.581+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~HZAM8VV8UVHZ.2 size=312898 2024-09-14T11:17:44.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.583+0000 7f1be8076780 1 < canceled multipart upload key=JQZ7C562TQ8D upload=HZAM8VV8UVHZ tag=G25UQZWJN5WS type=write size=3458626 2024-09-14T11:17:44.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.584+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=NA6KHK1LJ1E1 type=del size=3621545 2024-09-14T11:17:44.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.585+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~H4RUS2O7PG1X.0 size=1048576 2024-09-14T11:17:44.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.586+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~H4RUS2O7PG1X.1 size=105929 2024-09-14T11:17:44.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.588+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=H4RUS2O7PG1X tag=V0K70PTQKO37 type=write size=2203081 2024-09-14T11:17:44.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.590+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.0 size=1048576 2024-09-14T11:17:44.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.591+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.1 size=1048576 2024-09-14T11:17:44.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.591+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.2 size=705628 2024-09-14T11:17:44.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.591+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=JFMSJXNCV9F6 tag=JLRDBZ4YLGOC type=write size=3851356 2024-09-14T11:17:44.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.593+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=MDYT6K5CXGOU type=del 2024-09-14T11:17:44.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.595+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~17AHE49ZSB5C.0 size=1048576 2024-09-14T11:17:44.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.596+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~17AHE49ZSB5C.1 size=816022 2024-09-14T11:17:44.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.596+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=17AHE49ZSB5C tag=8HXPN92KC2BG type=write size=2913174 2024-09-14T11:17:44.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.597+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.0 size=1048576 2024-09-14T11:17:44.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.598+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.1 size=1048576 2024-09-14T11:17:44.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.599+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~Q1QKFM6UN2P7.2 size=154920 2024-09-14T11:17:44.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.601+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=Q1QKFM6UN2P7 tag=A6DACGEGGIX5 type=write size=3300648 2024-09-14T11:17:44.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.602+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=0TE8B9Y2R5HS type=del size=1003964 2024-09-14T11:17:44.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.604+0000 7f1be8076780 1 < suggested update operation key=T70EFGHRQZQ7 tag=8Q5WMBJ1EQBE type=del size=3217577 2024-09-14T11:17:44.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.605+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=PBUIM8VD5CHY type=del size=724488 2024-09-14T11:17:44.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.606+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~OEERI8GNW5XK.0 size=1048576 2024-09-14T11:17:44.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.607+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~OEERI8GNW5XK.1 size=467163 2024-09-14T11:17:44.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.609+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=OEERI8GNW5XK tag=OHQ6VRE7XDW0 type=write size=2564315 2024-09-14T11:17:44.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.611+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~F4G9W19ZYFP2.0 size=1048576 2024-09-14T11:17:44.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.612+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~F4G9W19ZYFP2.1 size=471103 2024-09-14T11:17:44.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.612+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=F4G9W19ZYFP2 tag=7X8AN5ZU6TQO type=write size=2568255 2024-09-14T11:17:44.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.614+0000 7f1be8076780 1 < suggested update operation key=SJES17ZIGRZE tag=658CPOF80VW2 type=del size=2771502 2024-09-14T11:17:44.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.616+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.0 size=1048576 2024-09-14T11:17:44.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.617+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.1 size=1048576 2024-09-14T11:17:44.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.618+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.2 size=358748 2024-09-14T11:17:44.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.618+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=4KN1I29RYHIP tag=BP5TK4D1EYKV type=write size=3504476 2024-09-14T11:17:44.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.619+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~BID2C0ZJH4D0.0 size=528776 2024-09-14T11:17:44.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.622+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=BID2C0ZJH4D0 tag=BRVMD9KB4AWI type=write size=1577352 2024-09-14T11:17:44.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.623+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=BNVI3YRY6NX7 type=del size=2871232 2024-09-14T11:17:44.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.624+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=FPED41F181YV type=del 2024-09-14T11:17:44.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.626+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~HVT6F9J8CZGO.0 size=1048576 2024-09-14T11:17:44.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.627+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~HVT6F9J8CZGO.1 size=525954 2024-09-14T11:17:44.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.627+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=HVT6F9J8CZGO tag=7LXY5W1R95AG type=write size=2623106 2024-09-14T11:17:44.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.628+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=BJ5XA11VZX3H type=write size=1028974 2024-09-14T11:17:44.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.629+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=0RCKTR7Z71CI type=del size=3273504 2024-09-14T11:17:44.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.630+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.0 size=1048576 2024-09-14T11:17:44.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.631+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.1 size=1048576 2024-09-14T11:17:44.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.632+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~6UAE12M1S6FF.2 size=903045 2024-09-14T11:17:44.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.634+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=6UAE12M1S6FF tag=YUFT0DE4BHP2 type=write size=4048773 2024-09-14T11:17:44.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.635+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=DGKAJP5DBGSY type=del size=180767 2024-09-14T11:17:44.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.636+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~G9AMCZWPNGDJ.0 size=945757 2024-09-14T11:17:44.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.638+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=G9AMCZWPNGDJ tag=WT1EWRJQ42B4 type=write size=1994333 2024-09-14T11:17:44.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.639+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=724KJQFNLQ6Y type=del size=1481428 2024-09-14T11:17:44.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.640+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~LZKXIIAC4RSW.0 size=1048576 2024-09-14T11:17:44.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.641+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~LZKXIIAC4RSW.1 size=167911 2024-09-14T11:17:44.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.642+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=LZKXIIAC4RSW tag=KLM89GTIUO32 type=write size=2265063 2024-09-14T11:17:44.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.644+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.0 size=1048576 2024-09-14T11:17:44.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.645+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.1 size=1048576 2024-09-14T11:17:44.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.646+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.2 size=842570 2024-09-14T11:17:44.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.646+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=C0MAZH8HKSLX tag=FICL3PB6159Y type=write size=3988298 2024-09-14T11:17:44.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.647+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~G3C43MMBDANZ.0 size=1048576 2024-09-14T11:17:44.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.648+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~G3C43MMBDANZ.1 size=823510 2024-09-14T11:17:44.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.650+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=G3C43MMBDANZ tag=SG0306G3E09V type=write size=2920662 2024-09-14T11:17:44.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.652+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.0 size=1048576 2024-09-14T11:17:44.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.653+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.1 size=1048576 2024-09-14T11:17:44.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.653+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.2 size=532586 2024-09-14T11:17:44.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.653+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=8H7KGGBX83C2 tag=1IUI6WU2E2KO type=write size=3678314 2024-09-14T11:17:44.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.655+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~KXTMOXK4WAUI.0 size=1048576 2024-09-14T11:17:44.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.656+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~KXTMOXK4WAUI.1 size=71056 2024-09-14T11:17:44.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.658+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=KXTMOXK4WAUI tag=0P2KYGHZA6CQ type=write size=2168208 2024-09-14T11:17:44.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.660+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=5WV83DJN0GXL type=del size=1944403 2024-09-14T11:17:44.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.663+0000 7f1be8076780 1 < suggested remove operation key=3Z71PEWG5UMA tag=J9C8OWB40HXD type=write 2024-09-14T11:17:44.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.665+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.0 size=1048576 2024-09-14T11:17:44.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.666+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.1 size=1048576 2024-09-14T11:17:44.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.667+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.2 size=5684 2024-09-14T11:17:44.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.667+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=DD808L3AARY6 tag=UQ5A2EXPHL6Z type=write size=3151412 2024-09-14T11:17:44.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.668+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=NA6KHK1LJ1E1 type=del 2024-09-14T11:17:44.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.669+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=4YV94DNOFO54 type=del size=136467 2024-09-14T11:17:44.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.671+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.0 size=1048576 2024-09-14T11:17:44.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.672+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.1 size=1048576 2024-09-14T11:17:44.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.673+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~JFMSJXNCV9F6.2 size=705628 2024-09-14T11:17:44.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.675+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=JFMSJXNCV9F6 tag=JLRDBZ4YLGOC type=write size=3851356 2024-09-14T11:17:44.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.676+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=LO6YN6IG7VWM type=del size=3337809 2024-09-14T11:17:44.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.677+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~17AHE49ZSB5C.0 size=1048576 2024-09-14T11:17:44.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.678+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~17AHE49ZSB5C.1 size=816022 2024-09-14T11:17:44.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.680+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=17AHE49ZSB5C tag=8HXPN92KC2BG type=write size=2913174 2024-09-14T11:17:44.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.681+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=2E4M88E928K7 type=del size=476170 2024-09-14T11:17:44.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.683+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=0TE8B9Y2R5HS type=del 2024-09-14T11:17:44.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.685+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~3O4H5XBWB0NA.0 size=1048576 2024-09-14T11:17:44.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.686+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~3O4H5XBWB0NA.1 size=793600 2024-09-14T11:17:44.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.686+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=3O4H5XBWB0NA tag=T03KGGX7T0E9 type=write size=2890752 2024-09-14T11:17:44.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.687+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=PBUIM8VD5CHY type=del 2024-09-14T11:17:44.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.689+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=BFB9ZDWPZZSY type=write size=775113 2024-09-14T11:17:44.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.690+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~F4G9W19ZYFP2.0 size=1048576 2024-09-14T11:17:44.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.691+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~F4G9W19ZYFP2.1 size=471103 2024-09-14T11:17:44.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.693+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=F4G9W19ZYFP2 tag=7X8AN5ZU6TQO type=write size=2568255 2024-09-14T11:17:44.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.696+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.0 size=1048576 2024-09-14T11:17:44.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.697+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.1 size=1048576 2024-09-14T11:17:44.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.698+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.2 size=7697 2024-09-14T11:17:44.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.698+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=ZYW2F8DFY8J9 tag=QLMTWFIIXSXV type=write size=3153425 2024-09-14T11:17:44.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.699+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.0 size=1048576 2024-09-14T11:17:44.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.700+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.1 size=1048576 2024-09-14T11:17:44.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.701+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4KN1I29RYHIP.2 size=358748 2024-09-14T11:17:44.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.702+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=4KN1I29RYHIP tag=BP5TK4D1EYKV type=write size=3504476 2024-09-14T11:17:44.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.705+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~RS5PEVBQ891E.0 size=1048576 2024-09-14T11:17:44.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.706+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~RS5PEVBQ891E.1 size=674375 2024-09-14T11:17:44.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.706+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=RS5PEVBQ891E tag=19HEDES3HGG0 type=write size=2771527 2024-09-14T11:17:44.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.707+0000 7f1be8076780 1 < canceled operation key=4AY6ZXFKO1YQ tag=BNVI3YRY6NX7 type=del size=2871232 2024-09-14T11:17:44.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.708+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=ZCL9A2HEHFNN type=del size=723340 2024-09-14T11:17:44.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.709+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~HVT6F9J8CZGO.0 size=1048576 2024-09-14T11:17:44.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.710+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~HVT6F9J8CZGO.1 size=525954 2024-09-14T11:17:44.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.712+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=HVT6F9J8CZGO tag=7LXY5W1R95AG type=write size=2623106 2024-09-14T11:17:44.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.713+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=AL96CAX681J9 type=del size=740196 2024-09-14T11:17:44.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.715+0000 7f1be8076780 1 < suggested remove operation key=MX5J0P18BM0D tag=0RCKTR7Z71CI type=del 2024-09-14T11:17:44.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.717+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.0 size=1048576 2024-09-14T11:17:44.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.718+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.1 size=1048576 2024-09-14T11:17:44.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.719+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.2 size=183843 2024-09-14T11:17:44.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.719+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=7DT6B4KQ961J tag=LI4RANLQDBZG type=write size=3329571 2024-09-14T11:17:44.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.721+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=DGKAJP5DBGSY type=del 2024-09-14T11:17:44.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.722+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=OLZI1FFMRKJ1 type=del size=1721888 2024-09-14T11:17:44.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.723+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=724KJQFNLQ6Y type=del 2024-09-14T11:17:44.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.724+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=YTI67Z13S82N type=del size=197864 2024-09-14T11:17:44.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.725+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.0 size=1048576 2024-09-14T11:17:44.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.726+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.1 size=1048576 2024-09-14T11:17:44.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.728+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~C0MAZH8HKSLX.2 size=842570 2024-09-14T11:17:44.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.732+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=C0MAZH8HKSLX tag=FICL3PB6159Y type=write size=3988298 2024-09-14T11:17:44.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.733+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=9302Q6IHG34Z type=del size=1537758 2024-09-14T11:17:44.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.735+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.0 size=1048576 2024-09-14T11:17:44.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.736+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.1 size=1048576 2024-09-14T11:17:44.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.737+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~8H7KGGBX83C2.2 size=532586 2024-09-14T11:17:44.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.739+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=8H7KGGBX83C2 tag=1IUI6WU2E2KO type=write size=3678314 2024-09-14T11:17:44.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.740+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=CRUZ3TF31ZXH type=write size=584945 2024-09-14T11:17:44.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.741+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=5WV83DJN0GXL type=del 2024-09-14T11:17:44.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.743+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~VJTTO34N7D1P.0 size=1048576 2024-09-14T11:17:44.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.744+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~VJTTO34N7D1P.1 size=353533 2024-09-14T11:17:44.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.744+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=VJTTO34N7D1P tag=1MPD71PF121I type=write size=2450685 2024-09-14T11:17:44.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.745+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.0 size=1048576 2024-09-14T11:17:44.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.746+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.1 size=1048576 2024-09-14T11:17:44.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.746+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~DD808L3AARY6.2 size=5684 2024-09-14T11:17:44.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.748+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=DD808L3AARY6 tag=UQ5A2EXPHL6Z type=write size=3151412 2024-09-14T11:17:44.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.750+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~8SJ2QP8ZLWBG.0 size=1048576 2024-09-14T11:17:44.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.751+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~8SJ2QP8ZLWBG.1 size=914820 2024-09-14T11:17:44.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.751+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=8SJ2QP8ZLWBG tag=PWLQMMHTAXO0 type=write size=3011972 2024-09-14T11:17:44.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.752+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=4YV94DNOFO54 type=del 2024-09-14T11:17:44.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.754+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=P1DBAN7AMSA9 type=write size=219969 2024-09-14T11:17:44.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.755+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=LO6YN6IG7VWM type=del 2024-09-14T11:17:44.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.757+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=LD1GGWVYYMYE type=write size=507386 2024-09-14T11:17:44.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.759+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=2E4M88E928K7 type=del size=476170 2024-09-14T11:17:44.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.760+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=PVC5B3GQSROI type=del size=3967356 2024-09-14T11:17:44.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.762+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~3O4H5XBWB0NA.0 size=1048576 2024-09-14T11:17:44.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.762+0000 7f1be8076780 1 < canceled part key=_multipart_JIWPGHQ3GEZB.2~3O4H5XBWB0NA.1 size=793600 2024-09-14T11:17:44.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.764+0000 7f1be8076780 1 < canceled multipart upload key=JIWPGHQ3GEZB upload=3O4H5XBWB0NA tag=T03KGGX7T0E9 type=write size=2890752 2024-09-14T11:17:44.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.765+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=2UW8BU2BPAN3 type=write size=1015504 2024-09-14T11:17:44.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.768+0000 7f1be8076780 1 < suggested remove operation key=3Z71PEWG5UMA tag=BFB9ZDWPZZSY type=write 2024-09-14T11:17:44.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.769+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=M9OF5B81LJWR type=del size=251181 2024-09-14T11:17:44.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.770+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.0 size=1048576 2024-09-14T11:17:44.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.771+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.1 size=1048576 2024-09-14T11:17:44.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.772+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~ZYW2F8DFY8J9.2 size=7697 2024-09-14T11:17:44.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.774+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=ZYW2F8DFY8J9 tag=QLMTWFIIXSXV type=write size=3153425 2024-09-14T11:17:44.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.776+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=XUQ3QLEHRCR2 type=del size=2865317 2024-09-14T11:17:44.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.777+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~RS5PEVBQ891E.0 size=1048576 2024-09-14T11:17:44.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.778+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~RS5PEVBQ891E.1 size=674375 2024-09-14T11:17:44.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.780+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=RS5PEVBQ891E tag=19HEDES3HGG0 type=write size=2771527 2024-09-14T11:17:44.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.781+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=BB1W2I3FL8DP type=del size=1478265 2024-09-14T11:17:44.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.782+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=ZCL9A2HEHFNN type=del 2024-09-14T11:17:44.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.784+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~DPRTOGUYN0RW.0 size=752825 2024-09-14T11:17:44.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.784+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=DPRTOGUYN0RW tag=LLF61X57LMM2 type=write size=1801401 2024-09-14T11:17:44.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.786+0000 7f1be8076780 1 < suggested remove operation key=QIEUKUQ8CS2U tag=AL96CAX681J9 type=del 2024-09-14T11:17:44.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.788+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=RBMNF2CYVIE2 type=write size=893712 2024-09-14T11:17:44.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.789+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.0 size=1048576 2024-09-14T11:17:44.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.790+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.1 size=1048576 2024-09-14T11:17:44.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.791+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~7DT6B4KQ961J.2 size=183843 2024-09-14T11:17:44.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.793+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=7DT6B4KQ961J tag=LI4RANLQDBZG type=write size=3329571 2024-09-14T11:17:44.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.794+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=TZ47RH1ICNCJ type=del size=4100119 2024-09-14T11:17:44.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.795+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=OLZI1FFMRKJ1 type=del 2024-09-14T11:17:44.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.796+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=2488DWE5DWES type=del size=3369708 2024-09-14T11:17:44.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.797+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=YTI67Z13S82N type=del 2024-09-14T11:17:44.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.798+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=WSFGAMNPDP8Q type=del size=2327005 2024-09-14T11:17:44.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.799+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=9302Q6IHG34Z type=del 2024-09-14T11:17:44.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.801+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~ZH5W0COD5SXU.0 size=926651 2024-09-14T11:17:44.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.801+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=ZH5W0COD5SXU tag=VBO1JAVGC06G type=write size=1975227 2024-09-14T11:17:44.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.803+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=CRUZ3TF31ZXH type=write size=584945 2024-09-14T11:17:44.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.804+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=G29QRPU43V8X type=del size=194334 2024-09-14T11:17:44.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.805+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~VJTTO34N7D1P.0 size=1048576 2024-09-14T11:17:44.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.806+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~VJTTO34N7D1P.1 size=353533 2024-09-14T11:17:44.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.808+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=VJTTO34N7D1P tag=1MPD71PF121I type=write size=2450685 2024-09-14T11:17:44.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.809+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=EUC6V5L2O1A6 type=del size=775951 2024-09-14T11:17:44.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.810+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~8SJ2QP8ZLWBG.0 size=1048576 2024-09-14T11:17:44.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.811+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~8SJ2QP8ZLWBG.1 size=914820 2024-09-14T11:17:44.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.813+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=8SJ2QP8ZLWBG tag=PWLQMMHTAXO0 type=write size=3011972 2024-09-14T11:17:44.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.815+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~0XSSKY2CZMA6.0 size=1048576 2024-09-14T11:17:44.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.816+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~0XSSKY2CZMA6.1 size=318180 2024-09-14T11:17:44.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.816+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=0XSSKY2CZMA6 tag=8HBIV0ZPLXNS type=write size=2415332 2024-09-14T11:17:44.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.817+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=P1DBAN7AMSA9 type=write size=219969 2024-09-14T11:17:44.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.819+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~1ZFIN83KR7ST.0 size=1048576 2024-09-14T11:17:44.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.820+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~1ZFIN83KR7ST.1 size=1002622 2024-09-14T11:17:44.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.820+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=1ZFIN83KR7ST tag=QZZ7G42SCZH9 type=write size=3099774 2024-09-14T11:17:44.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.821+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=LD1GGWVYYMYE type=write size=507386 2024-09-14T11:17:44.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.824+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~47O251VMVGQR.0 size=1048576 2024-09-14T11:17:44.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.824+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~47O251VMVGQR.1 size=691106 2024-09-14T11:17:44.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.824+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=47O251VMVGQR tag=PY14KCOTP7TT type=write size=2788258 2024-09-14T11:17:44.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.826+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=PVC5B3GQSROI type=del size=3967356 2024-09-14T11:17:44.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.828+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~RIIJZ2ENC7PA.0 size=1009558 2024-09-14T11:17:44.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.828+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=RIIJZ2ENC7PA tag=R80KB7CQYI3A type=write size=2058134 2024-09-14T11:17:44.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.829+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=2UW8BU2BPAN3 type=write size=1015504 2024-09-14T11:17:44.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.831+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.0 size=1048576 2024-09-14T11:17:44.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.834+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.1 size=1048576 2024-09-14T11:17:44.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.835+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.2 size=12860 2024-09-14T11:17:44.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.835+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=QI6EXKAH3WEY tag=CUCRO5O9IZP7 type=write size=3158588 2024-09-14T11:17:44.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.836+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=M9OF5B81LJWR type=del size=251181 2024-09-14T11:17:44.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.838+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~BRI31TQF5LYX.0 size=238505 2024-09-14T11:17:44.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.838+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=BRI31TQF5LYX tag=PFDCUXEPUVZR type=write size=1287081 2024-09-14T11:17:44.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.839+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=XUQ3QLEHRCR2 type=del 2024-09-14T11:17:44.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.840+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=B56STLC8TG0H type=del size=2556719 2024-09-14T11:17:44.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.842+0000 7f1be8076780 1 < canceled operation key=1X2EWK1Y2GE0 tag=BB1W2I3FL8DP type=del size=1478265 2024-09-14T11:17:44.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.845+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.0 size=1048576 2024-09-14T11:17:44.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.847+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.1 size=1048576 2024-09-14T11:17:44.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.848+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.2 size=893480 2024-09-14T11:17:44.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.848+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=0DEMDMMG3QNX tag=7D5WX6DO8OY0 type=write size=4039208 2024-09-14T11:17:44.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.849+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~DPRTOGUYN0RW.0 size=752825 2024-09-14T11:17:44.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.851+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=DPRTOGUYN0RW tag=LLF61X57LMM2 type=write size=1801401 2024-09-14T11:17:44.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.853+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~HFWRJ5CU352L.0 size=1048576 2024-09-14T11:17:44.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.854+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~HFWRJ5CU352L.1 size=427320 2024-09-14T11:17:44.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.854+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=HFWRJ5CU352L tag=LCJA66DK5RXZ type=write size=2524472 2024-09-14T11:17:44.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.856+0000 7f1be8076780 1 < canceled operation key=AUCQC0OBQP7Z tag=RBMNF2CYVIE2 type=write size=893712 2024-09-14T11:17:44.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.858+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~58UYH6HR8AU5.0 size=1048205 2024-09-14T11:17:44.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.858+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=58UYH6HR8AU5 tag=RHPX21L4NT0Z type=write size=2096781 2024-09-14T11:17:44.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.859+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=TZ47RH1ICNCJ type=del 2024-09-14T11:17:44.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.861+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=K0QN5GA0IO7P type=del size=3578324 2024-09-14T11:17:44.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.862+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=2488DWE5DWES type=del 2024-09-14T11:17:44.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.864+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.0 size=1048576 2024-09-14T11:17:44.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.865+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.1 size=1048576 2024-09-14T11:17:44.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.866+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.2 size=1041343 2024-09-14T11:17:44.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.866+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=23WHYOK66Z23 tag=LGIOR1O3I17X type=write size=4187071 2024-09-14T11:17:44.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.868+0000 7f1be8076780 1 < suggested remove operation key=MX5J0P18BM0D tag=WSFGAMNPDP8Q type=del 2024-09-14T11:17:44.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.869+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=WD6QADW5W162 type=del size=4068835 2024-09-14T11:17:44.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.870+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~ZH5W0COD5SXU.0 size=926651 2024-09-14T11:17:44.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.872+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=ZH5W0COD5SXU tag=VBO1JAVGC06G type=write size=1975227 2024-09-14T11:17:44.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.874+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~E16DNHR9CJIH.0 size=539983 2024-09-14T11:17:44.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.874+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=E16DNHR9CJIH tag=OAX9FL0OO36D type=write size=1588559 2024-09-14T11:17:44.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.875+0000 7f1be8076780 1 < canceled operation key=JIWPGHQ3GEZB tag=G29QRPU43V8X type=del size=194334 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.876+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=CD1R80YUR1YU type=write size=468521 2024-09-14T11:17:44.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.877+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=EUC6V5L2O1A6 type=del 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.879+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~70FRGLAMXM5M.0 size=183450 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.879+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=70FRGLAMXM5M tag=GFU9OMCY76W5 type=write size=1232026 2024-09-14T11:17:44.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.880+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~0XSSKY2CZMA6.0 size=1048576 2024-09-14T11:17:44.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.881+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~0XSSKY2CZMA6.1 size=318180 2024-09-14T11:17:44.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.883+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=0XSSKY2CZMA6 tag=8HBIV0ZPLXNS type=write size=2415332 2024-09-14T11:17:44.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.884+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=3RXQIIMLXQVM type=del size=264128 2024-09-14T11:17:44.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.885+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~1ZFIN83KR7ST.0 size=1048576 2024-09-14T11:17:44.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.886+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~1ZFIN83KR7ST.1 size=1002622 2024-09-14T11:17:44.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.888+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=1ZFIN83KR7ST tag=QZZ7G42SCZH9 type=write size=3099774 2024-09-14T11:17:44.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.890+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=0DMPPH9Z8J57 type=del size=2129178 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.891+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~47O251VMVGQR.0 size=1048576 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.891+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~47O251VMVGQR.1 size=691106 2024-09-14T11:17:44.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.893+0000 7f1be8076780 1 < canceled multipart upload key=MX5J0P18BM0D upload=47O251VMVGQR tag=PY14KCOTP7TT type=write size=2788258 2024-09-14T11:17:44.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.894+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=WC7JVT0BZI2O type=write size=233804 2024-09-14T11:17:44.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.895+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~RIIJZ2ENC7PA.0 size=1009558 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.897+0000 7f1be8076780 1 < canceled multipart upload key=JCDSP32N5C7M upload=RIIJZ2ENC7PA tag=R80KB7CQYI3A type=write size=2058134 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.899+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TEG177ITCP95.0 size=1048576 2024-09-14T11:17:44.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.900+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TEG177ITCP95.1 size=1048576 2024-09-14T11:17:44.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.901+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TEG177ITCP95.2 size=784109 2024-09-14T11:17:44.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.901+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=TEG177ITCP95 tag=C1ZNCUC307X8 type=write size=3929837 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.902+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.0 size=1048576 2024-09-14T11:17:44.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.903+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.1 size=1048576 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.904+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QI6EXKAH3WEY.2 size=12860 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.906+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=QI6EXKAH3WEY tag=CUCRO5O9IZP7 type=write size=3158588 2024-09-14T11:17:44.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.908+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.0 size=1048576 2024-09-14T11:17:44.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.909+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.1 size=1048576 2024-09-14T11:17:44.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.910+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.2 size=237940 2024-09-14T11:17:44.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.910+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=9WIGIKNL1JUE tag=WU0RASGI07Z5 type=write size=3383668 2024-09-14T11:17:44.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.911+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~BRI31TQF5LYX.0 size=238505 2024-09-14T11:17:44.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.915+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=BRI31TQF5LYX tag=PFDCUXEPUVZR type=write size=1287081 2024-09-14T11:17:44.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.917+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=0LK4XQMD0XW6 type=del size=2689654 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.920+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=B56STLC8TG0H type=del 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.930+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.0 size=1048576 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.931+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.1 size=1048576 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.933+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.2 size=332530 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.933+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=8ADGU6HEIM3R tag=9AZN3H3KYX8U type=write size=3478258 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.934+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.0 size=1048576 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.934+0000 7f1be8076780 1 < canceled part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.1 size=1048576 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.935+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0DEMDMMG3QNX.2 size=893480 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.937+0000 7f1be8076780 1 < canceled multipart upload key=UB0SEYZ7ITU1 upload=0DEMDMMG3QNX tag=7D5WX6DO8OY0 type=write size=4039208 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.940+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~4C7J289JWZ0N.0 size=361794 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.940+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=4C7J289JWZ0N tag=IEVMC4TP8P8W type=write size=1410370 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.941+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~HFWRJ5CU352L.0 size=1048576 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.942+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~HFWRJ5CU352L.1 size=427320 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.944+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=HFWRJ5CU352L tag=LCJA66DK5RXZ type=write size=2524472 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.946+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~T5Z8O0GTMUC4.0 size=467218 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.946+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=T5Z8O0GTMUC4 tag=OEC91OYRH0BC type=write size=1515794 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.946+0000 7f1be8076780 1 < canceled part key=_multipart_RIYGSRWKVKFF.2~58UYH6HR8AU5.0 size=1048205 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.948+0000 7f1be8076780 1 < canceled multipart upload key=RIYGSRWKVKFF upload=58UYH6HR8AU5 tag=RHPX21L4NT0Z type=write size=2096781 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.949+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=1SUL71Q305SS type=del size=1775607 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.952+0000 7f1be8076780 1 < suggested update operation key=4ADXXTIO715C tag=K0QN5GA0IO7P type=del size=3578324 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.954+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~16D7OSX0Y7JW.0 size=583702 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.954+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=16D7OSX0Y7JW tag=Q0RVGOEHSAAQ type=write size=1632278 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.955+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.0 size=1048576 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.957+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.1 size=1048576 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.957+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~23WHYOK66Z23.2 size=1041343 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.959+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=23WHYOK66Z23 tag=LGIOR1O3I17X type=write size=4187071 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.961+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~66OUY3T58JUH.0 size=1048576 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.963+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~66OUY3T58JUH.1 size=389012 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.963+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=66OUY3T58JUH tag=7VFHWA0ZI058 type=write size=2486164 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.964+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=WD6QADW5W162 type=del 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.967+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.0 size=1048576 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.968+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.1 size=1048576 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.969+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.2 size=492302 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.969+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=VG225DN2ZSB5 tag=N12PTDCAE5FH type=write size=3638030 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.970+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~E16DNHR9CJIH.0 size=539983 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.972+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=E16DNHR9CJIH tag=OAX9FL0OO36D type=write size=1588559 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.973+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=GON6T8HCB5ID type=del size=1393967 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.975+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=CD1R80YUR1YU type=write size=468521 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.977+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~1X4BW492HGTB.0 size=842642 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.977+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=1X4BW492HGTB tag=NBEF46CA12HN type=write size=1891218 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.978+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~70FRGLAMXM5M.0 size=183450 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.980+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=70FRGLAMXM5M tag=GFU9OMCY76W5 type=write size=1232026 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.981+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=GIYVWBF6VF9G type=del size=1354679 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.982+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=3RXQIIMLXQVM type=del 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.983+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=XUEVUHVLC1YA type=del size=2690244 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.984+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=0DMPPH9Z8J57 type=del size=2129178 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.985+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=HCMY1E3NVWET type=del size=3128898 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.986+0000 7f1be8076780 1 < completed write operation key=QIEUKUQ8CS2U tag=WC7JVT0BZI2O type=write size=233804 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.988+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=BDS9N20IB0QE type=del size=2700173 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.989+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TEG177ITCP95.0 size=1048576 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.990+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TEG177ITCP95.1 size=1048576 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.990+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TEG177ITCP95.2 size=784109 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.993+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=TEG177ITCP95 tag=C1ZNCUC307X8 type=write size=3929837 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.994+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=3X9F6MG7LG2R type=write size=366213 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.995+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.0 size=1048576 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.996+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.1 size=1048576 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:44.997+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~9WIGIKNL1JUE.2 size=237940 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.000+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=9WIGIKNL1JUE tag=WU0RASGI07Z5 type=write size=3383668 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.001+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=1N3XGZ3HSL22 type=del size=256751 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.002+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=0LK4XQMD0XW6 type=del 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.003+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=3T24P4XCMCTT type=del size=3371328 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.005+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.0 size=1048576 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.005+0000 7f1be8076780 1 < canceled part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.1 size=1048576 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.006+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~8ADGU6HEIM3R.2 size=332530 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.008+0000 7f1be8076780 1 < canceled multipart upload key=3YIK6B6Y2EU1 upload=8ADGU6HEIM3R tag=9AZN3H3KYX8U type=write size=3478258 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.009+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=H4BPKZLPKSYN type=del size=673857 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.010+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~4C7J289JWZ0N.0 size=361794 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.013+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=4C7J289JWZ0N tag=IEVMC4TP8P8W type=write size=1410370 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.014+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=T31HGYWOFVQ1 type=del size=2083959 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.015+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~T5Z8O0GTMUC4.0 size=467218 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.017+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=T5Z8O0GTMUC4 tag=OEC91OYRH0BC type=write size=1515794 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.019+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=Y99VR7IRE1G3 type=del size=3442826 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.020+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=1SUL71Q305SS type=del 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.022+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.0 size=1048576 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.023+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.1 size=1048576 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.024+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.2 size=706172 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.024+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=0XLNNO2B62BU tag=B0CT2ZN8VI0A type=write size=3851900 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.026+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~16D7OSX0Y7JW.0 size=583702 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.027+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=16D7OSX0Y7JW tag=Q0RVGOEHSAAQ type=write size=1632278 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.030+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.0 size=1048576 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.030+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.1 size=1048576 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.031+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.2 size=588301 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.031+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=4RCZ7PT3NW13 tag=XO9D7AQPGRB7 type=write size=3734029 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.033+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~66OUY3T58JUH.0 size=1048576 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.034+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~66OUY3T58JUH.1 size=389012 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.036+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=66OUY3T58JUH tag=7VFHWA0ZI058 type=write size=2486164 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.038+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~KMDTAU4USZ96.0 size=1048576 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.039+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~KMDTAU4USZ96.1 size=731311 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.039+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=KMDTAU4USZ96 tag=DGUVQB104TMN type=write size=2828463 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.040+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.0 size=1048576 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.040+0000 7f1be8076780 1 < canceled part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.1 size=1048576 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.040+0000 7f1be8076780 1 < canceled part key=_multipart_UB0SEYZ7ITU1.2~VG225DN2ZSB5.2 size=492302 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.042+0000 7f1be8076780 1 < canceled multipart upload key=UB0SEYZ7ITU1 upload=VG225DN2ZSB5 tag=N12PTDCAE5FH type=write size=3638030 2024-09-14T11:17:45.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.045+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.0 size=1048576 2024-09-14T11:17:45.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.046+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.1 size=1048576 2024-09-14T11:17:45.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.046+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.2 size=260557 2024-09-14T11:17:45.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.046+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=YIBFB69NCRJW tag=1QOEGCA29DI0 type=write size=3406285 2024-09-14T11:17:45.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.048+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=GON6T8HCB5ID type=del 2024-09-14T11:17:45.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.050+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~0TQ1DM2P7UIR.0 size=1048576 2024-09-14T11:17:45.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.051+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~0TQ1DM2P7UIR.1 size=195105 2024-09-14T11:17:45.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.051+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=0TQ1DM2P7UIR tag=AG9085DGGRLH type=write size=2292257 2024-09-14T11:17:45.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.052+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~1X4BW492HGTB.0 size=842642 2024-09-14T11:17:45.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.054+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=1X4BW492HGTB tag=NBEF46CA12HN type=write size=1891218 2024-09-14T11:17:45.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.055+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=DVDLKC075Q2E type=del size=3906618 2024-09-14T11:17:45.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.056+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=GIYVWBF6VF9G type=del 2024-09-14T11:17:45.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.057+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=84Y06USOAV4G type=write size=62255 2024-09-14T11:17:45.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.058+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=XUEVUHVLC1YA type=del 2024-09-14T11:17:45.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.061+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~813PUGWD5BE0.0 size=1048576 2024-09-14T11:17:45.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.061+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~813PUGWD5BE0.1 size=951235 2024-09-14T11:17:45.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.061+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=813PUGWD5BE0 tag=EATQTT2DXTVD type=write size=3048387 2024-09-14T11:17:45.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.063+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=HCMY1E3NVWET type=del 2024-09-14T11:17:45.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.065+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=4MH9PK9VT1DQ type=del size=1172234 2024-09-14T11:17:45.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.066+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=BDS9N20IB0QE type=del size=2700173 2024-09-14T11:17:45.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.068+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=14XBF512HDJV type=del size=1111009 2024-09-14T11:17:45.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.070+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=3X9F6MG7LG2R type=write 2024-09-14T11:17:45.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.071+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=86KWR53DY2NM type=del size=588519 2024-09-14T11:17:45.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.072+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=1N3XGZ3HSL22 type=del 2024-09-14T11:17:45.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.074+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.0 size=1048576 2024-09-14T11:17:45.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.075+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.1 size=1048576 2024-09-14T11:17:45.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.076+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.2 size=881688 2024-09-14T11:17:45.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.076+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=YVEM6UGDDDJF tag=DRRKYXPRI7UO type=write size=4027416 2024-09-14T11:17:45.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.078+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=3T24P4XCMCTT type=del 2024-09-14T11:17:45.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.080+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=5RHRRIF2O1DU type=del size=2577901 2024-09-14T11:17:45.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.081+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=H4BPKZLPKSYN type=del 2024-09-14T11:17:45.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.084+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=L12IJ9J9TH5R type=del size=3777124 2024-09-14T11:17:45.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.085+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=T31HGYWOFVQ1 type=del 2024-09-14T11:17:45.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.087+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~AG2FFD43JPJW.0 size=468801 2024-09-14T11:17:45.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.087+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=AG2FFD43JPJW tag=F82EQCSHMQL7 type=write size=1517377 2024-09-14T11:17:45.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.088+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=Y99VR7IRE1G3 type=del 2024-09-14T11:17:45.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.090+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.0 size=1048576 2024-09-14T11:17:45.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.091+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.1 size=1048576 2024-09-14T11:17:45.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.092+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.2 size=565252 2024-09-14T11:17:45.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.092+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=0XZUZ95FSSQ9 tag=5NJ3OU0AE2JX type=write size=3710980 2024-09-14T11:17:45.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.093+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.0 size=1048576 2024-09-14T11:17:45.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.094+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.1 size=1048576 2024-09-14T11:17:45.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.094+0000 7f1be8076780 1 < canceled part key=_multipart_UB0SEYZ7ITU1.2~0XLNNO2B62BU.2 size=706172 2024-09-14T11:17:45.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.096+0000 7f1be8076780 1 < canceled multipart upload key=UB0SEYZ7ITU1 upload=0XLNNO2B62BU tag=B0CT2ZN8VI0A type=write size=3851900 2024-09-14T11:17:45.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.097+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=O0D6ERCEMP7R type=del size=746101 2024-09-14T11:17:45.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.098+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.0 size=1048576 2024-09-14T11:17:45.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.099+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.1 size=1048576 2024-09-14T11:17:45.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.100+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~4RCZ7PT3NW13.2 size=588301 2024-09-14T11:17:45.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.102+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=4RCZ7PT3NW13 tag=XO9D7AQPGRB7 type=write size=3734029 2024-09-14T11:17:45.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.103+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=2GMZET49O84R type=del size=493888 2024-09-14T11:17:45.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.104+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~KMDTAU4USZ96.0 size=1048576 2024-09-14T11:17:45.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.105+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~KMDTAU4USZ96.1 size=731311 2024-09-14T11:17:45.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.107+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=KMDTAU4USZ96 tag=DGUVQB104TMN type=write size=2828463 2024-09-14T11:17:45.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.108+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=4EDX5H8FQLGM type=del size=4064162 2024-09-14T11:17:45.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.109+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.0 size=1048576 2024-09-14T11:17:45.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.109+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.1 size=1048576 2024-09-14T11:17:45.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.110+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~YIBFB69NCRJW.2 size=260557 2024-09-14T11:17:45.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.112+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=YIBFB69NCRJW tag=1QOEGCA29DI0 type=write size=3406285 2024-09-14T11:17:45.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.113+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=ER9R3JPSFUN7 type=write size=828235 2024-09-14T11:17:45.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.114+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~0TQ1DM2P7UIR.0 size=1048576 2024-09-14T11:17:45.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.115+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~0TQ1DM2P7UIR.1 size=195105 2024-09-14T11:17:45.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.117+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=0TQ1DM2P7UIR tag=AG9085DGGRLH type=write size=2292257 2024-09-14T11:17:45.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.119+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~A5LA7HDXKJRA.0 size=786639 2024-09-14T11:17:45.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.119+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=A5LA7HDXKJRA tag=FNCXMTZGKT33 type=write size=1835215 2024-09-14T11:17:45.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.120+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=DVDLKC075Q2E type=del 2024-09-14T11:17:45.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.122+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.0 size=1048576 2024-09-14T11:17:45.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.123+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.1 size=1048576 2024-09-14T11:17:45.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.123+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.2 size=199808 2024-09-14T11:17:45.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.123+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=PMUL8PTVTXNZ tag=C1ATBCB2GORR type=write size=3345536 2024-09-14T11:17:45.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.125+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=84Y06USOAV4G type=write size=62255 2024-09-14T11:17:45.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.127+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~R5JEPV5XR6ER.0 size=1048576 2024-09-14T11:17:45.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.127+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~R5JEPV5XR6ER.1 size=292305 2024-09-14T11:17:45.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.127+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=R5JEPV5XR6ER tag=N2GIPIUYAV31 type=write size=2389457 2024-09-14T11:17:45.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.128+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~813PUGWD5BE0.0 size=1048576 2024-09-14T11:17:45.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.129+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~813PUGWD5BE0.1 size=951235 2024-09-14T11:17:45.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.131+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=813PUGWD5BE0 tag=EATQTT2DXTVD type=write size=3048387 2024-09-14T11:17:45.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.132+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=JTHZ3SQRUVSE type=write size=151959 2024-09-14T11:17:45.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.133+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=4MH9PK9VT1DQ type=del 2024-09-14T11:17:45.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.134+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=ACN1ABJ3OBUU type=del size=924763 2024-09-14T11:17:45.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.135+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=14XBF512HDJV type=del 2024-09-14T11:17:45.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.137+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.0 size=1048576 2024-09-14T11:17:45.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.138+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.1 size=1048576 2024-09-14T11:17:45.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.139+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.2 size=948498 2024-09-14T11:17:45.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.139+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=PEFTPEQZPMMQ tag=A3E3RYR91NYS type=write size=4094226 2024-09-14T11:17:45.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.140+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=86KWR53DY2NM type=del 2024-09-14T11:17:45.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.141+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=THXWISAKHWOG type=write size=648727 2024-09-14T11:17:45.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.143+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.0 size=1048576 2024-09-14T11:17:45.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.143+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.1 size=1048576 2024-09-14T11:17:45.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.144+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~YVEM6UGDDDJF.2 size=881688 2024-09-14T11:17:45.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.146+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=YVEM6UGDDDJF tag=DRRKYXPRI7UO type=write size=4027416 2024-09-14T11:17:45.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.147+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=NDVJDQDI56NH type=del size=2756010 2024-09-14T11:17:45.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.148+0000 7f1be8076780 1 < canceled operation key=MX5J0P18BM0D tag=5RHRRIF2O1DU type=del size=2577901 2024-09-14T11:17:45.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.150+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~59JEQ333FZIS.0 size=928745 2024-09-14T11:17:45.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.150+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=59JEQ333FZIS tag=VLXI0H2IAE7B type=write size=1977321 2024-09-14T11:17:45.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.151+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=L12IJ9J9TH5R type=del 2024-09-14T11:17:45.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.153+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.0 size=1048576 2024-09-14T11:17:45.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.154+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.1 size=1048576 2024-09-14T11:17:45.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.155+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.2 size=244495 2024-09-14T11:17:45.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.155+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=II3J7LW18X1F tag=5BXIEQEI8PNT type=write size=3390223 2024-09-14T11:17:45.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.156+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~AG2FFD43JPJW.0 size=468801 2024-09-14T11:17:45.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.158+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=AG2FFD43JPJW tag=F82EQCSHMQL7 type=write size=1517377 2024-09-14T11:17:45.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.160+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~6T7YFFH0I2ZF.0 size=248774 2024-09-14T11:17:45.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.160+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=6T7YFFH0I2ZF tag=6DF2AXXFMU1L type=write size=1297350 2024-09-14T11:17:45.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.161+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.0 size=1048576 2024-09-14T11:17:45.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.162+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.1 size=1048576 2024-09-14T11:17:45.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.163+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0XZUZ95FSSQ9.2 size=565252 2024-09-14T11:17:45.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.165+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=0XZUZ95FSSQ9 tag=5NJ3OU0AE2JX type=write size=3710980 2024-09-14T11:17:45.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.166+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=741AFAIGPURM type=del size=76639 2024-09-14T11:17:45.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.167+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=O0D6ERCEMP7R type=del 2024-09-14T11:17:45.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.168+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=26GEH7NHNRBY type=del size=2662947 2024-09-14T11:17:45.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.169+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=2GMZET49O84R type=del 2024-09-14T11:17:45.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.171+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~JY6ZN6LTGVNO.0 size=979421 2024-09-14T11:17:45.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.171+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=JY6ZN6LTGVNO tag=DR5WLP6GYM1C type=write size=2027997 2024-09-14T11:17:45.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.173+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=4EDX5H8FQLGM type=del 2024-09-14T11:17:45.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.174+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=SK4024AAQHAQ type=del size=902573 2024-09-14T11:17:45.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.175+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=ER9R3JPSFUN7 type=write size=828235 2024-09-14T11:17:45.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.177+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=HKKLEG6GPFBF type=del size=2744635 2024-09-14T11:17:45.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.178+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~A5LA7HDXKJRA.0 size=786639 2024-09-14T11:17:45.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.180+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=A5LA7HDXKJRA tag=FNCXMTZGKT33 type=write size=1835215 2024-09-14T11:17:45.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.181+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=2ZVQE3MHR07I type=write size=690520 2024-09-14T11:17:45.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.182+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.0 size=1048576 2024-09-14T11:17:45.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.183+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.1 size=1048576 2024-09-14T11:17:45.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.184+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~PMUL8PTVTXNZ.2 size=199808 2024-09-14T11:17:45.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.187+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=PMUL8PTVTXNZ tag=C1ATBCB2GORR type=write size=3345536 2024-09-14T11:17:45.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.189+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2FX0XXJ07XNU.0 size=1048576 2024-09-14T11:17:45.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.190+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2FX0XXJ07XNU.1 size=463481 2024-09-14T11:17:45.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.190+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=2FX0XXJ07XNU tag=GZHDEUUDO30P type=write size=2560633 2024-09-14T11:17:45.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.191+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~R5JEPV5XR6ER.0 size=1048576 2024-09-14T11:17:45.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.192+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~R5JEPV5XR6ER.1 size=292305 2024-09-14T11:17:45.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.193+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=R5JEPV5XR6ER tag=N2GIPIUYAV31 type=write size=2389457 2024-09-14T11:17:45.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.195+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=XR4N5RX0VNJR type=write size=297233 2024-09-14T11:17:45.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.196+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=JTHZ3SQRUVSE type=write size=151959 2024-09-14T11:17:45.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.197+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=Z5D51EMKSEJO type=write size=299962 2024-09-14T11:17:45.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.198+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=ACN1ABJ3OBUU type=del 2024-09-14T11:17:45.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.200+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.0 size=1048576 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.201+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.1 size=1048576 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.201+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.2 size=728044 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.201+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=XJH195LBMUZG tag=5LE2GD7DMFL7 type=write size=3873772 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.203+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.0 size=1048576 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.203+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.1 size=1048576 2024-09-14T11:17:45.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.204+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~PEFTPEQZPMMQ.2 size=948498 2024-09-14T11:17:45.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.206+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=PEFTPEQZPMMQ tag=A3E3RYR91NYS type=write size=4094226 2024-09-14T11:17:45.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.208+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.0 size=1048576 2024-09-14T11:17:45.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.209+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.1 size=1048576 2024-09-14T11:17:45.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.210+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.2 size=746562 2024-09-14T11:17:45.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.210+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=XDTVQVSC0ILU tag=6E1ASTCUYW7C type=write size=3892290 2024-09-14T11:17:45.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.211+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=THXWISAKHWOG type=write size=648727 2024-09-14T11:17:45.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.212+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=ICWAQ07V1JWC type=del size=3754231 2024-09-14T11:17:45.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.214+0000 7f1be8076780 1 < suggested remove operation key=CQDRZMJAJ7FZ tag=NDVJDQDI56NH type=del 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.215+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=DMMP5GCHPB21 type=del size=3491336 2024-09-14T11:17:45.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.217+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~59JEQ333FZIS.0 size=928745 2024-09-14T11:17:45.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.219+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=59JEQ333FZIS tag=VLXI0H2IAE7B type=write size=1977321 2024-09-14T11:17:45.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.220+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=1JRMIO8ZSYEA type=del size=1918533 2024-09-14T11:17:45.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.221+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.0 size=1048576 2024-09-14T11:17:45.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.222+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.1 size=1048576 2024-09-14T11:17:45.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.222+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~II3J7LW18X1F.2 size=244495 2024-09-14T11:17:45.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.224+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=II3J7LW18X1F tag=5BXIEQEI8PNT type=write size=3390223 2024-09-14T11:17:45.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.227+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~FO7NC1C1W72E.0 size=1015633 2024-09-14T11:17:45.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.227+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=FO7NC1C1W72E tag=IXCICEHJEXKJ type=write size=2064209 2024-09-14T11:17:45.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.228+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~6T7YFFH0I2ZF.0 size=248774 2024-09-14T11:17:45.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.230+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=6T7YFFH0I2ZF tag=6DF2AXXFMU1L type=write size=1297350 2024-09-14T11:17:45.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.232+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=3L79OGDJC8KY type=del size=2253653 2024-09-14T11:17:45.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.233+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=741AFAIGPURM type=del 2024-09-14T11:17:45.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.234+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=0VEJO12RO80J type=del size=2638669 2024-09-14T11:17:45.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.235+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=26GEH7NHNRBY type=del 2024-09-14T11:17:45.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.237+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~EV4LJNODDIWI.0 size=1048576 2024-09-14T11:17:45.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.238+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~EV4LJNODDIWI.1 size=525771 2024-09-14T11:17:45.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.238+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=EV4LJNODDIWI tag=K1WZ1NLQYVS1 type=write size=2622923 2024-09-14T11:17:45.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.239+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~JY6ZN6LTGVNO.0 size=979421 2024-09-14T11:17:45.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.241+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=JY6ZN6LTGVNO tag=DR5WLP6GYM1C type=write size=2027997 2024-09-14T11:17:45.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.242+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=IEA8928SLN14 type=del size=537898 2024-09-14T11:17:45.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.245+0000 7f1be8076780 1 < suggested remove operation key=7OUNKTS3X7DJ tag=SK4024AAQHAQ type=del 2024-09-14T11:17:45.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.246+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=CZMHQRU7F937 type=write size=40660 2024-09-14T11:17:45.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.247+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=HKKLEG6GPFBF type=del 2024-09-14T11:17:45.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.250+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~TJEXCATEAZIE.0 size=1048576 2024-09-14T11:17:45.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.251+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~TJEXCATEAZIE.1 size=847425 2024-09-14T11:17:45.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.251+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=TJEXCATEAZIE tag=F5HF0T6MVLQK type=write size=2944577 2024-09-14T11:17:45.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.253+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=2ZVQE3MHR07I type=write size=690520 2024-09-14T11:17:45.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.254+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=IKDPKOZDATU6 type=del size=1207589 2024-09-14T11:17:45.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.255+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~2FX0XXJ07XNU.0 size=1048576 2024-09-14T11:17:45.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.256+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~2FX0XXJ07XNU.1 size=463481 2024-09-14T11:17:45.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.258+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=2FX0XXJ07XNU tag=GZHDEUUDO30P type=write size=2560633 2024-09-14T11:17:45.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.259+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=D3YH964BOG0P type=del size=3004540 2024-09-14T11:17:45.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.261+0000 7f1be8076780 1 < completed write operation key=UB0SEYZ7ITU1 tag=XR4N5RX0VNJR type=write size=297233 2024-09-14T11:17:45.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.263+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.0 size=1048576 2024-09-14T11:17:45.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.264+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.1 size=1048576 2024-09-14T11:17:45.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.265+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.2 size=1005037 2024-09-14T11:17:45.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.265+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=YF1LEZZYT0U4 tag=0Y923DGKD9GV type=write size=4150765 2024-09-14T11:17:45.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.266+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=Z5D51EMKSEJO type=write size=299962 2024-09-14T11:17:45.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.267+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=PS6F3F3GU4WI type=del size=3810075 2024-09-14T11:17:45.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.268+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.0 size=1048576 2024-09-14T11:17:45.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.269+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.1 size=1048576 2024-09-14T11:17:45.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.270+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~XJH195LBMUZG.2 size=728044 2024-09-14T11:17:45.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.272+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=XJH195LBMUZG tag=5LE2GD7DMFL7 type=write size=3873772 2024-09-14T11:17:45.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.273+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=TJ2WRNEOT7GY type=del size=2151864 2024-09-14T11:17:45.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.275+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.0 size=1048576 2024-09-14T11:17:45.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.276+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.1 size=1048576 2024-09-14T11:17:45.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.276+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~XDTVQVSC0ILU.2 size=746562 2024-09-14T11:17:45.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.278+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=XDTVQVSC0ILU tag=6E1ASTCUYW7C type=write size=3892290 2024-09-14T11:17:45.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.280+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=NV686JQZBMK9 type=del size=316847 2024-09-14T11:17:45.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.280+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=7OUNKTS3X7DJ tag=ICWAQ07V1JWC type=del size=3754231: (2) No such file or directory 2024-09-14T11:17:45.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.282+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~HF4JBTQM370B.0 size=1048576 2024-09-14T11:17:45.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.283+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~HF4JBTQM370B.1 size=453567 2024-09-14T11:17:45.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.283+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=HF4JBTQM370B tag=MDHBIW93HBKP type=write size=2550719 2024-09-14T11:17:45.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.285+0000 7f1be8076780 1 < canceled operation key=0BX70Q8C1QL0 tag=DMMP5GCHPB21 type=del size=3491336 2024-09-14T11:17:45.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.286+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=HICDP90QH7EI type=del size=2064545 2024-09-14T11:17:45.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.287+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=1JRMIO8ZSYEA type=del 2024-09-14T11:17:45.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.288+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=VPPCYUC7L167 type=del size=396070 2024-09-14T11:17:45.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.289+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~FO7NC1C1W72E.0 size=1015633 2024-09-14T11:17:45.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.291+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=FO7NC1C1W72E tag=IXCICEHJEXKJ type=write size=2064209 2024-09-14T11:17:45.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.292+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=93VI70DR2OS7 type=del size=4117791 2024-09-14T11:17:45.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.295+0000 7f1be8076780 1 < suggested update operation key=3YIK6B6Y2EU1 tag=3L79OGDJC8KY type=del size=2253653 2024-09-14T11:17:45.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.297+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=Y7SB4YJAHAKW type=write size=745979 2024-09-14T11:17:45.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.298+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=0VEJO12RO80J type=del 2024-09-14T11:17:45.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.300+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.0 size=1048576 2024-09-14T11:17:45.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.301+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.1 size=1048576 2024-09-14T11:17:45.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.302+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.2 size=903236 2024-09-14T11:17:45.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.302+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=A1O7C23GYBQU tag=9W42XZ73W9SQ type=write size=4048964 2024-09-14T11:17:45.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.303+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~EV4LJNODDIWI.0 size=1048576 2024-09-14T11:17:45.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.304+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~EV4LJNODDIWI.1 size=525771 2024-09-14T11:17:45.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.306+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=EV4LJNODDIWI tag=K1WZ1NLQYVS1 type=write size=2622923 2024-09-14T11:17:45.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.307+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=46T9D5D02O0T type=write size=355508 2024-09-14T11:17:45.305 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.308+0000 7f1be8076780 -1 < failed to complete operation key=QIEUKUQ8CS2U tag=IEA8928SLN14 type=del size=537898: (22) Invalid argument 2024-09-14T11:17:45.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.310+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~BV0D734CKS6W.0 size=1048576 2024-09-14T11:17:45.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.311+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~BV0D734CKS6W.1 size=913537 2024-09-14T11:17:45.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.311+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=BV0D734CKS6W tag=L04C27N04WCI type=write size=3010689 2024-09-14T11:17:45.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.312+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=CZMHQRU7F937 type=write size=40660 2024-09-14T11:17:45.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.313+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=JCWM0ONWG6LV type=del size=3837770 2024-09-14T11:17:45.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.314+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~TJEXCATEAZIE.0 size=1048576 2024-09-14T11:17:45.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.315+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~TJEXCATEAZIE.1 size=847425 2024-09-14T11:17:45.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.316+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=TJEXCATEAZIE tag=F5HF0T6MVLQK type=write size=2944577 2024-09-14T11:17:45.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.318+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=JKGL0O8JFLLJ type=del size=3968642 2024-09-14T11:17:45.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.319+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=IKDPKOZDATU6 type=del 2024-09-14T11:17:45.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.320+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=38SH8CQAJVCA type=del size=303036 2024-09-14T11:17:45.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.321+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=D3YH964BOG0P type=del 2024-09-14T11:17:45.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.323+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=5ZHFYQTJMJK2 type=del size=3699333 2024-09-14T11:17:45.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.324+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.0 size=1048576 2024-09-14T11:17:45.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.325+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.1 size=1048576 2024-09-14T11:17:45.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.325+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~YF1LEZZYT0U4.2 size=1005037 2024-09-14T11:17:45.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.327+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=YF1LEZZYT0U4 tag=0Y923DGKD9GV type=write size=4150765 2024-09-14T11:17:45.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.329+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~PN2X8WNQ5CZE.0 size=480035 2024-09-14T11:17:45.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.329+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=PN2X8WNQ5CZE tag=W20AXVZ18A13 type=write size=1528611 2024-09-14T11:17:45.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.331+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=PS6F3F3GU4WI type=del 2024-09-14T11:17:45.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.332+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=8CWOEZ7XN65M type=del size=361671 2024-09-14T11:17:45.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.333+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=TJ2WRNEOT7GY type=del 2024-09-14T11:17:45.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.334+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=LV29Z8YCYV4Z type=write size=436840 2024-09-14T11:17:45.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.335+0000 7f1be8076780 1 < canceled operation key=MX5J0P18BM0D tag=NV686JQZBMK9 type=del size=316847 2024-09-14T11:17:45.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.336+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=HPOY2YVYYU8V type=del size=3696889 2024-09-14T11:17:45.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.337+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~HF4JBTQM370B.0 size=1048576 2024-09-14T11:17:45.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.338+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~HF4JBTQM370B.1 size=453567 2024-09-14T11:17:45.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.340+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=HF4JBTQM370B tag=MDHBIW93HBKP type=write size=2550719 2024-09-14T11:17:45.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.341+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=3MDFDUIAWP2O type=del size=1800111 2024-09-14T11:17:45.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.344+0000 7f1be8076780 1 < suggested update operation key=JGEBWM9VRCFW tag=HICDP90QH7EI type=del size=2064545 2024-09-14T11:17:45.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.345+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=S03HZV13S4RN type=del size=1961729 2024-09-14T11:17:45.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.346+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=VPPCYUC7L167 type=del 2024-09-14T11:17:45.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.347+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=4JKM7V669OR0 type=write size=227287 2024-09-14T11:17:45.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.348+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=93VI70DR2OS7 type=del 2024-09-14T11:17:45.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.350+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~QWC71N6NEAW1.0 size=1048576 2024-09-14T11:17:45.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.351+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~QWC71N6NEAW1.1 size=186331 2024-09-14T11:17:45.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.351+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=QWC71N6NEAW1 tag=0B7MM7EP4JG9 type=write size=2283483 2024-09-14T11:17:45.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.354+0000 7f1be8076780 1 < suggested remove operation key=2RJYZ1CRDVEP tag=Y7SB4YJAHAKW type=write 2024-09-14T11:17:45.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.356+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.0 size=1048576 2024-09-14T11:17:45.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.357+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.1 size=1048576 2024-09-14T11:17:45.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.358+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.2 size=658873 2024-09-14T11:17:45.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.358+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=FQTTXWRO5WUX tag=8JUNKK3OFMQV type=write size=3804601 2024-09-14T11:17:45.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.359+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.0 size=1048576 2024-09-14T11:17:45.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.359+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.1 size=1048576 2024-09-14T11:17:45.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.360+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~A1O7C23GYBQU.2 size=903236 2024-09-14T11:17:45.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.362+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=A1O7C23GYBQU tag=9W42XZ73W9SQ type=write size=4048964 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.363+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=AW4HZ3J8E962 type=del size=2155221 2024-09-14T11:17:45.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.364+0000 7f1be8076780 1 < completed write operation key=7OUNKTS3X7DJ tag=46T9D5D02O0T type=write size=355508 2024-09-14T11:17:45.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.366+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.0 size=1048576 2024-09-14T11:17:45.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.367+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.1 size=1048576 2024-09-14T11:17:45.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.368+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.2 size=943570 2024-09-14T11:17:45.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.368+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=6VLAD874YLE1 tag=O6G77KKQY3TX type=write size=4089298 2024-09-14T11:17:45.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.369+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~BV0D734CKS6W.0 size=1048576 2024-09-14T11:17:45.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.370+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~BV0D734CKS6W.1 size=913537 2024-09-14T11:17:45.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.372+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=BV0D734CKS6W tag=L04C27N04WCI type=write size=3010689 2024-09-14T11:17:45.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.374+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=BNCW0TZXS2CS type=del size=1839325 2024-09-14T11:17:45.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.375+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=JCWM0ONWG6LV type=del 2024-09-14T11:17:45.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.376+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=CTR0MM4HU6WI type=del size=2556256 2024-09-14T11:17:45.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.378+0000 7f1be8076780 1 < suggested update operation key=1X2EWK1Y2GE0 tag=JKGL0O8JFLLJ type=del size=3968642 2024-09-14T11:17:45.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.379+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=2ESZZQIRV14Q type=del size=1552432 2024-09-14T11:17:45.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.381+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=38SH8CQAJVCA type=del 2024-09-14T11:17:45.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.383+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.0 size=1048576 2024-09-14T11:17:45.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.384+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.1 size=1048576 2024-09-14T11:17:45.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.384+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.2 size=223394 2024-09-14T11:17:45.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.384+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=QXZ2ZLGANMUG tag=7WMOLM8YV26W type=write size=3369122 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.386+0000 7f1be8076780 1 < canceled operation key=WQC5TVD66R0W tag=5ZHFYQTJMJK2 type=del size=3699333 2024-09-14T11:17:45.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.387+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=MBQDLUXYGM0K type=del size=1195701 2024-09-14T11:17:45.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.388+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~PN2X8WNQ5CZE.0 size=480035 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.390+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=PN2X8WNQ5CZE tag=W20AXVZ18A13 type=write size=1528611 2024-09-14T11:17:45.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.392+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~TCT08JC4BBPM.0 size=1048576 2024-09-14T11:17:45.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.393+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~TCT08JC4BBPM.1 size=998825 2024-09-14T11:17:45.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.393+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=TCT08JC4BBPM tag=XWNW2EOZ20SW type=write size=3095977 2024-09-14T11:17:45.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.394+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=8CWOEZ7XN65M type=del 2024-09-14T11:17:45.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.395+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=23SAEZ8W2OC5 type=del size=3192852 2024-09-14T11:17:45.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.396+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=LV29Z8YCYV4Z type=write size=436840 2024-09-14T11:17:45.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.398+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=EWCQ7JRD0V9E type=del size=2182509 2024-09-14T11:17:45.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.399+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=HPOY2YVYYU8V type=del 2024-09-14T11:17:45.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.400+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=L8KWJRQ3XMTX type=del size=4140730 2024-09-14T11:17:45.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.401+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=3MDFDUIAWP2O type=del 2024-09-14T11:17:45.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.403+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=3883OCZL3NW2 type=del size=2024054 2024-09-14T11:17:45.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.404+0000 7f1be8076780 -1 < failed to complete operation key=2RJYZ1CRDVEP tag=S03HZV13S4RN type=del size=1961729: (22) Invalid argument 2024-09-14T11:17:45.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.405+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=ME77LF05103Y type=del size=1157554 2024-09-14T11:17:45.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.407+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=4JKM7V669OR0 type=write size=227287 2024-09-14T11:17:45.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.409+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~CO61RUB1QICH.0 size=906195 2024-09-14T11:17:45.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.409+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=CO61RUB1QICH tag=IINX41RXLX2H type=write size=1954771 2024-09-14T11:17:45.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.410+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~QWC71N6NEAW1.0 size=1048576 2024-09-14T11:17:45.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.412+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~QWC71N6NEAW1.1 size=186331 2024-09-14T11:17:45.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.414+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=QWC71N6NEAW1 tag=0B7MM7EP4JG9 type=write size=2283483 2024-09-14T11:17:45.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.415+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=EMT5306QPF3P type=del size=3958636 2024-09-14T11:17:45.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.416+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.0 size=1048576 2024-09-14T11:17:45.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.416+0000 7f1be8076780 1 < canceled part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.1 size=1048576 2024-09-14T11:17:45.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.417+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~FQTTXWRO5WUX.2 size=658873 2024-09-14T11:17:45.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.419+0000 7f1be8076780 1 < canceled multipart upload key=KQ479IOZ0108 upload=FQTTXWRO5WUX tag=8JUNKK3OFMQV type=write size=3804601 2024-09-14T11:17:45.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.420+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=U2I6E9EQ7XCZ type=write size=365940 2024-09-14T11:17:45.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.422+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=AW4HZ3J8E962 type=del 2024-09-14T11:17:45.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.424+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.0 size=1048576 2024-09-14T11:17:45.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.425+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.1 size=1048576 2024-09-14T11:17:45.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.426+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.2 size=73253 2024-09-14T11:17:45.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.426+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=HVBZK7G1GXD0 tag=IZPU1ASD67BZ type=write size=3218981 2024-09-14T11:17:45.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.427+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.0 size=1048576 2024-09-14T11:17:45.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.427+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.1 size=1048576 2024-09-14T11:17:45.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.428+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~6VLAD874YLE1.2 size=943570 2024-09-14T11:17:45.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.430+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=6VLAD874YLE1 tag=O6G77KKQY3TX type=write size=4089298 2024-09-14T11:17:45.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.431+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=SV0LB06Z462V type=write size=388654 2024-09-14T11:17:45.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.432+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=BNCW0TZXS2CS type=del 2024-09-14T11:17:45.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.434+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~8UJVHAYWMZD2.0 size=578421 2024-09-14T11:17:45.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.434+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=8UJVHAYWMZD2 tag=6YNVJXA43P9L type=write size=1626997 2024-09-14T11:17:45.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.435+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=CTR0MM4HU6WI type=del 2024-09-14T11:17:45.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.438+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~VZR7VBYPFQE4.0 size=1048576 2024-09-14T11:17:45.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.439+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~VZR7VBYPFQE4.1 size=786606 2024-09-14T11:17:45.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.439+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=VZR7VBYPFQE4 tag=WFBD8EV9C4TR type=write size=2883758 2024-09-14T11:17:45.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.440+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=2ESZZQIRV14Q type=del 2024-09-14T11:17:45.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.441+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=4KCX8D2OHEOG type=del size=2102521 2024-09-14T11:17:45.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.442+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.0 size=1048576 2024-09-14T11:17:45.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.442+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.1 size=1048576 2024-09-14T11:17:45.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.443+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~QXZ2ZLGANMUG.2 size=223394 2024-09-14T11:17:45.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.445+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=QXZ2ZLGANMUG tag=7WMOLM8YV26W type=write size=3369122 2024-09-14T11:17:45.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.446+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=ZX0DHHS1OTA8 type=del size=1909104 2024-09-14T11:17:45.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.447+0000 7f1be8076780 1 < canceled operation key=4ADXXTIO715C tag=MBQDLUXYGM0K type=del size=1195701 2024-09-14T11:17:45.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.450+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~6C427K3JHUEP.0 size=1048576 2024-09-14T11:17:45.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.451+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~6C427K3JHUEP.1 size=691569 2024-09-14T11:17:45.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.451+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=6C427K3JHUEP tag=UWQXIU43SO4F type=write size=2788721 2024-09-14T11:17:45.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.452+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~TCT08JC4BBPM.0 size=1048576 2024-09-14T11:17:45.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.453+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~TCT08JC4BBPM.1 size=998825 2024-09-14T11:17:45.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.455+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=TCT08JC4BBPM tag=XWNW2EOZ20SW type=write size=3095977 2024-09-14T11:17:45.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.456+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=A42NCA5JMAFE type=del size=2477520 2024-09-14T11:17:45.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.459+0000 7f1be8076780 1 < suggested remove operation key=1X2EWK1Y2GE0 tag=23SAEZ8W2OC5 type=del 2024-09-14T11:17:45.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.460+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=K47IV7XC0D7O type=del size=28363 2024-09-14T11:17:45.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.461+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=EWCQ7JRD0V9E type=del 2024-09-14T11:17:45.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.462+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=9YVELDV8B0NU type=del size=1053673 2024-09-14T11:17:45.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.464+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=L8KWJRQ3XMTX type=del 2024-09-14T11:17:45.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.466+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~47LSVH0QEAI4.0 size=1048576 2024-09-14T11:17:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.467+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~47LSVH0QEAI4.1 size=778705 2024-09-14T11:17:45.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.467+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=47LSVH0QEAI4 tag=9MRSD3D691FX type=write size=2875857 2024-09-14T11:17:45.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.469+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=3883OCZL3NW2 type=del 2024-09-14T11:17:45.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.470+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=PVKDZXIOX3GY type=del size=4138432 2024-09-14T11:17:45.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.471+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=ME77LF05103Y type=del 2024-09-14T11:17:45.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.472+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=O33C8D1I8WE2 type=del size=3827191 2024-09-14T11:17:45.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.474+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~CO61RUB1QICH.0 size=906195 2024-09-14T11:17:45.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.476+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=CO61RUB1QICH tag=IINX41RXLX2H type=write size=1954771 2024-09-14T11:17:45.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.477+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=QYK4SXO14HDW type=del size=3468151 2024-09-14T11:17:45.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.478+0000 7f1be8076780 1 < canceled operation key=9DRSDTGM7Y3F tag=EMT5306QPF3P type=del size=3958636 2024-09-14T11:17:45.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.480+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~TJG4L19VNRAJ.0 size=1048576 2024-09-14T11:17:45.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.481+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~TJG4L19VNRAJ.1 size=631435 2024-09-14T11:17:45.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.481+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=TJG4L19VNRAJ tag=TAT4IUABL0J7 type=write size=2728587 2024-09-14T11:17:45.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.483+0000 7f1be8076780 1 < completed write operation key=MX5J0P18BM0D tag=U2I6E9EQ7XCZ type=write size=365940 2024-09-14T11:17:45.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.485+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.0 size=1048576 2024-09-14T11:17:45.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.486+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.1 size=1048576 2024-09-14T11:17:45.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.487+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.2 size=792458 2024-09-14T11:17:45.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.487+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=5785T5B91RHO tag=SC3AUZQNZBWL type=write size=3938186 2024-09-14T11:17:45.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.488+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.0 size=1048576 2024-09-14T11:17:45.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.489+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.1 size=1048576 2024-09-14T11:17:45.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.490+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~HVBZK7G1GXD0.2 size=73253 2024-09-14T11:17:45.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.492+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=HVBZK7G1GXD0 tag=IZPU1ASD67BZ type=write size=3218981 2024-09-14T11:17:45.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.494+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.0 size=1048576 2024-09-14T11:17:45.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.495+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.1 size=1048576 2024-09-14T11:17:45.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.496+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.2 size=1000564 2024-09-14T11:17:45.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.496+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=3KVZZSBSQZ1Y tag=TGW6TSB023OL type=write size=4146292 2024-09-14T11:17:45.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.499+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=SV0LB06Z462V type=write size=388654 2024-09-14T11:17:45.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.500+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=TS6VSDK7Y96D type=del size=2020093 2024-09-14T11:17:45.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.501+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~8UJVHAYWMZD2.0 size=578421 2024-09-14T11:17:45.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.504+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=8UJVHAYWMZD2 tag=6YNVJXA43P9L type=write size=1626997 2024-09-14T11:17:45.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.505+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=RF570FUQZ9G0 type=del size=2753178 2024-09-14T11:17:45.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.506+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~VZR7VBYPFQE4.0 size=1048576 2024-09-14T11:17:45.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.506+0000 7f1be8076780 1 < canceled part key=_multipart_INU0TV92GXSP.2~VZR7VBYPFQE4.1 size=786606 2024-09-14T11:17:45.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.508+0000 7f1be8076780 1 < canceled multipart upload key=INU0TV92GXSP upload=VZR7VBYPFQE4 tag=WFBD8EV9C4TR type=write size=2883758 2024-09-14T11:17:45.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.510+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~L0YDKYS70G5E.0 size=1048576 2024-09-14T11:17:45.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.512+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~L0YDKYS70G5E.1 size=531304 2024-09-14T11:17:45.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.512+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=L0YDKYS70G5E tag=5WXT9VLLU7LL type=write size=2628456 2024-09-14T11:17:45.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.513+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=4KCX8D2OHEOG type=del 2024-09-14T11:17:45.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.514+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=FRY6C0VHUWN4 type=del size=2271342 2024-09-14T11:17:45.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.515+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=ZX0DHHS1OTA8 type=del 2024-09-14T11:17:45.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.518+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~Y0EVPRGFGO9U.0 size=1048576 2024-09-14T11:17:45.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.519+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~Y0EVPRGFGO9U.1 size=857831 2024-09-14T11:17:45.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.519+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=Y0EVPRGFGO9U tag=MTX44ORZXDJX type=write size=2954983 2024-09-14T11:17:45.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.521+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~6C427K3JHUEP.0 size=1048576 2024-09-14T11:17:45.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.522+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~6C427K3JHUEP.1 size=691569 2024-09-14T11:17:45.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.524+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=6C427K3JHUEP tag=UWQXIU43SO4F type=write size=2788721 2024-09-14T11:17:45.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.526+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~BB6CQRMIF421.0 size=322799 2024-09-14T11:17:45.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.526+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=BB6CQRMIF421 tag=C4GTDKAUGALU type=write size=1371375 2024-09-14T11:17:45.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.527+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=A42NCA5JMAFE type=del 2024-09-14T11:17:45.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.528+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=11LGL0ZGJ5AH type=del size=641687 2024-09-14T11:17:45.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.530+0000 7f1be8076780 1 < suggested remove operation key=4AY6ZXFKO1YQ tag=K47IV7XC0D7O type=del 2024-09-14T11:17:45.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.531+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=IRY7XZTIJ6MC type=del size=2464796 2024-09-14T11:17:45.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.533+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=9YVELDV8B0NU type=del 2024-09-14T11:17:45.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.535+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~BD0ICMO0DAO1.0 size=655707 2024-09-14T11:17:45.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.535+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=BD0ICMO0DAO1 tag=W5OBBC5I62JR type=write size=1704283 2024-09-14T11:17:45.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.536+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~47LSVH0QEAI4.0 size=1048576 2024-09-14T11:17:45.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.537+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~47LSVH0QEAI4.1 size=778705 2024-09-14T11:17:45.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.539+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=47LSVH0QEAI4 tag=9MRSD3D691FX type=write size=2875857 2024-09-14T11:17:45.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.540+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=X0D4H29HWUJA type=del size=2605751 2024-09-14T11:17:45.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.543+0000 7f1be8076780 1 < suggested update operation key=SJES17ZIGRZE tag=PVKDZXIOX3GY type=del size=4138432 2024-09-14T11:17:45.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.544+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=XGW0L5S6TVAO type=del size=3011371 2024-09-14T11:17:45.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.546+0000 7f1be8076780 1 < suggested remove operation key=INU0TV92GXSP tag=O33C8D1I8WE2 type=del 2024-09-14T11:17:45.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.548+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.0 size=1048576 2024-09-14T11:17:45.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.549+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.1 size=1048576 2024-09-14T11:17:45.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.550+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.2 size=942388 2024-09-14T11:17:45.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.550+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=7G6IK26MX93T tag=RVP383JZTVZP type=write size=4088116 2024-09-14T11:17:45.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.551+0000 7f1be8076780 -1 < failed to complete operation key=4AY6ZXFKO1YQ tag=QYK4SXO14HDW type=del size=3468151: (22) Invalid argument 2024-09-14T11:17:45.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.552+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=D7I27NSEX57A type=del size=3373684 2024-09-14T11:17:45.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.553+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~TJG4L19VNRAJ.0 size=1048576 2024-09-14T11:17:45.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.554+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~TJG4L19VNRAJ.1 size=631435 2024-09-14T11:17:45.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.556+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=TJG4L19VNRAJ tag=TAT4IUABL0J7 type=write size=2728587 2024-09-14T11:17:45.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.557+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=7MCBFSBF8POK type=del size=2439458 2024-09-14T11:17:45.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.557+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.0 size=1048576 2024-09-14T11:17:45.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.558+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.1 size=1048576 2024-09-14T11:17:45.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.558+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~5785T5B91RHO.2 size=792458 2024-09-14T11:17:45.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.560+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=5785T5B91RHO tag=SC3AUZQNZBWL type=write size=3938186 2024-09-14T11:17:45.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.561+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=8Y4EO04S591W type=write size=447046 2024-09-14T11:17:45.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.562+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.0 size=1048576 2024-09-14T11:17:45.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.563+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.1 size=1048576 2024-09-14T11:17:45.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.564+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3KVZZSBSQZ1Y.2 size=1000564 2024-09-14T11:17:45.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.568+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=3KVZZSBSQZ1Y tag=TGW6TSB023OL type=write size=4146292 2024-09-14T11:17:45.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.569+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=JDFUOYNFXW3O type=del size=2346090 2024-09-14T11:17:45.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.570+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=TS6VSDK7Y96D type=del 2024-09-14T11:17:45.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.572+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=84CL0PAUNQ1Q type=del size=2940019 2024-09-14T11:17:45.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.573+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=RF570FUQZ9G0 type=del 2024-09-14T11:17:45.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.574+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=97YCS6OGB9PM type=del size=1934967 2024-09-14T11:17:45.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.575+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~L0YDKYS70G5E.0 size=1048576 2024-09-14T11:17:45.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.576+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~L0YDKYS70G5E.1 size=531304 2024-09-14T11:17:45.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.578+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=L0YDKYS70G5E tag=5WXT9VLLU7LL type=write size=2628456 2024-09-14T11:17:45.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.579+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=NG6OQ0PZUC2M type=del size=2542320 2024-09-14T11:17:45.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.581+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=FRY6C0VHUWN4 type=del 2024-09-14T11:17:45.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.583+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~JSDK63CIZT4E.0 size=1048576 2024-09-14T11:17:45.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.584+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~JSDK63CIZT4E.1 size=132184 2024-09-14T11:17:45.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.584+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=JSDK63CIZT4E tag=T1LCTJYN4P67 type=write size=2229336 2024-09-14T11:17:45.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.585+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~Y0EVPRGFGO9U.0 size=1048576 2024-09-14T11:17:45.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.586+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~Y0EVPRGFGO9U.1 size=857831 2024-09-14T11:17:45.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.588+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=Y0EVPRGFGO9U tag=MTX44ORZXDJX type=write size=2954983 2024-09-14T11:17:45.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.590+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~2P96N8MQ1LEP.0 size=525620 2024-09-14T11:17:45.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.590+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=2P96N8MQ1LEP tag=O2BW7S78P5MW type=write size=1574196 2024-09-14T11:17:45.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.591+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~BB6CQRMIF421.0 size=322799 2024-09-14T11:17:45.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.593+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=BB6CQRMIF421 tag=C4GTDKAUGALU type=write size=1371375 2024-09-14T11:17:45.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.594+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=ZT3GB2T98TEL type=write size=577572 2024-09-14T11:17:45.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.595+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=11LGL0ZGJ5AH type=del 2024-09-14T11:17:45.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.596+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=4YTZ8Y430R11 type=write size=565771 2024-09-14T11:17:45.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.598+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=IRY7XZTIJ6MC type=del 2024-09-14T11:17:45.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.599+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=QV0X894ADUUH type=del size=1658940 2024-09-14T11:17:45.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.600+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~BD0ICMO0DAO1.0 size=655707 2024-09-14T11:17:45.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.602+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=BD0ICMO0DAO1 tag=W5OBBC5I62JR type=write size=1704283 2024-09-14T11:17:45.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.603+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=CKKVIC993QPY type=del size=2019982 2024-09-14T11:17:45.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.604+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=X0D4H29HWUJA type=del 2024-09-14T11:17:45.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.605+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=61IKXMBGCRWD type=write size=20615 2024-09-14T11:17:45.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.607+0000 7f1be8076780 -1 < failed to complete operation key=INU0TV92GXSP tag=XGW0L5S6TVAO type=del size=3011371: (22) Invalid argument 2024-09-14T11:17:45.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.608+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=TID2HF848FJY type=del size=3508055 2024-09-14T11:17:45.607 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.609+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.0 size=1048576 2024-09-14T11:17:45.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.610+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.1 size=1048576 2024-09-14T11:17:45.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.611+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~7G6IK26MX93T.2 size=942388 2024-09-14T11:17:45.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.613+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=7G6IK26MX93T tag=RVP383JZTVZP type=write size=4088116 2024-09-14T11:17:45.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.614+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=AZM0DGCOHIL1 type=del size=3047856 2024-09-14T11:17:45.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.616+0000 7f1be8076780 1 < suggested remove operation key=KQ479IOZ0108 tag=D7I27NSEX57A type=del 2024-09-14T11:17:45.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.619+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.0 size=1048576 2024-09-14T11:17:45.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.620+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.1 size=1048576 2024-09-14T11:17:45.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.620+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.2 size=212077 2024-09-14T11:17:45.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.620+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=89T4ZIGM41EW tag=0JST70IUE3YK type=write size=3357805 2024-09-14T11:17:45.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.622+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=7MCBFSBF8POK type=del 2024-09-14T11:17:45.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.623+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=GU1U2T2AANC2 type=del size=4008181 2024-09-14T11:17:45.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.624+0000 7f1be8076780 1 < completed write operation key=QC6MEJABT7IM tag=8Y4EO04S591W type=write size=447046 2024-09-14T11:17:45.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.625+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=3A20607C2IE2 type=del size=2275125 2024-09-14T11:17:45.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.626+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=JDFUOYNFXW3O type=del 2024-09-14T11:17:45.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.628+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=61YDQR8BHHXB type=del size=2761845 2024-09-14T11:17:45.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.629+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=84CL0PAUNQ1Q type=del 2024-09-14T11:17:45.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.631+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~XDO8F7MTK043.0 size=13841 2024-09-14T11:17:45.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.631+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=XDO8F7MTK043 tag=3V6WUH5BG8RB type=write size=1062417 2024-09-14T11:17:45.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.633+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=97YCS6OGB9PM type=del 2024-09-14T11:17:45.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.634+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=33ZFQR54MPY0 type=del size=1934906 2024-09-14T11:17:45.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.636+0000 7f1be8076780 1 < suggested remove operation key=JIWPGHQ3GEZB tag=NG6OQ0PZUC2M type=del 2024-09-14T11:17:45.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.638+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=W5LFD6J28S93 type=del size=463296 2024-09-14T11:17:45.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.639+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~JSDK63CIZT4E.0 size=1048576 2024-09-14T11:17:45.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.640+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~JSDK63CIZT4E.1 size=132184 2024-09-14T11:17:45.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.642+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=JSDK63CIZT4E tag=T1LCTJYN4P67 type=write size=2229336 2024-09-14T11:17:45.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.643+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=TME7Z4W6EPQY type=del size=1431037 2024-09-14T11:17:45.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.644+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~2P96N8MQ1LEP.0 size=525620 2024-09-14T11:17:45.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.646+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=2P96N8MQ1LEP tag=O2BW7S78P5MW type=write size=1574196 2024-09-14T11:17:45.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.647+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=6FIKH8H1727T type=del size=1559270 2024-09-14T11:17:45.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.649+0000 7f1be8076780 1 < completed write operation key=3Z71PEWG5UMA tag=ZT3GB2T98TEL type=write size=577572 2024-09-14T11:17:45.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.651+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.0 size=1048576 2024-09-14T11:17:45.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.652+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.1 size=1048576 2024-09-14T11:17:45.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.653+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.2 size=57965 2024-09-14T11:17:45.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.653+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=LSYLSIRD1G73 tag=WG5I10CL2P88 type=write size=3203693 2024-09-14T11:17:45.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.654+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=4YTZ8Y430R11 type=write size=565771 2024-09-14T11:17:45.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.655+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=ORYQRK4H234A type=del size=412380 2024-09-14T11:17:45.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.658+0000 7f1be8076780 1 < suggested remove operation key=QIEUKUQ8CS2U tag=QV0X894ADUUH type=del 2024-09-14T11:17:45.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.660+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~7DTMV13ONV5B.0 size=1048576 2024-09-14T11:17:45.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.661+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~7DTMV13ONV5B.1 size=683587 2024-09-14T11:17:45.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.661+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=7DTMV13ONV5B tag=EMDZYQ0PUYS2 type=write size=2780739 2024-09-14T11:17:45.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.663+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=CKKVIC993QPY type=del 2024-09-14T11:17:45.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.665+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.0 size=1048576 2024-09-14T11:17:45.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.666+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.1 size=1048576 2024-09-14T11:17:45.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.667+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.2 size=481155 2024-09-14T11:17:45.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.667+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=8LEGKVLBZW4K tag=AVNYIJN5V24R type=write size=3626883 2024-09-14T11:17:45.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.668+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=61IKXMBGCRWD type=write size=20615 2024-09-14T11:17:45.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.670+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=0M0791W9V5TI type=del size=380022 2024-09-14T11:17:45.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.671+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=TID2HF848FJY type=del 2024-09-14T11:17:45.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.673+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~Q3ZNDEDOCPQ0.0 size=534604 2024-09-14T11:17:45.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.673+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=Q3ZNDEDOCPQ0 tag=EEJPEPU5SRYA type=write size=1583180 2024-09-14T11:17:45.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.674+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=AZM0DGCOHIL1 type=del 2024-09-14T11:17:45.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.676+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~8PC3TM287X3K.0 size=305759 2024-09-14T11:17:45.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.676+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=8PC3TM287X3K tag=9NIT5WIL6NCZ type=write size=1354335 2024-09-14T11:17:45.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.677+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.0 size=1048576 2024-09-14T11:17:45.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.678+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.1 size=1048576 2024-09-14T11:17:45.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.679+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~89T4ZIGM41EW.2 size=212077 2024-09-14T11:17:45.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.681+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=89T4ZIGM41EW tag=0JST70IUE3YK type=write size=3357805 2024-09-14T11:17:45.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.683+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=4I8XAU1V9SST type=del size=1488404 2024-09-14T11:17:45.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.684+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=GU1U2T2AANC2 type=del 2024-09-14T11:17:45.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.685+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=3OI00KKCH2OX type=del size=260820 2024-09-14T11:17:45.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.687+0000 7f1be8076780 1 < canceled operation key=LNMGQ54S2CXX tag=3A20607C2IE2 type=del size=2275125 2024-09-14T11:17:45.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.689+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~OXZSLXQPIY18.0 size=715715 2024-09-14T11:17:45.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.689+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=OXZSLXQPIY18 tag=IN6DX9WYHBXR type=write size=1764291 2024-09-14T11:17:45.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.690+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=61YDQR8BHHXB type=del 2024-09-14T11:17:45.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.691+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=53Y1PBLLB9KQ type=del size=1232769 2024-09-14T11:17:45.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.693+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~XDO8F7MTK043.0 size=13841 2024-09-14T11:17:45.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.695+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=XDO8F7MTK043 tag=3V6WUH5BG8RB type=write size=1062417 2024-09-14T11:17:45.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.696+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=46NK5EYKYO4V type=del size=2970013 2024-09-14T11:17:45.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.697+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=33ZFQR54MPY0 type=del 2024-09-14T11:17:45.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.699+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~EWZFZ9DQENDZ.0 size=1048576 2024-09-14T11:17:45.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.700+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~EWZFZ9DQENDZ.1 size=625795 2024-09-14T11:17:45.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.700+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=EWZFZ9DQENDZ tag=EHKN4E4SOQ4J type=write size=2722947 2024-09-14T11:17:45.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.701+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=W5LFD6J28S93 type=del 2024-09-14T11:17:45.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.703+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=UCF5C62XJTZI type=del size=2092276 2024-09-14T11:17:45.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.704+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=TME7Z4W6EPQY type=del 2024-09-14T11:17:45.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.705+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=IOCYOPOW7VY3 type=del size=3534121 2024-09-14T11:17:45.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.706+0000 7f1be8076780 -1 < failed to complete operation key=QIEUKUQ8CS2U tag=6FIKH8H1727T type=del size=1559270: (22) Invalid argument 2024-09-14T11:17:45.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.707+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=2BSZEYRBBIH8 type=del size=3872533 2024-09-14T11:17:45.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.708+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.0 size=1048576 2024-09-14T11:17:45.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.709+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.1 size=1048576 2024-09-14T11:17:45.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.710+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~LSYLSIRD1G73.2 size=57965 2024-09-14T11:17:45.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.712+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=LSYLSIRD1G73 tag=WG5I10CL2P88 type=write size=3203693 2024-09-14T11:17:45.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.714+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~2GJ69VB3KACT.0 size=108709 2024-09-14T11:17:45.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.714+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=2GJ69VB3KACT tag=42T0EBYIOJ8W type=write size=1157285 2024-09-14T11:17:45.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.716+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=ORYQRK4H234A type=del 2024-09-14T11:17:45.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.718+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=VWE2FMRGIA3J type=write size=498242 2024-09-14T11:17:45.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.719+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~7DTMV13ONV5B.0 size=1048576 2024-09-14T11:17:45.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.720+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~7DTMV13ONV5B.1 size=683587 2024-09-14T11:17:45.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.722+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=7DTMV13ONV5B tag=EMDZYQ0PUYS2 type=write size=2780739 2024-09-14T11:17:45.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.723+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=XTMSQA9W9FDD type=write size=830806 2024-09-14T11:17:45.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.724+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.0 size=1048576 2024-09-14T11:17:45.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.725+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.1 size=1048576 2024-09-14T11:17:45.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.726+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8LEGKVLBZW4K.2 size=481155 2024-09-14T11:17:45.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.728+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=8LEGKVLBZW4K tag=AVNYIJN5V24R type=write size=3626883 2024-09-14T11:17:45.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.729+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=DM340DTN8CKF type=del size=132498 2024-09-14T11:17:45.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.730+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=0M0791W9V5TI type=del 2024-09-14T11:17:45.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.732+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~B0ORMRB99JUB.0 size=272710 2024-09-14T11:17:45.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.732+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=B0ORMRB99JUB tag=P66MPMX1Q0WQ type=write size=1321286 2024-09-14T11:17:45.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.734+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~Q3ZNDEDOCPQ0.0 size=534604 2024-09-14T11:17:45.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.736+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=Q3ZNDEDOCPQ0 tag=EEJPEPU5SRYA type=write size=1583180 2024-09-14T11:17:45.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.737+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=L5YLQIAJIJ11 type=del size=2754434 2024-09-14T11:17:45.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.738+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~8PC3TM287X3K.0 size=305759 2024-09-14T11:17:45.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.740+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=8PC3TM287X3K tag=9NIT5WIL6NCZ type=write size=1354335 2024-09-14T11:17:45.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.742+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=796MZNMRM61K type=del size=4073844 2024-09-14T11:17:45.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.743+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=4I8XAU1V9SST type=del 2024-09-14T11:17:45.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.744+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=WC0M6Z81JUB3 type=del size=3607084 2024-09-14T11:17:45.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.745+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=3OI00KKCH2OX type=del 2024-09-14T11:17:45.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.747+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=J6FOM43M68NT type=write size=810876 2024-09-14T11:17:45.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.748+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~OXZSLXQPIY18.0 size=715715 2024-09-14T11:17:45.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.750+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=OXZSLXQPIY18 tag=IN6DX9WYHBXR type=write size=1764291 2024-09-14T11:17:45.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.752+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3T8G3WKGSXZ9.0 size=1048576 2024-09-14T11:17:45.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.753+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3T8G3WKGSXZ9.1 size=970740 2024-09-14T11:17:45.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.753+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=3T8G3WKGSXZ9 tag=1FVELA8ZSH9U type=write size=3067892 2024-09-14T11:17:45.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.754+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=53Y1PBLLB9KQ type=del 2024-09-14T11:17:45.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.756+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.0 size=1048576 2024-09-14T11:17:45.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.757+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.1 size=1048576 2024-09-14T11:17:45.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.758+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.2 size=804358 2024-09-14T11:17:45.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.758+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=2Z1BX3MCJC4C tag=WVMR036LVKKX type=write size=3950086 2024-09-14T11:17:45.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.759+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=46NK5EYKYO4V type=del 2024-09-14T11:17:45.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.760+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=0HWLJUZZ1PAO type=del size=3614496 2024-09-14T11:17:45.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.761+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~EWZFZ9DQENDZ.0 size=1048576 2024-09-14T11:17:45.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.763+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~EWZFZ9DQENDZ.1 size=625795 2024-09-14T11:17:45.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.764+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=EWZFZ9DQENDZ tag=EHKN4E4SOQ4J type=write size=2722947 2024-09-14T11:17:45.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.766+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=QA332YZT8YD6 type=del size=1436707 2024-09-14T11:17:45.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.767+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=UCF5C62XJTZI type=del 2024-09-14T11:17:45.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.768+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=U4A8GCFFRDOI type=del size=2246849 2024-09-14T11:17:45.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.769+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=IOCYOPOW7VY3 type=del 2024-09-14T11:17:45.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.771+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=DK2Z15MNKTVJ type=del size=2046880 2024-09-14T11:17:45.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.772+0000 7f1be8076780 1 < canceled operation key=RIYGSRWKVKFF tag=2BSZEYRBBIH8 type=del size=3872533 2024-09-14T11:17:45.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.773+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=0AI8VHDSMH3E type=del size=1926493 2024-09-14T11:17:45.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.774+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~2GJ69VB3KACT.0 size=108709 2024-09-14T11:17:45.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.776+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=2GJ69VB3KACT tag=42T0EBYIOJ8W type=write size=1157285 2024-09-14T11:17:45.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.777+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=A1ENFUY660K1 type=del size=1732245 2024-09-14T11:17:45.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.778+0000 7f1be8076780 1 < completed write operation key=T70EFGHRQZQ7 tag=VWE2FMRGIA3J type=write size=498242 2024-09-14T11:17:45.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.779+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=FSN34STAMMB5 type=del size=3629369 2024-09-14T11:17:45.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.781+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=XTMSQA9W9FDD type=write size=830806 2024-09-14T11:17:45.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.782+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=97OV5V6CQM9V type=del size=3980258 2024-09-14T11:17:45.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.784+0000 7f1be8076780 1 < suggested update operation key=WQC5TVD66R0W tag=DM340DTN8CKF type=del size=132498 2024-09-14T11:17:45.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.786+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~BS2PE9G2TRD3.0 size=245632 2024-09-14T11:17:45.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.786+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=BS2PE9G2TRD3 tag=CSQE12ARR6QK type=write size=1294208 2024-09-14T11:17:45.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.787+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~B0ORMRB99JUB.0 size=272710 2024-09-14T11:17:45.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.790+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=B0ORMRB99JUB tag=P66MPMX1Q0WQ type=write size=1321286 2024-09-14T11:17:45.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.792+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8L8ELSGQGI7X.0 size=1048576 2024-09-14T11:17:45.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.793+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8L8ELSGQGI7X.1 size=423777 2024-09-14T11:17:45.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.793+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=8L8ELSGQGI7X tag=9H2NE1KFOU8G type=write size=2520929 2024-09-14T11:17:45.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.794+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=L5YLQIAJIJ11 type=del 2024-09-14T11:17:45.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.796+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~S3DGM362HZGM.0 size=216532 2024-09-14T11:17:45.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.796+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=S3DGM362HZGM tag=U31AXQ92E4T2 type=write size=1265108 2024-09-14T11:17:45.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.798+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=796MZNMRM61K type=del 2024-09-14T11:17:45.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.800+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~SXW58NYZFJH4.0 size=1048576 2024-09-14T11:17:45.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.801+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~SXW58NYZFJH4.1 size=1038212 2024-09-14T11:17:45.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.801+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=SXW58NYZFJH4 tag=ZD3RJAHIZKD4 type=write size=3135364 2024-09-14T11:17:45.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.803+0000 7f1be8076780 1 < suggested update operation key=JDKFKO39I56L tag=WC0M6Z81JUB3 type=del size=3607084 2024-09-14T11:17:45.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.806+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.0 size=1048576 2024-09-14T11:17:45.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.807+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.1 size=1048576 2024-09-14T11:17:45.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.809+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.2 size=52757 2024-09-14T11:17:45.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.809+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=1M5GU1E041LH tag=AM28Z9VDU09J type=write size=3198485 2024-09-14T11:17:45.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.811+0000 7f1be8076780 1 < completed write operation key=LNMGQ54S2CXX tag=J6FOM43M68NT type=write size=810876 2024-09-14T11:17:45.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.813+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~WZ6WQQFVIEXY.0 size=1048576 2024-09-14T11:17:45.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.814+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~WZ6WQQFVIEXY.1 size=585852 2024-09-14T11:17:45.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.814+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=WZ6WQQFVIEXY tag=VH2AYF5EKA66 type=write size=2683004 2024-09-14T11:17:45.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.814+0000 7f1be8076780 1 < canceled part key=_multipart_4ADXXTIO715C.2~3T8G3WKGSXZ9.0 size=1048576 2024-09-14T11:17:45.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.815+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~3T8G3WKGSXZ9.1 size=970740 2024-09-14T11:17:45.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.817+0000 7f1be8076780 1 < canceled multipart upload key=4ADXXTIO715C upload=3T8G3WKGSXZ9 tag=1FVELA8ZSH9U type=write size=3067892 2024-09-14T11:17:45.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.818+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=TE5UJIH11EHD type=del size=2200523 2024-09-14T11:17:45.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.819+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.0 size=1048576 2024-09-14T11:17:45.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.820+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.1 size=1048576 2024-09-14T11:17:45.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.821+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~2Z1BX3MCJC4C.2 size=804358 2024-09-14T11:17:45.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.823+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=2Z1BX3MCJC4C tag=WVMR036LVKKX type=write size=3950086 2024-09-14T11:17:45.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.825+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=G534TCM55UMX type=del size=1246313 2024-09-14T11:17:45.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.826+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=0HWLJUZZ1PAO type=del 2024-09-14T11:17:45.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.827+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=8LLYCRNCA1O3 type=del size=2777533 2024-09-14T11:17:45.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.829+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=QA332YZT8YD6 type=del size=1436707 2024-09-14T11:17:45.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.832+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.0 size=1048576 2024-09-14T11:17:45.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.833+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.1 size=1048576 2024-09-14T11:17:45.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.834+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.2 size=953736 2024-09-14T11:17:45.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.834+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=BSEQN8YKR1KU tag=KJAFRH5Z1NJA type=write size=4099464 2024-09-14T11:17:45.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.835+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=U4A8GCFFRDOI type=del 2024-09-14T11:17:45.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.837+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~NNG11SWF4XD0.0 size=1048576 2024-09-14T11:17:45.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.838+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~NNG11SWF4XD0.1 size=841162 2024-09-14T11:17:45.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.838+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=NNG11SWF4XD0 tag=CWMDR18PY4OO type=write size=2938314 2024-09-14T11:17:45.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.841+0000 7f1be8076780 1 < suggested update operation key=4ADXXTIO715C tag=DK2Z15MNKTVJ type=del size=2046880 2024-09-14T11:17:45.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.843+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.0 size=1048576 2024-09-14T11:17:45.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.844+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.1 size=1048576 2024-09-14T11:17:45.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.845+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.2 size=610212 2024-09-14T11:17:45.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.845+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=A84FJY74LV0X tag=Z807H4JI8VFF type=write size=3755940 2024-09-14T11:17:45.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.846+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=0AI8VHDSMH3E type=del size=1926493 2024-09-14T11:17:45.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.847+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=VAL8ZA976DB8 type=del size=1917609 2024-09-14T11:17:45.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.848+0000 7f1be8076780 1 < canceled operation key=QC6MEJABT7IM tag=A1ENFUY660K1 type=del size=1732245 2024-09-14T11:17:45.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.850+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~2C1V5TOB8YU8.0 size=663380 2024-09-14T11:17:45.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.850+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=2C1V5TOB8YU8 tag=C6UQUIRCE4AD type=write size=1711956 2024-09-14T11:17:45.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.852+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=FSN34STAMMB5 type=del 2024-09-14T11:17:45.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.853+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=RZIMRN4K83YU type=del size=548164 2024-09-14T11:17:45.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.856+0000 7f1be8076780 1 < suggested remove operation key=JGEBWM9VRCFW tag=97OV5V6CQM9V type=del 2024-09-14T11:17:45.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.858+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~LMQ5MCNWFTOJ.0 size=120068 2024-09-14T11:17:45.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.858+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=LMQ5MCNWFTOJ tag=QKIPQTB4145D type=write size=1168644 2024-09-14T11:17:45.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.859+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~BS2PE9G2TRD3.0 size=245632 2024-09-14T11:17:45.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.862+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=BS2PE9G2TRD3 tag=CSQE12ARR6QK type=write size=1294208 2024-09-14T11:17:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.864+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~DPRUQZ76VCRW.0 size=800637 2024-09-14T11:17:45.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.864+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=DPRUQZ76VCRW tag=I9I6ZOAEU7CJ type=write size=1849213 2024-09-14T11:17:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.865+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8L8ELSGQGI7X.0 size=1048576 2024-09-14T11:17:45.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.866+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8L8ELSGQGI7X.1 size=423777 2024-09-14T11:17:45.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.868+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=8L8ELSGQGI7X tag=9H2NE1KFOU8G type=write size=2520929 2024-09-14T11:17:45.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.870+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.0 size=1048576 2024-09-14T11:17:45.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.871+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.1 size=1048576 2024-09-14T11:17:45.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.871+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.2 size=38734 2024-09-14T11:17:45.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.871+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=B1EN73JFHNH9 tag=D1EYUG7CBMSQ type=write size=3184462 2024-09-14T11:17:45.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.873+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~S3DGM362HZGM.0 size=216532 2024-09-14T11:17:45.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.875+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=S3DGM362HZGM tag=U31AXQ92E4T2 type=write size=1265108 2024-09-14T11:17:45.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.877+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~CCVZJJNJS834.0 size=1048576 2024-09-14T11:17:45.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.878+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~CCVZJJNJS834.1 size=414776 2024-09-14T11:17:45.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.878+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=CCVZJJNJS834 tag=PIW2N05AHSFF type=write size=2511928 2024-09-14T11:17:45.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.880+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~SXW58NYZFJH4.0 size=1048576 2024-09-14T11:17:45.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.881+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~SXW58NYZFJH4.1 size=1038212 2024-09-14T11:17:45.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.883+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=SXW58NYZFJH4 tag=ZD3RJAHIZKD4 type=write size=3135364 2024-09-14T11:17:45.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.885+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~ROJHBO2Y504K.0 size=340557 2024-09-14T11:17:45.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.885+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=ROJHBO2Y504K tag=6G02F8BOPJT4 type=write size=1389133 2024-09-14T11:17:45.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.886+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.0 size=1048576 2024-09-14T11:17:45.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.887+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.1 size=1048576 2024-09-14T11:17:45.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.888+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~1M5GU1E041LH.2 size=52757 2024-09-14T11:17:45.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.889+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=1M5GU1E041LH tag=AM28Z9VDU09J type=write size=3198485 2024-09-14T11:17:45.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.891+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~E5YHW0W11165.0 size=681858 2024-09-14T11:17:45.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.891+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=E5YHW0W11165 tag=0YGY5JQJFNTA type=write size=1730434 2024-09-14T11:17:45.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.892+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~WZ6WQQFVIEXY.0 size=1048576 2024-09-14T11:17:45.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.893+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~WZ6WQQFVIEXY.1 size=585852 2024-09-14T11:17:45.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.895+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=WZ6WQQFVIEXY tag=VH2AYF5EKA66 type=write size=2683004 2024-09-14T11:17:45.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.896+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=WJU6OE831D8D type=del size=1606692 2024-09-14T11:17:45.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.897+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=TE5UJIH11EHD type=del 2024-09-14T11:17:45.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.898+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=DI3YW8AFJ8QQ type=del size=445624 2024-09-14T11:17:45.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.901+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=G534TCM55UMX type=del size=1246313 2024-09-14T11:17:45.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.903+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~E6BF9WDRFTZX.0 size=1048576 2024-09-14T11:17:45.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.904+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~E6BF9WDRFTZX.1 size=633991 2024-09-14T11:17:45.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.904+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=E6BF9WDRFTZX tag=L8W9F7S9IUHT type=write size=2731143 2024-09-14T11:17:45.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.905+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=8LLYCRNCA1O3 type=del 2024-09-14T11:17:45.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.906+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=UFXMJN57SLNT type=write size=550721 2024-09-14T11:17:45.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.907+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.0 size=1048576 2024-09-14T11:17:45.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.908+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.1 size=1048576 2024-09-14T11:17:45.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.909+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~BSEQN8YKR1KU.2 size=953736 2024-09-14T11:17:45.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.911+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=BSEQN8YKR1KU tag=KJAFRH5Z1NJA type=write size=4099464 2024-09-14T11:17:45.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.913+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.0 size=1048576 2024-09-14T11:17:45.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.914+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.1 size=1048576 2024-09-14T11:17:45.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.915+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.2 size=345689 2024-09-14T11:17:45.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.915+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=3CA76NC6WUWS tag=70JYLR5EYO67 type=write size=3491417 2024-09-14T11:17:45.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.916+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~NNG11SWF4XD0.0 size=1048576 2024-09-14T11:17:45.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.917+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~NNG11SWF4XD0.1 size=841162 2024-09-14T11:17:45.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.919+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=NNG11SWF4XD0 tag=CWMDR18PY4OO type=write size=2938314 2024-09-14T11:17:45.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.921+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=B44SPUPJ5HRX type=del size=1376558 2024-09-14T11:17:45.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.922+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.0 size=1048576 2024-09-14T11:17:45.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.923+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.1 size=1048576 2024-09-14T11:17:45.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.924+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~A84FJY74LV0X.2 size=610212 2024-09-14T11:17:45.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.926+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=A84FJY74LV0X tag=Z807H4JI8VFF type=write size=3755940 2024-09-14T11:17:45.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.927+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=M8H84L2JHIKW type=del size=278606 2024-09-14T11:17:45.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.929+0000 7f1be8076780 1 < suggested remove operation key=MX5J0P18BM0D tag=VAL8ZA976DB8 type=del 2024-09-14T11:17:45.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.931+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.0 size=1048576 2024-09-14T11:17:45.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.932+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.1 size=1048576 2024-09-14T11:17:45.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.934+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.2 size=562439 2024-09-14T11:17:45.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.934+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=0161JTTDXY02 tag=AFRC9867SXSV type=write size=3708167 2024-09-14T11:17:45.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.935+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~2C1V5TOB8YU8.0 size=663380 2024-09-14T11:17:45.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.937+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=2C1V5TOB8YU8 tag=C6UQUIRCE4AD type=write size=1711956 2024-09-14T11:17:45.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.938+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=CAFGAIRCU4XO type=del size=3850804 2024-09-14T11:17:45.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.939+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=RZIMRN4K83YU type=del 2024-09-14T11:17:45.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.942+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.0 size=1048576 2024-09-14T11:17:45.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.943+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.1 size=1048576 2024-09-14T11:17:45.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.944+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.2 size=713376 2024-09-14T11:17:45.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.944+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=OF8LCAZL6RCV tag=HNGFD84UNKY6 type=write size=3859104 2024-09-14T11:17:45.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.945+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~LMQ5MCNWFTOJ.0 size=120068 2024-09-14T11:17:45.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.947+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=LMQ5MCNWFTOJ tag=QKIPQTB4145D type=write size=1168644 2024-09-14T11:17:45.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.949+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~83X946SGNBSG.0 size=666698 2024-09-14T11:17:45.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.949+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=83X946SGNBSG tag=HL84ULN1FKTD type=write size=1715274 2024-09-14T11:17:45.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.950+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~DPRUQZ76VCRW.0 size=800637 2024-09-14T11:17:45.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.952+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=DPRUQZ76VCRW tag=I9I6ZOAEU7CJ type=write size=1849213 2024-09-14T11:17:45.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.953+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=UKITMAGBFVWN type=del size=3892564 2024-09-14T11:17:45.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.954+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.0 size=1048576 2024-09-14T11:17:45.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.955+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.1 size=1048576 2024-09-14T11:17:45.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.956+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~B1EN73JFHNH9.2 size=38734 2024-09-14T11:17:45.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.958+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=B1EN73JFHNH9 tag=D1EYUG7CBMSQ type=write size=3184462 2024-09-14T11:17:45.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.960+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~AOFOQMML0H74.0 size=1048576 2024-09-14T11:17:45.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.962+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~AOFOQMML0H74.1 size=945811 2024-09-14T11:17:45.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.962+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=AOFOQMML0H74 tag=SO6612MJ1VDN type=write size=3042963 2024-09-14T11:17:45.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.963+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~CCVZJJNJS834.0 size=1048576 2024-09-14T11:17:45.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.964+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~CCVZJJNJS834.1 size=414776 2024-09-14T11:17:45.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.966+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=CCVZJJNJS834 tag=PIW2N05AHSFF type=write size=2511928 2024-09-14T11:17:45.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.967+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=E3J2N1TXU7GO type=del size=3792272 2024-09-14T11:17:45.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.968+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~ROJHBO2Y504K.0 size=340557 2024-09-14T11:17:45.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.970+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=ROJHBO2Y504K tag=6G02F8BOPJT4 type=write size=1389133 2024-09-14T11:17:45.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.971+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=W38Q480QHMWJ type=del size=790954 2024-09-14T11:17:45.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.972+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~E5YHW0W11165.0 size=681858 2024-09-14T11:17:45.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.974+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=E5YHW0W11165 tag=0YGY5JQJFNTA type=write size=1730434 2024-09-14T11:17:45.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.976+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~PE72SEV4JNYZ.0 size=1019374 2024-09-14T11:17:45.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.976+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=PE72SEV4JNYZ tag=H91VZ0KNCR2E type=write size=2067950 2024-09-14T11:17:45.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.978+0000 7f1be8076780 1 < suggested remove operation key=T70EFGHRQZQ7 tag=WJU6OE831D8D type=del 2024-09-14T11:17:45.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.979+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=NINIZP7G9VC0 type=del size=1486588 2024-09-14T11:17:45.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.982+0000 7f1be8076780 1 < suggested remove operation key=4ADXXTIO715C tag=DI3YW8AFJ8QQ type=del 2024-09-14T11:17:45.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.984+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~NGCJPQWZC6XB.0 size=923229 2024-09-14T11:17:45.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.984+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=NGCJPQWZC6XB tag=NVP4TDFJTS3X type=write size=1971805 2024-09-14T11:17:45.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.985+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~E6BF9WDRFTZX.0 size=1048576 2024-09-14T11:17:45.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.986+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~E6BF9WDRFTZX.1 size=633991 2024-09-14T11:17:45.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.988+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=E6BF9WDRFTZX tag=L8W9F7S9IUHT type=write size=2731143 2024-09-14T11:17:45.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.990+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~MX0ND3FYDSAB.0 size=336367 2024-09-14T11:17:45.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.990+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=MX0ND3FYDSAB tag=IVO6E14KXYYI type=write size=1384943 2024-09-14T11:17:45.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.991+0000 7f1be8076780 1 < completed write operation key=QIEUKUQ8CS2U tag=UFXMJN57SLNT type=write size=550721 2024-09-14T11:17:45.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.992+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=4MQM3R7H264P type=del size=54832 2024-09-14T11:17:45.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.993+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.0 size=1048576 2024-09-14T11:17:45.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.994+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.1 size=1048576 2024-09-14T11:17:45.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.995+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~3CA76NC6WUWS.2 size=345689 2024-09-14T11:17:45.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.996+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=3CA76NC6WUWS tag=70JYLR5EYO67 type=write size=3491417 2024-09-14T11:17:45.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.998+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=UAFP87FVYAYB type=del size=4060619 2024-09-14T11:17:45.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:45.999+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=B44SPUPJ5HRX type=del 2024-09-14T11:17:45.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.001+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.0 size=1048576 2024-09-14T11:17:46.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.002+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.1 size=1048576 2024-09-14T11:17:46.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.002+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.2 size=502126 2024-09-14T11:17:46.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.002+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=IN05V4IZ5TKK tag=GJOR1BVBYCHS type=write size=3647854 2024-09-14T11:17:46.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.004+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=M8H84L2JHIKW type=del 2024-09-14T11:17:46.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.005+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=866P0ZNXSDQJ type=del size=2191612 2024-09-14T11:17:46.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.006+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.0 size=1048576 2024-09-14T11:17:46.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.007+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.1 size=1048576 2024-09-14T11:17:46.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.007+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~0161JTTDXY02.2 size=562439 2024-09-14T11:17:46.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.009+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=0161JTTDXY02 tag=AFRC9867SXSV type=write size=3708167 2024-09-14T11:17:46.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.011+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~CX3BK8G7Y56X.0 size=1048576 2024-09-14T11:17:46.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.012+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~CX3BK8G7Y56X.1 size=122834 2024-09-14T11:17:46.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.012+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=CX3BK8G7Y56X tag=289QGMSF9I3G type=write size=2219986 2024-09-14T11:17:46.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.013+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=CAFGAIRCU4XO type=del 2024-09-14T11:17:46.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.015+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=X8SS5H9CGR3K type=del size=719887 2024-09-14T11:17:46.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.015+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.0 size=1048576 2024-09-14T11:17:46.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.015+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.1 size=1048576 2024-09-14T11:17:46.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.016+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~OF8LCAZL6RCV.2 size=713376 2024-09-14T11:17:46.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.018+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=OF8LCAZL6RCV tag=HNGFD84UNKY6 type=write size=3859104 2024-09-14T11:17:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.019+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=R8RNSGKQEIP2 type=write size=721390 2024-09-14T11:17:46.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.020+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~83X946SGNBSG.0 size=666698 2024-09-14T11:17:46.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.021+0000 7f1be8076780 1 < canceled multipart upload key=MX5J0P18BM0D upload=83X946SGNBSG tag=HL84ULN1FKTD type=write size=1715274 2024-09-14T11:17:46.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.022+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=NTJ5WRKU5DYR type=del size=2096301 2024-09-14T11:17:46.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.024+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=UKITMAGBFVWN type=del 2024-09-14T11:17:46.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.025+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=SNKZJUIXQ5N9 type=del size=142894 2024-09-14T11:17:46.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.026+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~AOFOQMML0H74.0 size=1048576 2024-09-14T11:17:46.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.027+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~AOFOQMML0H74.1 size=945811 2024-09-14T11:17:46.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.029+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=AOFOQMML0H74 tag=SO6612MJ1VDN type=write size=3042963 2024-09-14T11:17:46.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.031+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~6734RI0GWRH9.0 size=1048576 2024-09-14T11:17:46.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.031+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~6734RI0GWRH9.1 size=292977 2024-09-14T11:17:46.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.031+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=6734RI0GWRH9 tag=GM7PN3T4RFO3 type=write size=2390129 2024-09-14T11:17:46.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.033+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=E3J2N1TXU7GO type=del 2024-09-14T11:17:46.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.034+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=3AH1SORTARIW type=del size=400873 2024-09-14T11:17:46.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.036+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=W38Q480QHMWJ type=del size=790954 2024-09-14T11:17:46.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.037+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=61SWBXGUQGET type=del size=1981658 2024-09-14T11:17:46.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.038+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~PE72SEV4JNYZ.0 size=1019374 2024-09-14T11:17:46.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.040+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=PE72SEV4JNYZ tag=H91VZ0KNCR2E type=write size=2067950 2024-09-14T11:17:46.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.041+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=2UUDHK5FDIOW type=del size=2262944 2024-09-14T11:17:46.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.043+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=NINIZP7G9VC0 type=del size=1486588 2024-09-14T11:17:46.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.045+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.0 size=1048576 2024-09-14T11:17:46.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.046+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.1 size=1048576 2024-09-14T11:17:46.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.047+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.2 size=435133 2024-09-14T11:17:46.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.047+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=AWA2LGPK33PW tag=JO3U2ZHSQNEO type=write size=3580861 2024-09-14T11:17:46.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.048+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~NGCJPQWZC6XB.0 size=923229 2024-09-14T11:17:46.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.050+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=NGCJPQWZC6XB tag=NVP4TDFJTS3X type=write size=1971805 2024-09-14T11:17:46.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.051+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=ER53R8KUH9WA type=del size=2675580 2024-09-14T11:17:46.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.052+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~MX0ND3FYDSAB.0 size=336367 2024-09-14T11:17:46.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.054+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=MX0ND3FYDSAB tag=IVO6E14KXYYI type=write size=1384943 2024-09-14T11:17:46.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.056+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.0 size=1048576 2024-09-14T11:17:46.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.057+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.1 size=1048576 2024-09-14T11:17:46.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.058+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.2 size=443411 2024-09-14T11:17:46.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.058+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=8PDM6DMN78B3 tag=OU49APJ60NRM type=write size=3589139 2024-09-14T11:17:46.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.059+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=4MQM3R7H264P type=del 2024-09-14T11:17:46.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.060+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=EIHW63M9VT3S type=del size=1491445 2024-09-14T11:17:46.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.061+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=UAFP87FVYAYB type=del 2024-09-14T11:17:46.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.063+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.0 size=1048576 2024-09-14T11:17:46.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.065+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.1 size=1048576 2024-09-14T11:17:46.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.066+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.2 size=542151 2024-09-14T11:17:46.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.066+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=YMMGLH928OMO tag=CZR641BOLZMT type=write size=3687879 2024-09-14T11:17:46.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.068+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.0 size=1048576 2024-09-14T11:17:46.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.069+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.1 size=1048576 2024-09-14T11:17:46.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.070+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~IN05V4IZ5TKK.2 size=502126 2024-09-14T11:17:46.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.072+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=IN05V4IZ5TKK tag=GJOR1BVBYCHS type=write size=3647854 2024-09-14T11:17:46.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.074+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.0 size=1048576 2024-09-14T11:17:46.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.076+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.1 size=1048576 2024-09-14T11:17:46.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.076+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.2 size=755471 2024-09-14T11:17:46.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.076+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=SY8ZUM4SDN0O tag=G97NU9WKJHI5 type=write size=3901199 2024-09-14T11:17:46.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.078+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=866P0ZNXSDQJ type=del 2024-09-14T11:17:46.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.080+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.0 size=1048576 2024-09-14T11:17:46.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.081+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.1 size=1048576 2024-09-14T11:17:46.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.082+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.2 size=1035192 2024-09-14T11:17:46.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.082+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=1LFNZ5D291WT tag=13E2RLIDOIWG type=write size=4180920 2024-09-14T11:17:46.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.083+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~CX3BK8G7Y56X.0 size=1048576 2024-09-14T11:17:46.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.084+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~CX3BK8G7Y56X.1 size=122834 2024-09-14T11:17:46.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.086+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=CX3BK8G7Y56X tag=289QGMSF9I3G type=write size=2219986 2024-09-14T11:17:46.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.088+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~NBF1NW4YC05T.0 size=1048576 2024-09-14T11:17:46.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.089+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~NBF1NW4YC05T.1 size=999938 2024-09-14T11:17:46.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.089+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=NBF1NW4YC05T tag=X0C34QZO49ZU type=write size=3097090 2024-09-14T11:17:46.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.091+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=X8SS5H9CGR3K type=del size=719887 2024-09-14T11:17:46.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.094+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.0 size=1048576 2024-09-14T11:17:46.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.095+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.1 size=1048576 2024-09-14T11:17:46.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.096+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.2 size=928714 2024-09-14T11:17:46.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.096+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=1YVQXHO9L9TM tag=3OX3P9NRE8U9 type=write size=4074442 2024-09-14T11:17:46.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.097+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=R8RNSGKQEIP2 type=write size=721390 2024-09-14T11:17:46.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.098+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=9AX61W10UZ6E type=del size=280678 2024-09-14T11:17:46.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.100+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=NTJ5WRKU5DYR type=del 2024-09-14T11:17:46.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.102+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.0 size=1048576 2024-09-14T11:17:46.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.103+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.1 size=1048576 2024-09-14T11:17:46.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.103+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.2 size=499276 2024-09-14T11:17:46.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.103+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=BQ5OP62K23M9 tag=Z3YDWBTGW5ZZ type=write size=3645004 2024-09-14T11:17:46.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.105+0000 7f1be8076780 -1 < failed to complete operation key=2RJYZ1CRDVEP tag=SNKZJUIXQ5N9 type=del size=142894: (22) Invalid argument 2024-09-14T11:17:46.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.107+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.0 size=1048576 2024-09-14T11:17:46.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.108+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.1 size=1048576 2024-09-14T11:17:46.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.109+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.2 size=750346 2024-09-14T11:17:46.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.109+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=FQ05N3EBW1U8 tag=YJ8WFF71B1QP type=write size=3896074 2024-09-14T11:17:46.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.110+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~6734RI0GWRH9.0 size=1048576 2024-09-14T11:17:46.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.111+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~6734RI0GWRH9.1 size=292977 2024-09-14T11:17:46.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.113+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=6734RI0GWRH9 tag=GM7PN3T4RFO3 type=write size=2390129 2024-09-14T11:17:46.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.115+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.0 size=1048576 2024-09-14T11:17:46.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.116+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.1 size=1048576 2024-09-14T11:17:46.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.117+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.2 size=673990 2024-09-14T11:17:46.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.117+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=KZ4RHXL7QBZR tag=84OQ9OM7UI22 type=write size=3819718 2024-09-14T11:17:46.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.119+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=3AH1SORTARIW type=del size=400873 2024-09-14T11:17:46.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.120+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=3QVR0QIRVA08 type=del size=1971155 2024-09-14T11:17:46.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.122+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=61SWBXGUQGET type=del size=1981658 2024-09-14T11:17:46.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.123+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=H5QRU6V8FDXF type=write size=68083 2024-09-14T11:17:46.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.126+0000 7f1be8076780 1 < suggested remove operation key=2RJYZ1CRDVEP tag=2UUDHK5FDIOW type=del 2024-09-14T11:17:46.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.128+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.0 size=1048576 2024-09-14T11:17:46.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.129+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.1 size=1048576 2024-09-14T11:17:46.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.130+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.2 size=326856 2024-09-14T11:17:46.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.130+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=BCDO4Y5G5YWN tag=QRAOL38H0M93 type=write size=3472584 2024-09-14T11:17:46.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.131+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.0 size=1048576 2024-09-14T11:17:46.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.132+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.1 size=1048576 2024-09-14T11:17:46.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.132+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~AWA2LGPK33PW.2 size=435133 2024-09-14T11:17:46.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.134+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=AWA2LGPK33PW tag=JO3U2ZHSQNEO type=write size=3580861 2024-09-14T11:17:46.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.136+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~2BMVA3BKAORJ.0 size=1048576 2024-09-14T11:17:46.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.137+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~2BMVA3BKAORJ.1 size=393592 2024-09-14T11:17:46.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.137+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=2BMVA3BKAORJ tag=5KN0H7I0MF02 type=write size=2490744 2024-09-14T11:17:46.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.139+0000 7f1be8076780 1 < suggested update operation key=SJES17ZIGRZE tag=ER53R8KUH9WA type=del size=2675580 2024-09-14T11:17:46.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.141+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~TBDBRDV3PK0W.0 size=99642 2024-09-14T11:17:46.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.141+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=TBDBRDV3PK0W tag=3UYINGM9WXS3 type=write size=1148218 2024-09-14T11:17:46.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.142+0000 7f1be8076780 1 < canceled part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.0 size=1048576 2024-09-14T11:17:46.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.143+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.1 size=1048576 2024-09-14T11:17:46.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.144+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~8PDM6DMN78B3.2 size=443411 2024-09-14T11:17:46.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.145+0000 7f1be8076780 1 < canceled multipart upload key=3YIK6B6Y2EU1 upload=8PDM6DMN78B3 tag=OU49APJ60NRM type=write size=3589139 2024-09-14T11:17:46.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.147+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~UXG1M64N0DQV.0 size=1048576 2024-09-14T11:17:46.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.148+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~UXG1M64N0DQV.1 size=575212 2024-09-14T11:17:46.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.148+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=UXG1M64N0DQV tag=S5BTKNKCOHUF type=write size=2672364 2024-09-14T11:17:46.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.149+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=EIHW63M9VT3S type=del 2024-09-14T11:17:46.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.151+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=90EIX1Z3UYE1 type=del size=2409083 2024-09-14T11:17:46.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.152+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.0 size=1048576 2024-09-14T11:17:46.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.152+0000 7f1be8076780 1 < canceled part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.1 size=1048576 2024-09-14T11:17:46.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.153+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~YMMGLH928OMO.2 size=542151 2024-09-14T11:17:46.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.154+0000 7f1be8076780 1 < canceled multipart upload key=1RUE5J1DYH2C upload=YMMGLH928OMO tag=CZR641BOLZMT type=write size=3687879 2024-09-14T11:17:46.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.158+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~Y6XVMMDX0AXA.0 size=341291 2024-09-14T11:17:46.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.158+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=Y6XVMMDX0AXA tag=54PBUG4WCO0U type=write size=1389867 2024-09-14T11:17:46.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.160+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.0 size=1048576 2024-09-14T11:17:46.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.161+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.1 size=1048576 2024-09-14T11:17:46.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.162+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~SY8ZUM4SDN0O.2 size=755471 2024-09-14T11:17:46.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.163+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=SY8ZUM4SDN0O tag=G97NU9WKJHI5 type=write size=3901199 2024-09-14T11:17:46.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.165+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=Y1JB01IFNJSY type=del size=3955519 2024-09-14T11:17:46.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.166+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.0 size=1048576 2024-09-14T11:17:46.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.166+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.1 size=1048576 2024-09-14T11:17:46.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.166+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~1LFNZ5D291WT.2 size=1035192 2024-09-14T11:17:46.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.168+0000 7f1be8076780 1 < canceled multipart upload key=MX5J0P18BM0D upload=1LFNZ5D291WT tag=13E2RLIDOIWG type=write size=4180920 2024-09-14T11:17:46.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.169+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=TIQMWWBW9MWY type=write size=799643 2024-09-14T11:17:46.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.171+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~NBF1NW4YC05T.0 size=1048576 2024-09-14T11:17:46.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.172+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~NBF1NW4YC05T.1 size=999938 2024-09-14T11:17:46.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.175+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=NBF1NW4YC05T tag=X0C34QZO49ZU type=write size=3097090 2024-09-14T11:17:46.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.176+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=CVV029FMKZSA type=del size=1319951 2024-09-14T11:17:46.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.177+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.0 size=1048576 2024-09-14T11:17:46.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.178+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.1 size=1048576 2024-09-14T11:17:46.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.179+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~1YVQXHO9L9TM.2 size=928714 2024-09-14T11:17:46.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.181+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=1YVQXHO9L9TM tag=3OX3P9NRE8U9 type=write size=4074442 2024-09-14T11:17:46.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.183+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~0W65RHO58Z23.0 size=1048576 2024-09-14T11:17:46.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.184+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~0W65RHO58Z23.1 size=261133 2024-09-14T11:17:46.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.184+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=0W65RHO58Z23 tag=YIQ6UQU7HDKP type=write size=2358285 2024-09-14T11:17:46.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.185+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=9AX61W10UZ6E type=del 2024-09-14T11:17:46.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.186+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=ACG2QD6AA06S type=del size=1350122 2024-09-14T11:17:46.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.187+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.0 size=1048576 2024-09-14T11:17:46.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.188+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.1 size=1048576 2024-09-14T11:17:46.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.189+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~BQ5OP62K23M9.2 size=499276 2024-09-14T11:17:46.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.192+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=BQ5OP62K23M9 tag=Z3YDWBTGW5ZZ type=write size=3645004 2024-09-14T11:17:46.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.194+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~XSYYX1IOG2AR.0 size=1048576 2024-09-14T11:17:46.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.195+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~XSYYX1IOG2AR.1 size=974311 2024-09-14T11:17:46.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.195+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=XSYYX1IOG2AR tag=YI73YHG3S2P6 type=write size=3071463 2024-09-14T11:17:46.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.196+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.0 size=1048576 2024-09-14T11:17:46.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.197+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.1 size=1048576 2024-09-14T11:17:46.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.198+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~FQ05N3EBW1U8.2 size=750346 2024-09-14T11:17:46.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.199+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=FQ05N3EBW1U8 tag=YJ8WFF71B1QP type=write size=3896074 2024-09-14T11:17:46.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.201+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=R51RA7I4Y9IZ type=del size=1891151 2024-09-14T11:17:46.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.202+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.0 size=1048576 2024-09-14T11:17:46.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.203+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.1 size=1048576 2024-09-14T11:17:46.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.203+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~KZ4RHXL7QBZR.2 size=673990 2024-09-14T11:17:46.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.205+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=KZ4RHXL7QBZR tag=84OQ9OM7UI22 type=write size=3819718 2024-09-14T11:17:46.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.208+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~O5C6MJAB72XL.0 size=1048576 2024-09-14T11:17:46.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.209+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~O5C6MJAB72XL.1 size=328724 2024-09-14T11:17:46.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.209+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=O5C6MJAB72XL tag=IZDOGHG8HXI7 type=write size=2425876 2024-09-14T11:17:46.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.210+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=3QVR0QIRVA08 type=del 2024-09-14T11:17:46.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.211+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=4H7LI5UIXAIB type=del size=831359 2024-09-14T11:17:46.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.213+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=H5QRU6V8FDXF type=write size=68083 2024-09-14T11:17:46.215 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.217+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~PJPO5SOAY4WM.0 size=1048576 2024-09-14T11:17:46.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.218+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~PJPO5SOAY4WM.1 size=680105 2024-09-14T11:17:46.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.218+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=PJPO5SOAY4WM tag=1HJ3YC1825F6 type=write size=2777257 2024-09-14T11:17:46.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.218+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.0 size=1048576 2024-09-14T11:17:46.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.219+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.1 size=1048576 2024-09-14T11:17:46.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.219+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~BCDO4Y5G5YWN.2 size=326856 2024-09-14T11:17:46.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.221+0000 7f1be8076780 1 < canceled multipart upload key=JCDSP32N5C7M upload=BCDO4Y5G5YWN tag=QRAOL38H0M93 type=write size=3472584 2024-09-14T11:17:46.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.222+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=I176BDAQZXQY type=del size=2659731 2024-09-14T11:17:46.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.223+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~2BMVA3BKAORJ.0 size=1048576 2024-09-14T11:17:46.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.223+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~2BMVA3BKAORJ.1 size=393592 2024-09-14T11:17:46.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.225+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=2BMVA3BKAORJ tag=5KN0H7I0MF02 type=write size=2490744 2024-09-14T11:17:46.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.226+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=H2ZV1WQBAYP3 type=del size=2284092 2024-09-14T11:17:46.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.228+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~TBDBRDV3PK0W.0 size=99642 2024-09-14T11:17:46.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.230+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=TBDBRDV3PK0W tag=3UYINGM9WXS3 type=write size=1148218 2024-09-14T11:17:46.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.231+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=03UJEZ5LSTCM type=del size=3375010 2024-09-14T11:17:46.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.232+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~UXG1M64N0DQV.0 size=1048576 2024-09-14T11:17:46.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.233+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~UXG1M64N0DQV.1 size=575212 2024-09-14T11:17:46.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.235+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=UXG1M64N0DQV tag=S5BTKNKCOHUF type=write size=2672364 2024-09-14T11:17:46.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.236+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=023SWRFJE2XZ type=del size=1434593 2024-09-14T11:17:46.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.238+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=90EIX1Z3UYE1 type=del 2024-09-14T11:17:46.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.239+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=UXOSBHAP7MNS type=del size=2275345 2024-09-14T11:17:46.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.240+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~Y6XVMMDX0AXA.0 size=341291 2024-09-14T11:17:46.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.242+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=Y6XVMMDX0AXA tag=54PBUG4WCO0U type=write size=1389867 2024-09-14T11:17:46.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.244+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~6GVABWL6MRRN.0 size=1048576 2024-09-14T11:17:46.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.245+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~6GVABWL6MRRN.1 size=902867 2024-09-14T11:17:46.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.245+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=6GVABWL6MRRN tag=9VL5GLKRDWLW type=write size=3000019 2024-09-14T11:17:46.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.246+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=Y1JB01IFNJSY type=del 2024-09-14T11:17:46.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.247+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=Y6M27X8ZW3R7 type=del size=2530648 2024-09-14T11:17:46.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.248+0000 7f1be8076780 1 < completed write operation key=LNMGQ54S2CXX tag=TIQMWWBW9MWY type=write size=799643 2024-09-14T11:17:46.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.250+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.0 size=1048576 2024-09-14T11:17:46.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.251+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.1 size=1048576 2024-09-14T11:17:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.252+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.2 size=42841 2024-09-14T11:17:46.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.252+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=MAJTE2NGLDMX tag=2GWB7EV7Q4FZ type=write size=3188569 2024-09-14T11:17:46.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.253+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=CVV029FMKZSA type=del 2024-09-14T11:17:46.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.255+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.0 size=1048576 2024-09-14T11:17:46.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.256+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.1 size=1048576 2024-09-14T11:17:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.257+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.2 size=1020085 2024-09-14T11:17:46.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.257+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=FP77O7Y13I4I tag=IPZNXWNID9VD type=write size=4165813 2024-09-14T11:17:46.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.258+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~0W65RHO58Z23.0 size=1048576 2024-09-14T11:17:46.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.258+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~0W65RHO58Z23.1 size=261133 2024-09-14T11:17:46.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.260+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=0W65RHO58Z23 tag=YIQ6UQU7HDKP type=write size=2358285 2024-09-14T11:17:46.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.261+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=F1B2NCLSGIR4 type=del size=3454394 2024-09-14T11:17:46.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.262+0000 7f1be8076780 1 < canceled operation key=SJES17ZIGRZE tag=ACG2QD6AA06S type=del size=1350122 2024-09-14T11:17:46.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.263+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=C4NCE4IQZ0X5 type=del size=1253830 2024-09-14T11:17:46.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.265+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~XSYYX1IOG2AR.0 size=1048576 2024-09-14T11:17:46.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.266+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~XSYYX1IOG2AR.1 size=974311 2024-09-14T11:17:46.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.267+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=XSYYX1IOG2AR tag=YI73YHG3S2P6 type=write size=3071463 2024-09-14T11:17:46.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.269+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~TKSY1RQZHA27.0 size=1048576 2024-09-14T11:17:46.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.270+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~TKSY1RQZHA27.1 size=134750 2024-09-14T11:17:46.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.270+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=TKSY1RQZHA27 tag=HWHRMU8U3222 type=write size=2231902 2024-09-14T11:17:46.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.272+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=R51RA7I4Y9IZ type=del 2024-09-14T11:17:46.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.273+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=4R8QTJIMXBLJ type=del size=3187565 2024-09-14T11:17:46.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.274+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~O5C6MJAB72XL.0 size=1048576 2024-09-14T11:17:46.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.275+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~O5C6MJAB72XL.1 size=328724 2024-09-14T11:17:46.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.277+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=O5C6MJAB72XL tag=IZDOGHG8HXI7 type=write size=2425876 2024-09-14T11:17:46.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.278+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=399TCL0ZRO1L type=write size=433052 2024-09-14T11:17:46.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.279+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=4H7LI5UIXAIB type=del 2024-09-14T11:17:46.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.282+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~EJUHAM1MISHU.0 size=1048576 2024-09-14T11:17:46.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.283+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~EJUHAM1MISHU.1 size=648997 2024-09-14T11:17:46.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.283+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=EJUHAM1MISHU tag=MJ225IAO8EDK type=write size=2746149 2024-09-14T11:17:46.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.284+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~PJPO5SOAY4WM.0 size=1048576 2024-09-14T11:17:46.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.285+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~PJPO5SOAY4WM.1 size=680105 2024-09-14T11:17:46.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.287+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=PJPO5SOAY4WM tag=1HJ3YC1825F6 type=write size=2777257 2024-09-14T11:17:46.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.288+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=7GOBJXQ9T6Q8 type=del size=3136450 2024-09-14T11:17:46.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.289+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=I176BDAQZXQY type=del 2024-09-14T11:17:46.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.292+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~X7UPBA0E0X7T.0 size=1048576 2024-09-14T11:17:46.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.293+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~X7UPBA0E0X7T.1 size=642045 2024-09-14T11:17:46.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.293+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=X7UPBA0E0X7T tag=YKRFZWZO6SXO type=write size=2739197 2024-09-14T11:17:46.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.294+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=H2ZV1WQBAYP3 type=del 2024-09-14T11:17:46.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.296+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~FA19BJA4FQEQ.0 size=1048576 2024-09-14T11:17:46.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.297+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~FA19BJA4FQEQ.1 size=479218 2024-09-14T11:17:46.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.297+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=FA19BJA4FQEQ tag=YRISE2ECHRL4 type=write size=2576370 2024-09-14T11:17:46.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.298+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=03UJEZ5LSTCM type=del 2024-09-14T11:17:46.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.299+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=PIZRXBEYWMU8 type=write size=365252 2024-09-14T11:17:46.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.300+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=023SWRFJE2XZ type=del 2024-09-14T11:17:46.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.302+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~GLBD06OU98YQ.0 size=1048576 2024-09-14T11:17:46.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.303+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~GLBD06OU98YQ.1 size=3388 2024-09-14T11:17:46.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.303+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=GLBD06OU98YQ tag=OW7TOTC8OW56 type=write size=2100540 2024-09-14T11:17:46.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.304+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=UXOSBHAP7MNS type=del 2024-09-14T11:17:46.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.307+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=2BI1ABDIC3B8 type=del size=1874207 2024-09-14T11:17:46.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.308+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~6GVABWL6MRRN.0 size=1048576 2024-09-14T11:17:46.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.309+0000 7f1be8076780 1 < canceled part key=_multipart_9DRSDTGM7Y3F.2~6GVABWL6MRRN.1 size=902867 2024-09-14T11:17:46.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.311+0000 7f1be8076780 1 < canceled multipart upload key=9DRSDTGM7Y3F upload=6GVABWL6MRRN tag=9VL5GLKRDWLW type=write size=3000019 2024-09-14T11:17:46.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.312+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=HJKAFTD1442J type=del size=1225051 2024-09-14T11:17:46.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.313+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=Y6M27X8ZW3R7 type=del 2024-09-14T11:17:46.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.316+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~YB6N0OFQ6Y39.0 size=29592 2024-09-14T11:17:46.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.316+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=YB6N0OFQ6Y39 tag=MB76WE63SS4J type=write size=1078168 2024-09-14T11:17:46.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.317+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.0 size=1048576 2024-09-14T11:17:46.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.318+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.1 size=1048576 2024-09-14T11:17:46.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.319+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~MAJTE2NGLDMX.2 size=42841 2024-09-14T11:17:46.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.321+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=MAJTE2NGLDMX tag=2GWB7EV7Q4FZ type=write size=3188569 2024-09-14T11:17:46.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.322+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=RYIYTOMHB69H type=del size=2250813 2024-09-14T11:17:46.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.323+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.0 size=1048576 2024-09-14T11:17:46.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.324+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.1 size=1048576 2024-09-14T11:17:46.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.325+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~FP77O7Y13I4I.2 size=1020085 2024-09-14T11:17:46.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.327+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=FP77O7Y13I4I tag=IPZNXWNID9VD type=write size=4165813 2024-09-14T11:17:46.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.328+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=DKCQT5H1IGUG type=del size=1749478 2024-09-14T11:17:46.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.329+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=F1B2NCLSGIR4 type=del 2024-09-14T11:17:46.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.332+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~2H4PKMX3RIS9.0 size=848776 2024-09-14T11:17:46.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.332+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=2H4PKMX3RIS9 tag=R3R58K9Q1TYO type=write size=1897352 2024-09-14T11:17:46.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.333+0000 7f1be8076780 1 < canceled operation key=2RJYZ1CRDVEP tag=C4NCE4IQZ0X5 type=del size=1253830 2024-09-14T11:17:46.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.335+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~R8ORFL2QSCTE.0 size=546216 2024-09-14T11:17:46.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.335+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=R8ORFL2QSCTE tag=ZF9Q76PZOAT7 type=write size=1594792 2024-09-14T11:17:46.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.335+0000 7f1be8076780 1 < canceled part key=_multipart_RIYGSRWKVKFF.2~TKSY1RQZHA27.0 size=1048576 2024-09-14T11:17:46.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.336+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~TKSY1RQZHA27.1 size=134750 2024-09-14T11:17:46.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.338+0000 7f1be8076780 1 < canceled multipart upload key=RIYGSRWKVKFF upload=TKSY1RQZHA27 tag=HWHRMU8U3222 type=write size=2231902 2024-09-14T11:17:46.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.339+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=WPDOLUCXBY8E type=write size=50895 2024-09-14T11:17:46.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.340+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=4R8QTJIMXBLJ type=del 2024-09-14T11:17:46.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.342+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=2FU5BMJ91G1C type=del size=2005152 2024-09-14T11:17:46.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.344+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=399TCL0ZRO1L type=write size=433052 2024-09-14T11:17:46.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.345+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=MU42RLKK3VGH type=del size=2291285 2024-09-14T11:17:46.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.346+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~EJUHAM1MISHU.0 size=1048576 2024-09-14T11:17:46.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.347+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~EJUHAM1MISHU.1 size=648997 2024-09-14T11:17:46.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.349+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=EJUHAM1MISHU tag=MJ225IAO8EDK type=write size=2746149 2024-09-14T11:17:46.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.351+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.0 size=1048576 2024-09-14T11:17:46.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.352+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.1 size=1048576 2024-09-14T11:17:46.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.353+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.2 size=152236 2024-09-14T11:17:46.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.353+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=IVJBHSDG8S3K tag=PIWDFD26S18L type=write size=3297964 2024-09-14T11:17:46.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.354+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=7GOBJXQ9T6Q8 type=del 2024-09-14T11:17:46.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.355+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=FCK5J7DZEOV8 type=del size=4109655 2024-09-14T11:17:46.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.356+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~X7UPBA0E0X7T.0 size=1048576 2024-09-14T11:17:46.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.357+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~X7UPBA0E0X7T.1 size=642045 2024-09-14T11:17:46.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.359+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=X7UPBA0E0X7T tag=YKRFZWZO6SXO type=write size=2739197 2024-09-14T11:17:46.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.360+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=XLUD9WZ3G7U7 type=del size=2895896 2024-09-14T11:17:46.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.361+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~FA19BJA4FQEQ.0 size=1048576 2024-09-14T11:17:46.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.362+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~FA19BJA4FQEQ.1 size=479218 2024-09-14T11:17:46.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.364+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=FA19BJA4FQEQ tag=YRISE2ECHRL4 type=write size=2576370 2024-09-14T11:17:46.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.366+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.0 size=1048576 2024-09-14T11:17:46.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.367+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.1 size=1048576 2024-09-14T11:17:46.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.368+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.2 size=259791 2024-09-14T11:17:46.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.368+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=BSY9W19X9LGN tag=1N6ZMPTQVZRE type=write size=3405519 2024-09-14T11:17:46.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.369+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=PIZRXBEYWMU8 type=write size=365252 2024-09-14T11:17:46.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.371+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.0 size=1048576 2024-09-14T11:17:46.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.372+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.1 size=1048576 2024-09-14T11:17:46.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.373+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.2 size=698287 2024-09-14T11:17:46.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.373+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=ZH0DSV5BZ1I7 tag=7S6AH9FJD4IY type=write size=3844015 2024-09-14T11:17:46.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.374+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~GLBD06OU98YQ.0 size=1048576 2024-09-14T11:17:46.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.375+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~GLBD06OU98YQ.1 size=3388 2024-09-14T11:17:46.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.377+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=GLBD06OU98YQ tag=OW7TOTC8OW56 type=write size=2100540 2024-09-14T11:17:46.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.378+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=4UO5NDBM42LX type=del size=2438103 2024-09-14T11:17:46.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.379+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=2BI1ABDIC3B8 type=del 2024-09-14T11:17:46.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.381+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~M3PPS83SP0GW.0 size=739582 2024-09-14T11:17:46.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.381+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=M3PPS83SP0GW tag=9JBUR6I0PO9G type=write size=1788158 2024-09-14T11:17:46.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.382+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=HJKAFTD1442J type=del 2024-09-14T11:17:46.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.384+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=DA8HEMMQA0GG type=write size=673061 2024-09-14T11:17:46.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.385+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~YB6N0OFQ6Y39.0 size=29592 2024-09-14T11:17:46.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.387+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=YB6N0OFQ6Y39 tag=MB76WE63SS4J type=write size=1078168 2024-09-14T11:17:46.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.388+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=0FT9GX625MFZ type=del size=2842474 2024-09-14T11:17:46.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.389+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=RYIYTOMHB69H type=del 2024-09-14T11:17:46.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.392+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~VNL9M7P6D9KV.0 size=126848 2024-09-14T11:17:46.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.392+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=VNL9M7P6D9KV tag=MF1NE1F66V6C type=write size=1175424 2024-09-14T11:17:46.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.393+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=DKCQT5H1IGUG type=del 2024-09-14T11:17:46.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.395+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.0 size=1048576 2024-09-14T11:17:46.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.396+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.1 size=1048576 2024-09-14T11:17:46.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.397+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.2 size=61289 2024-09-14T11:17:46.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.397+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=XTXB9BFERXRZ tag=3U9N0A3GRW92 type=write size=3207017 2024-09-14T11:17:46.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.398+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~2H4PKMX3RIS9.0 size=848776 2024-09-14T11:17:46.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.400+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=2H4PKMX3RIS9 tag=R3R58K9Q1TYO type=write size=1897352 2024-09-14T11:17:46.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.402+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~LE8Y59992PBR.0 size=1048576 2024-09-14T11:17:46.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.403+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~LE8Y59992PBR.1 size=1011691 2024-09-14T11:17:46.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.403+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=LE8Y59992PBR tag=16EC08QBOY6N type=write size=3108843 2024-09-14T11:17:46.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.404+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~R8ORFL2QSCTE.0 size=546216 2024-09-14T11:17:46.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.406+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=R8ORFL2QSCTE tag=ZF9Q76PZOAT7 type=write size=1594792 2024-09-14T11:17:46.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.408+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=EG6H4CACW8O3 type=del size=3666307 2024-09-14T11:17:46.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.409+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=WPDOLUCXBY8E type=write size=50895 2024-09-14T11:17:46.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.411+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~VWTLAS099CBX.0 size=247278 2024-09-14T11:17:46.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.411+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=VWTLAS099CBX tag=AAAC68FZXANK type=write size=1295854 2024-09-14T11:17:46.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.412+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=2FU5BMJ91G1C type=del 2024-09-14T11:17:46.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.414+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=0VZ4Y4TJQ3M8 type=write size=982943 2024-09-14T11:17:46.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.415+0000 7f1be8076780 1 < canceled operation key=XB3M4CI0ERWP tag=MU42RLKK3VGH type=del size=2291285 2024-09-14T11:17:46.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.417+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.0 size=1048576 2024-09-14T11:17:46.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.418+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.1 size=1048576 2024-09-14T11:17:46.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.419+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.2 size=1040623 2024-09-14T11:17:46.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.419+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=A4C81XHZGLEC tag=ZJH9Y2PQ9TRK type=write size=4186351 2024-09-14T11:17:46.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.421+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.0 size=1048576 2024-09-14T11:17:46.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.422+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.1 size=1048576 2024-09-14T11:17:46.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.423+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~IVJBHSDG8S3K.2 size=152236 2024-09-14T11:17:46.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.425+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=IVJBHSDG8S3K tag=PIWDFD26S18L type=write size=3297964 2024-09-14T11:17:46.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.426+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=3N8AUMDEPVWL type=del size=3441154 2024-09-14T11:17:46.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.428+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=FCK5J7DZEOV8 type=del size=4109655 2024-09-14T11:17:46.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.430+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=56V5C7FJHN5T type=del size=481615 2024-09-14T11:17:46.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.432+0000 7f1be8076780 1 < suggested update operation key=QC6MEJABT7IM tag=XLUD9WZ3G7U7 type=del size=2895896 2024-09-14T11:17:46.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.434+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.0 size=1048576 2024-09-14T11:17:46.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.435+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.1 size=1048576 2024-09-14T11:17:46.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.436+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.2 size=626558 2024-09-14T11:17:46.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.436+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=CXS0RBUZT59N tag=J05VHUEX98LU type=write size=3772286 2024-09-14T11:17:46.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.437+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.0 size=1048576 2024-09-14T11:17:46.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.438+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.1 size=1048576 2024-09-14T11:17:46.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.439+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~BSY9W19X9LGN.2 size=259791 2024-09-14T11:17:46.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.441+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=BSY9W19X9LGN tag=1N6ZMPTQVZRE type=write size=3405519 2024-09-14T11:17:46.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.442+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=JZQ6T6JIDJG7 type=del size=1185129 2024-09-14T11:17:46.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.444+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.0 size=1048576 2024-09-14T11:17:46.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.445+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.1 size=1048576 2024-09-14T11:17:46.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.445+0000 7f1be8076780 1 < canceled part key=_multipart_UB0SEYZ7ITU1.2~ZH0DSV5BZ1I7.2 size=698287 2024-09-14T11:17:46.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.447+0000 7f1be8076780 1 < canceled multipart upload key=UB0SEYZ7ITU1 upload=ZH0DSV5BZ1I7 tag=7S6AH9FJD4IY type=write size=3844015 2024-09-14T11:17:46.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.449+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~ZB0G484W7YPR.0 size=580145 2024-09-14T11:17:46.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.449+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=ZB0G484W7YPR tag=YCHOLWK6YT2I type=write size=1628721 2024-09-14T11:17:46.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.450+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=4UO5NDBM42LX type=del 2024-09-14T11:17:46.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.451+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=U8F2Y1VO0S6R type=del size=3385393 2024-09-14T11:17:46.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.453+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~M3PPS83SP0GW.0 size=739582 2024-09-14T11:17:46.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.454+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=M3PPS83SP0GW tag=9JBUR6I0PO9G type=write size=1788158 2024-09-14T11:17:46.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.456+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=KNIDSW1IX0BI type=del size=1992817 2024-09-14T11:17:46.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.457+0000 7f1be8076780 1 < completed write operation key=9DRSDTGM7Y3F tag=DA8HEMMQA0GG type=write size=673061 2024-09-14T11:17:46.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.459+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.0 size=1048576 2024-09-14T11:17:46.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.460+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.1 size=1048576 2024-09-14T11:17:46.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.461+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.2 size=1010532 2024-09-14T11:17:46.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.461+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=WHI91WQO33JY tag=RXAITMFZQYEB type=write size=4156260 2024-09-14T11:17:46.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.462+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=0FT9GX625MFZ type=del size=2842474 2024-09-14T11:17:46.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.463+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=OB97M6YLQCV3 type=write size=392960 2024-09-14T11:17:46.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.464+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~VNL9M7P6D9KV.0 size=126848 2024-09-14T11:17:46.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.466+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=VNL9M7P6D9KV tag=MF1NE1F66V6C type=write size=1175424 2024-09-14T11:17:46.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.467+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=V9H9W8O89VPL type=del size=2790653 2024-09-14T11:17:46.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.468+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.0 size=1048576 2024-09-14T11:17:46.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.469+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.1 size=1048576 2024-09-14T11:17:46.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.470+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~XTXB9BFERXRZ.2 size=61289 2024-09-14T11:17:46.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.472+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=XTXB9BFERXRZ tag=3U9N0A3GRW92 type=write size=3207017 2024-09-14T11:17:46.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.473+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=X0LHE3WYHQK5 type=del size=1769004 2024-09-14T11:17:46.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.475+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~LE8Y59992PBR.0 size=1048576 2024-09-14T11:17:46.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.476+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~LE8Y59992PBR.1 size=1011691 2024-09-14T11:17:46.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.478+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=LE8Y59992PBR tag=16EC08QBOY6N type=write size=3108843 2024-09-14T11:17:46.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.479+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=7R4BXJVW70R7 type=write size=379271 2024-09-14T11:17:46.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.480+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=EG6H4CACW8O3 type=del 2024-09-14T11:17:46.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.481+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=X479G3G2RW1P type=write size=147039 2024-09-14T11:17:46.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.482+0000 7f1be8076780 1 < canceled part key=_multipart_7OUNKTS3X7DJ.2~VWTLAS099CBX.0 size=247278 2024-09-14T11:17:46.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.484+0000 7f1be8076780 1 < canceled multipart upload key=7OUNKTS3X7DJ upload=VWTLAS099CBX tag=AAAC68FZXANK type=write size=1295854 2024-09-14T11:17:46.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.486+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~568EXAW2N71U.0 size=1048576 2024-09-14T11:17:46.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.487+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~568EXAW2N71U.1 size=171481 2024-09-14T11:17:46.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.487+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=568EXAW2N71U tag=E6SB7GI3XFAI type=write size=2268633 2024-09-14T11:17:46.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.488+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=0VZ4Y4TJQ3M8 type=write size=982943 2024-09-14T11:17:46.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.489+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=Z8UFKER9U8PL type=del size=3615030 2024-09-14T11:17:46.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.490+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.0 size=1048576 2024-09-14T11:17:46.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.490+0000 7f1be8076780 1 < canceled part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.1 size=1048576 2024-09-14T11:17:46.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.491+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~A4C81XHZGLEC.2 size=1040623 2024-09-14T11:17:46.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.493+0000 7f1be8076780 1 < canceled multipart upload key=1RUE5J1DYH2C upload=A4C81XHZGLEC tag=ZJH9Y2PQ9TRK type=write size=4186351 2024-09-14T11:17:46.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.495+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~OA8VPVSJYK5Q.0 size=592170 2024-09-14T11:17:46.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.495+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=OA8VPVSJYK5Q tag=YRSEAVA3WC2C type=write size=1640746 2024-09-14T11:17:46.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.496+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=3N8AUMDEPVWL type=del 2024-09-14T11:17:46.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.498+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~HHZMK1G5KXYQ.0 size=792108 2024-09-14T11:17:46.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.498+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=HHZMK1G5KXYQ tag=FN43X1LJCXLJ type=write size=1840684 2024-09-14T11:17:46.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.500+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=56V5C7FJHN5T type=del 2024-09-14T11:17:46.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.504+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~K6LIJU4GLGUM.0 size=1048576 2024-09-14T11:17:46.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.505+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~K6LIJU4GLGUM.1 size=640787 2024-09-14T11:17:46.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.505+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=K6LIJU4GLGUM tag=ITRV98K0UJWC type=write size=2737939 2024-09-14T11:17:46.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.507+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.0 size=1048576 2024-09-14T11:17:46.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.508+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.1 size=1048576 2024-09-14T11:17:46.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.509+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~CXS0RBUZT59N.2 size=626558 2024-09-14T11:17:46.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.511+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=CXS0RBUZT59N tag=J05VHUEX98LU type=write size=3772286 2024-09-14T11:17:46.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.512+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=L7RXGDMKECD6 type=write size=7219 2024-09-14T11:17:46.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.514+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=JZQ6T6JIDJG7 type=del 2024-09-14T11:17:46.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.516+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~31VG0MGIVGH9.0 size=296466 2024-09-14T11:17:46.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.516+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=31VG0MGIVGH9 tag=81F233Q3YZHD type=write size=1345042 2024-09-14T11:17:46.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.517+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~ZB0G484W7YPR.0 size=580145 2024-09-14T11:17:46.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.519+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=ZB0G484W7YPR tag=YCHOLWK6YT2I type=write size=1628721 2024-09-14T11:17:46.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.520+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=BXQ29LBYLP60 type=del size=2050821 2024-09-14T11:17:46.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.521+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=U8F2Y1VO0S6R type=del 2024-09-14T11:17:46.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.522+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=1N1NZIFD373A type=del size=3435303 2024-09-14T11:17:46.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.524+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=KNIDSW1IX0BI type=del 2024-09-14T11:17:46.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.525+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=O9RDW8GR3NK3 type=write size=996950 2024-09-14T11:17:46.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.525+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.0 size=1048576 2024-09-14T11:17:46.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.526+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.1 size=1048576 2024-09-14T11:17:46.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.529+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~WHI91WQO33JY.2 size=1010532 2024-09-14T11:17:46.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.530+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=WHI91WQO33JY tag=RXAITMFZQYEB type=write size=4156260 2024-09-14T11:17:46.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.533+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~PUMMEQB0BPZ9.0 size=1048576 2024-09-14T11:17:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.533+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~PUMMEQB0BPZ9.1 size=207907 2024-09-14T11:17:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.533+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=PUMMEQB0BPZ9 tag=5YRK5539E5W0 type=write size=2305059 2024-09-14T11:17:46.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.535+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=OB97M6YLQCV3 type=write size=392960 2024-09-14T11:17:46.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.537+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~FEDCYMCXUN1S.0 size=1048576 2024-09-14T11:17:46.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.538+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~FEDCYMCXUN1S.1 size=942743 2024-09-14T11:17:46.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.538+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=FEDCYMCXUN1S tag=ZMCR7VIY4HS6 type=write size=3039895 2024-09-14T11:17:46.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.539+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=V9H9W8O89VPL type=del 2024-09-14T11:17:46.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.541+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=Y0YH4S5A16IF type=del size=2818669 2024-09-14T11:17:46.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.542+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=X0LHE3WYHQK5 type=del 2024-09-14T11:17:46.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.543+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=S80FQKHHW2WO type=del size=1573547 2024-09-14T11:17:46.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.544+0000 7f1be8076780 1 < canceled operation key=9DRSDTGM7Y3F tag=7R4BXJVW70R7 type=write size=379271 2024-09-14T11:17:46.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.545+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=MO1W42IGFXWK type=del size=702608 2024-09-14T11:17:46.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.547+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=X479G3G2RW1P type=write size=147039 2024-09-14T11:17:46.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.549+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.0 size=1048576 2024-09-14T11:17:46.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.550+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.1 size=1048576 2024-09-14T11:17:46.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.551+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.2 size=240934 2024-09-14T11:17:46.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.551+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=Z94OZCULWM6T tag=2HU18MXBVFZJ type=write size=3386662 2024-09-14T11:17:46.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.552+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~568EXAW2N71U.0 size=1048576 2024-09-14T11:17:46.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.553+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~568EXAW2N71U.1 size=171481 2024-09-14T11:17:46.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.555+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=568EXAW2N71U tag=E6SB7GI3XFAI type=write size=2268633 2024-09-14T11:17:46.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.556+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=6KFMJOYR7C0S type=del size=564636 2024-09-14T11:17:46.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.558+0000 7f1be8076780 1 < suggested update operation key=JGEBWM9VRCFW tag=Z8UFKER9U8PL type=del size=3615030 2024-09-14T11:17:46.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.559+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=O0BQW4AOT7EL type=del size=2573701 2024-09-14T11:17:46.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.560+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~OA8VPVSJYK5Q.0 size=592170 2024-09-14T11:17:46.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.562+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=OA8VPVSJYK5Q tag=YRSEAVA3WC2C type=write size=1640746 2024-09-14T11:17:46.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.565+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.0 size=1048576 2024-09-14T11:17:46.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.566+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.1 size=1048576 2024-09-14T11:17:46.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.567+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.2 size=708880 2024-09-14T11:17:46.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.567+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=S95RASG4XJ07 tag=ITSQ92RDCU08 type=write size=3854608 2024-09-14T11:17:46.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.568+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~HHZMK1G5KXYQ.0 size=792108 2024-09-14T11:17:46.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.570+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=HHZMK1G5KXYQ tag=FN43X1LJCXLJ type=write size=1840684 2024-09-14T11:17:46.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.571+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=B02U2IC0P7FZ type=del size=1138640 2024-09-14T11:17:46.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.572+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~K6LIJU4GLGUM.0 size=1048576 2024-09-14T11:17:46.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.573+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~K6LIJU4GLGUM.1 size=640787 2024-09-14T11:17:46.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.575+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=K6LIJU4GLGUM tag=ITRV98K0UJWC type=write size=2737939 2024-09-14T11:17:46.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.577+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.0 size=1048576 2024-09-14T11:17:46.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.578+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.1 size=1048576 2024-09-14T11:17:46.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.580+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.2 size=687898 2024-09-14T11:17:46.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.580+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=N0KHQNVDHS22 tag=LA53T43WZB9B type=write size=3833626 2024-09-14T11:17:46.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.581+0000 7f1be8076780 -1 < failed to complete operation key=JGEBWM9VRCFW tag=L7RXGDMKECD6 type=write size=7219: (22) Invalid argument 2024-09-14T11:17:46.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.582+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=1Y1NKAMD8U1E type=write size=384987 2024-09-14T11:17:46.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.583+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~31VG0MGIVGH9.0 size=296466 2024-09-14T11:17:46.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.585+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=31VG0MGIVGH9 tag=81F233Q3YZHD type=write size=1345042 2024-09-14T11:17:46.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.586+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=6IKHFUTUFIHP type=del size=2826239 2024-09-14T11:17:46.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.587+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=BXQ29LBYLP60 type=del 2024-09-14T11:17:46.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.588+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=0M5MJNIJUPXI type=write size=172140 2024-09-14T11:17:46.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.590+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=1N1NZIFD373A type=del 2024-09-14T11:17:46.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.591+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=3DGPLE8LGM8F type=del size=1225219 2024-09-14T11:17:46.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.592+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=O9RDW8GR3NK3 type=write size=996950 2024-09-14T11:17:46.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.593+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=5EWSANP7IPDY type=del size=3641802 2024-09-14T11:17:46.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.594+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~PUMMEQB0BPZ9.0 size=1048576 2024-09-14T11:17:46.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.595+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~PUMMEQB0BPZ9.1 size=207907 2024-09-14T11:17:46.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.597+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=PUMMEQB0BPZ9 tag=5YRK5539E5W0 type=write size=2305059 2024-09-14T11:17:46.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.598+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=BVD68MYXIX6V type=del size=1504199 2024-09-14T11:17:46.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.600+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~FEDCYMCXUN1S.0 size=1048576 2024-09-14T11:17:46.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.600+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~FEDCYMCXUN1S.1 size=942743 2024-09-14T11:17:46.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.602+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=FEDCYMCXUN1S tag=ZMCR7VIY4HS6 type=write size=3039895 2024-09-14T11:17:46.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.604+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~DRDP5SO2RHYC.0 size=19813 2024-09-14T11:17:46.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.604+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=DRDP5SO2RHYC tag=ETYV7IE9841Z type=write size=1068389 2024-09-14T11:17:46.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.606+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=Y0YH4S5A16IF type=del 2024-09-14T11:17:46.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.607+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=KQWAJPFKX1PP type=del size=2494961 2024-09-14T11:17:46.607 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.608+0000 7f1be8076780 1 < canceled operation key=MX5J0P18BM0D tag=S80FQKHHW2WO type=del size=1573547 2024-09-14T11:17:46.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.609+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=SGCXSCF7WY20 type=write size=56024 2024-09-14T11:17:46.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.610+0000 7f1be8076780 1 < canceled operation key=RIYGSRWKVKFF tag=MO1W42IGFXWK type=del size=702608 2024-09-14T11:17:46.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.612+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=USIH0SEKAE09 type=write size=283565 2024-09-14T11:17:46.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.612+0000 7f1be8076780 1 < canceled part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.0 size=1048576 2024-09-14T11:17:46.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.613+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.1 size=1048576 2024-09-14T11:17:46.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.615+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~Z94OZCULWM6T.2 size=240934 2024-09-14T11:17:46.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.617+0000 7f1be8076780 1 < canceled multipart upload key=JDKFKO39I56L upload=Z94OZCULWM6T tag=2HU18MXBVFZJ type=write size=3386662 2024-09-14T11:17:46.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.618+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=YS8KIXXDE9E7 type=del size=430308 2024-09-14T11:17:46.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.619+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=6KFMJOYR7C0S type=del 2024-09-14T11:17:46.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.620+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=6WN8NZI0GQK2 type=del size=3105057 2024-09-14T11:17:46.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.621+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=O0BQW4AOT7EL type=del 2024-09-14T11:17:46.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.622+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=OCUOKT7UBBMH type=del size=3648082 2024-09-14T11:17:46.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.624+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.0 size=1048576 2024-09-14T11:17:46.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.625+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.1 size=1048576 2024-09-14T11:17:46.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.626+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~S95RASG4XJ07.2 size=708880 2024-09-14T11:17:46.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.628+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=S95RASG4XJ07 tag=ITSQ92RDCU08 type=write size=3854608 2024-09-14T11:17:46.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.629+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=VD02E4JVH1X1 type=del size=793119 2024-09-14T11:17:46.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.630+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=B02U2IC0P7FZ type=del 2024-09-14T11:17:46.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.632+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~AFGVZV2BJDSW.0 size=675004 2024-09-14T11:17:46.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.632+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=AFGVZV2BJDSW tag=1AGIM09T16IF type=write size=1723580 2024-09-14T11:17:46.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.632+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.0 size=1048576 2024-09-14T11:17:46.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.632+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.1 size=1048576 2024-09-14T11:17:46.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.633+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~N0KHQNVDHS22.2 size=687898 2024-09-14T11:17:46.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.635+0000 7f1be8076780 1 < canceled multipart upload key=QIEUKUQ8CS2U upload=N0KHQNVDHS22 tag=LA53T43WZB9B type=write size=3833626 2024-09-14T11:17:46.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.636+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=KYQ6LL33GF80 type=del size=1913919 2024-09-14T11:17:46.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.639+0000 7f1be8076780 1 < suggested remove operation key=4AY6ZXFKO1YQ tag=1Y1NKAMD8U1E type=write 2024-09-14T11:17:46.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.640+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=GPUJQZSYEDQL type=del size=2670456 2024-09-14T11:17:46.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.641+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=6IKHFUTUFIHP type=del 2024-09-14T11:17:46.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.643+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=3V5YHZGMZQON type=del size=3736169 2024-09-14T11:17:46.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.644+0000 7f1be8076780 1 < completed write operation key=4ADXXTIO715C tag=0M5MJNIJUPXI type=write size=172140 2024-09-14T11:17:46.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.645+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=4O8Y1ZR4A1BB type=del size=3039955 2024-09-14T11:17:46.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.646+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=3DGPLE8LGM8F type=del 2024-09-14T11:17:46.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.649+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~0W3D3644VMK7.0 size=484279 2024-09-14T11:17:46.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.649+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=0W3D3644VMK7 tag=HHR3WGV5THTX type=write size=1532855 2024-09-14T11:17:46.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.650+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=5EWSANP7IPDY type=del 2024-09-14T11:17:46.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.653+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~5IVVAYV3ATRK.0 size=1048576 2024-09-14T11:17:46.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.654+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~5IVVAYV3ATRK.1 size=570461 2024-09-14T11:17:46.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.654+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=5IVVAYV3ATRK tag=OZG0EWOSQNHB type=write size=2667613 2024-09-14T11:17:46.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.655+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=BVD68MYXIX6V type=del 2024-09-14T11:17:46.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.658+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~G3P9D5JNWLS8.0 size=246525 2024-09-14T11:17:46.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.658+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=G3P9D5JNWLS8 tag=48BG0MMG2Y6N type=write size=1295101 2024-09-14T11:17:46.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.659+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~DRDP5SO2RHYC.0 size=19813 2024-09-14T11:17:46.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.661+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=DRDP5SO2RHYC tag=ETYV7IE9841Z type=write size=1068389 2024-09-14T11:17:46.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.662+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=5DZKTTSF7ZH9 type=del size=2655072 2024-09-14T11:17:46.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.664+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=KQWAJPFKX1PP type=del 2024-09-14T11:17:46.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.665+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=L29950R8812H type=write size=437381 2024-09-14T11:17:46.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.668+0000 7f1be8076780 1 < suggested remove operation key=JDKFKO39I56L tag=SGCXSCF7WY20 type=write 2024-09-14T11:17:46.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.669+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=SONLFCDUK8IJ type=del size=4018809 2024-09-14T11:17:46.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.670+0000 7f1be8076780 -1 < failed to complete operation key=4AY6ZXFKO1YQ tag=USIH0SEKAE09 type=write size=283565: (22) Invalid argument 2024-09-14T11:17:46.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.671+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=J92BJTT2VVS3 type=del size=1558157 2024-09-14T11:17:46.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.672+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=YS8KIXXDE9E7 type=del 2024-09-14T11:17:46.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.673+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=OQ181LSCF5CE type=del size=204871 2024-09-14T11:17:46.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.674+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=6WN8NZI0GQK2 type=del 2024-09-14T11:17:46.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.676+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=Y008FP5I4YOI type=del size=1699061 2024-09-14T11:17:46.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.677+0000 7f1be8076780 1 < canceled operation key=1RUE5J1DYH2C tag=OCUOKT7UBBMH type=del size=3648082 2024-09-14T11:17:46.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.679+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~2GGWHZB7MNBA.0 size=1048576 2024-09-14T11:17:46.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.680+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~2GGWHZB7MNBA.1 size=200143 2024-09-14T11:17:46.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.680+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=2GGWHZB7MNBA tag=VESC0T9BKM6K type=write size=2297295 2024-09-14T11:17:46.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.681+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=VD02E4JVH1X1 type=del 2024-09-14T11:17:46.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.682+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=5EBJILUCTSJ3 type=write size=257078 2024-09-14T11:17:46.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.683+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~AFGVZV2BJDSW.0 size=675004 2024-09-14T11:17:46.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.685+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=AFGVZV2BJDSW tag=1AGIM09T16IF type=write size=1723580 2024-09-14T11:17:46.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.687+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=TU882UVFNBAE type=del size=442146 2024-09-14T11:17:46.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.689+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=KYQ6LL33GF80 type=del 2024-09-14T11:17:46.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.690+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=A5C0VNTKIPGB type=write size=85670 2024-09-14T11:17:46.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.692+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=GPUJQZSYEDQL type=del 2024-09-14T11:17:46.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.694+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~NSKV9511P890.0 size=1048576 2024-09-14T11:17:46.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.695+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~NSKV9511P890.1 size=1048576 2024-09-14T11:17:46.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.696+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~NSKV9511P890.2 size=857571 2024-09-14T11:17:46.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.696+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=NSKV9511P890 tag=39RKO2QS94UK type=write size=4003299 2024-09-14T11:17:46.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.698+0000 7f1be8076780 1 < suggested remove operation key=4ADXXTIO715C tag=3V5YHZGMZQON type=del 2024-09-14T11:17:46.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.701+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~C1PFL37ZVBSU.0 size=1048576 2024-09-14T11:17:46.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.702+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~C1PFL37ZVBSU.1 size=134885 2024-09-14T11:17:46.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.702+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=C1PFL37ZVBSU tag=AH7OO9R2MEHZ type=write size=2232037 2024-09-14T11:17:46.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.703+0000 7f1be8076780 -1 < failed to complete operation key=0BX70Q8C1QL0 tag=4O8Y1ZR4A1BB type=del size=3039955: (22) Invalid argument 2024-09-14T11:17:46.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.704+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=8MVP3D7GHPWR type=del size=472315 2024-09-14T11:17:46.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.705+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~0W3D3644VMK7.0 size=484279 2024-09-14T11:17:46.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.707+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=0W3D3644VMK7 tag=HHR3WGV5THTX type=write size=1532855 2024-09-14T11:17:46.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.709+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~Z1PAYT59Y6RO.0 size=1048576 2024-09-14T11:17:46.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.710+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~Z1PAYT59Y6RO.1 size=763958 2024-09-14T11:17:46.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.710+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=Z1PAYT59Y6RO tag=TN8M1DABGLB8 type=write size=2861110 2024-09-14T11:17:46.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.712+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~5IVVAYV3ATRK.0 size=1048576 2024-09-14T11:17:46.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.713+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~5IVVAYV3ATRK.1 size=570461 2024-09-14T11:17:46.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.715+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=5IVVAYV3ATRK tag=OZG0EWOSQNHB type=write size=2667613 2024-09-14T11:17:46.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.717+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~MJY290GDBKI2.0 size=1048576 2024-09-14T11:17:46.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.718+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~MJY290GDBKI2.1 size=994126 2024-09-14T11:17:46.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.718+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=MJY290GDBKI2 tag=0OR3FZ1KIWIS type=write size=3091278 2024-09-14T11:17:46.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.719+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~G3P9D5JNWLS8.0 size=246525 2024-09-14T11:17:46.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.721+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=G3P9D5JNWLS8 tag=48BG0MMG2Y6N type=write size=1295101 2024-09-14T11:17:46.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.722+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=40FVJQZN57H2 type=write size=172721 2024-09-14T11:17:46.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.723+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=5DZKTTSF7ZH9 type=del 2024-09-14T11:17:46.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.725+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~1NTAK3RE39DG.0 size=48050 2024-09-14T11:17:46.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.725+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=1NTAK3RE39DG tag=4BV80PLRA2HQ type=write size=1096626 2024-09-14T11:17:46.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.727+0000 7f1be8076780 1 < completed write operation key=1X2EWK1Y2GE0 tag=L29950R8812H type=write size=437381 2024-09-14T11:17:46.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.728+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=8P5ZX69NBVNK type=write size=670155 2024-09-14T11:17:46.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.731+0000 7f1be8076780 1 < suggested update operation key=26WW5JFVB36U tag=SONLFCDUK8IJ type=del size=4018809 2024-09-14T11:17:46.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.733+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=ICIG8OYWLU5M type=write size=585119 2024-09-14T11:17:46.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.734+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=J92BJTT2VVS3 type=del size=1558157 2024-09-14T11:17:46.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.735+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=XJXZUKJC7EH3 type=del size=2782516 2024-09-14T11:17:46.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.736+0000 7f1be8076780 -1 < failed to complete operation key=4ADXXTIO715C tag=OQ181LSCF5CE type=del size=204871: (22) Invalid argument 2024-09-14T11:17:46.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.737+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=5N4SY9D3D86R type=del size=3608626 2024-09-14T11:17:46.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.738+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=Y008FP5I4YOI type=del 2024-09-14T11:17:46.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.741+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~9VVNLDDDAS3U.0 size=628226 2024-09-14T11:17:46.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.741+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=9VVNLDDDAS3U tag=FW6JTYPV8LWN type=write size=1676802 2024-09-14T11:17:46.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.742+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~2GGWHZB7MNBA.0 size=1048576 2024-09-14T11:17:46.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.743+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~2GGWHZB7MNBA.1 size=200143 2024-09-14T11:17:46.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.745+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=2GGWHZB7MNBA tag=VESC0T9BKM6K type=write size=2297295 2024-09-14T11:17:46.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.746+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=UVOXNGILLDDK type=del size=2771616 2024-09-14T11:17:46.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.747+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=5EBJILUCTSJ3 type=write size=257078 2024-09-14T11:17:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.749+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.0 size=1048576 2024-09-14T11:17:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.750+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.1 size=1048576 2024-09-14T11:17:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.751+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.2 size=834325 2024-09-14T11:17:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.751+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=HXFQRC71I2Z8 tag=37LKTXUYF3I7 type=write size=3980053 2024-09-14T11:17:46.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.752+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=TU882UVFNBAE type=del 2024-09-14T11:17:46.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.753+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=8C0ZFXSJSFIX type=write size=850473 2024-09-14T11:17:46.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.755+0000 7f1be8076780 1 < suggested remove operation key=1RUE5J1DYH2C tag=A5C0VNTKIPGB type=write 2024-09-14T11:17:46.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.756+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=E1GURZEMADY2 type=write size=358838 2024-09-14T11:17:46.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.757+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~NSKV9511P890.0 size=1048576 2024-09-14T11:17:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.758+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~NSKV9511P890.1 size=1048576 2024-09-14T11:17:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.758+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~NSKV9511P890.2 size=857571 2024-09-14T11:17:46.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.760+0000 7f1be8076780 1 < canceled multipart upload key=MVUN63538RAB upload=NSKV9511P890 tag=39RKO2QS94UK type=write size=4003299 2024-09-14T11:17:46.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.761+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=60MD0A9XFCX2 type=write size=757791 2024-09-14T11:17:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.762+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~C1PFL37ZVBSU.0 size=1048576 2024-09-14T11:17:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.763+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~C1PFL37ZVBSU.1 size=134885 2024-09-14T11:17:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.765+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=C1PFL37ZVBSU tag=AH7OO9R2MEHZ type=write size=2232037 2024-09-14T11:17:46.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.767+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.0 size=1048576 2024-09-14T11:17:46.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.768+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.1 size=1048576 2024-09-14T11:17:46.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.769+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.2 size=36436 2024-09-14T11:17:46.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.769+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=T1MLOMAZ42AF tag=QMLGLWSI2TJP type=write size=3182164 2024-09-14T11:17:46.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.770+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=8MVP3D7GHPWR type=del 2024-09-14T11:17:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.771+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=ATT07MGT7HY0 type=del size=1277108 2024-09-14T11:17:46.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.772+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~Z1PAYT59Y6RO.0 size=1048576 2024-09-14T11:17:46.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.773+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~Z1PAYT59Y6RO.1 size=763958 2024-09-14T11:17:46.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.775+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=Z1PAYT59Y6RO tag=TN8M1DABGLB8 type=write size=2861110 2024-09-14T11:17:46.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.776+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=78QF1OYS3Q2T type=write size=595426 2024-09-14T11:17:46.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.777+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~MJY290GDBKI2.0 size=1048576 2024-09-14T11:17:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.778+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~MJY290GDBKI2.1 size=994126 2024-09-14T11:17:46.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.780+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=MJY290GDBKI2 tag=0OR3FZ1KIWIS type=write size=3091278 2024-09-14T11:17:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.782+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=DEPBOWEN5GKF type=del size=1164166 2024-09-14T11:17:46.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.783+0000 7f1be8076780 1 < completed write operation key=MVUN63538RAB tag=40FVJQZN57H2 type=write size=172721 2024-09-14T11:17:46.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.784+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=C2QUBXOWHQGE type=write size=17968 2024-09-14T11:17:46.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.785+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~1NTAK3RE39DG.0 size=48050 2024-09-14T11:17:46.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.787+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=1NTAK3RE39DG tag=4BV80PLRA2HQ type=write size=1096626 2024-09-14T11:17:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.788+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=PT7WONCJ3I9M type=del size=3495279 2024-09-14T11:17:46.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.789+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=8P5ZX69NBVNK type=write size=670155 2024-09-14T11:17:46.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.790+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=T2N0BPDI6DAV type=del size=1565730 2024-09-14T11:17:46.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.792+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=ICIG8OYWLU5M type=write size=585119 2024-09-14T11:17:46.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.793+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=CB7H9JJX320X type=del size=53537 2024-09-14T11:17:46.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.795+0000 7f1be8076780 1 < suggested update operation key=INU0TV92GXSP tag=XJXZUKJC7EH3 type=del size=2782516 2024-09-14T11:17:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.797+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~D9BFE0LU55YN.0 size=1048576 2024-09-14T11:17:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.798+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~D9BFE0LU55YN.1 size=105145 2024-09-14T11:17:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.798+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=D9BFE0LU55YN tag=U0Z8Y0VDJ051 type=write size=2202297 2024-09-14T11:17:46.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.799+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=5N4SY9D3D86R type=del 2024-09-14T11:17:46.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.801+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.0 size=1048576 2024-09-14T11:17:46.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.802+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.1 size=1048576 2024-09-14T11:17:46.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.803+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.2 size=829169 2024-09-14T11:17:46.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.803+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=6MJMUGRTTR0Z tag=2E5FFF56AC3P type=write size=3974897 2024-09-14T11:17:46.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.804+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~9VVNLDDDAS3U.0 size=628226 2024-09-14T11:17:46.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.806+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=9VVNLDDDAS3U tag=FW6JTYPV8LWN type=write size=1676802 2024-09-14T11:17:46.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.807+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=AEL2X78304XG type=del size=2657250 2024-09-14T11:17:46.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.808+0000 7f1be8076780 -1 < failed to complete operation key=1RUE5J1DYH2C tag=UVOXNGILLDDK type=del size=2771616: (22) Invalid argument 2024-09-14T11:17:46.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.809+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=YBK15VZETX1Z type=write size=668576 2024-09-14T11:17:46.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.810+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.0 size=1048576 2024-09-14T11:17:46.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.810+0000 7f1be8076780 1 < canceled part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.1 size=1048576 2024-09-14T11:17:46.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.811+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~HXFQRC71I2Z8.2 size=834325 2024-09-14T11:17:46.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.813+0000 7f1be8076780 1 < canceled multipart upload key=4ADXXTIO715C upload=HXFQRC71I2Z8 tag=37LKTXUYF3I7 type=write size=3980053 2024-09-14T11:17:46.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.814+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=4N7BCI3F3FPJ type=del size=3233066 2024-09-14T11:17:46.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.815+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=8C0ZFXSJSFIX type=write size=850473 2024-09-14T11:17:46.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.817+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~T7U7WGB9TB8R.0 size=49552 2024-09-14T11:17:46.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.817+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=T7U7WGB9TB8R tag=ZYJ7YUY59YAR type=write size=1098128 2024-09-14T11:17:46.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.819+0000 7f1be8076780 1 < completed write operation key=9DRSDTGM7Y3F tag=E1GURZEMADY2 type=write size=358838 2024-09-14T11:17:46.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.820+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=DBOU1NT5V7HE type=write size=887909 2024-09-14T11:17:46.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.821+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=60MD0A9XFCX2 type=write size=757791 2024-09-14T11:17:46.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.822+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=NUHXFC73QILJ type=del size=1882523 2024-09-14T11:17:46.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.824+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.0 size=1048576 2024-09-14T11:17:46.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.825+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.1 size=1048576 2024-09-14T11:17:46.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.825+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~T1MLOMAZ42AF.2 size=36436 2024-09-14T11:17:46.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.827+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=T1MLOMAZ42AF tag=QMLGLWSI2TJP type=write size=3182164 2024-09-14T11:17:46.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.829+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=WPQ6J2E29UO1 type=del size=2306793 2024-09-14T11:17:46.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.830+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=ATT07MGT7HY0 type=del 2024-09-14T11:17:46.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.831+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=EJFAUPZT9JWI type=del size=3837897 2024-09-14T11:17:46.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.832+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=78QF1OYS3Q2T type=write size=595426 2024-09-14T11:17:46.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.834+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~HQH421E2VOOP.0 size=578427 2024-09-14T11:17:46.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.834+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=HQH421E2VOOP tag=B2FKLA1Z2QXX type=write size=1627003 2024-09-14T11:17:46.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.835+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=DEPBOWEN5GKF type=del 2024-09-14T11:17:46.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.838+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~O343XHQJX2XH.0 size=1048576 2024-09-14T11:17:46.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.839+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~O343XHQJX2XH.1 size=711848 2024-09-14T11:17:46.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.839+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=O343XHQJX2XH tag=M0LGZHGN65NC type=write size=2809000 2024-09-14T11:17:46.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.840+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=C2QUBXOWHQGE type=write size=17968 2024-09-14T11:17:46.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.842+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=LCZBOQB653JZ type=del size=556776 2024-09-14T11:17:46.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.843+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=PT7WONCJ3I9M type=del 2024-09-14T11:17:46.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.844+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=LVWHZCYPAW3G type=del size=1534557 2024-09-14T11:17:46.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.846+0000 7f1be8076780 1 < suggested update operation key=9DRSDTGM7Y3F tag=T2N0BPDI6DAV type=del size=1565730 2024-09-14T11:17:46.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.848+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=FIVO4FXS7V7U type=del size=313788 2024-09-14T11:17:46.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.849+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=CB7H9JJX320X type=del 2024-09-14T11:17:46.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.850+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=PSE3W6YGQKLJ type=del size=3692011 2024-09-14T11:17:46.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.851+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~D9BFE0LU55YN.0 size=1048576 2024-09-14T11:17:46.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.852+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~D9BFE0LU55YN.1 size=105145 2024-09-14T11:17:46.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.854+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=D9BFE0LU55YN tag=U0Z8Y0VDJ051 type=write size=2202297 2024-09-14T11:17:46.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.856+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~A2EXQ7P2HM95.0 size=1048576 2024-09-14T11:17:46.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.857+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~A2EXQ7P2HM95.1 size=82529 2024-09-14T11:17:46.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.857+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=A2EXQ7P2HM95 tag=L9NRGDN327WT type=write size=2179681 2024-09-14T11:17:46.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.858+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.0 size=1048576 2024-09-14T11:17:46.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.859+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.1 size=1048576 2024-09-14T11:17:46.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.860+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~6MJMUGRTTR0Z.2 size=829169 2024-09-14T11:17:46.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.862+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=6MJMUGRTTR0Z tag=2E5FFF56AC3P type=write size=3974897 2024-09-14T11:17:46.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.863+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=G740ZSIBXES1 type=del size=3454578 2024-09-14T11:17:46.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.864+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=AEL2X78304XG type=del 2024-09-14T11:17:46.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.866+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~KPH962S803AJ.0 size=172276 2024-09-14T11:17:46.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.866+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=KPH962S803AJ tag=P1IX8AAWHLZU type=write size=1220852 2024-09-14T11:17:46.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.867+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=YBK15VZETX1Z type=write size=668576 2024-09-14T11:17:46.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.869+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~G55F9DSQJR3U.0 size=1048576 2024-09-14T11:17:46.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.870+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~G55F9DSQJR3U.1 size=678247 2024-09-14T11:17:46.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.870+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=G55F9DSQJR3U tag=I2MKI1IW88DT type=write size=2775399 2024-09-14T11:17:46.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.871+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=4N7BCI3F3FPJ type=del 2024-09-14T11:17:46.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.872+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=7VJFGMJ1V69A type=del size=2558456 2024-09-14T11:17:46.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.874+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~T7U7WGB9TB8R.0 size=49552 2024-09-14T11:17:46.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.875+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=T7U7WGB9TB8R tag=ZYJ7YUY59YAR type=write size=1098128 2024-09-14T11:17:46.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.876+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=ASC6E5MNEBH9 type=del size=1633081 2024-09-14T11:17:46.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.879+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=DBOU1NT5V7HE type=write size=887909 2024-09-14T11:17:46.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.880+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=2WY8WPEHLAKA type=del size=2305178 2024-09-14T11:17:46.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.881+0000 7f1be8076780 1 < canceled operation key=AUCQC0OBQP7Z tag=NUHXFC73QILJ type=del size=1882523 2024-09-14T11:17:46.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.883+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~UYIRFF1ZWKDX.0 size=1048576 2024-09-14T11:17:46.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.884+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~UYIRFF1ZWKDX.1 size=290739 2024-09-14T11:17:46.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.884+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=UYIRFF1ZWKDX tag=FIKSFBUMPTGP type=write size=2387891 2024-09-14T11:17:46.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.885+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=WPQ6J2E29UO1 type=del 2024-09-14T11:17:46.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.886+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=45C189O6J1OL type=del size=3001511 2024-09-14T11:17:46.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.887+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=EJFAUPZT9JWI type=del 2024-09-14T11:17:46.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.889+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.0 size=1048576 2024-09-14T11:17:46.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.890+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.1 size=1048576 2024-09-14T11:17:46.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.891+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.2 size=410887 2024-09-14T11:17:46.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.891+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=GNOODUX98AD9 tag=YY2XBKVDW3U3 type=write size=3556615 2024-09-14T11:17:46.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.892+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~HQH421E2VOOP.0 size=578427 2024-09-14T11:17:46.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.895+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=HQH421E2VOOP tag=B2FKLA1Z2QXX type=write size=1627003 2024-09-14T11:17:46.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.897+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~M6TJ0YBYZAQT.0 size=1048576 2024-09-14T11:17:46.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.898+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~M6TJ0YBYZAQT.1 size=206737 2024-09-14T11:17:46.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.898+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=M6TJ0YBYZAQT tag=EINEB26TM0NF type=write size=2303889 2024-09-14T11:17:46.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.900+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~O343XHQJX2XH.0 size=1048576 2024-09-14T11:17:46.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.900+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~O343XHQJX2XH.1 size=711848 2024-09-14T11:17:46.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.902+0000 7f1be8076780 1 < canceled multipart upload key=MVUN63538RAB upload=O343XHQJX2XH tag=M0LGZHGN65NC type=write size=2809000 2024-09-14T11:17:46.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.904+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~UMPMOTI8ODUL.0 size=1048576 2024-09-14T11:17:46.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.905+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~UMPMOTI8ODUL.1 size=617025 2024-09-14T11:17:46.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.905+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=UMPMOTI8ODUL tag=SRPKSDF8QXM6 type=write size=2714177 2024-09-14T11:17:46.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.906+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=LCZBOQB653JZ type=del 2024-09-14T11:17:46.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.907+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=15XKPA22PUDN type=write size=981022 2024-09-14T11:17:46.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.909+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=LVWHZCYPAW3G type=del 2024-09-14T11:17:46.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.911+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.0 size=1048576 2024-09-14T11:17:46.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.912+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.1 size=1048576 2024-09-14T11:17:46.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.913+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.2 size=541558 2024-09-14T11:17:46.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.913+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=WIE3A264WS62 tag=2JG998B1XMQT type=write size=3687286 2024-09-14T11:17:46.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.914+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=FIVO4FXS7V7U type=del 2024-09-14T11:17:46.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.916+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~NLZXHON4BI2D.0 size=1048576 2024-09-14T11:17:46.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.917+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~NLZXHON4BI2D.1 size=751680 2024-09-14T11:17:46.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.917+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=NLZXHON4BI2D tag=3QPSNG9BGOIV type=write size=2848832 2024-09-14T11:17:46.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.920+0000 7f1be8076780 1 < suggested remove operation key=3Z71PEWG5UMA tag=PSE3W6YGQKLJ type=del 2024-09-14T11:17:46.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.922+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.0 size=1048576 2024-09-14T11:17:46.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.924+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.1 size=1048576 2024-09-14T11:17:46.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.925+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.2 size=301247 2024-09-14T11:17:46.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.925+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=E15UFQCSBGOO tag=0E0NQP30F9IX type=write size=3446975 2024-09-14T11:17:46.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.926+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~A2EXQ7P2HM95.0 size=1048576 2024-09-14T11:17:46.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.927+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~A2EXQ7P2HM95.1 size=82529 2024-09-14T11:17:46.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.929+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=A2EXQ7P2HM95 tag=L9NRGDN327WT type=write size=2179681 2024-09-14T11:17:46.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.930+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=UBJIM4QQZW8D type=del size=1073897 2024-09-14T11:17:46.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.931+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=G740ZSIBXES1 type=del 2024-09-14T11:17:46.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.933+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.0 size=1048576 2024-09-14T11:17:46.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.934+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.1 size=1048576 2024-09-14T11:17:46.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.935+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.2 size=516515 2024-09-14T11:17:46.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.935+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=GYUJGRO279Z0 tag=PYJAW7QTXX2C type=write size=3662243 2024-09-14T11:17:46.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.936+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~KPH962S803AJ.0 size=172276 2024-09-14T11:17:46.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.938+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=KPH962S803AJ tag=P1IX8AAWHLZU type=write size=1220852 2024-09-14T11:17:46.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.939+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=9PFU6TQCWJZY type=del size=1328336 2024-09-14T11:17:46.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.941+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~G55F9DSQJR3U.0 size=1048576 2024-09-14T11:17:46.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.942+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~G55F9DSQJR3U.1 size=678247 2024-09-14T11:17:46.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.944+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=G55F9DSQJR3U tag=I2MKI1IW88DT type=write size=2775399 2024-09-14T11:17:46.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.946+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~DTYLDCI9GEE1.0 size=1048576 2024-09-14T11:17:46.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.948+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~DTYLDCI9GEE1.1 size=754929 2024-09-14T11:17:46.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.948+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=DTYLDCI9GEE1 tag=CDQ3U2U4BJTS type=write size=2852081 2024-09-14T11:17:46.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.950+0000 7f1be8076780 1 < suggested remove operation key=2RJYZ1CRDVEP tag=7VJFGMJ1V69A type=del 2024-09-14T11:17:46.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.952+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~IE0ITE3MEF8H.0 size=1048576 2024-09-14T11:17:46.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.953+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~IE0ITE3MEF8H.1 size=981709 2024-09-14T11:17:46.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.953+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=IE0ITE3MEF8H tag=SQDA1VEB94S8 type=write size=3078861 2024-09-14T11:17:46.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.955+0000 7f1be8076780 1 < suggested remove operation key=1RUE5J1DYH2C tag=ASC6E5MNEBH9 type=del 2024-09-14T11:17:46.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.956+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=7DJMEPFNXPOO type=del size=2016034 2024-09-14T11:17:46.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.957+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=2WY8WPEHLAKA type=del 2024-09-14T11:17:46.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.958+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=KTVKNKHDDCNQ type=del size=332155 2024-09-14T11:17:46.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.959+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~UYIRFF1ZWKDX.0 size=1048576 2024-09-14T11:17:46.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.960+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~UYIRFF1ZWKDX.1 size=290739 2024-09-14T11:17:46.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.962+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=UYIRFF1ZWKDX tag=FIKSFBUMPTGP type=write size=2387891 2024-09-14T11:17:46.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.963+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=AR0HGLO87UIC type=del size=3253604 2024-09-14T11:17:46.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.964+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=45C189O6J1OL type=del size=3001511 2024-09-14T11:17:46.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.966+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=VT5GX7VZ2DDU type=write size=241381 2024-09-14T11:17:46.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.968+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.0 size=1048576 2024-09-14T11:17:46.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.969+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.1 size=1048576 2024-09-14T11:17:46.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.970+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~GNOODUX98AD9.2 size=410887 2024-09-14T11:17:46.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.972+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=GNOODUX98AD9 tag=YY2XBKVDW3U3 type=write size=3556615 2024-09-14T11:17:46.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.973+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=EZB6CBYQTL5Z type=del size=4115487 2024-09-14T11:17:46.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.975+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~M6TJ0YBYZAQT.0 size=1048576 2024-09-14T11:17:46.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.976+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~M6TJ0YBYZAQT.1 size=206737 2024-09-14T11:17:46.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.978+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=M6TJ0YBYZAQT tag=EINEB26TM0NF type=write size=2303889 2024-09-14T11:17:46.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.980+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~MV4U1R2YES57.0 size=1048576 2024-09-14T11:17:46.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.981+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~MV4U1R2YES57.1 size=298123 2024-09-14T11:17:46.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.981+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=MV4U1R2YES57 tag=BYWAYW97TR3W type=write size=2395275 2024-09-14T11:17:46.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.982+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~UMPMOTI8ODUL.0 size=1048576 2024-09-14T11:17:46.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.983+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~UMPMOTI8ODUL.1 size=617025 2024-09-14T11:17:46.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.985+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=UMPMOTI8ODUL tag=SRPKSDF8QXM6 type=write size=2714177 2024-09-14T11:17:46.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.987+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=8Q4DKGKXNYB9 type=del size=2724363 2024-09-14T11:17:46.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.988+0000 7f1be8076780 1 < completed write operation key=QIEUKUQ8CS2U tag=15XKPA22PUDN type=write size=981022 2024-09-14T11:17:46.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.989+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=WF13DVF6OGI6 type=write size=393353 2024-09-14T11:17:46.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.990+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.0 size=1048576 2024-09-14T11:17:46.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.991+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.1 size=1048576 2024-09-14T11:17:46.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.992+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~WIE3A264WS62.2 size=541558 2024-09-14T11:17:46.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.994+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=WIE3A264WS62 tag=2JG998B1XMQT type=write size=3687286 2024-09-14T11:17:46.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.995+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=B1OG4X3DBQOR type=del size=3101691 2024-09-14T11:17:46.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.996+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~NLZXHON4BI2D.0 size=1048576 2024-09-14T11:17:46.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.997+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~NLZXHON4BI2D.1 size=751680 2024-09-14T11:17:46.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:46.999+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=NLZXHON4BI2D tag=3QPSNG9BGOIV type=write size=2848832 2024-09-14T11:17:46.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.001+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~TI3D6LZOJD2U.0 size=213090 2024-09-14T11:17:46.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.001+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=TI3D6LZOJD2U tag=5QOSKIVPSH2O type=write size=1261666 2024-09-14T11:17:47.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.002+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.0 size=1048576 2024-09-14T11:17:47.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.003+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.1 size=1048576 2024-09-14T11:17:47.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.004+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~E15UFQCSBGOO.2 size=301247 2024-09-14T11:17:47.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.006+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=E15UFQCSBGOO tag=0E0NQP30F9IX type=write size=3446975 2024-09-14T11:17:47.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.007+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=QLBYBBQ7KBRP type=del size=127426 2024-09-14T11:17:47.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.008+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=UBJIM4QQZW8D type=del 2024-09-14T11:17:47.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.010+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.0 size=1048576 2024-09-14T11:17:47.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.011+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.1 size=1048576 2024-09-14T11:17:47.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.012+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.2 size=704985 2024-09-14T11:17:47.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.012+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=CS45R2AF1F1H tag=CHF34GMG99KX type=write size=3850713 2024-09-14T11:17:47.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.012+0000 7f1be8076780 1 < canceled part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.0 size=1048576 2024-09-14T11:17:47.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.013+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.1 size=1048576 2024-09-14T11:17:47.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.014+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~GYUJGRO279Z0.2 size=516515 2024-09-14T11:17:47.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.016+0000 7f1be8076780 1 < canceled multipart upload key=9DRSDTGM7Y3F upload=GYUJGRO279Z0 tag=PYJAW7QTXX2C type=write size=3662243 2024-09-14T11:17:47.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.017+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=FCH27UP8JTJ8 type=del size=3986316 2024-09-14T11:17:47.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.018+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=9PFU6TQCWJZY type=del 2024-09-14T11:17:47.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.019+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=5G40JVTMOQE7 type=del size=3800928 2024-09-14T11:17:47.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.021+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~DTYLDCI9GEE1.0 size=1048576 2024-09-14T11:17:47.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.021+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~DTYLDCI9GEE1.1 size=754929 2024-09-14T11:17:47.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.023+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=DTYLDCI9GEE1 tag=CDQ3U2U4BJTS type=write size=2852081 2024-09-14T11:17:47.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.026+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.0 size=1048576 2024-09-14T11:17:47.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.027+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.1 size=1048576 2024-09-14T11:17:47.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.028+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.2 size=70861 2024-09-14T11:17:47.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.028+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=6PFMMT3RC0BG tag=1NCHRCY2C08W type=write size=3216589 2024-09-14T11:17:47.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.028+0000 7f1be8076780 1 < canceled part key=_multipart_1RUE5J1DYH2C.2~IE0ITE3MEF8H.0 size=1048576 2024-09-14T11:17:47.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.029+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~IE0ITE3MEF8H.1 size=981709 2024-09-14T11:17:47.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.031+0000 7f1be8076780 1 < canceled multipart upload key=1RUE5J1DYH2C upload=IE0ITE3MEF8H tag=SQDA1VEB94S8 type=write size=3078861 2024-09-14T11:17:47.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.032+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=9JE2NVT3S7RE type=del size=3529137 2024-09-14T11:17:47.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.034+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=7DJMEPFNXPOO type=del 2024-09-14T11:17:47.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.035+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=NGRXFCBEWILX type=write size=1041772 2024-09-14T11:17:47.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.036+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=KTVKNKHDDCNQ type=del 2024-09-14T11:17:47.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.037+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=GT8BQ879SLWA type=del size=1888236 2024-09-14T11:17:47.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.038+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=AR0HGLO87UIC type=del 2024-09-14T11:17:47.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.040+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=88SAEM5F23ID type=write size=454994 2024-09-14T11:17:47.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.041+0000 7f1be8076780 1 < completed write operation key=CQDRZMJAJ7FZ tag=VT5GX7VZ2DDU type=write size=241381 2024-09-14T11:17:47.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.042+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=WC4FIIA6YXH9 type=del size=3737288 2024-09-14T11:17:47.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.043+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=EZB6CBYQTL5Z type=del 2024-09-14T11:17:47.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.047+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~9TDWEA57G5G2.0 size=926773 2024-09-14T11:17:47.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.047+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=9TDWEA57G5G2 tag=6IFWJ75G1MZ4 type=write size=1975349 2024-09-14T11:17:47.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.048+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~MV4U1R2YES57.0 size=1048576 2024-09-14T11:17:47.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.049+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~MV4U1R2YES57.1 size=298123 2024-09-14T11:17:47.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.051+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=MV4U1R2YES57 tag=BYWAYW97TR3W type=write size=2395275 2024-09-14T11:17:47.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.052+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=UC7F20AS39U7 type=write size=190613 2024-09-14T11:17:47.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.053+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=8Q4DKGKXNYB9 type=del 2024-09-14T11:17:47.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.054+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=J8DP8BJ9JKV3 type=del size=740305 2024-09-14T11:17:47.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.055+0000 7f1be8076780 1 < completed write operation key=SJES17ZIGRZE tag=WF13DVF6OGI6 type=write size=393353 2024-09-14T11:17:47.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.059+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~30PY9MD9DYSW.0 size=391736 2024-09-14T11:17:47.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.059+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=30PY9MD9DYSW tag=RZWRILN7J08S type=write size=1440312 2024-09-14T11:17:47.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.062+0000 7f1be8076780 1 < suggested remove operation key=9DRSDTGM7Y3F tag=B1OG4X3DBQOR type=del 2024-09-14T11:17:47.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.065+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~BCDJTG20XIEC.0 size=1048576 2024-09-14T11:17:47.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.066+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~BCDJTG20XIEC.1 size=126656 2024-09-14T11:17:47.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.066+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=BCDJTG20XIEC tag=5L19GYIYOX5M type=write size=2223808 2024-09-14T11:17:47.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.067+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~TI3D6LZOJD2U.0 size=213090 2024-09-14T11:17:47.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.069+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=TI3D6LZOJD2U tag=5QOSKIVPSH2O type=write size=1261666 2024-09-14T11:17:47.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.070+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=GHFMLSDLQBU0 type=del size=4079174 2024-09-14T11:17:47.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.071+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=QLBYBBQ7KBRP type=del 2024-09-14T11:17:47.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.072+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=7LD8UNFZ71FU type=del size=2317958 2024-09-14T11:17:47.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.073+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.0 size=1048576 2024-09-14T11:17:47.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.074+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.1 size=1048576 2024-09-14T11:17:47.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.074+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~CS45R2AF1F1H.2 size=704985 2024-09-14T11:17:47.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.076+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=CS45R2AF1F1H tag=CHF34GMG99KX type=write size=3850713 2024-09-14T11:17:47.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.077+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=UML31DT9F1ZO type=del size=1620235 2024-09-14T11:17:47.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.078+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=FCH27UP8JTJ8 type=del 2024-09-14T11:17:47.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.080+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=VR4MW9ON5Z9H type=del size=3499049 2024-09-14T11:17:47.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.081+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=5G40JVTMOQE7 type=del 2024-09-14T11:17:47.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.082+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=L0MHB1LHCUJF type=del size=2033347 2024-09-14T11:17:47.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.083+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.0 size=1048576 2024-09-14T11:17:47.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.084+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.1 size=1048576 2024-09-14T11:17:47.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.085+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~6PFMMT3RC0BG.2 size=70861 2024-09-14T11:17:47.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.087+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=6PFMMT3RC0BG tag=1NCHRCY2C08W type=write size=3216589 2024-09-14T11:17:47.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.088+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=LZZZSGB4FQKS type=write size=969719 2024-09-14T11:17:47.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.088+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=9DRSDTGM7Y3F tag=9JE2NVT3S7RE type=del size=3529137: (2) No such file or directory 2024-09-14T11:17:47.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.091+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.0 size=1048576 2024-09-14T11:17:47.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.092+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.1 size=1048576 2024-09-14T11:17:47.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.093+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.2 size=432007 2024-09-14T11:17:47.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.093+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=612JCIG3DMTV tag=YWJC1PA4R9H9 type=write size=3577735 2024-09-14T11:17:47.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.094+0000 7f1be8076780 1 < completed write operation key=1X2EWK1Y2GE0 tag=NGRXFCBEWILX type=write size=1041772 2024-09-14T11:17:47.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.097+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.0 size=1048576 2024-09-14T11:17:47.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.098+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.1 size=1048576 2024-09-14T11:17:47.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.098+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.2 size=68351 2024-09-14T11:17:47.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.098+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=A13OF74VAFPU tag=PBBCJ1TTDN0F type=write size=3214079 2024-09-14T11:17:47.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.100+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=GT8BQ879SLWA type=del 2024-09-14T11:17:47.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.101+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=ZMV7I1M7SMJH type=write size=328935 2024-09-14T11:17:47.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.102+0000 7f1be8076780 1 < completed write operation key=QC6MEJABT7IM tag=88SAEM5F23ID type=write size=454994 2024-09-14T11:17:47.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.103+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=N60W35JYGDVT type=del size=2046828 2024-09-14T11:17:47.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.104+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=WC4FIIA6YXH9 type=del 2024-09-14T11:17:47.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.107+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~OH2BD1YII2PT.0 size=770551 2024-09-14T11:17:47.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.107+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=OH2BD1YII2PT tag=61JMUML9G4M9 type=write size=1819127 2024-09-14T11:17:47.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.108+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~9TDWEA57G5G2.0 size=926773 2024-09-14T11:17:47.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.110+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=9TDWEA57G5G2 tag=6IFWJ75G1MZ4 type=write size=1975349 2024-09-14T11:17:47.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.112+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.0 size=1048576 2024-09-14T11:17:47.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.113+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.1 size=1048576 2024-09-14T11:17:47.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.114+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.2 size=873956 2024-09-14T11:17:47.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.114+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=224UAI8EHQRU tag=NYN495UAOKL9 type=write size=4019684 2024-09-14T11:17:47.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.115+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=UC7F20AS39U7 type=write size=190613 2024-09-14T11:17:47.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.116+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=1RHTV7IEVZL8 type=del size=2099915 2024-09-14T11:17:47.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.119+0000 7f1be8076780 1 < suggested update operation key=4ADXXTIO715C tag=J8DP8BJ9JKV3 type=del size=740305 2024-09-14T11:17:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.121+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.0 size=1048576 2024-09-14T11:17:47.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.122+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.1 size=1048576 2024-09-14T11:17:47.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.123+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.2 size=582268 2024-09-14T11:17:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.123+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=9JTRH82PU337 tag=FVIHWRGTDQ1G type=write size=3727996 2024-09-14T11:17:47.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.124+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~30PY9MD9DYSW.0 size=391736 2024-09-14T11:17:47.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.126+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=30PY9MD9DYSW tag=RZWRILN7J08S type=write size=1440312 2024-09-14T11:17:47.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.130+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.0 size=1048576 2024-09-14T11:17:47.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.131+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.1 size=1048576 2024-09-14T11:17:47.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.132+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.2 size=436276 2024-09-14T11:17:47.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.132+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=Q0TV93VM9Y9J tag=K1QUE2K6AF7E type=write size=3582004 2024-09-14T11:17:47.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.133+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~BCDJTG20XIEC.0 size=1048576 2024-09-14T11:17:47.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.133+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~BCDJTG20XIEC.1 size=126656 2024-09-14T11:17:47.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.135+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=BCDJTG20XIEC tag=5L19GYIYOX5M type=write size=2223808 2024-09-14T11:17:47.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.136+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=546LVZ1SS07N type=write size=335494 2024-09-14T11:17:47.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.137+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=GHFMLSDLQBU0 type=del 2024-09-14T11:17:47.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.139+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~L0GJP3O520XZ.0 size=867810 2024-09-14T11:17:47.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.139+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=L0GJP3O520XZ tag=XJ6NCF0IU9JA type=write size=1916386 2024-09-14T11:17:47.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.141+0000 7f1be8076780 1 < suggested update operation key=1X2EWK1Y2GE0 tag=7LD8UNFZ71FU type=del size=2317958 2024-09-14T11:17:47.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.143+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=7TUUH06XYI1A type=del size=2999337 2024-09-14T11:17:47.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.145+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=UML31DT9F1ZO type=del size=1620235 2024-09-14T11:17:47.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.146+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=JU6ZJWE6F2X6 type=del size=3960025 2024-09-14T11:17:47.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.148+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=VR4MW9ON5Z9H type=del 2024-09-14T11:17:47.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.151+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=WRK8VMMS54YA type=del size=1415822 2024-09-14T11:17:47.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.153+0000 7f1be8076780 1 < suggested remove operation key=RIYGSRWKVKFF tag=L0MHB1LHCUJF type=del 2024-09-14T11:17:47.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.155+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=6ZZWTAI22ROT type=write size=863927 2024-09-14T11:17:47.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.156+0000 7f1be8076780 -1 < failed to complete operation key=QIEUKUQ8CS2U tag=LZZZSGB4FQKS type=write size=969719: (22) Invalid argument 2024-09-14T11:17:47.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.157+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=SQWC1AZE2I86 type=del size=3503207 2024-09-14T11:17:47.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.158+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.0 size=1048576 2024-09-14T11:17:47.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.159+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.1 size=1048576 2024-09-14T11:17:47.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.160+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~612JCIG3DMTV.2 size=432007 2024-09-14T11:17:47.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.162+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=612JCIG3DMTV tag=YWJC1PA4R9H9 type=write size=3577735 2024-09-14T11:17:47.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.163+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=3A384VA79UOY type=del size=132236 2024-09-14T11:17:47.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.164+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.0 size=1048576 2024-09-14T11:17:47.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.165+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.1 size=1048576 2024-09-14T11:17:47.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.165+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~A13OF74VAFPU.2 size=68351 2024-09-14T11:17:47.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.167+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=A13OF74VAFPU tag=PBBCJ1TTDN0F type=write size=3214079 2024-09-14T11:17:47.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.168+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=V02XPXMYV1RN type=del size=3056988 2024-09-14T11:17:47.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.170+0000 7f1be8076780 -1 < failed to complete operation key=1X2EWK1Y2GE0 tag=ZMV7I1M7SMJH type=write size=328935: (22) Invalid argument 2024-09-14T11:17:47.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.171+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=OB9XGWD5UN3U type=write size=570779 2024-09-14T11:17:47.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.172+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=N60W35JYGDVT type=del 2024-09-14T11:17:47.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.174+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=I0YAXZ33IOKP type=write size=36342 2024-09-14T11:17:47.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.175+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~OH2BD1YII2PT.0 size=770551 2024-09-14T11:17:47.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.177+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=OH2BD1YII2PT tag=61JMUML9G4M9 type=write size=1819127 2024-09-14T11:17:47.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.178+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=C8HLVVK4L593 type=del size=3398282 2024-09-14T11:17:47.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.179+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.0 size=1048576 2024-09-14T11:17:47.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.179+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.1 size=1048576 2024-09-14T11:17:47.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.180+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~224UAI8EHQRU.2 size=873956 2024-09-14T11:17:47.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.182+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=224UAI8EHQRU tag=NYN495UAOKL9 type=write size=4019684 2024-09-14T11:17:47.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.183+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=GYU2G43052SI type=del size=238479 2024-09-14T11:17:47.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.185+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=1RHTV7IEVZL8 type=del 2024-09-14T11:17:47.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.187+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~9YPRV6WQWZV2.0 size=1048576 2024-09-14T11:17:47.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.188+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~9YPRV6WQWZV2.1 size=63980 2024-09-14T11:17:47.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.188+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=9YPRV6WQWZV2 tag=SDKW2U65TVJN type=write size=2161132 2024-09-14T11:17:47.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.189+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.0 size=1048576 2024-09-14T11:17:47.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.190+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.1 size=1048576 2024-09-14T11:17:47.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.191+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~9JTRH82PU337.2 size=582268 2024-09-14T11:17:47.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.193+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=9JTRH82PU337 tag=FVIHWRGTDQ1G type=write size=3727996 2024-09-14T11:17:47.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.194+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=AWXSDSI2QN6U type=del size=423540 2024-09-14T11:17:47.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.195+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.0 size=1048576 2024-09-14T11:17:47.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.196+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.1 size=1048576 2024-09-14T11:17:47.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.196+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~Q0TV93VM9Y9J.2 size=436276 2024-09-14T11:17:47.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.198+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=Q0TV93VM9Y9J tag=K1QUE2K6AF7E type=write size=3582004 2024-09-14T11:17:47.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.200+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~712K6CU0138P.0 size=1048576 2024-09-14T11:17:47.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.201+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~712K6CU0138P.1 size=806551 2024-09-14T11:17:47.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.201+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=712K6CU0138P tag=COINYBGISWEF type=write size=2903703 2024-09-14T11:17:47.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.202+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=546LVZ1SS07N type=write size=335494 2024-09-14T11:17:47.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.204+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=ZSX1PJF8ZI06 type=del size=1699365 2024-09-14T11:17:47.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.205+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~L0GJP3O520XZ.0 size=867810 2024-09-14T11:17:47.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.207+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=L0GJP3O520XZ tag=XJ6NCF0IU9JA type=write size=1916386 2024-09-14T11:17:47.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.208+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=731325Q7NGNL type=del size=2375240 2024-09-14T11:17:47.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.210+0000 7f1be8076780 1 < suggested remove operation key=1X2EWK1Y2GE0 tag=7TUUH06XYI1A type=del 2024-09-14T11:17:47.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.211+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=SN48TJO9I8OS type=del size=80263 2024-09-14T11:17:47.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.213+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=JU6ZJWE6F2X6 type=del 2024-09-14T11:17:47.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.215+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~8802P4LLOOHH.0 size=1048576 2024-09-14T11:17:47.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.216+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~8802P4LLOOHH.1 size=114976 2024-09-14T11:17:47.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.216+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=8802P4LLOOHH tag=13KPTM9PTXGC type=write size=2212128 2024-09-14T11:17:47.215 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.217+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=WRK8VMMS54YA type=del 2024-09-14T11:17:47.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.219+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~9X115K5ZS6UN.0 size=515393 2024-09-14T11:17:47.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.219+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=9X115K5ZS6UN tag=864CGCUZSSA9 type=write size=1563969 2024-09-14T11:17:47.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.220+0000 7f1be8076780 1 < completed write operation key=JQZ7C562TQ8D tag=6ZZWTAI22ROT type=write size=863927 2024-09-14T11:17:47.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.221+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=AL31RWH6Q4L5 type=del size=413353 2024-09-14T11:17:47.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.224+0000 7f1be8076780 1 < suggested update operation key=JIWPGHQ3GEZB tag=SQWC1AZE2I86 type=del size=3503207 2024-09-14T11:17:47.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.226+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~CMSW7GSY20OK.0 size=1048576 2024-09-14T11:17:47.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.227+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~CMSW7GSY20OK.1 size=446139 2024-09-14T11:17:47.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.227+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=CMSW7GSY20OK tag=855ECRFOD77X type=write size=2543291 2024-09-14T11:17:47.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.228+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=3A384VA79UOY type=del 2024-09-14T11:17:47.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.229+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=YMIXAU7RX855 type=del size=2639309 2024-09-14T11:17:47.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.230+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=V02XPXMYV1RN type=del 2024-09-14T11:17:47.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.231+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=E5Z8LWJ61AD7 type=del size=3377864 2024-09-14T11:17:47.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.232+0000 7f1be8076780 1 < canceled operation key=4AY6ZXFKO1YQ tag=OB9XGWD5UN3U type=write size=570779 2024-09-14T11:17:47.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.234+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=HOBKW4A3JGJJ type=del size=2853747 2024-09-14T11:17:47.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.235+0000 7f1be8076780 1 < completed write operation key=SJES17ZIGRZE tag=I0YAXZ33IOKP type=write size=36342 2024-09-14T11:17:47.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.237+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~YX5F8KM414EA.0 size=453843 2024-09-14T11:17:47.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.237+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=YX5F8KM414EA tag=ARH3VIYIQ909 type=write size=1502419 2024-09-14T11:17:47.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.238+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=C8HLVVK4L593 type=del 2024-09-14T11:17:47.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.239+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=CPFE4OJ4P7W6 type=del size=4038165 2024-09-14T11:17:47.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.241+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=GYU2G43052SI type=del 2024-09-14T11:17:47.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.242+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=17M77TJ7MZZJ type=del size=1544173 2024-09-14T11:17:47.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.243+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~9YPRV6WQWZV2.0 size=1048576 2024-09-14T11:17:47.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.244+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~9YPRV6WQWZV2.1 size=63980 2024-09-14T11:17:47.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.246+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=9YPRV6WQWZV2 tag=SDKW2U65TVJN type=write size=2161132 2024-09-14T11:17:47.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.247+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=BROGSX2I41GH type=del size=3151062 2024-09-14T11:17:47.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.248+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=AWXSDSI2QN6U type=del 2024-09-14T11:17:47.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.250+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.0 size=1048576 2024-09-14T11:17:47.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.251+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.1 size=1048576 2024-09-14T11:17:47.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.252+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.2 size=793582 2024-09-14T11:17:47.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.252+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=6LC22YXY33H8 tag=I4BOUTSUM3L2 type=write size=3939310 2024-09-14T11:17:47.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.253+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~712K6CU0138P.0 size=1048576 2024-09-14T11:17:47.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.254+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~712K6CU0138P.1 size=806551 2024-09-14T11:17:47.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.256+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=712K6CU0138P tag=COINYBGISWEF type=write size=2903703 2024-09-14T11:17:47.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.257+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=KW651O59C3OU type=del size=3808913 2024-09-14T11:17:47.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.259+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=ZSX1PJF8ZI06 type=del 2024-09-14T11:17:47.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.261+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~ZDXXTJOCYWVN.0 size=684901 2024-09-14T11:17:47.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.261+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=ZDXXTJOCYWVN tag=6KOOX6FSZV6A type=write size=1733477 2024-09-14T11:17:47.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.262+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=731325Q7NGNL type=del 2024-09-14T11:17:47.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.264+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=ITZJV9ERLVXV type=del size=1360259 2024-09-14T11:17:47.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.266+0000 7f1be8076780 1 < canceled operation key=1X2EWK1Y2GE0 tag=SN48TJO9I8OS type=del size=80263 2024-09-14T11:17:47.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.267+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=ALV16SGAS5KT type=write size=704626 2024-09-14T11:17:47.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.268+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~8802P4LLOOHH.0 size=1048576 2024-09-14T11:17:47.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.269+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~8802P4LLOOHH.1 size=114976 2024-09-14T11:17:47.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.271+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=8802P4LLOOHH tag=13KPTM9PTXGC type=write size=2212128 2024-09-14T11:17:47.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.272+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=LX13XOP91G37 type=del size=1738713 2024-09-14T11:17:47.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.273+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~9X115K5ZS6UN.0 size=515393 2024-09-14T11:17:47.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.276+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=9X115K5ZS6UN tag=864CGCUZSSA9 type=write size=1563969 2024-09-14T11:17:47.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.277+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=XWT93KLHWPGV type=del size=2056156 2024-09-14T11:17:47.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.279+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=AL31RWH6Q4L5 type=del size=413353 2024-09-14T11:17:47.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.280+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=PDCBYUDMERMH type=del size=3292019 2024-09-14T11:17:47.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.281+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~CMSW7GSY20OK.0 size=1048576 2024-09-14T11:17:47.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.282+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~CMSW7GSY20OK.1 size=446139 2024-09-14T11:17:47.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.286+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=CMSW7GSY20OK tag=855ECRFOD77X type=write size=2543291 2024-09-14T11:17:47.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.287+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=1NHKYNOV51HH type=del size=1401508 2024-09-14T11:17:47.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.288+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=YMIXAU7RX855 type=del size=2639309 2024-09-14T11:17:47.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.290+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=0UBPX6AJKMYH type=write size=16091 2024-09-14T11:17:47.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.291+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=E5Z8LWJ61AD7 type=del 2024-09-14T11:17:47.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.292+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=59KUDHM2T241 type=del size=104499 2024-09-14T11:17:47.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.293+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=HOBKW4A3JGJJ type=del 2024-09-14T11:17:47.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.295+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.0 size=1048576 2024-09-14T11:17:47.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.296+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.1 size=1048576 2024-09-14T11:17:47.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.297+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.2 size=338232 2024-09-14T11:17:47.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.297+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=8B56DPXWX25N tag=E312DMY1QYMN type=write size=3483960 2024-09-14T11:17:47.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.298+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~YX5F8KM414EA.0 size=453843 2024-09-14T11:17:47.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.300+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=YX5F8KM414EA tag=ARH3VIYIQ909 type=write size=1502419 2024-09-14T11:17:47.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.302+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.0 size=1048576 2024-09-14T11:17:47.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.303+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.1 size=1048576 2024-09-14T11:17:47.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.304+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.2 size=845123 2024-09-14T11:17:47.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.304+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=ZMA19B7BJD7S tag=IGDTWQ6A7I9F type=write size=3990851 2024-09-14T11:17:47.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.305+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=CPFE4OJ4P7W6 type=del 2024-09-14T11:17:47.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.307+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~X16V22KN5MCB.0 size=1048576 2024-09-14T11:17:47.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.308+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~X16V22KN5MCB.1 size=955393 2024-09-14T11:17:47.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.308+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=X16V22KN5MCB tag=EIPU7UQ5T6SK type=write size=3052545 2024-09-14T11:17:47.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.309+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=17M77TJ7MZZJ type=del 2024-09-14T11:17:47.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.310+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=GSR9APPQXZIE type=del size=2793887 2024-09-14T11:17:47.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.311+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=BROGSX2I41GH type=del 2024-09-14T11:17:47.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.313+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=604OVY95UPD9 type=write size=947255 2024-09-14T11:17:47.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.314+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.0 size=1048576 2024-09-14T11:17:47.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.315+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.1 size=1048576 2024-09-14T11:17:47.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.316+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~6LC22YXY33H8.2 size=793582 2024-09-14T11:17:47.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.318+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=6LC22YXY33H8 tag=I4BOUTSUM3L2 type=write size=3939310 2024-09-14T11:17:47.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.319+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=QZSN7UIEME1T type=write size=579100 2024-09-14T11:17:47.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.320+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=KW651O59C3OU type=del 2024-09-14T11:17:47.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.322+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.0 size=1048576 2024-09-14T11:17:47.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.323+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.1 size=1048576 2024-09-14T11:17:47.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.324+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.2 size=1028073 2024-09-14T11:17:47.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.324+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=0JON70AK93LL tag=VFS5U26MTG2S type=write size=4173801 2024-09-14T11:17:47.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.325+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~ZDXXTJOCYWVN.0 size=684901 2024-09-14T11:17:47.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.327+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=ZDXXTJOCYWVN tag=6KOOX6FSZV6A type=write size=1733477 2024-09-14T11:17:47.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.329+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~HHFEBZBYOHE4.0 size=40521 2024-09-14T11:17:47.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.329+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=HHFEBZBYOHE4 tag=TYQAWO66KDHK type=write size=1089097 2024-09-14T11:17:47.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.330+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=ITZJV9ERLVXV type=del 2024-09-14T11:17:47.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.332+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=YCWRP6OM3JO8 type=del size=110911 2024-09-14T11:17:47.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.333+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=ALV16SGAS5KT type=write size=704626 2024-09-14T11:17:47.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.335+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.0 size=1048576 2024-09-14T11:17:47.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.336+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.1 size=1048576 2024-09-14T11:17:47.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.337+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.2 size=783258 2024-09-14T11:17:47.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.337+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=IUJM4LUPEGBA tag=0FCHZO5TKZDA type=write size=3928986 2024-09-14T11:17:47.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.338+0000 7f1be8076780 1 < canceled operation key=1X2EWK1Y2GE0 tag=LX13XOP91G37 type=del size=1738713 2024-09-14T11:17:47.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.340+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~V2NDN0WDUVNU.0 size=217265 2024-09-14T11:17:47.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.340+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=V2NDN0WDUVNU tag=52RGS9VP33GK type=write size=1265841 2024-09-14T11:17:47.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.341+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=XWT93KLHWPGV type=del 2024-09-14T11:17:47.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.344+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~4Q0I87YYJKDD.0 size=1048576 2024-09-14T11:17:47.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.345+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~4Q0I87YYJKDD.1 size=159606 2024-09-14T11:17:47.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.345+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=4Q0I87YYJKDD tag=ET7FWYDWJ99Q type=write size=2256758 2024-09-14T11:17:47.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.346+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=PDCBYUDMERMH type=del 2024-09-14T11:17:47.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.347+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=71W9PSZBO4LQ type=write size=668816 2024-09-14T11:17:47.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.348+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=1NHKYNOV51HH type=del 2024-09-14T11:17:47.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.349+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=963LI182WPA7 type=write size=618636 2024-09-14T11:17:47.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.350+0000 7f1be8076780 1 < canceled operation key=7OUNKTS3X7DJ tag=0UBPX6AJKMYH type=write size=16091 2024-09-14T11:17:47.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.352+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.0 size=1048576 2024-09-14T11:17:47.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.353+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.1 size=1048576 2024-09-14T11:17:47.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.354+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.2 size=765459 2024-09-14T11:17:47.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.354+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=KSEZHZX4N2QY tag=KBIQ8BI23REP type=write size=3911187 2024-09-14T11:17:47.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.355+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=59KUDHM2T241 type=del 2024-09-14T11:17:47.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.357+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.0 size=1048576 2024-09-14T11:17:47.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.358+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.1 size=1048576 2024-09-14T11:17:47.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.359+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.2 size=352270 2024-09-14T11:17:47.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.359+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=QCZAUL8FFZ77 tag=HT9R6G5432BQ type=write size=3497998 2024-09-14T11:17:47.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.360+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.0 size=1048576 2024-09-14T11:17:47.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.361+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.1 size=1048576 2024-09-14T11:17:47.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.362+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~8B56DPXWX25N.2 size=338232 2024-09-14T11:17:47.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.364+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=8B56DPXWX25N tag=E312DMY1QYMN type=write size=3483960 2024-09-14T11:17:47.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.365+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=1JN5X4I43PNH type=del size=64719 2024-09-14T11:17:47.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.366+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.0 size=1048576 2024-09-14T11:17:47.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.366+0000 7f1be8076780 1 < canceled part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.1 size=1048576 2024-09-14T11:17:47.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.366+0000 7f1be8076780 1 < canceled part key=_multipart_JIWPGHQ3GEZB.2~ZMA19B7BJD7S.2 size=845123 2024-09-14T11:17:47.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.369+0000 7f1be8076780 1 < canceled multipart upload key=JIWPGHQ3GEZB upload=ZMA19B7BJD7S tag=IGDTWQ6A7I9F type=write size=3990851 2024-09-14T11:17:47.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.370+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=U1Y1WBXH1N4Q type=write size=448876 2024-09-14T11:17:47.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.371+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~X16V22KN5MCB.0 size=1048576 2024-09-14T11:17:47.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.372+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~X16V22KN5MCB.1 size=955393 2024-09-14T11:17:47.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.374+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=X16V22KN5MCB tag=EIPU7UQ5T6SK type=write size=3052545 2024-09-14T11:17:47.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.375+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=EBB0PJHAPOV5 type=del size=3876717 2024-09-14T11:17:47.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.377+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=GSR9APPQXZIE type=del size=2793887 2024-09-14T11:17:47.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.379+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.0 size=1048576 2024-09-14T11:17:47.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.380+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.1 size=1048576 2024-09-14T11:17:47.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.381+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.2 size=275483 2024-09-14T11:17:47.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.381+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=2BHYJLEJL6SP tag=YVZ0HCU8H9Y2 type=write size=3421211 2024-09-14T11:17:47.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.382+0000 7f1be8076780 1 < completed write operation key=WQC5TVD66R0W tag=604OVY95UPD9 type=write size=947255 2024-09-14T11:17:47.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.384+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~9W80HX6PJJM9.0 size=1048576 2024-09-14T11:17:47.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.385+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~9W80HX6PJJM9.1 size=894513 2024-09-14T11:17:47.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.385+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=9W80HX6PJJM9 tag=8P1L5IJL52MT type=write size=2991665 2024-09-14T11:17:47.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.387+0000 7f1be8076780 1 < completed write operation key=4ADXXTIO715C tag=QZSN7UIEME1T type=write size=579100 2024-09-14T11:17:47.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.389+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~ROGAYFLIQUAQ.0 size=506636 2024-09-14T11:17:47.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.389+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=ROGAYFLIQUAQ tag=9N6530H1BOMB type=write size=1555212 2024-09-14T11:17:47.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.390+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.0 size=1048576 2024-09-14T11:17:47.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.391+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.1 size=1048576 2024-09-14T11:17:47.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.392+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~0JON70AK93LL.2 size=1028073 2024-09-14T11:17:47.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.395+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=0JON70AK93LL tag=VFS5U26MTG2S type=write size=4173801 2024-09-14T11:17:47.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.397+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=18I93WTZJCI9 type=del size=1926760 2024-09-14T11:17:47.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.398+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~HHFEBZBYOHE4.0 size=40521 2024-09-14T11:17:47.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.400+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=HHFEBZBYOHE4 tag=TYQAWO66KDHK type=write size=1089097 2024-09-14T11:17:47.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.402+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.0 size=1048576 2024-09-14T11:17:47.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.402+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.1 size=1048576 2024-09-14T11:17:47.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.403+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.2 size=249030 2024-09-14T11:17:47.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.403+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=WYR5F1HWRAG6 tag=K6E5J77KGI26 type=write size=3394758 2024-09-14T11:17:47.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.404+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=YCWRP6OM3JO8 type=del 2024-09-14T11:17:47.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.406+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=IHRACB097QP2 type=del size=3680816 2024-09-14T11:17:47.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.407+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.0 size=1048576 2024-09-14T11:17:47.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.408+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.1 size=1048576 2024-09-14T11:17:47.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.409+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~IUJM4LUPEGBA.2 size=783258 2024-09-14T11:17:47.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.411+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=IUJM4LUPEGBA tag=0FCHZO5TKZDA type=write size=3928986 2024-09-14T11:17:47.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.413+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~DD6QRCIH9QQI.0 size=1048576 2024-09-14T11:17:47.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.414+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~DD6QRCIH9QQI.1 size=547456 2024-09-14T11:17:47.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.414+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=DD6QRCIH9QQI tag=WWX4OVZ2JMQF type=write size=2644608 2024-09-14T11:17:47.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.415+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~V2NDN0WDUVNU.0 size=217265 2024-09-14T11:17:47.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.417+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=V2NDN0WDUVNU tag=52RGS9VP33GK type=write size=1265841 2024-09-14T11:17:47.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.420+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~RN3VWA4YXTO3.0 size=1048576 2024-09-14T11:17:47.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.421+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~RN3VWA4YXTO3.1 size=642609 2024-09-14T11:17:47.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.421+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=RN3VWA4YXTO3 tag=ZZHH06AO21MR type=write size=2739761 2024-09-14T11:17:47.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.421+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~4Q0I87YYJKDD.0 size=1048576 2024-09-14T11:17:47.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.422+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~4Q0I87YYJKDD.1 size=159606 2024-09-14T11:17:47.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.424+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=4Q0I87YYJKDD tag=ET7FWYDWJ99Q type=write size=2256758 2024-09-14T11:17:47.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.425+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=CRWO6OB3E12R type=write size=1047046 2024-09-14T11:17:47.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.427+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=71W9PSZBO4LQ type=write size=668816 2024-09-14T11:17:47.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.429+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~2BM28YQPKY7V.0 size=238561 2024-09-14T11:17:47.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.429+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=2BM28YQPKY7V tag=G31HUI2LDHOE type=write size=1287137 2024-09-14T11:17:47.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.430+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=963LI182WPA7 type=write size=618636 2024-09-14T11:17:47.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.433+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~INTGC0RYGD89.0 size=230704 2024-09-14T11:17:47.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.433+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=INTGC0RYGD89 tag=V0J9X3UCRVNU type=write size=1279280 2024-09-14T11:17:47.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.434+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.0 size=1048576 2024-09-14T11:17:47.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.435+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.1 size=1048576 2024-09-14T11:17:47.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.435+0000 7f1be8076780 1 < canceled part key=_multipart_JDKFKO39I56L.2~KSEZHZX4N2QY.2 size=765459 2024-09-14T11:17:47.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.437+0000 7f1be8076780 1 < canceled multipart upload key=JDKFKO39I56L upload=KSEZHZX4N2QY tag=KBIQ8BI23REP type=write size=3911187 2024-09-14T11:17:47.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.438+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=UB8WJGOPMI4X type=del size=2114762 2024-09-14T11:17:47.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.440+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.0 size=1048576 2024-09-14T11:17:47.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.441+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.1 size=1048576 2024-09-14T11:17:47.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.442+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~QCZAUL8FFZ77.2 size=352270 2024-09-14T11:17:47.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.444+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=QCZAUL8FFZ77 tag=HT9R6G5432BQ type=write size=3497998 2024-09-14T11:17:47.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.446+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~J7BXQGN095KQ.0 size=1048576 2024-09-14T11:17:47.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.447+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~J7BXQGN095KQ.1 size=576265 2024-09-14T11:17:47.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.447+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=J7BXQGN095KQ tag=EGJHW24YRMJ1 type=write size=2673417 2024-09-14T11:17:47.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.448+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=1JN5X4I43PNH type=del 2024-09-14T11:17:47.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.449+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=S6C4Q7P2SDGC type=write size=621734 2024-09-14T11:17:47.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.450+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=U1Y1WBXH1N4Q type=write size=448876 2024-09-14T11:17:47.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.452+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~0BN04NTDI80X.0 size=1048576 2024-09-14T11:17:47.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.453+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~0BN04NTDI80X.1 size=873582 2024-09-14T11:17:47.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.453+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=0BN04NTDI80X tag=ZJ9NEE5F9GMU type=write size=2970734 2024-09-14T11:17:47.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.455+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=EBB0PJHAPOV5 type=del 2024-09-14T11:17:47.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.457+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.0 size=1048576 2024-09-14T11:17:47.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.458+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.1 size=1048576 2024-09-14T11:17:47.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.459+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.2 size=753483 2024-09-14T11:17:47.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.459+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=P7MEFG7WRITU tag=Q78I5QOKIX8Z type=write size=3899211 2024-09-14T11:17:47.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.459+0000 7f1be8076780 1 < canceled part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.0 size=1048576 2024-09-14T11:17:47.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.460+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.1 size=1048576 2024-09-14T11:17:47.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.461+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~2BHYJLEJL6SP.2 size=275483 2024-09-14T11:17:47.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.463+0000 7f1be8076780 1 < canceled multipart upload key=9DRSDTGM7Y3F upload=2BHYJLEJL6SP tag=YVZ0HCU8H9Y2 type=write size=3421211 2024-09-14T11:17:47.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.464+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=MB7SKH6AU4PS type=del size=3904551 2024-09-14T11:17:47.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.466+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~9W80HX6PJJM9.0 size=1048576 2024-09-14T11:17:47.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.466+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~9W80HX6PJJM9.1 size=894513 2024-09-14T11:17:47.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.468+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=9W80HX6PJJM9 tag=8P1L5IJL52MT type=write size=2991665 2024-09-14T11:17:47.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.470+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.0 size=1048576 2024-09-14T11:17:47.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.471+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.1 size=1048576 2024-09-14T11:17:47.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.472+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.2 size=659048 2024-09-14T11:17:47.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.472+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=S8ZISS2N75UE tag=6N3PG14GRFE1 type=write size=3804776 2024-09-14T11:17:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.473+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~ROGAYFLIQUAQ.0 size=506636 2024-09-14T11:17:47.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.475+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=ROGAYFLIQUAQ tag=9N6530H1BOMB type=write size=1555212 2024-09-14T11:17:47.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.476+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=4JNN2UKFEK9D type=del size=3081338 2024-09-14T11:17:47.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.479+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=18I93WTZJCI9 type=del size=1926760 2024-09-14T11:17:47.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.481+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.0 size=1048576 2024-09-14T11:17:47.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.482+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.1 size=1048576 2024-09-14T11:17:47.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.483+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.2 size=695992 2024-09-14T11:17:47.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.483+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=Y7YWZH33DV7W tag=UZXDAKSZAW21 type=write size=3841720 2024-09-14T11:17:47.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.484+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.0 size=1048576 2024-09-14T11:17:47.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.484+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.1 size=1048576 2024-09-14T11:17:47.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.485+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~WYR5F1HWRAG6.2 size=249030 2024-09-14T11:17:47.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.487+0000 7f1be8076780 1 < canceled multipart upload key=QIEUKUQ8CS2U upload=WYR5F1HWRAG6 tag=K6E5J77KGI26 type=write size=3394758 2024-09-14T11:17:47.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.488+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=CWOGDC7KV71L type=del size=2215191 2024-09-14T11:17:47.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.491+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=IHRACB097QP2 type=del size=3680816 2024-09-14T11:17:47.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.493+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HBVZ1QHQD4KR.0 size=731822 2024-09-14T11:17:47.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.493+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=HBVZ1QHQD4KR tag=R6EPD9UAT1HD type=write size=1780398 2024-09-14T11:17:47.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.494+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~DD6QRCIH9QQI.0 size=1048576 2024-09-14T11:17:47.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.495+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~DD6QRCIH9QQI.1 size=547456 2024-09-14T11:17:47.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.497+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=DD6QRCIH9QQI tag=WWX4OVZ2JMQF type=write size=2644608 2024-09-14T11:17:47.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.499+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.0 size=1048576 2024-09-14T11:17:47.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.500+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.1 size=1048576 2024-09-14T11:17:47.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.501+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.2 size=108010 2024-09-14T11:17:47.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.501+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=2CB3G43ZPU20 tag=T1Z13G2K3B1E type=write size=3253738 2024-09-14T11:17:47.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.502+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~RN3VWA4YXTO3.0 size=1048576 2024-09-14T11:17:47.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.504+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~RN3VWA4YXTO3.1 size=642609 2024-09-14T11:17:47.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.506+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=RN3VWA4YXTO3 tag=ZZHH06AO21MR type=write size=2739761 2024-09-14T11:17:47.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.508+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~9UTC3VE7B7F0.0 size=1048576 2024-09-14T11:17:47.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.509+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~9UTC3VE7B7F0.1 size=118599 2024-09-14T11:17:47.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.509+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=9UTC3VE7B7F0 tag=65CV00FLKQ0O type=write size=2215751 2024-09-14T11:17:47.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.510+0000 7f1be8076780 -1 < failed to complete operation key=MVUN63538RAB tag=CRWO6OB3E12R type=write size=1047046: (22) Invalid argument 2024-09-14T11:17:47.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.512+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~BY4H109JN1MH.0 size=218443 2024-09-14T11:17:47.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.512+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=BY4H109JN1MH tag=JOILFP6XP562 type=write size=1267019 2024-09-14T11:17:47.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.513+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~2BM28YQPKY7V.0 size=238561 2024-09-14T11:17:47.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.514+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=2BM28YQPKY7V tag=G31HUI2LDHOE type=write size=1287137 2024-09-14T11:17:47.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.515+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=8ADM3ZDV2KEM type=del size=2457150 2024-09-14T11:17:47.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.517+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~INTGC0RYGD89.0 size=230704 2024-09-14T11:17:47.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.518+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=INTGC0RYGD89 tag=V0J9X3UCRVNU type=write size=1279280 2024-09-14T11:17:47.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.519+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=IMLY3J70Q4SS type=del size=2402174 2024-09-14T11:17:47.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.520+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=UB8WJGOPMI4X type=del 2024-09-14T11:17:47.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.522+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.0 size=1048576 2024-09-14T11:17:47.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.523+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.1 size=1048576 2024-09-14T11:17:47.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.524+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.2 size=190088 2024-09-14T11:17:47.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.524+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=ZC7LOMYN16AT tag=E36FSE3I4PP1 type=write size=3335816 2024-09-14T11:17:47.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.525+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~J7BXQGN095KQ.0 size=1048576 2024-09-14T11:17:47.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.526+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~J7BXQGN095KQ.1 size=576265 2024-09-14T11:17:47.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.528+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=J7BXQGN095KQ tag=EGJHW24YRMJ1 type=write size=2673417 2024-09-14T11:17:47.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.529+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=LACSM3SCV7F9 type=del size=2866121 2024-09-14T11:17:47.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.530+0000 7f1be8076780 1 < completed write operation key=SJES17ZIGRZE tag=S6C4Q7P2SDGC type=write size=621734 2024-09-14T11:17:47.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.531+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=YGNZ88JRNJJC type=del size=1254527 2024-09-14T11:17:47.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.533+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~0BN04NTDI80X.0 size=1048576 2024-09-14T11:17:47.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.534+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~0BN04NTDI80X.1 size=873582 2024-09-14T11:17:47.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.536+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=0BN04NTDI80X tag=ZJ9NEE5F9GMU type=write size=2970734 2024-09-14T11:17:47.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.537+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=HSAAZXRY8KVE type=del size=806387 2024-09-14T11:17:47.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.538+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.0 size=1048576 2024-09-14T11:17:47.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.539+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.1 size=1048576 2024-09-14T11:17:47.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.540+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~P7MEFG7WRITU.2 size=753483 2024-09-14T11:17:47.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.542+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=P7MEFG7WRITU tag=Q78I5QOKIX8Z type=write size=3899211 2024-09-14T11:17:47.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.543+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=SQICW5WYIEAI type=del size=2856059 2024-09-14T11:17:47.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.545+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=MB7SKH6AU4PS type=del size=3904551 2024-09-14T11:17:47.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.546+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=2CAAVJ1POUUX type=write size=376599 2024-09-14T11:17:47.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.548+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.0 size=1048576 2024-09-14T11:17:47.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.548+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.1 size=1048576 2024-09-14T11:17:47.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.549+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~S8ZISS2N75UE.2 size=659048 2024-09-14T11:17:47.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.551+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=S8ZISS2N75UE tag=6N3PG14GRFE1 type=write size=3804776 2024-09-14T11:17:47.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.552+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=R66G4KON5C21 type=write size=570266 2024-09-14T11:17:47.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.553+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=4JNN2UKFEK9D type=del 2024-09-14T11:17:47.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.554+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=01ESINWG07UG type=del size=2673083 2024-09-14T11:17:47.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.555+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.0 size=1048576 2024-09-14T11:17:47.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.556+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.1 size=1048576 2024-09-14T11:17:47.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.557+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~Y7YWZH33DV7W.2 size=695992 2024-09-14T11:17:47.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.559+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=Y7YWZH33DV7W tag=UZXDAKSZAW21 type=write size=3841720 2024-09-14T11:17:47.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.561+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TNBGN62G0Q80.0 size=606551 2024-09-14T11:17:47.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.561+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=TNBGN62G0Q80 tag=O6SKC2842EWN type=write size=1655127 2024-09-14T11:17:47.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.562+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=CWOGDC7KV71L type=del 2024-09-14T11:17:47.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.563+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=QMYMS60LIESB type=write size=63607 2024-09-14T11:17:47.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.564+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HBVZ1QHQD4KR.0 size=731822 2024-09-14T11:17:47.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.566+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=HBVZ1QHQD4KR tag=R6EPD9UAT1HD type=write size=1780398 2024-09-14T11:17:47.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.567+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=HND4YKP9FBQV type=del size=2797519 2024-09-14T11:17:47.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.568+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.0 size=1048576 2024-09-14T11:17:47.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.568+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.1 size=1048576 2024-09-14T11:17:47.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.570+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~2CB3G43ZPU20.2 size=108010 2024-09-14T11:17:47.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.572+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=2CB3G43ZPU20 tag=T1Z13G2K3B1E type=write size=3253738 2024-09-14T11:17:47.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.573+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=5YW7AN7JY82L type=write size=364713 2024-09-14T11:17:47.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.574+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~9UTC3VE7B7F0.0 size=1048576 2024-09-14T11:17:47.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.575+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~9UTC3VE7B7F0.1 size=118599 2024-09-14T11:17:47.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.577+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=9UTC3VE7B7F0 tag=65CV00FLKQ0O type=write size=2215751 2024-09-14T11:17:47.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.579+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~MLYS3M539UZ1.0 size=357583 2024-09-14T11:17:47.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.579+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=MLYS3M539UZ1 tag=09LFCD72SMY4 type=write size=1406159 2024-09-14T11:17:47.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.580+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~BY4H109JN1MH.0 size=218443 2024-09-14T11:17:47.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.582+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=BY4H109JN1MH tag=JOILFP6XP562 type=write size=1267019 2024-09-14T11:17:47.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.584+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~5DKP8XVOQYL9.0 size=959040 2024-09-14T11:17:47.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.584+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=5DKP8XVOQYL9 tag=QP757F3H9F1T type=write size=2007616 2024-09-14T11:17:47.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.585+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=8ADM3ZDV2KEM type=del size=2457150 2024-09-14T11:17:47.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.586+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=ZRGRPX7D731Z type=del size=2252971 2024-09-14T11:17:47.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.589+0000 7f1be8076780 1 < suggested remove operation key=XB3M4CI0ERWP tag=IMLY3J70Q4SS type=del 2024-09-14T11:17:47.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.590+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=HEQ8PNYFBDJK type=del size=3682653 2024-09-14T11:17:47.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.591+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.0 size=1048576 2024-09-14T11:17:47.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.592+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.1 size=1048576 2024-09-14T11:17:47.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.592+0000 7f1be8076780 1 < canceled part key=_multipart_7OUNKTS3X7DJ.2~ZC7LOMYN16AT.2 size=190088 2024-09-14T11:17:47.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.594+0000 7f1be8076780 1 < canceled multipart upload key=7OUNKTS3X7DJ upload=ZC7LOMYN16AT tag=E36FSE3I4PP1 type=write size=3335816 2024-09-14T11:17:47.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.596+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.0 size=1048576 2024-09-14T11:17:47.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.597+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.1 size=1048576 2024-09-14T11:17:47.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.598+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.2 size=274209 2024-09-14T11:17:47.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.598+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=6WV669GQKK0U tag=6E2T063K377M type=write size=3419937 2024-09-14T11:17:47.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.600+0000 7f1be8076780 1 < suggested remove operation key=26WW5JFVB36U tag=LACSM3SCV7F9 type=del 2024-09-14T11:17:47.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.601+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=3YFO83KS33QU type=write size=548241 2024-09-14T11:17:47.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.602+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=YGNZ88JRNJJC type=del 2024-09-14T11:17:47.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.604+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=CHEWW9VRAS2W type=del size=2411421 2024-09-14T11:17:47.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.605+0000 7f1be8076780 -1 < failed to complete operation key=XB3M4CI0ERWP tag=HSAAZXRY8KVE type=del size=806387: (22) Invalid argument 2024-09-14T11:17:47.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.606+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=UUPIW9QAH1NS type=del size=2895446 2024-09-14T11:17:47.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.607+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=SQICW5WYIEAI type=del 2024-09-14T11:17:47.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.611+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.0 size=1048576 2024-09-14T11:17:47.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.611+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.1 size=1048576 2024-09-14T11:17:47.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.612+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.2 size=518291 2024-09-14T11:17:47.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.612+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=1ZO8O11FLKA4 tag=5MX8BZ7KHYVM type=write size=3664019 2024-09-14T11:17:47.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.613+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=2CAAVJ1POUUX type=write size=376599 2024-09-14T11:17:47.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.615+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=MM135NQLPI79 type=del size=862745 2024-09-14T11:17:47.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.616+0000 7f1be8076780 1 < completed write operation key=7OUNKTS3X7DJ tag=R66G4KON5C21 type=write size=570266 2024-09-14T11:17:47.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.617+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=KV01KSCFHEF9 type=del size=2412592 2024-09-14T11:17:47.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.618+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=01ESINWG07UG type=del 2024-09-14T11:17:47.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.620+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=VIGGFEGN790W type=del size=837557 2024-09-14T11:17:47.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.621+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TNBGN62G0Q80.0 size=606551 2024-09-14T11:17:47.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.623+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=TNBGN62G0Q80 tag=O6SKC2842EWN type=write size=1655127 2024-09-14T11:17:47.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.624+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=IW0698H11CRG type=del size=2574109 2024-09-14T11:17:47.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.625+0000 7f1be8076780 1 < completed write operation key=WQC5TVD66R0W tag=QMYMS60LIESB type=write size=63607 2024-09-14T11:17:47.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.626+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=T9D6U6AGRF55 type=del size=1370843 2024-09-14T11:17:47.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.627+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=HND4YKP9FBQV type=del 2024-09-14T11:17:47.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.629+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=DV20LZJ99RU5 type=del size=2437934 2024-09-14T11:17:47.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.630+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=5YW7AN7JY82L type=write size=364713 2024-09-14T11:17:47.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.631+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=9W3557GY2ZQ5 type=del size=3764759 2024-09-14T11:17:47.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.632+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~MLYS3M539UZ1.0 size=357583 2024-09-14T11:17:47.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.634+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=MLYS3M539UZ1 tag=09LFCD72SMY4 type=write size=1406159 2024-09-14T11:17:47.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.635+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=JUGSQMNPY2AM type=del size=4067293 2024-09-14T11:17:47.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.636+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~5DKP8XVOQYL9.0 size=959040 2024-09-14T11:17:47.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.638+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=5DKP8XVOQYL9 tag=QP757F3H9F1T type=write size=2007616 2024-09-14T11:17:47.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.639+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=VKAOYDIVXP81 type=del size=2366474 2024-09-14T11:17:47.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.641+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=ZRGRPX7D731Z type=del size=2252971 2024-09-14T11:17:47.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.642+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=YOVRUH1IJI9D type=del size=2372197 2024-09-14T11:17:47.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.643+0000 7f1be8076780 1 < canceled operation key=9DRSDTGM7Y3F tag=HEQ8PNYFBDJK type=del size=3682653 2024-09-14T11:17:47.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.644+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=TLDD2LR9GAU0 type=del size=2417968 2024-09-14T11:17:47.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.645+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.0 size=1048576 2024-09-14T11:17:47.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.646+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.1 size=1048576 2024-09-14T11:17:47.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.647+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~6WV669GQKK0U.2 size=274209 2024-09-14T11:17:47.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.649+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=6WV669GQKK0U tag=6E2T063K377M type=write size=3419937 2024-09-14T11:17:47.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.651+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.0 size=1048576 2024-09-14T11:17:47.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.652+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.1 size=1048576 2024-09-14T11:17:47.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.653+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.2 size=617325 2024-09-14T11:17:47.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.653+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=V24XW2S00RMO tag=VWLWDVY2LSCR type=write size=3763053 2024-09-14T11:17:47.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.654+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=3YFO83KS33QU type=write size=548241 2024-09-14T11:17:47.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.655+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=7HWQ20FO6BHG type=del size=950848 2024-09-14T11:17:47.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.656+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=CHEWW9VRAS2W type=del 2024-09-14T11:17:47.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.657+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=2TP47GZMXY7D type=del size=1665463 2024-09-14T11:17:47.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.658+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=UUPIW9QAH1NS type=del 2024-09-14T11:17:47.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.659+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=VG49O9ZGN3RU type=del size=4029087 2024-09-14T11:17:47.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.661+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.0 size=1048576 2024-09-14T11:17:47.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.661+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.1 size=1048576 2024-09-14T11:17:47.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.662+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~1ZO8O11FLKA4.2 size=518291 2024-09-14T11:17:47.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.664+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=1ZO8O11FLKA4 tag=5MX8BZ7KHYVM type=write size=3664019 2024-09-14T11:17:47.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.665+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=GCNIW0M3EXWN type=del size=1506519 2024-09-14T11:17:47.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.666+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=MM135NQLPI79 type=del 2024-09-14T11:17:47.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.667+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=WGEHA5GL4CEK type=del size=699618 2024-09-14T11:17:47.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.669+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=KV01KSCFHEF9 type=del 2024-09-14T11:17:47.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.670+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.0 size=1048576 2024-09-14T11:17:47.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.671+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.1 size=1048576 2024-09-14T11:17:47.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.672+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.2 size=856345 2024-09-14T11:17:47.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.672+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=UE2LH1PK2D5D tag=VI3VOYZQ4QTT type=write size=4002073 2024-09-14T11:17:47.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.673+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=VIGGFEGN790W type=del 2024-09-14T11:17:47.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.675+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~VKCR3Z22AAP3.0 size=969080 2024-09-14T11:17:47.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.675+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=VKCR3Z22AAP3 tag=FU339N67CW21 type=write size=2017656 2024-09-14T11:17:47.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.677+0000 7f1be8076780 1 < suggested update operation key=AUCQC0OBQP7Z tag=IW0698H11CRG type=del size=2574109 2024-09-14T11:17:47.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.679+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=8BCJPZ4MOEIJ type=del size=692786 2024-09-14T11:17:47.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.680+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=T9D6U6AGRF55 type=del 2024-09-14T11:17:47.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.682+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.0 size=1048576 2024-09-14T11:17:47.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.683+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.1 size=1048576 2024-09-14T11:17:47.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.684+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.2 size=375803 2024-09-14T11:17:47.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.684+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=B0MOR34U91SU tag=0BCOV55HD6HA type=write size=3521531 2024-09-14T11:17:47.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.685+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=DV20LZJ99RU5 type=del 2024-09-14T11:17:47.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.686+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=5QMG371N9TJE type=del size=2551526 2024-09-14T11:17:47.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.688+0000 7f1be8076780 1 < suggested remove operation key=3YIK6B6Y2EU1 tag=9W3557GY2ZQ5 type=del 2024-09-14T11:17:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.691+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~9NEJ9LKG5VCA.0 size=535623 2024-09-14T11:17:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.691+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=9NEJ9LKG5VCA tag=RAXBIFNNT6E2 type=write size=1584199 2024-09-14T11:17:47.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.692+0000 7f1be8076780 -1 < failed to complete operation key=MVUN63538RAB tag=JUGSQMNPY2AM type=del size=4067293: (22) Invalid argument 2024-09-14T11:17:47.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.693+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=CJT8TJDHNIZP type=write size=448086 2024-09-14T11:17:47.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.694+0000 7f1be8076780 1 < canceled operation key=QC6MEJABT7IM tag=VKAOYDIVXP81 type=del size=2366474 2024-09-14T11:17:47.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.696+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~JM93X2WDY0X5.0 size=1048576 2024-09-14T11:17:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.697+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~JM93X2WDY0X5.1 size=230447 2024-09-14T11:17:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.697+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=JM93X2WDY0X5 tag=W23KV6B5A8HJ type=write size=2327599 2024-09-14T11:17:47.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.699+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=YOVRUH1IJI9D type=del 2024-09-14T11:17:47.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.700+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=NQVVYR3GW103 type=del size=1717281 2024-09-14T11:17:47.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.701+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=TLDD2LR9GAU0 type=del 2024-09-14T11:17:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.702+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=CMK7IV9PL1QP type=write size=681691 2024-09-14T11:17:47.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.703+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.0 size=1048576 2024-09-14T11:17:47.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.704+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.1 size=1048576 2024-09-14T11:17:47.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.705+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~V24XW2S00RMO.2 size=617325 2024-09-14T11:17:47.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.709+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=V24XW2S00RMO tag=VWLWDVY2LSCR type=write size=3763053 2024-09-14T11:17:47.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.710+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=W8IT5FZ03R5E type=write size=734440 2024-09-14T11:17:47.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.713+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=7HWQ20FO6BHG type=del 2024-09-14T11:17:47.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.715+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.0 size=1048576 2024-09-14T11:17:47.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.716+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.1 size=1048576 2024-09-14T11:17:47.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.717+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.2 size=751249 2024-09-14T11:17:47.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.717+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=HFG8DN0B82LM tag=EIUHG1JGFPA1 type=write size=3896977 2024-09-14T11:17:47.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.719+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=2TP47GZMXY7D type=del size=1665463 2024-09-14T11:17:47.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.722+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=1XVXKAP1Y04E type=del size=3591941 2024-09-14T11:17:47.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.724+0000 7f1be8076780 1 < suggested update operation key=RIYGSRWKVKFF tag=VG49O9ZGN3RU type=del size=4029087 2024-09-14T11:17:47.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.726+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=EEMZDR4Y13PZ type=del size=3719886 2024-09-14T11:17:47.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.727+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=GCNIW0M3EXWN type=del 2024-09-14T11:17:47.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.729+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~W2GK6GDCE3K2.0 size=940188 2024-09-14T11:17:47.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.729+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=W2GK6GDCE3K2 tag=GU8HJP7SSCPL type=write size=1988764 2024-09-14T11:17:47.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.730+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=WGEHA5GL4CEK type=del 2024-09-14T11:17:47.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.732+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.0 size=1048576 2024-09-14T11:17:47.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.733+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.1 size=1048576 2024-09-14T11:17:47.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.734+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.2 size=116815 2024-09-14T11:17:47.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.734+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=TESPYNA2Z962 tag=Y8SKYLBEE4U8 type=write size=3262543 2024-09-14T11:17:47.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.735+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.0 size=1048576 2024-09-14T11:17:47.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.736+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.1 size=1048576 2024-09-14T11:17:47.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.737+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~UE2LH1PK2D5D.2 size=856345 2024-09-14T11:17:47.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.739+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=UE2LH1PK2D5D tag=VI3VOYZQ4QTT type=write size=4002073 2024-09-14T11:17:47.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.741+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.0 size=1048576 2024-09-14T11:17:47.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.742+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.1 size=1048576 2024-09-14T11:17:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.743+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.2 size=173493 2024-09-14T11:17:47.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.743+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=SLYCOMJKHFUH tag=TURNIFX8NWTY type=write size=3319221 2024-09-14T11:17:47.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.744+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~VKCR3Z22AAP3.0 size=969080 2024-09-14T11:17:47.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.746+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=VKCR3Z22AAP3 tag=FU339N67CW21 type=write size=2017656 2024-09-14T11:17:47.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.749+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~DHIKIDCH88P9.0 size=330850 2024-09-14T11:17:47.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.749+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=DHIKIDCH88P9 tag=4TMC6FIVNE9E type=write size=1379426 2024-09-14T11:17:47.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.750+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=8BCJPZ4MOEIJ type=del 2024-09-14T11:17:47.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.752+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~LUVC9V7DLJDE.0 size=1048576 2024-09-14T11:17:47.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.753+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~LUVC9V7DLJDE.1 size=135154 2024-09-14T11:17:47.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.753+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=LUVC9V7DLJDE tag=IJX4GUSQB754 type=write size=2232306 2024-09-14T11:17:47.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.754+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.0 size=1048576 2024-09-14T11:17:47.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.755+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.1 size=1048576 2024-09-14T11:17:47.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.756+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~B0MOR34U91SU.2 size=375803 2024-09-14T11:17:47.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.758+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=B0MOR34U91SU tag=0BCOV55HD6HA type=write size=3521531 2024-09-14T11:17:47.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.759+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=4VH03FSWLKLA type=del size=1418923 2024-09-14T11:17:47.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.760+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=5QMG371N9TJE type=del 2024-09-14T11:17:47.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.762+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~KYT2L0J7H18Y.0 size=855946 2024-09-14T11:17:47.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.762+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=KYT2L0J7H18Y tag=7RN4UBS08B7R type=write size=1904522 2024-09-14T11:17:47.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.763+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~9NEJ9LKG5VCA.0 size=535623 2024-09-14T11:17:47.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.765+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=9NEJ9LKG5VCA tag=RAXBIFNNT6E2 type=write size=1584199 2024-09-14T11:17:47.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.766+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=IYII7SP0XUXV type=write size=335221 2024-09-14T11:17:47.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.767+0000 7f1be8076780 1 < completed write operation key=7OUNKTS3X7DJ tag=CJT8TJDHNIZP type=write size=448086 2024-09-14T11:17:47.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.769+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~EW23HPD0E68A.0 size=1048576 2024-09-14T11:17:47.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.770+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~EW23HPD0E68A.1 size=891903 2024-09-14T11:17:47.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.770+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=EW23HPD0E68A tag=8CQ4SPH0WNIG type=write size=2989055 2024-09-14T11:17:47.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.770+0000 7f1be8076780 1 < canceled part key=_multipart_1X2EWK1Y2GE0.2~JM93X2WDY0X5.0 size=1048576 2024-09-14T11:17:47.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.771+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~JM93X2WDY0X5.1 size=230447 2024-09-14T11:17:47.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.773+0000 7f1be8076780 1 < canceled multipart upload key=1X2EWK1Y2GE0 upload=JM93X2WDY0X5 tag=W23KV6B5A8HJ type=write size=2327599 2024-09-14T11:17:47.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.776+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~D40XGDLEOCK9.0 size=1048576 2024-09-14T11:17:47.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.777+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~D40XGDLEOCK9.1 size=372303 2024-09-14T11:17:47.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.777+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=D40XGDLEOCK9 tag=CXHIJPCFRHXK type=write size=2469455 2024-09-14T11:17:47.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.778+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=NQVVYR3GW103 type=del size=1717281 2024-09-14T11:17:47.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.779+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=EZ0VMU6M66EF type=write size=127385 2024-09-14T11:17:47.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.780+0000 7f1be8076780 1 < completed write operation key=LNMGQ54S2CXX tag=CMK7IV9PL1QP type=write size=681691 2024-09-14T11:17:47.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.781+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=I83LQPG16F82 type=del size=921618 2024-09-14T11:17:47.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.782+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=W8IT5FZ03R5E type=write size=734440 2024-09-14T11:17:47.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.784+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.0 size=1048576 2024-09-14T11:17:47.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.785+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.1 size=1048576 2024-09-14T11:17:47.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.786+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.2 size=15314 2024-09-14T11:17:47.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.786+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=ONP172D809DZ tag=SD6FMZS8069S type=write size=3161042 2024-09-14T11:17:47.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.787+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.0 size=1048576 2024-09-14T11:17:47.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.788+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.1 size=1048576 2024-09-14T11:17:47.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.789+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~HFG8DN0B82LM.2 size=751249 2024-09-14T11:17:47.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.792+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=HFG8DN0B82LM tag=EIUHG1JGFPA1 type=write size=3896977 2024-09-14T11:17:47.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.794+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~AQ5NLP4W7PGM.0 size=1048576 2024-09-14T11:17:47.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.795+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~AQ5NLP4W7PGM.1 size=869860 2024-09-14T11:17:47.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.795+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=AQ5NLP4W7PGM tag=OVS77TBVPFR9 type=write size=2967012 2024-09-14T11:17:47.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.796+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=1XVXKAP1Y04E type=del 2024-09-14T11:17:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.798+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~QUMWIU4V2TIV.0 size=822966 2024-09-14T11:17:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.798+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=QUMWIU4V2TIV tag=KZ0CZH7ZXW75 type=write size=1871542 2024-09-14T11:17:47.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.799+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=EEMZDR4Y13PZ type=del 2024-09-14T11:17:47.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.801+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~WWFM0VLVEYMF.0 size=657616 2024-09-14T11:17:47.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.801+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=WWFM0VLVEYMF tag=QMDZO0LSWBW5 type=write size=1706192 2024-09-14T11:17:47.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.802+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~W2GK6GDCE3K2.0 size=940188 2024-09-14T11:17:47.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.804+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=W2GK6GDCE3K2 tag=GU8HJP7SSCPL type=write size=1988764 2024-09-14T11:17:47.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.806+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~U8KZNJQID92T.0 size=417534 2024-09-14T11:17:47.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.806+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=U8KZNJQID92T tag=TQ4H5P1BNKY4 type=write size=1466110 2024-09-14T11:17:47.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.807+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.0 size=1048576 2024-09-14T11:17:47.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.808+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.1 size=1048576 2024-09-14T11:17:47.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.809+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TESPYNA2Z962.2 size=116815 2024-09-14T11:17:47.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.811+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=TESPYNA2Z962 tag=Y8SKYLBEE4U8 type=write size=3262543 2024-09-14T11:17:47.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.813+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~0VSHZYSVUFF6.0 size=1048576 2024-09-14T11:17:47.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.814+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~0VSHZYSVUFF6.1 size=638590 2024-09-14T11:17:47.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.814+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=0VSHZYSVUFF6 tag=IFY7EEUVCS9X type=write size=2735742 2024-09-14T11:17:47.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.815+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.0 size=1048576 2024-09-14T11:17:47.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.816+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.1 size=1048576 2024-09-14T11:17:47.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.816+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~SLYCOMJKHFUH.2 size=173493 2024-09-14T11:17:47.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.818+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=SLYCOMJKHFUH tag=TURNIFX8NWTY type=write size=3319221 2024-09-14T11:17:47.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.819+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=96LDK3SG6VHY type=del size=3580041 2024-09-14T11:17:47.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.821+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~DHIKIDCH88P9.0 size=330850 2024-09-14T11:17:47.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.823+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=DHIKIDCH88P9 tag=4TMC6FIVNE9E type=write size=1379426 2024-09-14T11:17:47.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.824+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=PA7QUL79RYMD type=del size=211440 2024-09-14T11:17:47.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.826+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~LUVC9V7DLJDE.0 size=1048576 2024-09-14T11:17:47.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.827+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~LUVC9V7DLJDE.1 size=135154 2024-09-14T11:17:47.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.829+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=LUVC9V7DLJDE tag=IJX4GUSQB754 type=write size=2232306 2024-09-14T11:17:47.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.831+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~G4SVWS1K4I6J.0 size=1048576 2024-09-14T11:17:47.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.832+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~G4SVWS1K4I6J.1 size=86256 2024-09-14T11:17:47.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.832+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=G4SVWS1K4I6J tag=JNAATGN0RJZV type=write size=2183408 2024-09-14T11:17:47.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.833+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=4VH03FSWLKLA type=del size=1418923 2024-09-14T11:17:47.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.834+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=UW530DH18RO7 type=del size=560956 2024-09-14T11:17:47.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.835+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~KYT2L0J7H18Y.0 size=855946 2024-09-14T11:17:47.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.837+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=KYT2L0J7H18Y tag=7RN4UBS08B7R type=write size=1904522 2024-09-14T11:17:47.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.838+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=04SRUDBAFH5P type=del size=1901085 2024-09-14T11:17:47.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.840+0000 7f1be8076780 1 < completed write operation key=CQDRZMJAJ7FZ tag=IYII7SP0XUXV type=write size=335221 2024-09-14T11:17:47.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.841+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~5QX7B6Y09HT7.0 size=1048576 2024-09-14T11:17:47.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.842+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~5QX7B6Y09HT7.1 size=1010563 2024-09-14T11:17:47.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.842+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=5QX7B6Y09HT7 tag=7Z1TL3J6P5OY type=write size=3107715 2024-09-14T11:17:47.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.844+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~EW23HPD0E68A.0 size=1048576 2024-09-14T11:17:47.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.844+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~EW23HPD0E68A.1 size=891903 2024-09-14T11:17:47.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.846+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=EW23HPD0E68A tag=8CQ4SPH0WNIG type=write size=2989055 2024-09-14T11:17:47.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.847+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=G4WUSQ4FAB32 type=del size=2398205 2024-09-14T11:17:47.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.848+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~D40XGDLEOCK9.0 size=1048576 2024-09-14T11:17:47.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.848+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~D40XGDLEOCK9.1 size=372303 2024-09-14T11:17:47.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.850+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=D40XGDLEOCK9 tag=CXHIJPCFRHXK type=write size=2469455 2024-09-14T11:17:47.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.851+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=98F23ACNVULX type=del size=765695 2024-09-14T11:17:47.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.854+0000 7f1be8076780 1 < suggested remove operation key=LNMGQ54S2CXX tag=EZ0VMU6M66EF type=write 2024-09-14T11:17:47.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.856+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~N924PQY737VC.0 size=520602 2024-09-14T11:17:47.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.856+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=N924PQY737VC tag=UB9MN1VX5DPV type=write size=1569178 2024-09-14T11:17:47.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.857+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=I83LQPG16F82 type=del 2024-09-14T11:17:47.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.858+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=MFU8CGGXZ0LV type=del size=4154739 2024-09-14T11:17:47.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.859+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.0 size=1048576 2024-09-14T11:17:47.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.860+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.1 size=1048576 2024-09-14T11:17:47.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.861+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~ONP172D809DZ.2 size=15314 2024-09-14T11:17:47.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.862+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=ONP172D809DZ tag=SD6FMZS8069S type=write size=3161042 2024-09-14T11:17:47.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.864+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=4NIMVINZ3NC3 type=del size=1295962 2024-09-14T11:17:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.865+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~AQ5NLP4W7PGM.0 size=1048576 2024-09-14T11:17:47.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.866+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~AQ5NLP4W7PGM.1 size=869860 2024-09-14T11:17:47.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.868+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=AQ5NLP4W7PGM tag=OVS77TBVPFR9 type=write size=2967012 2024-09-14T11:17:47.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.870+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~ARY8AJ1H7COQ.0 size=1048576 2024-09-14T11:17:47.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.871+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~ARY8AJ1H7COQ.1 size=308154 2024-09-14T11:17:47.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.871+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=ARY8AJ1H7COQ tag=UFCTBV322CGQ type=write size=2405306 2024-09-14T11:17:47.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.872+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~QUMWIU4V2TIV.0 size=822966 2024-09-14T11:17:47.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.874+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=QUMWIU4V2TIV tag=KZ0CZH7ZXW75 type=write size=1871542 2024-09-14T11:17:47.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.875+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=8WU21XFOINWR type=del size=2740757 2024-09-14T11:17:47.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.875+0000 7f1be8076780 1 < canceled part key=_multipart_26WW5JFVB36U.2~WWFM0VLVEYMF.0 size=657616 2024-09-14T11:17:47.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.877+0000 7f1be8076780 1 < canceled multipart upload key=26WW5JFVB36U upload=WWFM0VLVEYMF tag=QMDZO0LSWBW5 type=write size=1706192 2024-09-14T11:17:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.879+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~3GHE6UKNSJJT.0 size=893314 2024-09-14T11:17:47.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.879+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=3GHE6UKNSJJT tag=OJ0NDUN13QUU type=write size=1941890 2024-09-14T11:17:47.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.880+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~U8KZNJQID92T.0 size=417534 2024-09-14T11:17:47.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.882+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=U8KZNJQID92T tag=TQ4H5P1BNKY4 type=write size=1466110 2024-09-14T11:17:47.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.883+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=JXFNOC7EGRN2 type=del size=3073985 2024-09-14T11:17:47.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.884+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~0VSHZYSVUFF6.0 size=1048576 2024-09-14T11:17:47.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.885+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~0VSHZYSVUFF6.1 size=638590 2024-09-14T11:17:47.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.887+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=0VSHZYSVUFF6 tag=IFY7EEUVCS9X type=write size=2735742 2024-09-14T11:17:47.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.890+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~AW3KY9WB1YVK.0 size=1048576 2024-09-14T11:17:47.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.890+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~AW3KY9WB1YVK.1 size=281991 2024-09-14T11:17:47.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.890+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=AW3KY9WB1YVK tag=LB816G8SJMLM type=write size=2379143 2024-09-14T11:17:47.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.892+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=96LDK3SG6VHY type=del 2024-09-14T11:17:47.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.893+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=ZOKBTBOWVNI3 type=del size=1138511 2024-09-14T11:17:47.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.895+0000 7f1be8076780 1 < suggested remove operation key=JGEBWM9VRCFW tag=PA7QUL79RYMD type=del 2024-09-14T11:17:47.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.896+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=E823C4MH885B type=write size=481456 2024-09-14T11:17:47.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.898+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~G4SVWS1K4I6J.0 size=1048576 2024-09-14T11:17:47.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.899+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~G4SVWS1K4I6J.1 size=86256 2024-09-14T11:17:47.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.901+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=G4SVWS1K4I6J tag=JNAATGN0RJZV type=write size=2183408 2024-09-14T11:17:47.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.903+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~OSKFT5ILNAKS.0 size=1048576 2024-09-14T11:17:47.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.904+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~OSKFT5ILNAKS.1 size=443695 2024-09-14T11:17:47.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.904+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=OSKFT5ILNAKS tag=J52A5TFII0DF type=write size=2540847 2024-09-14T11:17:47.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.905+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=UW530DH18RO7 type=del 2024-09-14T11:17:47.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.907+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.0 size=1048576 2024-09-14T11:17:47.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.908+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.1 size=1048576 2024-09-14T11:17:47.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.909+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.2 size=827581 2024-09-14T11:17:47.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.909+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=BBEYH4DZNL98 tag=S1NLOAZ2QM0W type=write size=3973309 2024-09-14T11:17:47.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.910+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=04SRUDBAFH5P type=del 2024-09-14T11:17:47.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.911+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=9L5SUYPKP9FV type=write size=876259 2024-09-14T11:17:47.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.913+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~5QX7B6Y09HT7.0 size=1048576 2024-09-14T11:17:47.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.914+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~5QX7B6Y09HT7.1 size=1010563 2024-09-14T11:17:47.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.916+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=5QX7B6Y09HT7 tag=7Z1TL3J6P5OY type=write size=3107715 2024-09-14T11:17:47.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.917+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=LF9Y91CZG83T type=del size=453560 2024-09-14T11:17:47.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.918+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=G4WUSQ4FAB32 type=del 2024-09-14T11:17:47.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.920+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=KT32G67G6CLP type=del size=1785357 2024-09-14T11:17:47.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.922+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=98F23ACNVULX type=del size=765695 2024-09-14T11:17:47.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.924+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.0 size=1048576 2024-09-14T11:17:47.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.925+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.1 size=1048576 2024-09-14T11:17:47.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.926+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.2 size=997272 2024-09-14T11:17:47.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.926+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=PBFPL964Z37H tag=O3YPDX102VJ7 type=write size=4143000 2024-09-14T11:17:47.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.927+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~N924PQY737VC.0 size=520602 2024-09-14T11:17:47.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.929+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=N924PQY737VC tag=UB9MN1VX5DPV type=write size=1569178 2024-09-14T11:17:47.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.930+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=66N7106EVO2A type=del size=4089309 2024-09-14T11:17:47.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.936+0000 7f1be8076780 1 < suggested remove operation key=3YIK6B6Y2EU1 tag=MFU8CGGXZ0LV type=del 2024-09-14T11:17:47.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.937+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=IXX90DWUNV70 type=write size=877678 2024-09-14T11:17:47.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.938+0000 7f1be8076780 1 < canceled operation key=1RUE5J1DYH2C tag=4NIMVINZ3NC3 type=del size=1295962 2024-09-14T11:17:47.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.940+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=JRLIBOL5PO2C type=del size=3225026 2024-09-14T11:17:47.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.941+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~ARY8AJ1H7COQ.0 size=1048576 2024-09-14T11:17:47.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.941+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~ARY8AJ1H7COQ.1 size=308154 2024-09-14T11:17:47.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.943+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=ARY8AJ1H7COQ tag=UFCTBV322CGQ type=write size=2405306 2024-09-14T11:17:47.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.945+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.0 size=1048576 2024-09-14T11:17:47.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.946+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.1 size=1048576 2024-09-14T11:17:47.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.947+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.2 size=913431 2024-09-14T11:17:47.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.947+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=SENIIMIX84XG tag=YPR3150NBMRL type=write size=4059159 2024-09-14T11:17:47.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.948+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=8WU21XFOINWR type=del 2024-09-14T11:17:47.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.950+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~X0OLRQBP975W.0 size=137231 2024-09-14T11:17:47.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.950+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=X0OLRQBP975W tag=34URMPBWWS85 type=write size=1185807 2024-09-14T11:17:47.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.951+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~3GHE6UKNSJJT.0 size=893314 2024-09-14T11:17:47.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.953+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=3GHE6UKNSJJT tag=OJ0NDUN13QUU type=write size=1941890 2024-09-14T11:17:47.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.954+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=6L8WMEGPRVKM type=del size=319621 2024-09-14T11:17:47.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.956+0000 7f1be8076780 1 < suggested remove operation key=WQC5TVD66R0W tag=JXFNOC7EGRN2 type=del 2024-09-14T11:17:47.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.958+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.0 size=1048576 2024-09-14T11:17:47.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.959+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.1 size=1048576 2024-09-14T11:17:47.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.960+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.2 size=883932 2024-09-14T11:17:47.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.960+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=ZVUUWQTVMAK1 tag=NXRNMZJA1OTJ type=write size=4029660 2024-09-14T11:17:47.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.961+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~AW3KY9WB1YVK.0 size=1048576 2024-09-14T11:17:47.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.962+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~AW3KY9WB1YVK.1 size=281991 2024-09-14T11:17:47.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.964+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=AW3KY9WB1YVK tag=LB816G8SJMLM type=write size=2379143 2024-09-14T11:17:47.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.965+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=HRTK469FOEQ3 type=del size=3896507 2024-09-14T11:17:47.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.968+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=ZOKBTBOWVNI3 type=del size=1138511 2024-09-14T11:17:47.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.969+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=KIA0IR8XAGBU type=write size=297046 2024-09-14T11:17:47.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.970+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=E823C4MH885B type=write size=481456 2024-09-14T11:17:47.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.971+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=AOMKM7SQWN48 type=del size=4164327 2024-09-14T11:17:47.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.972+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~OSKFT5ILNAKS.0 size=1048576 2024-09-14T11:17:47.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.973+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~OSKFT5ILNAKS.1 size=443695 2024-09-14T11:17:47.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.975+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=OSKFT5ILNAKS tag=J52A5TFII0DF type=write size=2540847 2024-09-14T11:17:47.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.977+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~2NFYMNQ4BUU8.0 size=734758 2024-09-14T11:17:47.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.977+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=2NFYMNQ4BUU8 tag=TSOMNX77J5WS type=write size=1783334 2024-09-14T11:17:47.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.978+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.0 size=1048576 2024-09-14T11:17:47.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.979+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.1 size=1048576 2024-09-14T11:17:47.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.980+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~BBEYH4DZNL98.2 size=827581 2024-09-14T11:17:47.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.982+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=BBEYH4DZNL98 tag=S1NLOAZ2QM0W type=write size=3973309 2024-09-14T11:17:47.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.983+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=FLF5FMQ3BNLK type=del size=3866099 2024-09-14T11:17:47.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.984+0000 7f1be8076780 1 < completed write operation key=XB3M4CI0ERWP tag=9L5SUYPKP9FV type=write size=876259 2024-09-14T11:17:47.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.985+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=S2LQH3BDXQ4R type=del size=897139 2024-09-14T11:17:47.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.986+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=LF9Y91CZG83T type=del 2024-09-14T11:17:47.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.988+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~19AO8P1DLUIF.0 size=395635 2024-09-14T11:17:47.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.988+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=19AO8P1DLUIF tag=D89YNR3V49RS type=write size=1444211 2024-09-14T11:17:47.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.990+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=KT32G67G6CLP type=del 2024-09-14T11:17:47.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.991+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=04Y5JOWZ1DP5 type=write size=282461 2024-09-14T11:17:47.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.992+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.0 size=1048576 2024-09-14T11:17:47.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.993+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.1 size=1048576 2024-09-14T11:17:47.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.994+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~PBFPL964Z37H.2 size=997272 2024-09-14T11:17:47.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.996+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=PBFPL964Z37H tag=O3YPDX102VJ7 type=write size=4143000 2024-09-14T11:17:47.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.998+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~DJW0CGD244Q1.0 size=924963 2024-09-14T11:17:47.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.998+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=DJW0CGD244Q1 tag=PPD96HSY02YP type=write size=1973539 2024-09-14T11:17:47.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:47.999+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=66N7106EVO2A type=del 2024-09-14T11:17:47.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.000+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=8TYBA3NIFT52 type=write size=149671 2024-09-14T11:17:48.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.001+0000 7f1be8076780 1 < completed write operation key=UB0SEYZ7ITU1 tag=IXX90DWUNV70 type=write size=877678 2024-09-14T11:17:48.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.002+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=QCMD583IKZR9 type=del size=2610851 2024-09-14T11:17:48.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.004+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=JRLIBOL5PO2C type=del 2024-09-14T11:17:48.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.006+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.0 size=1048576 2024-09-14T11:17:48.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.006+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.1 size=1048576 2024-09-14T11:17:48.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.008+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.2 size=5341 2024-09-14T11:17:48.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.008+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=MTHVCYO6A26Q tag=SQ58DDTGMXN9 type=write size=3151069 2024-09-14T11:17:48.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.009+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.0 size=1048576 2024-09-14T11:17:48.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.010+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.1 size=1048576 2024-09-14T11:17:48.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.011+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~SENIIMIX84XG.2 size=913431 2024-09-14T11:17:48.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.013+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=SENIIMIX84XG tag=YPR3150NBMRL type=write size=4059159 2024-09-14T11:17:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.015+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~TOXQ9VR176B8.0 size=1036691 2024-09-14T11:17:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.015+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=TOXQ9VR176B8 tag=HQ87SESGQAD9 type=write size=2085267 2024-09-14T11:17:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.016+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~X0OLRQBP975W.0 size=137231 2024-09-14T11:17:48.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.018+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=X0OLRQBP975W tag=34URMPBWWS85 type=write size=1185807 2024-09-14T11:17:48.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.019+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=108RKGY3C0VQ type=write size=800674 2024-09-14T11:17:48.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.021+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=6L8WMEGPRVKM type=del size=319621 2024-09-14T11:17:48.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.023+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~QBA7JJH0DOHZ.0 size=963237 2024-09-14T11:17:48.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.023+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=QBA7JJH0DOHZ tag=JTGB3CC262NU type=write size=2011813 2024-09-14T11:17:48.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.024+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.0 size=1048576 2024-09-14T11:17:48.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.025+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.1 size=1048576 2024-09-14T11:17:48.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.026+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ZVUUWQTVMAK1.2 size=883932 2024-09-14T11:17:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.028+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=ZVUUWQTVMAK1 tag=NXRNMZJA1OTJ type=write size=4029660 2024-09-14T11:17:48.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.030+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.0 size=1048576 2024-09-14T11:17:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.031+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.1 size=1048576 2024-09-14T11:17:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.032+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.2 size=423260 2024-09-14T11:17:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.032+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=59N4QCUGY6N5 tag=TQ0DNM52U8OW type=write size=3568988 2024-09-14T11:17:48.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.033+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=HRTK469FOEQ3 type=del 2024-09-14T11:17:48.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.035+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=90CW23W6HQZT type=write size=821642 2024-09-14T11:17:48.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.036+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=KIA0IR8XAGBU type=write size=297046 2024-09-14T11:17:48.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.038+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WPS47CIOOKVN.0 size=602065 2024-09-14T11:17:48.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.038+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=WPS47CIOOKVN tag=S1ZZOE75ZRTY type=write size=1650641 2024-09-14T11:17:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.039+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=AOMKM7SQWN48 type=del 2024-09-14T11:17:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.042+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~LLGSYSQRCM4F.0 size=1048576 2024-09-14T11:17:48.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.043+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~LLGSYSQRCM4F.1 size=911929 2024-09-14T11:17:48.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.043+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=LLGSYSQRCM4F tag=IU83PCI74435 type=write size=3009081 2024-09-14T11:17:48.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.044+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~2NFYMNQ4BUU8.0 size=734758 2024-09-14T11:17:48.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.046+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=2NFYMNQ4BUU8 tag=TSOMNX77J5WS type=write size=1783334 2024-09-14T11:17:48.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.048+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~RHWSESWU8LWJ.0 size=1048576 2024-09-14T11:17:48.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.049+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~RHWSESWU8LWJ.1 size=849007 2024-09-14T11:17:48.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.049+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=RHWSESWU8LWJ tag=Z5BDASG71ZND type=write size=2946159 2024-09-14T11:17:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.050+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=FLF5FMQ3BNLK type=del 2024-09-14T11:17:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.052+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.0 size=1048576 2024-09-14T11:17:48.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.053+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.1 size=1048576 2024-09-14T11:17:48.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.054+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.2 size=364944 2024-09-14T11:17:48.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.054+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=TCF9OPBHRGDC tag=G058VP4PD3LD type=write size=3510672 2024-09-14T11:17:48.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.057+0000 7f1be8076780 1 < suggested update operation key=XI178717NOE8 tag=S2LQH3BDXQ4R type=del size=897139 2024-09-14T11:17:48.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.059+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~AGZ7UK807WTH.0 size=794640 2024-09-14T11:17:48.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.059+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=AGZ7UK807WTH tag=M7Z03T2H6XQO type=write size=1843216 2024-09-14T11:17:48.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.060+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~19AO8P1DLUIF.0 size=395635 2024-09-14T11:17:48.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.062+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=19AO8P1DLUIF tag=D89YNR3V49RS type=write size=1444211 2024-09-14T11:17:48.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.064+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~NYGH3VV50L7F.0 size=104657 2024-09-14T11:17:48.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.064+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=NYGH3VV50L7F tag=W942A9I7J0W8 type=write size=1153233 2024-09-14T11:17:48.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.066+0000 7f1be8076780 1 < canceled operation key=MVUN63538RAB tag=04Y5JOWZ1DP5 type=write size=282461 2024-09-14T11:17:48.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.068+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~WZA8T81D2UQP.0 size=900778 2024-09-14T11:17:48.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.068+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=WZA8T81D2UQP tag=2I6FPQA2P52W type=write size=1949354 2024-09-14T11:17:48.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.068+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~DJW0CGD244Q1.0 size=924963 2024-09-14T11:17:48.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.070+0000 7f1be8076780 1 < canceled multipart upload key=0BX70Q8C1QL0 upload=DJW0CGD244Q1 tag=PPD96HSY02YP type=write size=1973539 2024-09-14T11:17:48.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.072+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.0 size=1048576 2024-09-14T11:17:48.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.073+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.1 size=1048576 2024-09-14T11:17:48.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.075+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.2 size=569462 2024-09-14T11:17:48.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.075+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=XV2Z6O956409 tag=1EWKUZYR3WAC type=write size=3715190 2024-09-14T11:17:48.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.076+0000 7f1be8076780 1 < canceled operation key=JIWPGHQ3GEZB tag=8TYBA3NIFT52 type=write size=149671 2024-09-14T11:17:48.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.077+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=GAR8W6OWCRUA type=del size=690133 2024-09-14T11:17:48.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.079+0000 7f1be8076780 1 < canceled operation key=9DRSDTGM7Y3F tag=QCMD583IKZR9 type=del size=2610851 2024-09-14T11:17:48.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.081+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.0 size=1048576 2024-09-14T11:17:48.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.082+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.1 size=1048576 2024-09-14T11:17:48.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.083+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.2 size=276 2024-09-14T11:17:48.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.083+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=5HAJ4Y79XXFT tag=RE6VFB9Y8VGW type=write size=3146004 2024-09-14T11:17:48.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.084+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.0 size=1048576 2024-09-14T11:17:48.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.085+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.1 size=1048576 2024-09-14T11:17:48.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.086+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~MTHVCYO6A26Q.2 size=5341 2024-09-14T11:17:48.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.088+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=MTHVCYO6A26Q tag=SQ58DDTGMXN9 type=write size=3151069 2024-09-14T11:17:48.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.089+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=OVV314CYR5A5 type=del size=2329382 2024-09-14T11:17:48.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.090+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~TOXQ9VR176B8.0 size=1036691 2024-09-14T11:17:48.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.092+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=TOXQ9VR176B8 tag=HQ87SESGQAD9 type=write size=2085267 2024-09-14T11:17:48.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.093+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=IEZP2SPI19KO type=del size=3639746 2024-09-14T11:17:48.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.094+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=108RKGY3C0VQ type=write size=800674 2024-09-14T11:17:48.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.095+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=BRJVUYZJDITM type=del size=2118333 2024-09-14T11:17:48.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.096+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~QBA7JJH0DOHZ.0 size=963237 2024-09-14T11:17:48.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.098+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=QBA7JJH0DOHZ tag=JTGB3CC262NU type=write size=2011813 2024-09-14T11:17:48.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.099+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=NRALUHLHSUEM type=del size=2191412 2024-09-14T11:17:48.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.099+0000 7f1be8076780 1 < canceled part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.0 size=1048576 2024-09-14T11:17:48.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.100+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.1 size=1048576 2024-09-14T11:17:48.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.101+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~59N4QCUGY6N5.2 size=423260 2024-09-14T11:17:48.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.102+0000 7f1be8076780 1 < canceled multipart upload key=4ADXXTIO715C upload=59N4QCUGY6N5 tag=TQ0DNM52U8OW type=write size=3568988 2024-09-14T11:17:48.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.104+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~43SI6830M1WQ.0 size=845473 2024-09-14T11:17:48.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.104+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=43SI6830M1WQ tag=E7PXZSE09NXA type=write size=1894049 2024-09-14T11:17:48.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.105+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=90CW23W6HQZT type=write size=821642 2024-09-14T11:17:48.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.107+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=WGQ2E2QAK2HZ type=del size=3423686 2024-09-14T11:17:48.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.108+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~WPS47CIOOKVN.0 size=602065 2024-09-14T11:17:48.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.110+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=WPS47CIOOKVN tag=S1ZZOE75ZRTY type=write size=1650641 2024-09-14T11:17:48.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.111+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~M11EXD37XOSR.0 size=1048576 2024-09-14T11:17:48.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.112+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~M11EXD37XOSR.1 size=717022 2024-09-14T11:17:48.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.112+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=M11EXD37XOSR tag=WAZ3ZFBRF9Q3 type=write size=2814174 2024-09-14T11:17:48.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.113+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~LLGSYSQRCM4F.0 size=1048576 2024-09-14T11:17:48.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.114+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~LLGSYSQRCM4F.1 size=911929 2024-09-14T11:17:48.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.116+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=LLGSYSQRCM4F tag=IU83PCI74435 type=write size=3009081 2024-09-14T11:17:48.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.118+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~XNTUAYRTY5G0.0 size=1048576 2024-09-14T11:17:48.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.119+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~XNTUAYRTY5G0.1 size=612003 2024-09-14T11:17:48.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.119+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=XNTUAYRTY5G0 tag=9LIYVEKFGYBW type=write size=2709155 2024-09-14T11:17:48.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.120+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~RHWSESWU8LWJ.0 size=1048576 2024-09-14T11:17:48.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.121+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~RHWSESWU8LWJ.1 size=849007 2024-09-14T11:17:48.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.122+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=RHWSESWU8LWJ tag=Z5BDASG71ZND type=write size=2946159 2024-09-14T11:17:48.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.124+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=JZTP52THW6VD type=del size=2293027 2024-09-14T11:17:48.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.125+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.0 size=1048576 2024-09-14T11:17:48.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.126+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.1 size=1048576 2024-09-14T11:17:48.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.127+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~TCF9OPBHRGDC.2 size=364944 2024-09-14T11:17:48.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.129+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=TCF9OPBHRGDC tag=G058VP4PD3LD type=write size=3510672 2024-09-14T11:17:48.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.130+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=411RZKL0OMWG type=del size=3190506 2024-09-14T11:17:48.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.131+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~AGZ7UK807WTH.0 size=794640 2024-09-14T11:17:48.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.133+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=AGZ7UK807WTH tag=M7Z03T2H6XQO type=write size=1843216 2024-09-14T11:17:48.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.135+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~38601SQ9MK2H.0 size=1048576 2024-09-14T11:17:48.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.136+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~38601SQ9MK2H.1 size=797948 2024-09-14T11:17:48.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.136+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=38601SQ9MK2H tag=QEBVKC51D0AX type=write size=2895100 2024-09-14T11:17:48.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.137+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~NYGH3VV50L7F.0 size=104657 2024-09-14T11:17:48.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.139+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=NYGH3VV50L7F tag=W942A9I7J0W8 type=write size=1153233 2024-09-14T11:17:48.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.142+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~9VQIV515VA8S.0 size=1016787 2024-09-14T11:17:48.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.142+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=9VQIV515VA8S tag=6OH6DHZH9CJP type=write size=2065363 2024-09-14T11:17:48.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.143+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~WZA8T81D2UQP.0 size=900778 2024-09-14T11:17:48.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.145+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=WZA8T81D2UQP tag=2I6FPQA2P52W type=write size=1949354 2024-09-14T11:17:48.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.148+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=YZNW0PEJFZ97 type=write size=158010 2024-09-14T11:17:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.149+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.0 size=1048576 2024-09-14T11:17:48.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.150+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.1 size=1048576 2024-09-14T11:17:48.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.151+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XV2Z6O956409.2 size=569462 2024-09-14T11:17:48.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.152+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=XV2Z6O956409 tag=1EWKUZYR3WAC type=write size=3715190 2024-09-14T11:17:48.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.155+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~GKDQ09Q5K3I6.0 size=324253 2024-09-14T11:17:48.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.155+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=GKDQ09Q5K3I6 tag=SWA9AKHZBV8W type=write size=1372829 2024-09-14T11:17:48.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.156+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=GAR8W6OWCRUA type=del 2024-09-14T11:17:48.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.157+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=UEW6K9JHO0UZ type=write size=270309 2024-09-14T11:17:48.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.157+0000 7f1be8076780 1 < canceled part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.0 size=1048576 2024-09-14T11:17:48.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.158+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.1 size=1048576 2024-09-14T11:17:48.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.159+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~5HAJ4Y79XXFT.2 size=276 2024-09-14T11:17:48.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.161+0000 7f1be8076780 1 < canceled multipart upload key=KQ479IOZ0108 upload=5HAJ4Y79XXFT tag=RE6VFB9Y8VGW type=write size=3146004 2024-09-14T11:17:48.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.162+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=ZVH0HXJ4SZ0R type=del size=4192663 2024-09-14T11:17:48.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.163+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=OVV314CYR5A5 type=del 2024-09-14T11:17:48.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.164+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=QYC7Q0LP2Y9J type=del size=755391 2024-09-14T11:17:48.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.166+0000 7f1be8076780 1 < canceled operation key=1RUE5J1DYH2C tag=IEZP2SPI19KO type=del size=3639746 2024-09-14T11:17:48.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.167+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=LOBYLSI6E893 type=del size=2367413 2024-09-14T11:17:48.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.168+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=BRJVUYZJDITM type=del 2024-09-14T11:17:48.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.169+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=2K941XMQFM2S type=del size=331332 2024-09-14T11:17:48.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.171+0000 7f1be8076780 1 < canceled operation key=MX5J0P18BM0D tag=NRALUHLHSUEM type=del size=2191412 2024-09-14T11:17:48.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.172+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=RJE13820MKUO type=del size=107462 2024-09-14T11:17:48.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.173+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~43SI6830M1WQ.0 size=845473 2024-09-14T11:17:48.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.175+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=43SI6830M1WQ tag=E7PXZSE09NXA type=write size=1894049 2024-09-14T11:17:48.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.176+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=1LOYKXKP9KQS type=del size=1020361 2024-09-14T11:17:48.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.178+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=WGQ2E2QAK2HZ type=del 2024-09-14T11:17:48.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.179+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=XHV67W7ZSF2L type=del size=2194851 2024-09-14T11:17:48.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.180+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~M11EXD37XOSR.0 size=1048576 2024-09-14T11:17:48.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.181+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~M11EXD37XOSR.1 size=717022 2024-09-14T11:17:48.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.183+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=M11EXD37XOSR tag=WAZ3ZFBRF9Q3 type=write size=2814174 2024-09-14T11:17:48.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.185+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~78K4QRCFZI2L.0 size=1048576 2024-09-14T11:17:48.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.186+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~78K4QRCFZI2L.1 size=612966 2024-09-14T11:17:48.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.186+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=78K4QRCFZI2L tag=XGD0FFOICGOZ type=write size=2710118 2024-09-14T11:17:48.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.187+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~XNTUAYRTY5G0.0 size=1048576 2024-09-14T11:17:48.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.188+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~XNTUAYRTY5G0.1 size=612003 2024-09-14T11:17:48.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.190+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=XNTUAYRTY5G0 tag=9LIYVEKFGYBW type=write size=2709155 2024-09-14T11:17:48.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.192+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~NLAV3TQGFMAE.0 size=1048576 2024-09-14T11:17:48.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.193+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~NLAV3TQGFMAE.1 size=645459 2024-09-14T11:17:48.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.193+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=NLAV3TQGFMAE tag=ZVZ97XFND0JA type=write size=2742611 2024-09-14T11:17:48.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.194+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=JZTP52THW6VD type=del 2024-09-14T11:17:48.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.196+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~JU2VGH5MEV43.0 size=669636 2024-09-14T11:17:48.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.196+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=JU2VGH5MEV43 tag=4S0NFVHZ80HV type=write size=1718212 2024-09-14T11:17:48.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.197+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=411RZKL0OMWG type=del 2024-09-14T11:17:48.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.199+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=WUYU6TUVV87Y type=write size=5984 2024-09-14T11:17:48.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.200+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~38601SQ9MK2H.0 size=1048576 2024-09-14T11:17:48.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.200+0000 7f1be8076780 1 < canceled part key=_multipart_RIYGSRWKVKFF.2~38601SQ9MK2H.1 size=797948 2024-09-14T11:17:48.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.202+0000 7f1be8076780 1 < canceled multipart upload key=RIYGSRWKVKFF upload=38601SQ9MK2H tag=QEBVKC51D0AX type=write size=2895100 2024-09-14T11:17:48.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.203+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=SAP1N4149RWL type=del size=2645008 2024-09-14T11:17:48.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.204+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~9VQIV515VA8S.0 size=1016787 2024-09-14T11:17:48.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.206+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=9VQIV515VA8S tag=6OH6DHZH9CJP type=write size=2065363 2024-09-14T11:17:48.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.207+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=LAI96R9ARF30 type=del size=2350165 2024-09-14T11:17:48.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.208+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=YZNW0PEJFZ97 type=write size=158010 2024-09-14T11:17:48.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.209+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=4ZV0JXYU2J49 type=del size=3940775 2024-09-14T11:17:48.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.211+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~GKDQ09Q5K3I6.0 size=324253 2024-09-14T11:17:48.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.212+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=GKDQ09Q5K3I6 tag=SWA9AKHZBV8W type=write size=1372829 2024-09-14T11:17:48.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.214+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=8M3I9N4XTCV1 type=del size=399847 2024-09-14T11:17:48.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.215+0000 7f1be8076780 1 < canceled operation key=SJES17ZIGRZE tag=UEW6K9JHO0UZ type=write size=270309 2024-09-14T11:17:48.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.216+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=Q02PRXNIQEWB type=del size=3342165 2024-09-14T11:17:48.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.218+0000 7f1be8076780 1 < suggested remove operation key=4ADXXTIO715C tag=ZVH0HXJ4SZ0R type=del 2024-09-14T11:17:48.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.219+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=VOPK4JNW1WWV type=del size=1778038 2024-09-14T11:17:48.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.220+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=QYC7Q0LP2Y9J type=del 2024-09-14T11:17:48.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.223+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~ZJ2L8O57ITHG.0 size=168040 2024-09-14T11:17:48.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.223+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=ZJ2L8O57ITHG tag=6BXRQ9B5YRHO type=write size=1216616 2024-09-14T11:17:48.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.224+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=LOBYLSI6E893 type=del 2024-09-14T11:17:48.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.225+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=NODYAL5MCT31 type=del size=1986425 2024-09-14T11:17:48.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.227+0000 7f1be8076780 1 < suggested remove operation key=T70EFGHRQZQ7 tag=2K941XMQFM2S type=del 2024-09-14T11:17:48.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.229+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.0 size=1048576 2024-09-14T11:17:48.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.230+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.1 size=1048576 2024-09-14T11:17:48.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.231+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.2 size=247339 2024-09-14T11:17:48.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.231+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=KTV73R890AFE tag=SOJD06B1LAXO type=write size=3393067 2024-09-14T11:17:48.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.232+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=RJE13820MKUO type=del 2024-09-14T11:17:48.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.234+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=XKQ4OQ1J38P2 type=write size=206907 2024-09-14T11:17:48.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.235+0000 7f1be8076780 -1 < failed to complete operation key=4ADXXTIO715C tag=1LOYKXKP9KQS type=del size=1020361: (22) Invalid argument 2024-09-14T11:17:48.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.236+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=DNSOXK0ODD89 type=del size=2599101 2024-09-14T11:17:48.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.237+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=XHV67W7ZSF2L type=del 2024-09-14T11:17:48.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.238+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=WGGIELKE7GPB type=del size=1503397 2024-09-14T11:17:48.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.239+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~78K4QRCFZI2L.0 size=1048576 2024-09-14T11:17:48.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.240+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~78K4QRCFZI2L.1 size=612966 2024-09-14T11:17:48.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.243+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=78K4QRCFZI2L tag=XGD0FFOICGOZ type=write size=2710118 2024-09-14T11:17:48.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.244+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=DHJCJYOFRVTB type=del size=2325759 2024-09-14T11:17:48.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.245+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~NLAV3TQGFMAE.0 size=1048576 2024-09-14T11:17:48.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.245+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~NLAV3TQGFMAE.1 size=645459 2024-09-14T11:17:48.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.247+0000 7f1be8076780 1 < canceled multipart upload key=MVUN63538RAB upload=NLAV3TQGFMAE tag=ZVZ97XFND0JA type=write size=2742611 2024-09-14T11:17:48.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.248+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=IHNGFFN9XXQ4 type=write size=1004047 2024-09-14T11:17:48.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.249+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~JU2VGH5MEV43.0 size=669636 2024-09-14T11:17:48.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.251+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=JU2VGH5MEV43 tag=4S0NFVHZ80HV type=write size=1718212 2024-09-14T11:17:48.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.253+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~AYU6UBR5PQZP.0 size=1048576 2024-09-14T11:17:48.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.254+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~AYU6UBR5PQZP.1 size=292838 2024-09-14T11:17:48.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.254+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=AYU6UBR5PQZP tag=1N6HI9E91UNC type=write size=2389990 2024-09-14T11:17:48.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.257+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=WUYU6TUVV87Y type=write 2024-09-14T11:17:48.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.259+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~T4O2ZYK43VNU.0 size=1048576 2024-09-14T11:17:48.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.260+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~T4O2ZYK43VNU.1 size=859722 2024-09-14T11:17:48.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.260+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=T4O2ZYK43VNU tag=DNOQG8H3WFRY type=write size=2956874 2024-09-14T11:17:48.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.261+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=SAP1N4149RWL type=del 2024-09-14T11:17:48.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.263+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=A09FHNURFQWA type=write size=102314 2024-09-14T11:17:48.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.265+0000 7f1be8076780 1 < suggested update operation key=KQ479IOZ0108 tag=LAI96R9ARF30 type=del size=2350165 2024-09-14T11:17:48.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.266+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=Y13AAN5CI1H6 type=del size=449328 2024-09-14T11:17:48.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.267+0000 7f1be8076780 -1 < failed to complete operation key=4ADXXTIO715C tag=4ZV0JXYU2J49 type=del size=3940775: (22) Invalid argument 2024-09-14T11:17:48.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.269+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=O884F3416D4V type=del size=808083 2024-09-14T11:17:48.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.270+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=8M3I9N4XTCV1 type=del 2024-09-14T11:17:48.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.272+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~P6F0IEXHPULY.0 size=368918 2024-09-14T11:17:48.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.272+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=P6F0IEXHPULY tag=DNSTN0147KF3 type=write size=1417494 2024-09-14T11:17:48.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.273+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=Q02PRXNIQEWB type=del 2024-09-14T11:17:48.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.275+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.0 size=1048576 2024-09-14T11:17:48.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.276+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.1 size=1048576 2024-09-14T11:17:48.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.277+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.2 size=445507 2024-09-14T11:17:48.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.277+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=EL97D0JAAQJG tag=LP3O054E13NF type=write size=3591235 2024-09-14T11:17:48.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.278+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=VOPK4JNW1WWV type=del 2024-09-14T11:17:48.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.279+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=NV4MNAKWK59Z type=del size=1644932 2024-09-14T11:17:48.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.281+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~ZJ2L8O57ITHG.0 size=168040 2024-09-14T11:17:48.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.284+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=ZJ2L8O57ITHG tag=6BXRQ9B5YRHO type=write size=1216616 2024-09-14T11:17:48.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.285+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=11MJWU08JGGM type=del size=1461454 2024-09-14T11:17:48.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.286+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=NODYAL5MCT31 type=del 2024-09-14T11:17:48.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.288+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.0 size=1048576 2024-09-14T11:17:48.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.289+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.1 size=1048576 2024-09-14T11:17:48.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.290+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.2 size=219188 2024-09-14T11:17:48.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.290+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=AOG4F30E19WP tag=97CSLJ7VXFUU type=write size=3364916 2024-09-14T11:17:48.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.291+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.0 size=1048576 2024-09-14T11:17:48.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.292+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.1 size=1048576 2024-09-14T11:17:48.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.293+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~KTV73R890AFE.2 size=247339 2024-09-14T11:17:48.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.295+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=KTV73R890AFE tag=SOJD06B1LAXO type=write size=3393067 2024-09-14T11:17:48.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.297+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=49N63ELLVGY0 type=del size=2779729 2024-09-14T11:17:48.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.298+0000 7f1be8076780 1 < completed write operation key=3YIK6B6Y2EU1 tag=XKQ4OQ1J38P2 type=write size=206907 2024-09-14T11:17:48.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.299+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=AITZS3H7GLKD type=del size=1619991 2024-09-14T11:17:48.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.300+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=DNSOXK0ODD89 type=del 2024-09-14T11:17:48.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.302+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=2OJ2IOYZGAO9 type=del size=1881635 2024-09-14T11:17:48.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.304+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=WGGIELKE7GPB type=del size=1503397 2024-09-14T11:17:48.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.305+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=3L8RBLT1PHHX type=del size=3081418 2024-09-14T11:17:48.305 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.306+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=DHJCJYOFRVTB type=del 2024-09-14T11:17:48.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.308+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~1LL151N5X2IB.0 size=1048576 2024-09-14T11:17:48.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.309+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~1LL151N5X2IB.1 size=42765 2024-09-14T11:17:48.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.309+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=1LL151N5X2IB tag=INBC4XE9GX9A type=write size=2139917 2024-09-14T11:17:48.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.311+0000 7f1be8076780 1 < suggested update operation key=RIYGSRWKVKFF tag=IHNGFFN9XXQ4 type=write size=1004047 2024-09-14T11:17:48.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.312+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=TZGJAC45A1WR type=del size=1583474 2024-09-14T11:17:48.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.314+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~AYU6UBR5PQZP.0 size=1048576 2024-09-14T11:17:48.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.315+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~AYU6UBR5PQZP.1 size=292838 2024-09-14T11:17:48.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.317+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=AYU6UBR5PQZP tag=1N6HI9E91UNC type=write size=2389990 2024-09-14T11:17:48.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.319+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.0 size=1048576 2024-09-14T11:17:48.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.320+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.1 size=1048576 2024-09-14T11:17:48.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.321+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.2 size=920470 2024-09-14T11:17:48.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.321+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=HNVNXI819P99 tag=ZQANN2L91ADM type=write size=4066198 2024-09-14T11:17:48.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.323+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~T4O2ZYK43VNU.0 size=1048576 2024-09-14T11:17:48.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.323+0000 7f1be8076780 1 < canceled part key=_multipart_7OUNKTS3X7DJ.2~T4O2ZYK43VNU.1 size=859722 2024-09-14T11:17:48.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.325+0000 7f1be8076780 1 < canceled multipart upload key=7OUNKTS3X7DJ upload=T4O2ZYK43VNU tag=DNOQG8H3WFRY type=write size=2956874 2024-09-14T11:17:48.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.326+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=3DXHRKOD314J type=write size=887210 2024-09-14T11:17:48.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.328+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=A09FHNURFQWA type=write size=102314 2024-09-14T11:17:48.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.329+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=MKA6A0SSUG81 type=write size=899330 2024-09-14T11:17:48.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.331+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=Y13AAN5CI1H6 type=del 2024-09-14T11:17:48.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.333+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~VYMHCO01O1SG.0 size=345574 2024-09-14T11:17:48.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.333+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=VYMHCO01O1SG tag=1S0X1NATW4T1 type=write size=1394150 2024-09-14T11:17:48.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.334+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=O884F3416D4V type=del 2024-09-14T11:17:48.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.335+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=YYLCHYZ4JT29 type=del size=1690618 2024-09-14T11:17:48.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.336+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~P6F0IEXHPULY.0 size=368918 2024-09-14T11:17:48.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.338+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=P6F0IEXHPULY tag=DNSTN0147KF3 type=write size=1417494 2024-09-14T11:17:48.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.339+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=B9MSS75TZ3BL type=del size=709849 2024-09-14T11:17:48.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.340+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.0 size=1048576 2024-09-14T11:17:48.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.341+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.1 size=1048576 2024-09-14T11:17:48.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.342+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~EL97D0JAAQJG.2 size=445507 2024-09-14T11:17:48.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.344+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=EL97D0JAAQJG tag=LP3O054E13NF type=write size=3591235 2024-09-14T11:17:48.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.345+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=KIVVUWBAPF3I type=write size=522310 2024-09-14T11:17:48.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.346+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=NV4MNAKWK59Z type=del 2024-09-14T11:17:48.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.347+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=RXYFFXKL4DJG type=del size=3890082 2024-09-14T11:17:48.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.348+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=11MJWU08JGGM type=del 2024-09-14T11:17:48.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.350+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~UNWB3JZC6DMD.0 size=668565 2024-09-14T11:17:48.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.350+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=UNWB3JZC6DMD tag=SX3RFQPST50O type=write size=1717141 2024-09-14T11:17:48.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.351+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.0 size=1048576 2024-09-14T11:17:48.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.352+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.1 size=1048576 2024-09-14T11:17:48.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.353+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~AOG4F30E19WP.2 size=219188 2024-09-14T11:17:48.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.355+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=AOG4F30E19WP tag=97CSLJ7VXFUU type=write size=3364916 2024-09-14T11:17:48.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.356+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=CHXMMV0KFLTV type=del size=642274 2024-09-14T11:17:48.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.357+0000 7f1be8076780 -1 < failed to complete operation key=2RJYZ1CRDVEP tag=49N63ELLVGY0 type=del size=2779729: (22) Invalid argument 2024-09-14T11:17:48.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.358+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=9DH7Z2IOHBYZ type=del size=393937 2024-09-14T11:17:48.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.359+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=AITZS3H7GLKD type=del 2024-09-14T11:17:48.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.360+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=4YOKPUEKDTIA type=del size=2770462 2024-09-14T11:17:48.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.362+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=2OJ2IOYZGAO9 type=del 2024-09-14T11:17:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.364+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.0 size=1048576 2024-09-14T11:17:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.365+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.1 size=1048576 2024-09-14T11:17:48.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.366+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.2 size=688856 2024-09-14T11:17:48.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.366+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=9BQH2HGANLZR tag=O5E1K9D5AUVV type=write size=3834584 2024-09-14T11:17:48.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.368+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=3L8RBLT1PHHX type=del 2024-09-14T11:17:48.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.370+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=UYCX55KLXYDY type=del size=2086904 2024-09-14T11:17:48.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.370+0000 7f1be8076780 1 < canceled part key=_multipart_T70EFGHRQZQ7.2~1LL151N5X2IB.0 size=1048576 2024-09-14T11:17:48.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.370+0000 7f1be8076780 1 < canceled part key=_multipart_T70EFGHRQZQ7.2~1LL151N5X2IB.1 size=42765 2024-09-14T11:17:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.372+0000 7f1be8076780 1 < canceled multipart upload key=T70EFGHRQZQ7 upload=1LL151N5X2IB tag=INBC4XE9GX9A type=write size=2139917 2024-09-14T11:17:48.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.374+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~016TBHE9170M.0 size=1048576 2024-09-14T11:17:48.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.375+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~016TBHE9170M.1 size=1048576 2024-09-14T11:17:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.376+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~016TBHE9170M.2 size=128741 2024-09-14T11:17:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.376+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=016TBHE9170M tag=V8G34WRUM63W type=write size=3274469 2024-09-14T11:17:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.377+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=TZGJAC45A1WR type=del 2024-09-14T11:17:48.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.379+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~2P0VC98VJKF8.0 size=1048576 2024-09-14T11:17:48.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.380+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~2P0VC98VJKF8.1 size=612174 2024-09-14T11:17:48.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.380+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=2P0VC98VJKF8 tag=5Y93KWT26GP8 type=write size=2709326 2024-09-14T11:17:48.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.381+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.0 size=1048576 2024-09-14T11:17:48.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.382+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.1 size=1048576 2024-09-14T11:17:48.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.383+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~HNVNXI819P99.2 size=920470 2024-09-14T11:17:48.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.385+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=HNVNXI819P99 tag=ZQANN2L91ADM type=write size=4066198 2024-09-14T11:17:48.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.387+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~6030GKD53E92.0 size=147110 2024-09-14T11:17:48.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.387+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=6030GKD53E92 tag=56D77OI3OZ3V type=write size=1195686 2024-09-14T11:17:48.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.388+0000 7f1be8076780 1 < completed write operation key=JQZ7C562TQ8D tag=3DXHRKOD314J type=write size=887210 2024-09-14T11:17:48.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.389+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=XJ0CJUA2K06N type=del size=3579286 2024-09-14T11:17:48.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.391+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=MKA6A0SSUG81 type=write size=899330 2024-09-14T11:17:48.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.392+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=HS8K4L1CZKQY type=write size=481594 2024-09-14T11:17:48.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.392+0000 7f1be8076780 1 < canceled part key=_multipart_9DRSDTGM7Y3F.2~VYMHCO01O1SG.0 size=345574 2024-09-14T11:17:48.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.394+0000 7f1be8076780 1 < canceled multipart upload key=9DRSDTGM7Y3F upload=VYMHCO01O1SG tag=1S0X1NATW4T1 type=write size=1394150 2024-09-14T11:17:48.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.395+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=JD85BVKQXWTS type=write size=770819 2024-09-14T11:17:48.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.396+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=YYLCHYZ4JT29 type=del 2024-09-14T11:17:48.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.399+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=BU1IXK2X2SVF type=write size=717230 2024-09-14T11:17:48.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.400+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=B9MSS75TZ3BL type=del 2024-09-14T11:17:48.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.401+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=5U8MVUP73GN7 type=del size=3742680 2024-09-14T11:17:48.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.403+0000 7f1be8076780 1 < canceled operation key=XB3M4CI0ERWP tag=KIVVUWBAPF3I type=write size=522310 2024-09-14T11:17:48.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.404+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=D200YT2A5E56 type=del size=1794874 2024-09-14T11:17:48.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.406+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=RXYFFXKL4DJG type=del size=3890082 2024-09-14T11:17:48.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.407+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=1JENRV0TYD0E type=del size=1955031 2024-09-14T11:17:48.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.408+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~UNWB3JZC6DMD.0 size=668565 2024-09-14T11:17:48.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.410+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=UNWB3JZC6DMD tag=SX3RFQPST50O type=write size=1717141 2024-09-14T11:17:48.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.412+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.0 size=1048576 2024-09-14T11:17:48.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.413+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.1 size=1048576 2024-09-14T11:17:48.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.414+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.2 size=451306 2024-09-14T11:17:48.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.414+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=VIVIZXBONNWI tag=271EWZT52XR6 type=write size=3597034 2024-09-14T11:17:48.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.415+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=CHXMMV0KFLTV type=del 2024-09-14T11:17:48.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.417+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~Y78IBP5YKQV5.0 size=488822 2024-09-14T11:17:48.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.417+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=Y78IBP5YKQV5 tag=UORZ4LJLQZKB type=write size=1537398 2024-09-14T11:17:48.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.418+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=9DH7Z2IOHBYZ type=del 2024-09-14T11:17:48.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.420+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.0 size=1048576 2024-09-14T11:17:48.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.421+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.1 size=1048576 2024-09-14T11:17:48.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.422+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.2 size=703884 2024-09-14T11:17:48.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.422+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=5JGT4LOS2SSD tag=29YGPTL868IN type=write size=3849612 2024-09-14T11:17:48.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.423+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=4YOKPUEKDTIA type=del 2024-09-14T11:17:48.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.425+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~B8WUK61OG3C1.0 size=1048576 2024-09-14T11:17:48.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.426+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~B8WUK61OG3C1.1 size=1047936 2024-09-14T11:17:48.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.426+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=B8WUK61OG3C1 tag=GKA5E4LVUATS type=write size=3145088 2024-09-14T11:17:48.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.426+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.0 size=1048576 2024-09-14T11:17:48.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.427+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.1 size=1048576 2024-09-14T11:17:48.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.427+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~9BQH2HGANLZR.2 size=688856 2024-09-14T11:17:48.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.429+0000 7f1be8076780 1 < canceled multipart upload key=0BX70Q8C1QL0 upload=9BQH2HGANLZR tag=O5E1K9D5AUVV type=write size=3834584 2024-09-14T11:17:48.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.431+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~2189W6XVWHCA.0 size=1048576 2024-09-14T11:17:48.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.432+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~2189W6XVWHCA.1 size=610464 2024-09-14T11:17:48.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.432+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=2189W6XVWHCA tag=PY7MKKLX7DQN type=write size=2707616 2024-09-14T11:17:48.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.433+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=UYCX55KLXYDY type=del 2024-09-14T11:17:48.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.435+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=6AJRK4ZFZOR7 type=del size=3015368 2024-09-14T11:17:48.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.436+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~016TBHE9170M.0 size=1048576 2024-09-14T11:17:48.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.437+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~016TBHE9170M.1 size=1048576 2024-09-14T11:17:48.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.437+0000 7f1be8076780 1 < canceled part key=_multipart_XI178717NOE8.2~016TBHE9170M.2 size=128741 2024-09-14T11:17:48.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.438+0000 7f1be8076780 1 < canceled multipart upload key=XI178717NOE8 upload=016TBHE9170M tag=V8G34WRUM63W type=write size=3274469 2024-09-14T11:17:48.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.441+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~XURDV30EVID8.0 size=1048576 2024-09-14T11:17:48.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.441+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~XURDV30EVID8.1 size=816360 2024-09-14T11:17:48.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.442+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=XURDV30EVID8 tag=RTT3MYOK46XO type=write size=2913512 2024-09-14T11:17:48.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.443+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~2P0VC98VJKF8.0 size=1048576 2024-09-14T11:17:48.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.444+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~2P0VC98VJKF8.1 size=612174 2024-09-14T11:17:48.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.446+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=2P0VC98VJKF8 tag=5Y93KWT26GP8 type=write size=2709326 2024-09-14T11:17:48.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.447+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=MI9B9ECDIEDD type=del size=3527918 2024-09-14T11:17:48.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.448+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~6030GKD53E92.0 size=147110 2024-09-14T11:17:48.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.450+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=6030GKD53E92 tag=56D77OI3OZ3V type=write size=1195686 2024-09-14T11:17:48.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.452+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~R27RNUIFZ608.0 size=1048576 2024-09-14T11:17:48.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.453+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~R27RNUIFZ608.1 size=577069 2024-09-14T11:17:48.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.453+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=R27RNUIFZ608 tag=373580KHYIJ2 type=write size=2674221 2024-09-14T11:17:48.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.454+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=XJ0CJUA2K06N type=del 2024-09-14T11:17:48.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.456+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.0 size=1048576 2024-09-14T11:17:48.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.457+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.1 size=1048576 2024-09-14T11:17:48.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.458+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.2 size=829012 2024-09-14T11:17:48.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.458+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=UUU8C5PNBXZQ tag=HDTSOY2BINAV type=write size=3974740 2024-09-14T11:17:48.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.459+0000 7f1be8076780 1 < canceled operation key=JIWPGHQ3GEZB tag=HS8K4L1CZKQY type=write size=481594 2024-09-14T11:17:48.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.460+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=AKRM11GR0SDG type=del size=3773522 2024-09-14T11:17:48.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.462+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=JD85BVKQXWTS type=write size=770819 2024-09-14T11:17:48.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.463+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=VUPWTX29OYA1 type=del size=2666611 2024-09-14T11:17:48.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.464+0000 7f1be8076780 1 < completed write operation key=MVUN63538RAB tag=BU1IXK2X2SVF type=write size=717230 2024-09-14T11:17:48.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.465+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=QAQPE9VGQFV7 type=del size=3369741 2024-09-14T11:17:48.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.467+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=5U8MVUP73GN7 type=del 2024-09-14T11:17:48.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.469+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~5MH5065YMEJE.0 size=1048576 2024-09-14T11:17:48.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.470+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~5MH5065YMEJE.1 size=579178 2024-09-14T11:17:48.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.470+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=5MH5065YMEJE tag=YPQKZ022DX3B type=write size=2676330 2024-09-14T11:17:48.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.471+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=D200YT2A5E56 type=del 2024-09-14T11:17:48.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.473+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=8BRI8SHUEWY0 type=del size=2648499 2024-09-14T11:17:48.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.474+0000 7f1be8076780 1 < canceled operation key=UB0SEYZ7ITU1 tag=1JENRV0TYD0E type=del size=1955031 2024-09-14T11:17:48.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.475+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=5O7TF1X9U1G3 type=write size=298028 2024-09-14T11:17:48.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.477+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.0 size=1048576 2024-09-14T11:17:48.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.479+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.1 size=1048576 2024-09-14T11:17:48.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.480+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~VIVIZXBONNWI.2 size=451306 2024-09-14T11:17:48.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.482+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=VIVIZXBONNWI tag=271EWZT52XR6 type=write size=3597034 2024-09-14T11:17:48.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.484+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.0 size=1048576 2024-09-14T11:17:48.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.485+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.1 size=1048576 2024-09-14T11:17:48.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.485+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.2 size=523378 2024-09-14T11:17:48.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.485+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=083ZFRBPZPQS tag=IGG2RX8K5WFI type=write size=3669106 2024-09-14T11:17:48.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.487+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~Y78IBP5YKQV5.0 size=488822 2024-09-14T11:17:48.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.490+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=Y78IBP5YKQV5 tag=UORZ4LJLQZKB type=write size=1537398 2024-09-14T11:17:48.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.492+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.0 size=1048576 2024-09-14T11:17:48.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.493+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.1 size=1048576 2024-09-14T11:17:48.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.494+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.2 size=980284 2024-09-14T11:17:48.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.494+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=LF1ROVZX0M5W tag=62H7ONTLFEH2 type=write size=4126012 2024-09-14T11:17:48.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.494+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.0 size=1048576 2024-09-14T11:17:48.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.495+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.1 size=1048576 2024-09-14T11:17:48.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.496+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~5JGT4LOS2SSD.2 size=703884 2024-09-14T11:17:48.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.498+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=5JGT4LOS2SSD tag=29YGPTL868IN type=write size=3849612 2024-09-14T11:17:48.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.499+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=LR5OVDF7S7MK type=write size=940339 2024-09-14T11:17:48.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.501+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~B8WUK61OG3C1.0 size=1048576 2024-09-14T11:17:48.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.501+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~B8WUK61OG3C1.1 size=1047936 2024-09-14T11:17:48.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.504+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=B8WUK61OG3C1 tag=GKA5E4LVUATS type=write size=3145088 2024-09-14T11:17:48.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.506+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.0 size=1048576 2024-09-14T11:17:48.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.507+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.1 size=1048576 2024-09-14T11:17:48.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.508+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.2 size=428235 2024-09-14T11:17:48.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.508+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=U5NX63MQ7XCN tag=VLOZQ47JSHTQ type=write size=3573963 2024-09-14T11:17:48.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.509+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~2189W6XVWHCA.0 size=1048576 2024-09-14T11:17:48.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.510+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~2189W6XVWHCA.1 size=610464 2024-09-14T11:17:48.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.512+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=2189W6XVWHCA tag=PY7MKKLX7DQN type=write size=2707616 2024-09-14T11:17:48.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.514+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.0 size=1048576 2024-09-14T11:17:48.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.515+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.1 size=1048576 2024-09-14T11:17:48.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.516+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.2 size=837655 2024-09-14T11:17:48.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.516+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=BY92ZEEVXRZG tag=ZY833PPJXRVB type=write size=3983383 2024-09-14T11:17:48.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.517+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=6AJRK4ZFZOR7 type=del 2024-09-14T11:17:48.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.519+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~767E7WBPBR91.0 size=1048576 2024-09-14T11:17:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.520+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~767E7WBPBR91.1 size=698131 2024-09-14T11:17:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.520+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=767E7WBPBR91 tag=TEWODR67T5P1 type=write size=2795283 2024-09-14T11:17:48.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.521+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~XURDV30EVID8.0 size=1048576 2024-09-14T11:17:48.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.522+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~XURDV30EVID8.1 size=816360 2024-09-14T11:17:48.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.524+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=XURDV30EVID8 tag=RTT3MYOK46XO type=write size=2913512 2024-09-14T11:17:48.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.525+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=IL1SV0FNQKAQ type=del size=1915325 2024-09-14T11:17:48.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.526+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=MI9B9ECDIEDD type=del 2024-09-14T11:17:48.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.527+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=1QS5ZD6NR5GH type=del size=3521409 2024-09-14T11:17:48.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.528+0000 7f1be8076780 1 < canceled part key=_multipart_XI178717NOE8.2~R27RNUIFZ608.0 size=1048576 2024-09-14T11:17:48.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.529+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~R27RNUIFZ608.1 size=577069 2024-09-14T11:17:48.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.530+0000 7f1be8076780 1 < canceled multipart upload key=XI178717NOE8 upload=R27RNUIFZ608 tag=373580KHYIJ2 type=write size=2674221 2024-09-14T11:17:48.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.532+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=GGU31BJS5HGZ type=del size=314205 2024-09-14T11:17:48.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.533+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.0 size=1048576 2024-09-14T11:17:48.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.534+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.1 size=1048576 2024-09-14T11:17:48.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.535+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~UUU8C5PNBXZQ.2 size=829012 2024-09-14T11:17:48.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.536+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=UUU8C5PNBXZQ tag=HDTSOY2BINAV type=write size=3974740 2024-09-14T11:17:48.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.538+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=K80UKQ2UKVDY type=del size=1161685 2024-09-14T11:17:48.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.539+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=AKRM11GR0SDG type=del 2024-09-14T11:17:48.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.541+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~906DCTU5P0FY.0 size=1048576 2024-09-14T11:17:48.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.542+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~906DCTU5P0FY.1 size=931310 2024-09-14T11:17:48.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.542+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=906DCTU5P0FY tag=S6H1HS9D1IC2 type=write size=3028462 2024-09-14T11:17:48.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.543+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=VUPWTX29OYA1 type=del 2024-09-14T11:17:48.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.544+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=E6ZGATR1M91C type=del size=2483718 2024-09-14T11:17:48.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.546+0000 7f1be8076780 1 < canceled operation key=4AY6ZXFKO1YQ tag=QAQPE9VGQFV7 type=del size=3369741 2024-09-14T11:17:48.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.548+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~324SDQW9I7UY.0 size=1048576 2024-09-14T11:17:48.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.549+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~324SDQW9I7UY.1 size=166784 2024-09-14T11:17:48.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.549+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=324SDQW9I7UY tag=ZP7BW3YLOXVU type=write size=2263936 2024-09-14T11:17:48.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.549+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~5MH5065YMEJE.0 size=1048576 2024-09-14T11:17:48.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.549+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~5MH5065YMEJE.1 size=579178 2024-09-14T11:17:48.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.551+0000 7f1be8076780 1 < canceled multipart upload key=JCDSP32N5C7M upload=5MH5065YMEJE tag=YPQKZ022DX3B type=write size=2676330 2024-09-14T11:17:48.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.553+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.0 size=1048576 2024-09-14T11:17:48.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.554+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.1 size=1048576 2024-09-14T11:17:48.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.555+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.2 size=515475 2024-09-14T11:17:48.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.555+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=SL9T7UHMDOCU tag=45EAB6C9NOYQ type=write size=3661203 2024-09-14T11:17:48.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.557+0000 7f1be8076780 1 < suggested update operation key=AUCQC0OBQP7Z tag=8BRI8SHUEWY0 type=del size=2648499 2024-09-14T11:17:48.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.560+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~JO3YENVNCD0B.0 size=1048576 2024-09-14T11:17:48.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.561+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~JO3YENVNCD0B.1 size=387765 2024-09-14T11:17:48.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.561+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=JO3YENVNCD0B tag=VA0VZEHG0705 type=write size=2484917 2024-09-14T11:17:48.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.562+0000 7f1be8076780 1 < completed write operation key=1X2EWK1Y2GE0 tag=5O7TF1X9U1G3 type=write size=298028 2024-09-14T11:17:48.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.564+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~5OFJYEXM56SM.0 size=947647 2024-09-14T11:17:48.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.564+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=5OFJYEXM56SM tag=BFM4M4E6KY9X type=write size=1996223 2024-09-14T11:17:48.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.565+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.0 size=1048576 2024-09-14T11:17:48.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.566+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.1 size=1048576 2024-09-14T11:17:48.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.566+0000 7f1be8076780 1 < canceled part key=_multipart_LNMGQ54S2CXX.2~083ZFRBPZPQS.2 size=523378 2024-09-14T11:17:48.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.568+0000 7f1be8076780 1 < canceled multipart upload key=LNMGQ54S2CXX upload=083ZFRBPZPQS tag=IGG2RX8K5WFI type=write size=3669106 2024-09-14T11:17:48.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.570+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.0 size=1048576 2024-09-14T11:17:48.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.571+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.1 size=1048576 2024-09-14T11:17:48.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.572+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.2 size=248704 2024-09-14T11:17:48.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.572+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=75HB2Q4PSQXN tag=4STTW449QL2W type=write size=3394432 2024-09-14T11:17:48.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.573+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.0 size=1048576 2024-09-14T11:17:48.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.574+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.1 size=1048576 2024-09-14T11:17:48.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.575+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~LF1ROVZX0M5W.2 size=980284 2024-09-14T11:17:48.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.577+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=LF1ROVZX0M5W tag=62H7ONTLFEH2 type=write size=4126012 2024-09-14T11:17:48.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.580+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.0 size=1048576 2024-09-14T11:17:48.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.581+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.1 size=1048576 2024-09-14T11:17:48.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.582+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.2 size=486673 2024-09-14T11:17:48.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.582+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=BEKI66ZS0S6E tag=AP0LBXVS0TRE type=write size=3632401 2024-09-14T11:17:48.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.583+0000 7f1be8076780 1 < completed write operation key=CQDRZMJAJ7FZ tag=LR5OVDF7S7MK type=write size=940339 2024-09-14T11:17:48.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.584+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=DT3SRPUUZGUH type=write size=637339 2024-09-14T11:17:48.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.586+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.0 size=1048576 2024-09-14T11:17:48.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.587+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.1 size=1048576 2024-09-14T11:17:48.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.589+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~U5NX63MQ7XCN.2 size=428235 2024-09-14T11:17:48.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.591+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=U5NX63MQ7XCN tag=VLOZQ47JSHTQ type=write size=3573963 2024-09-14T11:17:48.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.592+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=0KPA0AORJI69 type=del size=3869681 2024-09-14T11:17:48.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.593+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.0 size=1048576 2024-09-14T11:17:48.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.594+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.1 size=1048576 2024-09-14T11:17:48.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.595+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~BY92ZEEVXRZG.2 size=837655 2024-09-14T11:17:48.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.597+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=BY92ZEEVXRZG tag=ZY833PPJXRVB type=write size=3983383 2024-09-14T11:17:48.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.598+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=NTBX0MFZORCD type=del size=1496524 2024-09-14T11:17:48.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.598+0000 7f1be8076780 1 < canceled part key=_multipart_2RJYZ1CRDVEP.2~767E7WBPBR91.0 size=1048576 2024-09-14T11:17:48.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.599+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~767E7WBPBR91.1 size=698131 2024-09-14T11:17:48.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.601+0000 7f1be8076780 1 < canceled multipart upload key=2RJYZ1CRDVEP upload=767E7WBPBR91 tag=TEWODR67T5P1 type=write size=2795283 2024-09-14T11:17:48.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.602+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=FPG4538S33SK type=del size=1029189 2024-09-14T11:17:48.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.603+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=IL1SV0FNQKAQ type=del size=1915325 2024-09-14T11:17:48.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.605+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=A1AM4DL2ZV8Y type=del size=554410 2024-09-14T11:17:48.607 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.609+0000 7f1be8076780 1 < suggested remove operation key=JGEBWM9VRCFW tag=1QS5ZD6NR5GH type=del 2024-09-14T11:17:48.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.611+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~7GISEGZS3ZXO.0 size=795588 2024-09-14T11:17:48.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.611+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=7GISEGZS3ZXO tag=1P9SEEY2XLGR type=write size=1844164 2024-09-14T11:17:48.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.612+0000 7f1be8076780 -1 < failed to complete operation key=AUCQC0OBQP7Z tag=GGU31BJS5HGZ type=del size=314205: (22) Invalid argument 2024-09-14T11:17:48.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.615+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~LHPP6E3RK7KR.0 size=1048576 2024-09-14T11:17:48.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.615+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~LHPP6E3RK7KR.1 size=269917 2024-09-14T11:17:48.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.615+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=LHPP6E3RK7KR tag=B48GTC0T87BS type=write size=2367069 2024-09-14T11:17:48.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.617+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=K80UKQ2UKVDY type=del 2024-09-14T11:17:48.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.619+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ZRA93NV94A6O.0 size=1048576 2024-09-14T11:17:48.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.620+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ZRA93NV94A6O.1 size=122780 2024-09-14T11:17:48.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.620+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=ZRA93NV94A6O tag=POTXCRDA4AZL type=write size=2219932 2024-09-14T11:17:48.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.621+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~906DCTU5P0FY.0 size=1048576 2024-09-14T11:17:48.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.622+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~906DCTU5P0FY.1 size=931310 2024-09-14T11:17:48.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.624+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=906DCTU5P0FY tag=S6H1HS9D1IC2 type=write size=3028462 2024-09-14T11:17:48.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.626+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.0 size=1048576 2024-09-14T11:17:48.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.627+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.1 size=1048576 2024-09-14T11:17:48.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.628+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.2 size=358669 2024-09-14T11:17:48.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.628+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=O1F7GAWX8R6A tag=BUALWICNNB18 type=write size=3504397 2024-09-14T11:17:48.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.629+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=E6ZGATR1M91C type=del size=2483718 2024-09-14T11:17:48.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.632+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.0 size=1048576 2024-09-14T11:17:48.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.633+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.1 size=1048576 2024-09-14T11:17:48.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.634+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.2 size=394492 2024-09-14T11:17:48.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.634+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=5WQVDZ1FNFYU tag=6MCCY67REW56 type=write size=3540220 2024-09-14T11:17:48.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.635+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~324SDQW9I7UY.0 size=1048576 2024-09-14T11:17:48.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.636+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~324SDQW9I7UY.1 size=166784 2024-09-14T11:17:48.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.638+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=324SDQW9I7UY tag=ZP7BW3YLOXVU type=write size=2263936 2024-09-14T11:17:48.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.639+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=HDU2I9METGSB type=del size=1060639 2024-09-14T11:17:48.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.641+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.0 size=1048576 2024-09-14T11:17:48.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.642+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.1 size=1048576 2024-09-14T11:17:48.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.643+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~SL9T7UHMDOCU.2 size=515475 2024-09-14T11:17:48.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.645+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=SL9T7UHMDOCU tag=45EAB6C9NOYQ type=write size=3661203 2024-09-14T11:17:48.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.646+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=B4N20W20SWGY type=write size=2714 2024-09-14T11:17:48.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.647+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~JO3YENVNCD0B.0 size=1048576 2024-09-14T11:17:48.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.648+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~JO3YENVNCD0B.1 size=387765 2024-09-14T11:17:48.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.650+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=JO3YENVNCD0B tag=VA0VZEHG0705 type=write size=2484917 2024-09-14T11:17:48.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.652+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=IJDNP61IPUPH type=del size=374271 2024-09-14T11:17:48.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.653+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~5OFJYEXM56SM.0 size=947647 2024-09-14T11:17:48.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.655+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=5OFJYEXM56SM tag=BFM4M4E6KY9X type=write size=1996223 2024-09-14T11:17:48.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.656+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=DVJHGGO74961 type=del size=829684 2024-09-14T11:17:48.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.657+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.0 size=1048576 2024-09-14T11:17:48.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.658+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.1 size=1048576 2024-09-14T11:17:48.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.660+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~75HB2Q4PSQXN.2 size=248704 2024-09-14T11:17:48.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.662+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=75HB2Q4PSQXN tag=4STTW449QL2W type=write size=3394432 2024-09-14T11:17:48.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.663+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=R8U34UAAD0X4 type=del size=3942667 2024-09-14T11:17:48.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.665+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.0 size=1048576 2024-09-14T11:17:48.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.666+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.1 size=1048576 2024-09-14T11:17:48.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.667+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~BEKI66ZS0S6E.2 size=486673 2024-09-14T11:17:48.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.669+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=BEKI66ZS0S6E tag=AP0LBXVS0TRE type=write size=3632401 2024-09-14T11:17:48.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.670+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=QE8O580MVFBT type=del size=2552240 2024-09-14T11:17:48.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.673+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=DT3SRPUUZGUH type=write size=637339 2024-09-14T11:17:48.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.674+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=KG04Z7BXMKC3 type=write size=52884 2024-09-14T11:17:48.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.675+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=0KPA0AORJI69 type=del 2024-09-14T11:17:48.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.676+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=IT3V115GY4TA type=del size=50855 2024-09-14T11:17:48.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.678+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=NTBX0MFZORCD type=del 2024-09-14T11:17:48.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.679+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=I9ZO86L3YKP2 type=del size=2839094 2024-09-14T11:17:48.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.680+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=FPG4538S33SK type=del 2024-09-14T11:17:48.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.683+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~44TGKZ3VV3D5.0 size=1048576 2024-09-14T11:17:48.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.684+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~44TGKZ3VV3D5.1 size=231674 2024-09-14T11:17:48.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.684+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=44TGKZ3VV3D5 tag=QRC5GKRQQ6II type=write size=2328826 2024-09-14T11:17:48.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.685+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=A1AM4DL2ZV8Y type=del 2024-09-14T11:17:48.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.687+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.0 size=1048576 2024-09-14T11:17:48.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.688+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.1 size=1048576 2024-09-14T11:17:48.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.689+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.2 size=503504 2024-09-14T11:17:48.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.689+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=M9NXFKN1KKJ6 tag=JGV3AV5E6EVA type=write size=3649232 2024-09-14T11:17:48.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.691+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~7GISEGZS3ZXO.0 size=795588 2024-09-14T11:17:48.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.693+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=7GISEGZS3ZXO tag=1P9SEEY2XLGR type=write size=1844164 2024-09-14T11:17:48.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.694+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=CZOYMOQI7VRL type=del size=3203964 2024-09-14T11:17:48.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.695+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~LHPP6E3RK7KR.0 size=1048576 2024-09-14T11:17:48.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.696+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~LHPP6E3RK7KR.1 size=269917 2024-09-14T11:17:48.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.698+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=LHPP6E3RK7KR tag=B48GTC0T87BS type=write size=2367069 2024-09-14T11:17:48.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.699+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=M7UHDW0TP10E type=del size=3398166 2024-09-14T11:17:48.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.701+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~ZRA93NV94A6O.0 size=1048576 2024-09-14T11:17:48.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.704+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~ZRA93NV94A6O.1 size=122780 2024-09-14T11:17:48.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.707+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=ZRA93NV94A6O tag=POTXCRDA4AZL type=write size=2219932 2024-09-14T11:17:48.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.710+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~Q8N1VOEZC9R7.0 size=1048576 2024-09-14T11:17:48.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.711+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~Q8N1VOEZC9R7.1 size=155763 2024-09-14T11:17:48.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.711+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=Q8N1VOEZC9R7 tag=D7E4JXCYZ6C8 type=write size=2252915 2024-09-14T11:17:48.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.711+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.0 size=1048576 2024-09-14T11:17:48.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.712+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.1 size=1048576 2024-09-14T11:17:48.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.713+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~O1F7GAWX8R6A.2 size=358669 2024-09-14T11:17:48.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.715+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=O1F7GAWX8R6A tag=BUALWICNNB18 type=write size=3504397 2024-09-14T11:17:48.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.716+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=P74CBTRZQ6G0 type=del size=3631837 2024-09-14T11:17:48.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.717+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.0 size=1048576 2024-09-14T11:17:48.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.718+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.1 size=1048576 2024-09-14T11:17:48.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.719+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~5WQVDZ1FNFYU.2 size=394492 2024-09-14T11:17:48.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.721+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=5WQVDZ1FNFYU tag=6MCCY67REW56 type=write size=3540220 2024-09-14T11:17:48.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.722+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=1Y8W6V8KOUD3 type=del size=4001368 2024-09-14T11:17:48.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.723+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=HDU2I9METGSB type=del 2024-09-14T11:17:48.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.724+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=V4FRBF7KI4WZ type=del size=324165 2024-09-14T11:17:48.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.725+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=B4N20W20SWGY type=write size=2714 2024-09-14T11:17:48.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.726+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=ZU7RRGZC60G2 type=del size=1106969 2024-09-14T11:17:48.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.728+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=IJDNP61IPUPH type=del size=374271 2024-09-14T11:17:48.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.729+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=EBC906AP6ZVZ type=del size=1562731 2024-09-14T11:17:48.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.730+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=DVJHGGO74961 type=del 2024-09-14T11:17:48.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.731+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=WPQVEZIRFE6C type=del size=3514255 2024-09-14T11:17:48.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.732+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=R8U34UAAD0X4 type=del 2024-09-14T11:17:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.734+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~L11A09NO1QSO.0 size=352897 2024-09-14T11:17:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.734+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=L11A09NO1QSO tag=FSMFOYP6GER1 type=write size=1401473 2024-09-14T11:17:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.735+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=QE8O580MVFBT type=del 2024-09-14T11:17:48.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.737+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~IP4G0SXUQON3.0 size=751656 2024-09-14T11:17:48.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.737+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=IP4G0SXUQON3 tag=L1INER0U6N1N type=write size=1800232 2024-09-14T11:17:48.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.738+0000 7f1be8076780 1 < completed write operation key=SJES17ZIGRZE tag=KG04Z7BXMKC3 type=write size=52884 2024-09-14T11:17:48.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.740+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.0 size=1048576 2024-09-14T11:17:48.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.741+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.1 size=1048576 2024-09-14T11:17:48.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.742+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.2 size=1022029 2024-09-14T11:17:48.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.742+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=B8CQFX6LH1ZU tag=9QQMYB4UKMRH type=write size=4167757 2024-09-14T11:17:48.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.743+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=IT3V115GY4TA type=del size=50855 2024-09-14T11:17:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.744+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=NYQJB6QOURR8 type=del size=3548238 2024-09-14T11:17:48.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.746+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=I9ZO86L3YKP2 type=del 2024-09-14T11:17:48.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.747+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=XSDNC4KDEXB6 type=write size=895996 2024-09-14T11:17:48.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.748+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~44TGKZ3VV3D5.0 size=1048576 2024-09-14T11:17:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.748+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~44TGKZ3VV3D5.1 size=231674 2024-09-14T11:17:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.750+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=44TGKZ3VV3D5 tag=QRC5GKRQQ6II type=write size=2328826 2024-09-14T11:17:48.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.753+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.0 size=1048576 2024-09-14T11:17:48.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.753+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.1 size=1048576 2024-09-14T11:17:48.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.754+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.2 size=728593 2024-09-14T11:17:48.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.754+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=2DJSF2HY6IB1 tag=T32JEW1J8CZ7 type=write size=3874321 2024-09-14T11:17:48.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.756+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.0 size=1048576 2024-09-14T11:17:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.756+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.1 size=1048576 2024-09-14T11:17:48.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.757+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~M9NXFKN1KKJ6.2 size=503504 2024-09-14T11:17:48.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.760+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=M9NXFKN1KKJ6 tag=JGV3AV5E6EVA type=write size=3649232 2024-09-14T11:17:48.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.761+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=126BDH8PMBJG type=del size=530753 2024-09-14T11:17:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.762+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=CZOYMOQI7VRL type=del 2024-09-14T11:17:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.763+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=7BO2GUVL5IWR type=del size=863564 2024-09-14T11:17:48.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.765+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=M7UHDW0TP10E type=del 2024-09-14T11:17:48.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.766+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=S00WF4HGS779 type=del size=1391441 2024-09-14T11:17:48.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.767+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~Q8N1VOEZC9R7.0 size=1048576 2024-09-14T11:17:48.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.767+0000 7f1be8076780 1 < canceled part key=_multipart_CQDRZMJAJ7FZ.2~Q8N1VOEZC9R7.1 size=155763 2024-09-14T11:17:48.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.769+0000 7f1be8076780 1 < canceled multipart upload key=CQDRZMJAJ7FZ upload=Q8N1VOEZC9R7 tag=D7E4JXCYZ6C8 type=write size=2252915 2024-09-14T11:17:48.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.770+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=Q1MBHN5JE3W9 type=del size=3782153 2024-09-14T11:17:48.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.772+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=P74CBTRZQ6G0 type=del 2024-09-14T11:17:48.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.773+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=72JIG2PBX5OM type=del size=645310 2024-09-14T11:17:48.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.774+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=1Y8W6V8KOUD3 type=del 2024-09-14T11:17:48.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.775+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=VGH5R5X417EP type=del size=3659784 2024-09-14T11:17:48.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.777+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=V4FRBF7KI4WZ type=del 2024-09-14T11:17:48.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.778+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=FSPG9YUFKAXU type=write size=866686 2024-09-14T11:17:48.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.780+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=ZU7RRGZC60G2 type=del size=1106969 2024-09-14T11:17:48.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.781+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=N71EI17KR8EP type=write size=943420 2024-09-14T11:17:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.782+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=EBC906AP6ZVZ type=del 2024-09-14T11:17:48.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.784+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=XL3JDM8PRODV type=del size=1103695 2024-09-14T11:17:48.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.785+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=WPQVEZIRFE6C type=del 2024-09-14T11:17:48.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.786+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=FKIFDZDSYOVI type=del size=639603 2024-09-14T11:17:48.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.787+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~L11A09NO1QSO.0 size=352897 2024-09-14T11:17:48.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.789+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=L11A09NO1QSO tag=FSMFOYP6GER1 type=write size=1401473 2024-09-14T11:17:48.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.791+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~W733IF375O00.0 size=1048576 2024-09-14T11:17:48.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.792+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~W733IF375O00.1 size=218508 2024-09-14T11:17:48.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.792+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=W733IF375O00 tag=I5XZT6JO8IJ6 type=write size=2315660 2024-09-14T11:17:48.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.793+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~IP4G0SXUQON3.0 size=751656 2024-09-14T11:17:48.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.795+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=IP4G0SXUQON3 tag=L1INER0U6N1N type=write size=1800232 2024-09-14T11:17:48.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.798+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.0 size=1048576 2024-09-14T11:17:48.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.799+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.1 size=1048576 2024-09-14T11:17:48.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.800+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.2 size=201313 2024-09-14T11:17:48.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.800+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=XWMS0DV9N0O7 tag=LI1MDW8E0VVH type=write size=3347041 2024-09-14T11:17:48.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.801+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.0 size=1048576 2024-09-14T11:17:48.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.802+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.1 size=1048576 2024-09-14T11:17:48.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.803+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~B8CQFX6LH1ZU.2 size=1022029 2024-09-14T11:17:48.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.805+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=B8CQFX6LH1ZU tag=9QQMYB4UKMRH type=write size=4167757 2024-09-14T11:17:48.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.807+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.0 size=1048576 2024-09-14T11:17:48.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.808+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.1 size=1048576 2024-09-14T11:17:48.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.809+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.2 size=308363 2024-09-14T11:17:48.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.809+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=SNLQNHTS0H0C tag=T17TDU0EMDAA type=write size=3454091 2024-09-14T11:17:48.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.811+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=NYQJB6QOURR8 type=del 2024-09-14T11:17:48.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.813+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~TE9UKYNQ91OA.0 size=189248 2024-09-14T11:17:48.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.813+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=TE9UKYNQ91OA tag=ABJ8JKZ47Z14 type=write size=1237824 2024-09-14T11:17:48.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.815+0000 7f1be8076780 1 < completed write operation key=1X2EWK1Y2GE0 tag=XSDNC4KDEXB6 type=write size=895996 2024-09-14T11:17:48.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.817+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=5R0P6PYAI0VD type=del size=2238387 2024-09-14T11:17:48.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.818+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.0 size=1048576 2024-09-14T11:17:48.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.819+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.1 size=1048576 2024-09-14T11:17:48.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.820+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~2DJSF2HY6IB1.2 size=728593 2024-09-14T11:17:48.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.822+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=2DJSF2HY6IB1 tag=T32JEW1J8CZ7 type=write size=3874321 2024-09-14T11:17:48.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.824+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~LQ2VU34TNZOP.0 size=1048576 2024-09-14T11:17:48.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.825+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~LQ2VU34TNZOP.1 size=158264 2024-09-14T11:17:48.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.825+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=LQ2VU34TNZOP tag=9RBMN4YJF4JI type=write size=2255416 2024-09-14T11:17:48.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.827+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=126BDH8PMBJG type=del size=530753 2024-09-14T11:17:48.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.828+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=WOB25J54Z2UT type=del size=1160005 2024-09-14T11:17:48.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.830+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=7BO2GUVL5IWR type=del size=863564 2024-09-14T11:17:48.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.831+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=4L1ADZLYHLSA type=del size=2639153 2024-09-14T11:17:48.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.833+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=S00WF4HGS779 type=del 2024-09-14T11:17:48.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.834+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=7OB2EUW9KNV0 type=del size=4152484 2024-09-14T11:17:48.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.835+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=Q1MBHN5JE3W9 type=del 2024-09-14T11:17:48.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.836+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=I771JYOP8BYZ type=del size=1593791 2024-09-14T11:17:48.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.837+0000 7f1be8076780 1 < canceled operation key=WQC5TVD66R0W tag=72JIG2PBX5OM type=del size=645310 2024-09-14T11:17:48.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.839+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~R8SGVT3Z92HR.0 size=1048576 2024-09-14T11:17:48.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.840+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~R8SGVT3Z92HR.1 size=715551 2024-09-14T11:17:48.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.840+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=R8SGVT3Z92HR tag=1LDQVT7JHJ24 type=write size=2812703 2024-09-14T11:17:48.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.842+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=VGH5R5X417EP type=del 2024-09-14T11:17:48.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.844+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.0 size=1048576 2024-09-14T11:17:48.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.845+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.1 size=1048576 2024-09-14T11:17:48.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.845+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.2 size=122115 2024-09-14T11:17:48.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.845+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=IWQI2GRGAC1I tag=MJYEMDHUFMIZ type=write size=3267843 2024-09-14T11:17:48.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.848+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=FSPG9YUFKAXU type=write size=866686 2024-09-14T11:17:48.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.849+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=Z14TCNWTKUL2 type=del size=1504035 2024-09-14T11:17:48.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.850+0000 7f1be8076780 1 < canceled operation key=RIYGSRWKVKFF tag=N71EI17KR8EP type=write size=943420 2024-09-14T11:17:48.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.852+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=0UXN91GXQ98M type=del size=3185119 2024-09-14T11:17:48.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.854+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=XL3JDM8PRODV type=del size=1103695 2024-09-14T11:17:48.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.855+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=I233C3TFR55R type=write size=18905 2024-09-14T11:17:48.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.856+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=FKIFDZDSYOVI type=del 2024-09-14T11:17:48.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.859+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~K2KSIEE4VTHC.0 size=1048576 2024-09-14T11:17:48.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.860+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~K2KSIEE4VTHC.1 size=482005 2024-09-14T11:17:48.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.860+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=K2KSIEE4VTHC tag=S3AWLO65KS4X type=write size=2579157 2024-09-14T11:17:48.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.861+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~W733IF375O00.0 size=1048576 2024-09-14T11:17:48.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.862+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~W733IF375O00.1 size=218508 2024-09-14T11:17:48.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.864+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=W733IF375O00 tag=I5XZT6JO8IJ6 type=write size=2315660 2024-09-14T11:17:48.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.865+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=D3VW34Y2ZAIH type=del size=3538382 2024-09-14T11:17:48.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.866+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.0 size=1048576 2024-09-14T11:17:48.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.867+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.1 size=1048576 2024-09-14T11:17:48.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.870+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~XWMS0DV9N0O7.2 size=201313 2024-09-14T11:17:48.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.872+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=XWMS0DV9N0O7 tag=LI1MDW8E0VVH type=write size=3347041 2024-09-14T11:17:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.874+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~GI7OQYJSDJXL.0 size=929594 2024-09-14T11:17:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.874+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=GI7OQYJSDJXL tag=NXOQ1OCPP802 type=write size=1978170 2024-09-14T11:17:48.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.875+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.0 size=1048576 2024-09-14T11:17:48.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.876+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.1 size=1048576 2024-09-14T11:17:48.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.877+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~SNLQNHTS0H0C.2 size=308363 2024-09-14T11:17:48.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.879+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=SNLQNHTS0H0C tag=T17TDU0EMDAA type=write size=3454091 2024-09-14T11:17:48.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.880+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=EELUNDXTEQWR type=del size=1026704 2024-09-14T11:17:48.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.880+0000 7f1be8076780 1 < canceled part key=_multipart_26WW5JFVB36U.2~TE9UKYNQ91OA.0 size=189248 2024-09-14T11:17:48.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.882+0000 7f1be8076780 1 < canceled multipart upload key=26WW5JFVB36U upload=TE9UKYNQ91OA tag=ABJ8JKZ47Z14 type=write size=1237824 2024-09-14T11:17:48.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.883+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=19V7EJZGLU7B type=del size=3283742 2024-09-14T11:17:48.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.884+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=5R0P6PYAI0VD type=del 2024-09-14T11:17:48.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.885+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=0FGQ60F860FV type=del size=416045 2024-09-14T11:17:48.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.887+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~LQ2VU34TNZOP.0 size=1048576 2024-09-14T11:17:48.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.888+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~LQ2VU34TNZOP.1 size=158264 2024-09-14T11:17:48.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.890+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=LQ2VU34TNZOP tag=9RBMN4YJF4JI type=write size=2255416 2024-09-14T11:17:48.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.891+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=JHUMLDW3QGH0 type=del size=2468593 2024-09-14T11:17:48.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.892+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=WOB25J54Z2UT type=del 2024-09-14T11:17:48.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.893+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=JAVC7ZE43IMC type=del size=2530113 2024-09-14T11:17:48.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.894+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=4L1ADZLYHLSA type=del 2024-09-14T11:17:48.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.896+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.0 size=1048576 2024-09-14T11:17:48.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.898+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.1 size=1048576 2024-09-14T11:17:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.899+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.2 size=401231 2024-09-14T11:17:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.899+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=Q4EKJIZGEG50 tag=STQ3NOWLRPAT type=write size=3546959 2024-09-14T11:17:48.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.901+0000 7f1be8076780 1 < suggested remove operation key=QIEUKUQ8CS2U tag=7OB2EUW9KNV0 type=del 2024-09-14T11:17:48.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.902+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=W0Y6IG12C8NF type=write size=532472 2024-09-14T11:17:48.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.904+0000 7f1be8076780 -1 < failed to complete operation key=QIEUKUQ8CS2U tag=I771JYOP8BYZ type=del size=1593791: (22) Invalid argument 2024-09-14T11:17:48.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.905+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=MDUEEHSO8DRG type=write size=1036365 2024-09-14T11:17:48.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.906+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~R8SGVT3Z92HR.0 size=1048576 2024-09-14T11:17:48.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.907+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~R8SGVT3Z92HR.1 size=715551 2024-09-14T11:17:48.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.909+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=R8SGVT3Z92HR tag=1LDQVT7JHJ24 type=write size=2812703 2024-09-14T11:17:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.910+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=6LF8C0UL3NU7 type=del size=53888 2024-09-14T11:17:48.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.911+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.0 size=1048576 2024-09-14T11:17:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.912+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.1 size=1048576 2024-09-14T11:17:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.913+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~IWQI2GRGAC1I.2 size=122115 2024-09-14T11:17:48.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.915+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=IWQI2GRGAC1I tag=MJYEMDHUFMIZ type=write size=3267843 2024-09-14T11:17:48.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.917+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.0 size=1048576 2024-09-14T11:17:48.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.918+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.1 size=1048576 2024-09-14T11:17:48.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.919+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.2 size=990132 2024-09-14T11:17:48.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.919+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=I2QFNMAV5UGZ tag=ALGVH4YEEDY4 type=write size=4135860 2024-09-14T11:17:48.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.920+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=Z14TCNWTKUL2 type=del 2024-09-14T11:17:48.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.922+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=T09JH0G1IIES type=write size=147797 2024-09-14T11:17:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.923+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=0UXN91GXQ98M type=del size=3185119 2024-09-14T11:17:48.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.925+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.0 size=1048576 2024-09-14T11:17:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.926+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.1 size=1048576 2024-09-14T11:17:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.927+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.2 size=737943 2024-09-14T11:17:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.927+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=F3Q7F1M4RTTW tag=K9PZIX3WIV9G type=write size=3883671 2024-09-14T11:17:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.930+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=I233C3TFR55R type=write size=18905 2024-09-14T11:17:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.932+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~A5HP9HO2MSTF.0 size=329221 2024-09-14T11:17:48.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.932+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=A5HP9HO2MSTF tag=GNY81CNWCU8I type=write size=1377797 2024-09-14T11:17:48.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.933+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~K2KSIEE4VTHC.0 size=1048576 2024-09-14T11:17:48.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.934+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~K2KSIEE4VTHC.1 size=482005 2024-09-14T11:17:48.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.936+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=K2KSIEE4VTHC tag=S3AWLO65KS4X type=write size=2579157 2024-09-14T11:17:48.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.937+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=5K3Y71E1HXCF type=del size=1707690 2024-09-14T11:17:48.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.938+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=D3VW34Y2ZAIH type=del 2024-09-14T11:17:48.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.940+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=ALFZVKOWLKF8 type=del size=3703789 2024-09-14T11:17:48.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.941+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~GI7OQYJSDJXL.0 size=929594 2024-09-14T11:17:48.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.943+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=GI7OQYJSDJXL tag=NXOQ1OCPP802 type=write size=1978170 2024-09-14T11:17:48.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.945+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.0 size=1048576 2024-09-14T11:17:48.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.946+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.1 size=1048576 2024-09-14T11:17:48.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.947+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.2 size=838601 2024-09-14T11:17:48.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.947+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=8I9BXXP5V0MF tag=F1O6G5NVOE6Q type=write size=3984329 2024-09-14T11:17:48.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.948+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=EELUNDXTEQWR type=del 2024-09-14T11:17:48.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.949+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=A6R0N2IXSM8X type=del size=677695 2024-09-14T11:17:48.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.951+0000 7f1be8076780 1 < suggested remove operation key=MVUN63538RAB tag=19V7EJZGLU7B type=del 2024-09-14T11:17:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.953+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~056LKKXXKCQP.0 size=1048576 2024-09-14T11:17:48.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.954+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~056LKKXXKCQP.1 size=873362 2024-09-14T11:17:48.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.954+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=056LKKXXKCQP tag=02ZTHOFAOJF2 type=write size=2970514 2024-09-14T11:17:48.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.955+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=0FGQ60F860FV type=del 2024-09-14T11:17:48.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.957+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=SPN118UT5VV8 type=write size=349263 2024-09-14T11:17:48.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.958+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=JHUMLDW3QGH0 type=del 2024-09-14T11:17:48.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.959+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=GI478V9H5RKP type=del size=3077934 2024-09-14T11:17:48.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.960+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=JAVC7ZE43IMC type=del 2024-09-14T11:17:48.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.962+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~1SF4MWEGYX4O.0 size=1048576 2024-09-14T11:17:48.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.963+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~1SF4MWEGYX4O.1 size=757766 2024-09-14T11:17:48.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.963+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=1SF4MWEGYX4O tag=G30TH2RQR997 type=write size=2854918 2024-09-14T11:17:48.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.964+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.0 size=1048576 2024-09-14T11:17:48.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.965+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.1 size=1048576 2024-09-14T11:17:48.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.966+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~Q4EKJIZGEG50.2 size=401231 2024-09-14T11:17:48.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.968+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=Q4EKJIZGEG50 tag=STQ3NOWLRPAT type=write size=3546959 2024-09-14T11:17:48.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.969+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=4MJBP0M0KO59 type=write size=110612 2024-09-14T11:17:48.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.970+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=W0Y6IG12C8NF type=write size=532472 2024-09-14T11:17:48.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.972+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=ZZW4FUTE8WCI type=write size=470916 2024-09-14T11:17:48.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.973+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=MDUEEHSO8DRG type=write size=1036365 2024-09-14T11:17:48.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.974+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=0MAPIO0ETVDK type=del size=547178 2024-09-14T11:17:48.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.975+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=6LF8C0UL3NU7 type=del 2024-09-14T11:17:48.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.976+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=LO9BU0RPMUVK type=del size=3169462 2024-09-14T11:17:48.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.978+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.0 size=1048576 2024-09-14T11:17:48.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.979+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.1 size=1048576 2024-09-14T11:17:48.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.979+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~I2QFNMAV5UGZ.2 size=990132 2024-09-14T11:17:48.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.981+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=I2QFNMAV5UGZ tag=ALGVH4YEEDY4 type=write size=4135860 2024-09-14T11:17:48.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.984+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~SKM8XT1SRM3L.0 size=923014 2024-09-14T11:17:48.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.984+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=SKM8XT1SRM3L tag=IJMPM9QA54ZQ type=write size=1971590 2024-09-14T11:17:48.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.985+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=T09JH0G1IIES type=write size=147797 2024-09-14T11:17:48.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.987+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TO3HX18CSWFP.0 size=1048576 2024-09-14T11:17:48.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.988+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~TO3HX18CSWFP.1 size=275488 2024-09-14T11:17:48.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.988+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=TO3HX18CSWFP tag=BMFW46PRK3VS type=write size=2372640 2024-09-14T11:17:48.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.989+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.0 size=1048576 2024-09-14T11:17:48.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.989+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.1 size=1048576 2024-09-14T11:17:48.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.990+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~F3Q7F1M4RTTW.2 size=737943 2024-09-14T11:17:48.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.992+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=F3Q7F1M4RTTW tag=K9PZIX3WIV9G type=write size=3883671 2024-09-14T11:17:48.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.994+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~JK6AZBESDU9Q.0 size=307816 2024-09-14T11:17:48.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.994+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=JK6AZBESDU9Q tag=M7IVEUN3U7H7 type=write size=1356392 2024-09-14T11:17:48.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.995+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~A5HP9HO2MSTF.0 size=329221 2024-09-14T11:17:48.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.997+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=A5HP9HO2MSTF tag=GNY81CNWCU8I type=write size=1377797 2024-09-14T11:17:48.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.998+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=54TTQYGS9X5U type=del size=3652545 2024-09-14T11:17:48.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:48.999+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=5K3Y71E1HXCF type=del 2024-09-14T11:17:48.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.001+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=Q4RTJFYMVAMM type=del size=2340472 2024-09-14T11:17:49.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.003+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=ALFZVKOWLKF8 type=del size=3703789 2024-09-14T11:17:49.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.004+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=EKV50779YBP5 type=del size=372350 2024-09-14T11:17:49.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.005+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.0 size=1048576 2024-09-14T11:17:49.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.006+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.1 size=1048576 2024-09-14T11:17:49.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.007+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8I9BXXP5V0MF.2 size=838601 2024-09-14T11:17:49.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.009+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=8I9BXXP5V0MF tag=F1O6G5NVOE6Q type=write size=3984329 2024-09-14T11:17:49.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.011+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.0 size=1048576 2024-09-14T11:17:49.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.012+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.1 size=1048576 2024-09-14T11:17:49.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.013+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.2 size=202877 2024-09-14T11:17:49.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.013+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=OZ8PZPQ7K1H0 tag=WS2757HUSTDJ type=write size=3348605 2024-09-14T11:17:49.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.014+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=A6R0N2IXSM8X type=del 2024-09-14T11:17:49.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.016+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~JHY5QMTSQ4IQ.0 size=1048576 2024-09-14T11:17:49.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.017+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~JHY5QMTSQ4IQ.1 size=304200 2024-09-14T11:17:49.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.017+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=JHY5QMTSQ4IQ tag=SMCY2TR9T1N5 type=write size=2401352 2024-09-14T11:17:49.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.018+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~056LKKXXKCQP.0 size=1048576 2024-09-14T11:17:49.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.019+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~056LKKXXKCQP.1 size=873362 2024-09-14T11:17:49.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.021+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=056LKKXXKCQP tag=02ZTHOFAOJF2 type=write size=2970514 2024-09-14T11:17:49.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.024+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~0LXBBUCUUM52.0 size=137695 2024-09-14T11:17:49.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.024+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=0LXBBUCUUM52 tag=O5EGL5OOHLQW type=write size=1186271 2024-09-14T11:17:49.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.026+0000 7f1be8076780 1 < suggested remove operation key=QIEUKUQ8CS2U tag=SPN118UT5VV8 type=write 2024-09-14T11:17:49.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.027+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=7LP8SQDA93VJ type=del size=878914 2024-09-14T11:17:49.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.028+0000 7f1be8076780 1 < canceled operation key=2RJYZ1CRDVEP tag=GI478V9H5RKP type=del size=3077934 2024-09-14T11:17:49.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.030+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=CRF7ZS77DW4L type=del size=332072 2024-09-14T11:17:49.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.030+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~1SF4MWEGYX4O.0 size=1048576 2024-09-14T11:17:49.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.031+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~1SF4MWEGYX4O.1 size=757766 2024-09-14T11:17:49.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.033+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=1SF4MWEGYX4O tag=G30TH2RQR997 type=write size=2854918 2024-09-14T11:17:49.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.035+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.0 size=1048576 2024-09-14T11:17:49.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.036+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.1 size=1048576 2024-09-14T11:17:49.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.038+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.2 size=53304 2024-09-14T11:17:49.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.038+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=N61D4ZK36RGF tag=2CZ5G12OBD6A type=write size=3199032 2024-09-14T11:17:49.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.039+0000 7f1be8076780 1 < completed write operation key=9DRSDTGM7Y3F tag=4MJBP0M0KO59 type=write size=110612 2024-09-14T11:17:49.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.040+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=7PPPYQL1YHXA type=del size=1845749 2024-09-14T11:17:49.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.042+0000 7f1be8076780 1 < completed write operation key=QC6MEJABT7IM tag=ZZW4FUTE8WCI type=write size=470916 2024-09-14T11:17:49.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.043+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=22FYS5MXGUYF type=del size=3057749 2024-09-14T11:17:49.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.044+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=0MAPIO0ETVDK type=del 2024-09-14T11:17:49.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.045+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=34SP9UIHW1E9 type=del size=1822037 2024-09-14T11:17:49.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.046+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=LO9BU0RPMUVK type=del 2024-09-14T11:17:49.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.047+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=HDCNMHIHBLZF type=del size=3586115 2024-09-14T11:17:49.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.048+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~SKM8XT1SRM3L.0 size=923014 2024-09-14T11:17:49.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.050+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=SKM8XT1SRM3L tag=IJMPM9QA54ZQ type=write size=1971590 2024-09-14T11:17:49.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.051+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=UC766NEYD9W7 type=del size=1351974 2024-09-14T11:17:49.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.052+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TO3HX18CSWFP.0 size=1048576 2024-09-14T11:17:49.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.053+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~TO3HX18CSWFP.1 size=275488 2024-09-14T11:17:49.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.055+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=TO3HX18CSWFP tag=BMFW46PRK3VS type=write size=2372640 2024-09-14T11:17:49.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.056+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=L2AKGVI3YRMP type=write size=228819 2024-09-14T11:17:49.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.057+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~JK6AZBESDU9Q.0 size=307816 2024-09-14T11:17:49.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.059+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=JK6AZBESDU9Q tag=M7IVEUN3U7H7 type=write size=1356392 2024-09-14T11:17:49.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.060+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=7P0KW3V7U9HD type=del size=3837672 2024-09-14T11:17:49.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.061+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=54TTQYGS9X5U type=del 2024-09-14T11:17:49.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.063+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~TIDKAF380HOD.0 size=1048576 2024-09-14T11:17:49.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.064+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~TIDKAF380HOD.1 size=173105 2024-09-14T11:17:49.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.064+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=TIDKAF380HOD tag=1SVZ4EORWAGY type=write size=2270257 2024-09-14T11:17:49.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.065+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=Q4RTJFYMVAMM type=del 2024-09-14T11:17:49.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.067+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=HHTFABL3NIDC type=del size=679605 2024-09-14T11:17:49.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.068+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=EKV50779YBP5 type=del 2024-09-14T11:17:49.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.070+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~Q9XUZH9A89Z2.0 size=856366 2024-09-14T11:17:49.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.070+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=Q9XUZH9A89Z2 tag=R4NQQOZRTX0Y type=write size=1904942 2024-09-14T11:17:49.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.071+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.0 size=1048576 2024-09-14T11:17:49.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.072+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.1 size=1048576 2024-09-14T11:17:49.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.073+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~OZ8PZPQ7K1H0.2 size=202877 2024-09-14T11:17:49.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.075+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=OZ8PZPQ7K1H0 tag=WS2757HUSTDJ type=write size=3348605 2024-09-14T11:17:49.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.076+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=YKLCPZM1W91D type=del size=233251 2024-09-14T11:17:49.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.077+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~JHY5QMTSQ4IQ.0 size=1048576 2024-09-14T11:17:49.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.078+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~JHY5QMTSQ4IQ.1 size=304200 2024-09-14T11:17:49.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.080+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=JHY5QMTSQ4IQ tag=SMCY2TR9T1N5 type=write size=2401352 2024-09-14T11:17:49.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.081+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=FJHFMNT9E09K type=del size=1808588 2024-09-14T11:17:49.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.081+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~0LXBBUCUUM52.0 size=137695 2024-09-14T11:17:49.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.083+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=0LXBBUCUUM52 tag=O5EGL5OOHLQW type=write size=1186271 2024-09-14T11:17:49.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.085+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~ND8SUHI0PTVR.0 size=1048576 2024-09-14T11:17:49.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.086+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~ND8SUHI0PTVR.1 size=1042350 2024-09-14T11:17:49.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.086+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=ND8SUHI0PTVR tag=H1V9C52NTL4H type=write size=3139502 2024-09-14T11:17:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.087+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=7LP8SQDA93VJ type=del 2024-09-14T11:17:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.089+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~02EYJQBFG8P2.0 size=1029644 2024-09-14T11:17:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.089+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=02EYJQBFG8P2 tag=3ERNTWWROTJ6 type=write size=2078220 2024-09-14T11:17:49.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.090+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=CRF7ZS77DW4L type=del 2024-09-14T11:17:49.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.092+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=HZLXUUZ7F095 type=del size=2837724 2024-09-14T11:17:49.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.093+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.0 size=1048576 2024-09-14T11:17:49.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.094+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.1 size=1048576 2024-09-14T11:17:49.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.095+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~N61D4ZK36RGF.2 size=53304 2024-09-14T11:17:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.097+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=N61D4ZK36RGF tag=2CZ5G12OBD6A type=write size=3199032 2024-09-14T11:17:49.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.099+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~KRSLCRY3YXVN.0 size=391755 2024-09-14T11:17:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.099+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=KRSLCRY3YXVN tag=IITL1D0440DB type=write size=1440331 2024-09-14T11:17:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.101+0000 7f1be8076780 1 < suggested remove operation key=4AY6ZXFKO1YQ tag=7PPPYQL1YHXA type=del 2024-09-14T11:17:49.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.102+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=7QT0FL3KZD9S type=del size=471713 2024-09-14T11:17:49.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.104+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=22FYS5MXGUYF type=del 2024-09-14T11:17:49.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.105+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=9IFUATWLM811 type=del size=2866432 2024-09-14T11:17:49.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.106+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=34SP9UIHW1E9 type=del 2024-09-14T11:17:49.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.108+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~1GCRHU58FM4S.0 size=1048576 2024-09-14T11:17:49.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.109+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~1GCRHU58FM4S.1 size=53264 2024-09-14T11:17:49.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.109+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=1GCRHU58FM4S tag=1QAGMOH93F2H type=write size=2150416 2024-09-14T11:17:49.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.112+0000 7f1be8076780 1 < suggested update operation key=1X2EWK1Y2GE0 tag=HDCNMHIHBLZF type=del size=3586115 2024-09-14T11:17:49.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.114+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~5V22RN60T9JY.0 size=958624 2024-09-14T11:17:49.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.114+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=5V22RN60T9JY tag=QQELG50559A3 type=write size=2007200 2024-09-14T11:17:49.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.115+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=UC766NEYD9W7 type=del 2024-09-14T11:17:49.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.116+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=LQ8JWMSL72IB type=write size=531323 2024-09-14T11:17:49.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.117+0000 7f1be8076780 1 < completed write operation key=JQZ7C562TQ8D tag=L2AKGVI3YRMP type=write size=228819 2024-09-14T11:17:49.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.118+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=J9O87F4JTTH3 type=del size=1371632 2024-09-14T11:17:49.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.119+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=7P0KW3V7U9HD type=del 2024-09-14T11:17:49.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.121+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=BB0X7WHXT4UC type=del size=3811435 2024-09-14T11:17:49.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.122+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~TIDKAF380HOD.0 size=1048576 2024-09-14T11:17:49.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.123+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~TIDKAF380HOD.1 size=173105 2024-09-14T11:17:49.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.124+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=TIDKAF380HOD tag=1SVZ4EORWAGY type=write size=2270257 2024-09-14T11:17:49.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.126+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=HJTD0JBL7WNC type=del size=1529548 2024-09-14T11:17:49.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.127+0000 7f1be8076780 1 < canceled operation key=WQC5TVD66R0W tag=HHTFABL3NIDC type=del size=679605 2024-09-14T11:17:49.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.128+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=179HY1Q30FYF type=write size=763971 2024-09-14T11:17:49.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.129+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~Q9XUZH9A89Z2.0 size=856366 2024-09-14T11:17:49.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.131+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=Q9XUZH9A89Z2 tag=R4NQQOZRTX0Y type=write size=1904942 2024-09-14T11:17:49.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.132+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=AN7OUXVKS3AS type=write size=688044 2024-09-14T11:17:49.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.134+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=YKLCPZM1W91D type=del 2024-09-14T11:17:49.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.135+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=I4778BG80A9N type=del size=334994 2024-09-14T11:17:49.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.136+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=FJHFMNT9E09K type=del 2024-09-14T11:17:49.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.138+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.0 size=1048576 2024-09-14T11:17:49.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.139+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.1 size=1048576 2024-09-14T11:17:49.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.140+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.2 size=373040 2024-09-14T11:17:49.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.140+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=M9ZBBDBS1LD3 tag=VKTLEOH9GWE2 type=write size=3518768 2024-09-14T11:17:49.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.142+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~ND8SUHI0PTVR.0 size=1048576 2024-09-14T11:17:49.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.143+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~ND8SUHI0PTVR.1 size=1042350 2024-09-14T11:17:49.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.144+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=ND8SUHI0PTVR tag=H1V9C52NTL4H type=write size=3139502 2024-09-14T11:17:49.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.148+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~7ZUJCPU3E5CN.0 size=1048576 2024-09-14T11:17:49.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.149+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~7ZUJCPU3E5CN.1 size=110178 2024-09-14T11:17:49.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.149+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=7ZUJCPU3E5CN tag=0ZE7CVX724J0 type=write size=2207330 2024-09-14T11:17:49.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.150+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~02EYJQBFG8P2.0 size=1029644 2024-09-14T11:17:49.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.151+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=02EYJQBFG8P2 tag=3ERNTWWROTJ6 type=write size=2078220 2024-09-14T11:17:49.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.153+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=2PR7GP2W4WD9 type=del size=921179 2024-09-14T11:17:49.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.154+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=HZLXUUZ7F095 type=del size=2837724 2024-09-14T11:17:49.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.155+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=DIIZL3SSW0BK type=write size=922869 2024-09-14T11:17:49.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.156+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~KRSLCRY3YXVN.0 size=391755 2024-09-14T11:17:49.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.158+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=KRSLCRY3YXVN tag=IITL1D0440DB type=write size=1440331 2024-09-14T11:17:49.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.160+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.0 size=1048576 2024-09-14T11:17:49.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.161+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.1 size=1048576 2024-09-14T11:17:49.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.162+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.2 size=895643 2024-09-14T11:17:49.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.162+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=QQ2P5G728KL5 tag=7WE1NHOFSTFY type=write size=4041371 2024-09-14T11:17:49.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.163+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=7QT0FL3KZD9S type=del 2024-09-14T11:17:49.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.165+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.0 size=1048576 2024-09-14T11:17:49.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.166+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.1 size=1048576 2024-09-14T11:17:49.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.167+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.2 size=228916 2024-09-14T11:17:49.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.167+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=H4KDX89MKO68 tag=7WDWHCHOSE7K type=write size=3374644 2024-09-14T11:17:49.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.169+0000 7f1be8076780 1 < suggested update operation key=JQZ7C562TQ8D tag=9IFUATWLM811 type=del size=2866432 2024-09-14T11:17:49.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.170+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=U0LWOGCNSY65 type=del size=2343 2024-09-14T11:17:49.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.172+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~1GCRHU58FM4S.0 size=1048576 2024-09-14T11:17:49.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.173+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~1GCRHU58FM4S.1 size=53264 2024-09-14T11:17:49.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.174+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=1GCRHU58FM4S tag=1QAGMOH93F2H type=write size=2150416 2024-09-14T11:17:49.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.176+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=NX4BL75N0YAA type=del size=2313963 2024-09-14T11:17:49.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.177+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~5V22RN60T9JY.0 size=958624 2024-09-14T11:17:49.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.179+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=5V22RN60T9JY tag=QQELG50559A3 type=write size=2007200 2024-09-14T11:17:49.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.181+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.0 size=1048576 2024-09-14T11:17:49.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.182+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.1 size=1048576 2024-09-14T11:17:49.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.182+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.2 size=565201 2024-09-14T11:17:49.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.182+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=YFXLGBQCV7QI tag=83538BR8GKY7 type=write size=3710929 2024-09-14T11:17:49.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.184+0000 7f1be8076780 1 < canceled operation key=UB0SEYZ7ITU1 tag=LQ8JWMSL72IB type=write size=531323 2024-09-14T11:17:49.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.185+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=PMM0N0R631CX type=del size=2552879 2024-09-14T11:17:49.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.186+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=J9O87F4JTTH3 type=del 2024-09-14T11:17:49.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.187+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=Z0FN449J0E62 type=del size=1463105 2024-09-14T11:17:49.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.188+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=BB0X7WHXT4UC type=del 2024-09-14T11:17:49.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.190+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~VQHEZ7NO1OG3.0 size=627901 2024-09-14T11:17:49.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.190+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=VQHEZ7NO1OG3 tag=ST57P88UK15Y type=write size=1676477 2024-09-14T11:17:49.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.191+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=HJTD0JBL7WNC type=del 2024-09-14T11:17:49.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.192+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=K2IVGQMRPTDF type=del size=631353 2024-09-14T11:17:49.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.194+0000 7f1be8076780 1 < completed write operation key=MX5J0P18BM0D tag=179HY1Q30FYF type=write size=763971 2024-09-14T11:17:49.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.195+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=IA6Y9Q9HWE4C type=del size=765972 2024-09-14T11:17:49.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.196+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=AN7OUXVKS3AS type=write size=688044 2024-09-14T11:17:49.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.198+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~ZRG31VNMK62I.0 size=1048576 2024-09-14T11:17:49.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.199+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~ZRG31VNMK62I.1 size=74636 2024-09-14T11:17:49.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.199+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=ZRG31VNMK62I tag=UHXMJSSYC0J7 type=write size=2171788 2024-09-14T11:17:49.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.200+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=I4778BG80A9N type=del 2024-09-14T11:17:49.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.201+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=ZKMLN0XCGQ2C type=del size=3177504 2024-09-14T11:17:49.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.202+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.0 size=1048576 2024-09-14T11:17:49.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.203+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.1 size=1048576 2024-09-14T11:17:49.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.204+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~M9ZBBDBS1LD3.2 size=373040 2024-09-14T11:17:49.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.206+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=M9ZBBDBS1LD3 tag=VKTLEOH9GWE2 type=write size=3518768 2024-09-14T11:17:49.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.207+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=RN2BFSNPIEM5 type=del size=3640120 2024-09-14T11:17:49.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.209+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~7ZUJCPU3E5CN.0 size=1048576 2024-09-14T11:17:49.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.210+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~7ZUJCPU3E5CN.1 size=110178 2024-09-14T11:17:49.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.211+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=7ZUJCPU3E5CN tag=0ZE7CVX724J0 type=write size=2207330 2024-09-14T11:17:49.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.214+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.0 size=1048576 2024-09-14T11:17:49.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.214+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.1 size=1048576 2024-09-14T11:17:49.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.215+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.2 size=867822 2024-09-14T11:17:49.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.215+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=YQKROIL6OYKU tag=WF3C4QXC708L type=write size=4013550 2024-09-14T11:17:49.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.217+0000 7f1be8076780 1 < suggested remove operation key=26WW5JFVB36U tag=2PR7GP2W4WD9 type=del 2024-09-14T11:17:49.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.219+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=ZX1DEEOB6ADY type=del size=3725344 2024-09-14T11:17:49.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.220+0000 7f1be8076780 1 < completed write operation key=XB3M4CI0ERWP tag=DIIZL3SSW0BK type=write size=922869 2024-09-14T11:17:49.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.222+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~2MY0LKX49EOU.0 size=971218 2024-09-14T11:17:49.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.222+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=2MY0LKX49EOU tag=WRTXM0LL16R0 type=write size=2019794 2024-09-14T11:17:49.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.223+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.0 size=1048576 2024-09-14T11:17:49.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.224+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.1 size=1048576 2024-09-14T11:17:49.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.225+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~QQ2P5G728KL5.2 size=895643 2024-09-14T11:17:49.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.227+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=QQ2P5G728KL5 tag=7WE1NHOFSTFY type=write size=4041371 2024-09-14T11:17:49.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.228+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=DI3SY3T6E17R type=del size=419972 2024-09-14T11:17:49.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.229+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.0 size=1048576 2024-09-14T11:17:49.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.230+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.1 size=1048576 2024-09-14T11:17:49.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.231+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~H4KDX89MKO68.2 size=228916 2024-09-14T11:17:49.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.233+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=H4KDX89MKO68 tag=7WDWHCHOSE7K type=write size=3374644 2024-09-14T11:17:49.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.235+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=QW930KOW9BFD type=del size=524122 2024-09-14T11:17:49.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.237+0000 7f1be8076780 1 < suggested update operation key=JIWPGHQ3GEZB tag=U0LWOGCNSY65 type=del size=2343 2024-09-14T11:17:49.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.239+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.0 size=1048576 2024-09-14T11:17:49.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.240+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.1 size=1048576 2024-09-14T11:17:49.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.241+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.2 size=106511 2024-09-14T11:17:49.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.241+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=U1PNNQCGVQP3 tag=WMK0KNW9Q25W type=write size=3252239 2024-09-14T11:17:49.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.242+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=NX4BL75N0YAA type=del 2024-09-14T11:17:49.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.245+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.0 size=1048576 2024-09-14T11:17:49.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.245+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.1 size=1048576 2024-09-14T11:17:49.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.246+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.2 size=977398 2024-09-14T11:17:49.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.246+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=B7LVTL24GRVQ tag=F0DOW6T9UPKE type=write size=4123126 2024-09-14T11:17:49.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.248+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.0 size=1048576 2024-09-14T11:17:49.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.249+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.1 size=1048576 2024-09-14T11:17:49.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.249+0000 7f1be8076780 1 < canceled part key=_multipart_JDKFKO39I56L.2~YFXLGBQCV7QI.2 size=565201 2024-09-14T11:17:49.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.251+0000 7f1be8076780 1 < canceled multipart upload key=JDKFKO39I56L upload=YFXLGBQCV7QI tag=83538BR8GKY7 type=write size=3710929 2024-09-14T11:17:49.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.253+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=4QQDSUSVKXRS type=del size=166234 2024-09-14T11:17:49.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.254+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=PMM0N0R631CX type=del 2024-09-14T11:17:49.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.256+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~H3WKR392XCUT.0 size=684913 2024-09-14T11:17:49.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.256+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=H3WKR392XCUT tag=TJ4UO7195K2Z type=write size=1733489 2024-09-14T11:17:49.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.258+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=Z0FN449J0E62 type=del 2024-09-14T11:17:49.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.260+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.0 size=1048576 2024-09-14T11:17:49.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.261+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.1 size=1048576 2024-09-14T11:17:49.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.262+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.2 size=106552 2024-09-14T11:17:49.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.262+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=1WA8AP3ORC3G tag=S9SCBMC503FB type=write size=3252280 2024-09-14T11:17:49.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.263+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~VQHEZ7NO1OG3.0 size=627901 2024-09-14T11:17:49.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.265+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=VQHEZ7NO1OG3 tag=ST57P88UK15Y type=write size=1676477 2024-09-14T11:17:49.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.267+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=GH0E33R5V8PU type=del size=1087883 2024-09-14T11:17:49.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.268+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=K2IVGQMRPTDF type=del 2024-09-14T11:17:49.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.270+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~3R5HHHR9QTLJ.0 size=827974 2024-09-14T11:17:49.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.270+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=3R5HHHR9QTLJ tag=P5ULFWNNYM1Y type=write size=1876550 2024-09-14T11:17:49.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.271+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=IA6Y9Q9HWE4C type=del 2024-09-14T11:17:49.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.273+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.0 size=1048576 2024-09-14T11:17:49.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.274+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.1 size=1048576 2024-09-14T11:17:49.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.275+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.2 size=219654 2024-09-14T11:17:49.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.275+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=555WS013A1CM tag=D7AKFMGC3M4H type=write size=3365382 2024-09-14T11:17:49.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.276+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~ZRG31VNMK62I.0 size=1048576 2024-09-14T11:17:49.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.276+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~ZRG31VNMK62I.1 size=74636 2024-09-14T11:17:49.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.278+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=ZRG31VNMK62I tag=UHXMJSSYC0J7 type=write size=2171788 2024-09-14T11:17:49.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.281+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.0 size=1048576 2024-09-14T11:17:49.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.282+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.1 size=1048576 2024-09-14T11:17:49.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.282+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.2 size=329768 2024-09-14T11:17:49.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.282+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=APK0SBN5SQQW tag=O15E28FNVQGF type=write size=3475496 2024-09-14T11:17:49.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.284+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=ZKMLN0XCGQ2C type=del 2024-09-14T11:17:49.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.285+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=3KWH89YJV9YS type=del size=3258868 2024-09-14T11:17:49.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.287+0000 7f1be8076780 1 < suggested update operation key=3Z71PEWG5UMA tag=RN2BFSNPIEM5 type=del size=3640120 2024-09-14T11:17:49.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.289+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~BJCE54112ZWZ.0 size=542346 2024-09-14T11:17:49.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.289+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=BJCE54112ZWZ tag=ZM937AU711K1 type=write size=1590922 2024-09-14T11:17:49.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.290+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.0 size=1048576 2024-09-14T11:17:49.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.291+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.1 size=1048576 2024-09-14T11:17:49.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.292+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~YQKROIL6OYKU.2 size=867822 2024-09-14T11:17:49.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.294+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=YQKROIL6OYKU tag=WF3C4QXC708L type=write size=4013550 2024-09-14T11:17:49.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.295+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=0C4MBDSDBGIU type=write size=994715 2024-09-14T11:17:49.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.298+0000 7f1be8076780 1 < suggested update operation key=3YIK6B6Y2EU1 tag=ZX1DEEOB6ADY type=del size=3725344 2024-09-14T11:17:49.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.299+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=JORD1NJGY8WA type=write size=572030 2024-09-14T11:17:49.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.302+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~2MY0LKX49EOU.0 size=971218 2024-09-14T11:17:49.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.308+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=2MY0LKX49EOU tag=WRTXM0LL16R0 type=write size=2019794 2024-09-14T11:17:49.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.309+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=S7VD5CXLQ476 type=del size=854731 2024-09-14T11:17:49.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.310+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=DI3SY3T6E17R type=del 2024-09-14T11:17:49.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.313+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~YGSC5LYSOARW.0 size=240193 2024-09-14T11:17:49.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.313+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=YGSC5LYSOARW tag=QSKA7LFR58OA type=write size=1288769 2024-09-14T11:17:49.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.315+0000 7f1be8076780 1 < suggested update operation key=4AY6ZXFKO1YQ tag=QW930KOW9BFD type=del size=524122 2024-09-14T11:17:49.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.316+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=O0E0RS8YL5QL type=write size=260484 2024-09-14T11:17:49.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.317+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.0 size=1048576 2024-09-14T11:17:49.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.318+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.1 size=1048576 2024-09-14T11:17:49.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.319+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~U1PNNQCGVQP3.2 size=106511 2024-09-14T11:17:49.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.321+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=U1PNNQCGVQP3 tag=WMK0KNW9Q25W type=write size=3252239 2024-09-14T11:17:49.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.323+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.0 size=1048576 2024-09-14T11:17:49.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.324+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.1 size=1048576 2024-09-14T11:17:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.325+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.2 size=778996 2024-09-14T11:17:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.325+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=DFUHH7VC1TZY tag=32T2N6YMPMKO type=write size=3924724 2024-09-14T11:17:49.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.325+0000 7f1be8076780 1 < canceled part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.0 size=1048576 2024-09-14T11:17:49.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.326+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.1 size=1048576 2024-09-14T11:17:49.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.327+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~B7LVTL24GRVQ.2 size=977398 2024-09-14T11:17:49.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.329+0000 7f1be8076780 1 < canceled multipart upload key=WQC5TVD66R0W upload=B7LVTL24GRVQ tag=F0DOW6T9UPKE type=write size=4123126 2024-09-14T11:17:49.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.331+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~WH2MNWG2PS4Z.0 size=758992 2024-09-14T11:17:49.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.331+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=WH2MNWG2PS4Z tag=ANECQH0SNNV6 type=write size=1807568 2024-09-14T11:17:49.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.332+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=4QQDSUSVKXRS type=del 2024-09-14T11:17:49.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.334+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=CSYTBN9YKJQ7 type=del size=1854790 2024-09-14T11:17:49.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.335+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~H3WKR392XCUT.0 size=684913 2024-09-14T11:17:49.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.337+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=H3WKR392XCUT tag=TJ4UO7195K2Z type=write size=1733489 2024-09-14T11:17:49.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.339+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.0 size=1048576 2024-09-14T11:17:49.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.340+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.1 size=1048576 2024-09-14T11:17:49.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.340+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.2 size=633909 2024-09-14T11:17:49.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.340+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=Y71JVJHODYSI tag=XDESABFP2LYO type=write size=3779637 2024-09-14T11:17:49.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.342+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.0 size=1048576 2024-09-14T11:17:49.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.343+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.1 size=1048576 2024-09-14T11:17:49.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.344+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~1WA8AP3ORC3G.2 size=106552 2024-09-14T11:17:49.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.345+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=1WA8AP3ORC3G tag=S9SCBMC503FB type=write size=3252280 2024-09-14T11:17:49.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.348+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.0 size=1048576 2024-09-14T11:17:49.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.348+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.1 size=1048576 2024-09-14T11:17:49.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.349+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.2 size=61722 2024-09-14T11:17:49.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.349+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=KFEUTC9KABCO tag=2227SVPJ6ANP type=write size=3207450 2024-09-14T11:17:49.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.351+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=GH0E33R5V8PU type=del 2024-09-14T11:17:49.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.352+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=LYFLR5MFPCMV type=del size=2046095 2024-09-14T11:17:49.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.353+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~3R5HHHR9QTLJ.0 size=827974 2024-09-14T11:17:49.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.355+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=3R5HHHR9QTLJ tag=P5ULFWNNYM1Y type=write size=1876550 2024-09-14T11:17:49.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.356+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=C1ZKRO0IMVL6 type=del size=1347359 2024-09-14T11:17:49.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.357+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.0 size=1048576 2024-09-14T11:17:49.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.358+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.1 size=1048576 2024-09-14T11:17:49.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.359+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~555WS013A1CM.2 size=219654 2024-09-14T11:17:49.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.361+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=555WS013A1CM tag=D7AKFMGC3M4H type=write size=3365382 2024-09-14T11:17:49.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.363+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=9M39L298W57S type=del size=2605439 2024-09-14T11:17:49.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.364+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.0 size=1048576 2024-09-14T11:17:49.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.365+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.1 size=1048576 2024-09-14T11:17:49.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.367+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~APK0SBN5SQQW.2 size=329768 2024-09-14T11:17:49.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.369+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=APK0SBN5SQQW tag=O15E28FNVQGF type=write size=3475496 2024-09-14T11:17:49.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.370+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=BT2H26YDXYQW type=del size=2851622 2024-09-14T11:17:49.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.371+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=3KWH89YJV9YS type=del 2024-09-14T11:17:49.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.372+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=3QDGIDB4B99E type=write size=405751 2024-09-14T11:17:49.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.373+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~BJCE54112ZWZ.0 size=542346 2024-09-14T11:17:49.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.375+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=BJCE54112ZWZ tag=ZM937AU711K1 type=write size=1590922 2024-09-14T11:17:49.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.376+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=JCISDWF1B929 type=del size=515125 2024-09-14T11:17:49.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.378+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=0C4MBDSDBGIU type=write size=994715 2024-09-14T11:17:49.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.379+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=QTVE6CALVE0S type=del size=705369 2024-09-14T11:17:49.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.381+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=JORD1NJGY8WA type=write size=572030 2024-09-14T11:17:49.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.382+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=ZB7OT05L9C4D type=del size=810641 2024-09-14T11:17:49.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.383+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=S7VD5CXLQ476 type=del 2024-09-14T11:17:49.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.385+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~NR9T1URCG4SN.0 size=848207 2024-09-14T11:17:49.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.385+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=NR9T1URCG4SN tag=9AYNN1B6LY7X type=write size=1896783 2024-09-14T11:17:49.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.386+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~YGSC5LYSOARW.0 size=240193 2024-09-14T11:17:49.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.388+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=YGSC5LYSOARW tag=QSKA7LFR58OA type=write size=1288769 2024-09-14T11:17:49.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.389+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=GP6SIS1523ZJ type=del size=3994906 2024-09-14T11:17:49.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.390+0000 7f1be8076780 1 < completed write operation key=9DRSDTGM7Y3F tag=O0E0RS8YL5QL type=write size=260484 2024-09-14T11:17:49.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.391+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=6KAWH3ZBSOC8 type=write size=682158 2024-09-14T11:17:49.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.393+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.0 size=1048576 2024-09-14T11:17:49.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.393+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.1 size=1048576 2024-09-14T11:17:49.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.393+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~DFUHH7VC1TZY.2 size=778996 2024-09-14T11:17:49.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.395+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=DFUHH7VC1TZY tag=32T2N6YMPMKO type=write size=3924724 2024-09-14T11:17:49.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.397+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~V3F8FYFPHV86.0 size=1048576 2024-09-14T11:17:49.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.398+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~V3F8FYFPHV86.1 size=857934 2024-09-14T11:17:49.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.398+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=V3F8FYFPHV86 tag=VHLIDMDVDPE2 type=write size=2955086 2024-09-14T11:17:49.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.399+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~WH2MNWG2PS4Z.0 size=758992 2024-09-14T11:17:49.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.401+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=WH2MNWG2PS4Z tag=ANECQH0SNNV6 type=write size=1807568 2024-09-14T11:17:49.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.403+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~QNOM8ZJK1AYU.0 size=1048576 2024-09-14T11:17:49.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.404+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~QNOM8ZJK1AYU.1 size=146124 2024-09-14T11:17:49.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.404+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=QNOM8ZJK1AYU tag=4P6Y0U3XIGW4 type=write size=2243276 2024-09-14T11:17:49.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.405+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=CSYTBN9YKJQ7 type=del 2024-09-14T11:17:49.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.407+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~W3MWNKNXXT9N.0 size=1048576 2024-09-14T11:17:49.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.408+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~W3MWNKNXXT9N.1 size=124484 2024-09-14T11:17:49.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.408+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=W3MWNKNXXT9N tag=2Y4ZIO41Y7TS type=write size=2221636 2024-09-14T11:17:49.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.409+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.0 size=1048576 2024-09-14T11:17:49.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.410+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.1 size=1048576 2024-09-14T11:17:49.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.411+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~Y71JVJHODYSI.2 size=633909 2024-09-14T11:17:49.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.412+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=Y71JVJHODYSI tag=XDESABFP2LYO type=write size=3779637 2024-09-14T11:17:49.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.414+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=1MK9M6UFLXR9 type=del size=1797560 2024-09-14T11:17:49.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.415+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.0 size=1048576 2024-09-14T11:17:49.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.416+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.1 size=1048576 2024-09-14T11:17:49.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.417+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~KFEUTC9KABCO.2 size=61722 2024-09-14T11:17:49.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.418+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=KFEUTC9KABCO tag=2227SVPJ6ANP type=write size=3207450 2024-09-14T11:17:49.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.419+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=LU40T2SDX3JH type=del size=1756231 2024-09-14T11:17:49.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.421+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=LYFLR5MFPCMV type=del 2024-09-14T11:17:49.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.422+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=KGS9ICWPE3XZ type=del size=2195956 2024-09-14T11:17:49.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.424+0000 7f1be8076780 1 < suggested remove operation key=LNMGQ54S2CXX tag=C1ZKRO0IMVL6 type=del 2024-09-14T11:17:49.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.425+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=PF4QJJXEY637 type=write size=840538 2024-09-14T11:17:49.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.426+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=9M39L298W57S type=del 2024-09-14T11:17:49.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.427+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=KIF79S0YWDC9 type=write size=975097 2024-09-14T11:17:49.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.428+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=BT2H26YDXYQW type=del 2024-09-14T11:17:49.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.430+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~7Z591YGZ58U8.0 size=1048576 2024-09-14T11:17:49.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.431+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~7Z591YGZ58U8.1 size=872516 2024-09-14T11:17:49.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.431+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=7Z591YGZ58U8 tag=INQOWTDAYM9C type=write size=2969668 2024-09-14T11:17:49.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.432+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=3QDGIDB4B99E type=write size=405751 2024-09-14T11:17:49.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.434+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=6R7KYBWGS6XL type=del size=470975 2024-09-14T11:17:49.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.435+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=JCISDWF1B929 type=del 2024-09-14T11:17:49.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.436+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=YEA4HJH9KT1E type=del size=3292325 2024-09-14T11:17:49.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.437+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=QTVE6CALVE0S type=del 2024-09-14T11:17:49.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.439+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.0 size=1048576 2024-09-14T11:17:49.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.440+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.1 size=1048576 2024-09-14T11:17:49.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.441+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.2 size=286501 2024-09-14T11:17:49.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.441+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=JULZ5J17P1NT tag=86MX4YU4AD6B type=write size=3432229 2024-09-14T11:17:49.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.442+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=ZB7OT05L9C4D type=del 2024-09-14T11:17:49.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.444+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=79XACZUZPBVH type=del size=1453065 2024-09-14T11:17:49.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.445+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~NR9T1URCG4SN.0 size=848207 2024-09-14T11:17:49.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.447+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=NR9T1URCG4SN tag=9AYNN1B6LY7X type=write size=1896783 2024-09-14T11:17:49.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.448+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=20CC00JP3M77 type=del size=1463047 2024-09-14T11:17:49.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.451+0000 7f1be8076780 1 < suggested update operation key=QC6MEJABT7IM tag=GP6SIS1523ZJ type=del size=3994906 2024-09-14T11:17:49.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.452+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=XNF4OUK96GRD type=write size=447361 2024-09-14T11:17:49.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.452+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=LNMGQ54S2CXX tag=6KAWH3ZBSOC8 type=write size=682158: (2) No such file or directory 2024-09-14T11:17:49.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.454+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~AIZYNTE3K84C.0 size=1048576 2024-09-14T11:17:49.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.455+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~AIZYNTE3K84C.1 size=167136 2024-09-14T11:17:49.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.455+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=AIZYNTE3K84C tag=XLQ3OLHF47KB type=write size=2264288 2024-09-14T11:17:49.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.456+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~V3F8FYFPHV86.0 size=1048576 2024-09-14T11:17:49.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.457+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~V3F8FYFPHV86.1 size=857934 2024-09-14T11:17:49.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.459+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=V3F8FYFPHV86 tag=VHLIDMDVDPE2 type=write size=2955086 2024-09-14T11:17:49.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.460+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=2O5ERV19U8AY type=write size=936238 2024-09-14T11:17:49.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.461+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~QNOM8ZJK1AYU.0 size=1048576 2024-09-14T11:17:49.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.462+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~QNOM8ZJK1AYU.1 size=146124 2024-09-14T11:17:49.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.464+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=QNOM8ZJK1AYU tag=4P6Y0U3XIGW4 type=write size=2243276 2024-09-14T11:17:49.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.465+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=RQKPWXK6STU4 type=write size=627401 2024-09-14T11:17:49.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.467+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~W3MWNKNXXT9N.0 size=1048576 2024-09-14T11:17:49.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.468+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~W3MWNKNXXT9N.1 size=124484 2024-09-14T11:17:49.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.470+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=W3MWNKNXXT9N tag=2Y4ZIO41Y7TS type=write size=2221636 2024-09-14T11:17:49.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.471+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=49O5RARZZTVL type=del size=3571770 2024-09-14T11:17:49.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.473+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=1MK9M6UFLXR9 type=del 2024-09-14T11:17:49.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.475+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=DP535UYMP6BD type=del size=4189189 2024-09-14T11:17:49.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.476+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=LU40T2SDX3JH type=del 2024-09-14T11:17:49.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.478+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.0 size=1048576 2024-09-14T11:17:49.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.479+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.1 size=1048576 2024-09-14T11:17:49.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.480+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.2 size=416775 2024-09-14T11:17:49.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.480+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=R0VUTLOXSLT3 tag=XX7PP5OSOGJB type=write size=3562503 2024-09-14T11:17:49.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.481+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=KGS9ICWPE3XZ type=del 2024-09-14T11:17:49.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.482+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=5EVSO1UWS6JX type=del size=1598104 2024-09-14T11:17:49.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.484+0000 7f1be8076780 1 < suggested remove operation key=RIYGSRWKVKFF tag=PF4QJJXEY637 type=write 2024-09-14T11:17:49.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.486+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.0 size=1048576 2024-09-14T11:17:49.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.487+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.1 size=1048576 2024-09-14T11:17:49.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.488+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.2 size=688039 2024-09-14T11:17:49.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.488+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=DUHT0NWUKT6U tag=B5X5PBMBXQT1 type=write size=3833767 2024-09-14T11:17:49.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.490+0000 7f1be8076780 1 < suggested remove operation key=XI178717NOE8 tag=KIF79S0YWDC9 type=write 2024-09-14T11:17:49.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.491+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=JOCGORL4DIW8 type=del size=814827 2024-09-14T11:17:49.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.492+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~7Z591YGZ58U8.0 size=1048576 2024-09-14T11:17:49.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.493+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~7Z591YGZ58U8.1 size=872516 2024-09-14T11:17:49.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.495+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=7Z591YGZ58U8 tag=INQOWTDAYM9C type=write size=2969668 2024-09-14T11:17:49.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.497+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~P30DMQ4KH382.0 size=199480 2024-09-14T11:17:49.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.497+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=P30DMQ4KH382 tag=SCMB8UBDQMLF type=write size=1248056 2024-09-14T11:17:49.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.499+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=6R7KYBWGS6XL type=del 2024-09-14T11:17:49.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.500+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=L1C610OST6O4 type=del size=2407986 2024-09-14T11:17:49.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.502+0000 7f1be8076780 1 < suggested update operation key=XB3M4CI0ERWP tag=YEA4HJH9KT1E type=del size=3292325 2024-09-14T11:17:49.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.504+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=EJYNHSHATKXF type=del size=3508416 2024-09-14T11:17:49.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.505+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.0 size=1048576 2024-09-14T11:17:49.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.506+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.1 size=1048576 2024-09-14T11:17:49.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.507+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~JULZ5J17P1NT.2 size=286501 2024-09-14T11:17:49.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.510+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=JULZ5J17P1NT tag=86MX4YU4AD6B type=write size=3432229 2024-09-14T11:17:49.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.511+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=BI3QWC8OX896 type=del size=295038 2024-09-14T11:17:49.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.512+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=79XACZUZPBVH type=del 2024-09-14T11:17:49.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.514+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~Z7DX9B2TSDVZ.0 size=502399 2024-09-14T11:17:49.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.514+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=Z7DX9B2TSDVZ tag=WEBWUR7Q36R7 type=write size=1550975 2024-09-14T11:17:49.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.516+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=20CC00JP3M77 type=del 2024-09-14T11:17:49.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.518+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~WVBIGH5TEGRE.0 size=451326 2024-09-14T11:17:49.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.518+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=WVBIGH5TEGRE tag=4EQPNQTLAT6C type=write size=1499902 2024-09-14T11:17:49.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.519+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=XNF4OUK96GRD type=write size=447361 2024-09-14T11:17:49.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.520+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=XUQX6HNBKO24 type=del size=2982518 2024-09-14T11:17:49.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.521+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~AIZYNTE3K84C.0 size=1048576 2024-09-14T11:17:49.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.522+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~AIZYNTE3K84C.1 size=167136 2024-09-14T11:17:49.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.524+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=AIZYNTE3K84C tag=XLQ3OLHF47KB type=write size=2264288 2024-09-14T11:17:49.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.525+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=VGCTJNYWZX14 type=del size=3396732 2024-09-14T11:17:49.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.526+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=2O5ERV19U8AY type=write size=936238 2024-09-14T11:17:49.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.528+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~YYOIA8KCAPLR.0 size=1048576 2024-09-14T11:17:49.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.529+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~YYOIA8KCAPLR.1 size=909521 2024-09-14T11:17:49.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.529+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=YYOIA8KCAPLR tag=S9NXSILHXDCQ type=write size=3006673 2024-09-14T11:17:49.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.530+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=RQKPWXK6STU4 type=write size=627401 2024-09-14T11:17:49.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.531+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=ZA00TL0J2DV2 type=del size=3249122 2024-09-14T11:17:49.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.534+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=49O5RARZZTVL type=del size=3571770 2024-09-14T11:17:49.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.536+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~KGJOK6V1HYK8.0 size=112460 2024-09-14T11:17:49.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.536+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=KGJOK6V1HYK8 tag=69W0DONDMAZE type=write size=1161036 2024-09-14T11:17:49.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.538+0000 7f1be8076780 1 < suggested remove operation key=XI178717NOE8 tag=DP535UYMP6BD type=del 2024-09-14T11:17:49.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.539+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=ULMXCL3GSUAT type=del size=309221 2024-09-14T11:17:49.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.541+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.0 size=1048576 2024-09-14T11:17:49.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.542+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.1 size=1048576 2024-09-14T11:17:49.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.542+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~R0VUTLOXSLT3.2 size=416775 2024-09-14T11:17:49.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.544+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=R0VUTLOXSLT3 tag=XX7PP5OSOGJB type=write size=3562503 2024-09-14T11:17:49.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.546+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=TJU7G3K2V2MQ type=del size=1085156 2024-09-14T11:17:49.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.547+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=5EVSO1UWS6JX type=del 2024-09-14T11:17:49.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.549+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~A87BQLET67DK.0 size=1048576 2024-09-14T11:17:49.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.550+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~A87BQLET67DK.1 size=14333 2024-09-14T11:17:49.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.550+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=A87BQLET67DK tag=64DJX42O63X8 type=write size=2111485 2024-09-14T11:17:49.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.552+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.0 size=1048576 2024-09-14T11:17:49.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.553+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.1 size=1048576 2024-09-14T11:17:49.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.553+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~DUHT0NWUKT6U.2 size=688039 2024-09-14T11:17:49.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.556+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=DUHT0NWUKT6U tag=B5X5PBMBXQT1 type=write size=3833767 2024-09-14T11:17:49.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.557+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=ZC7X4FVD2MNJ type=del size=2184824 2024-09-14T11:17:49.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.558+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=JOCGORL4DIW8 type=del 2024-09-14T11:17:49.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.559+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=08KQHEXHXFU6 type=del size=1200967 2024-09-14T11:17:49.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.561+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~P30DMQ4KH382.0 size=199480 2024-09-14T11:17:49.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.563+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=P30DMQ4KH382 tag=SCMB8UBDQMLF type=write size=1248056 2024-09-14T11:17:49.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.564+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=F92SKB1MVJZ9 type=write size=126986 2024-09-14T11:17:49.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.565+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=L1C610OST6O4 type=del 2024-09-14T11:17:49.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.567+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~Z6BSOK831VNY.0 size=560034 2024-09-14T11:17:49.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.567+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=Z6BSOK831VNY tag=VU5XPBVYNPMY type=write size=1608610 2024-09-14T11:17:49.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.570+0000 7f1be8076780 1 < suggested remove operation key=JCDSP32N5C7M tag=EJYNHSHATKXF type=del 2024-09-14T11:17:49.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.571+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=OV370YKZ6J6N type=write size=739221 2024-09-14T11:17:49.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.572+0000 7f1be8076780 -1 < failed to complete operation key=JCDSP32N5C7M tag=BI3QWC8OX896 type=del size=295038: (22) Invalid argument 2024-09-14T11:17:49.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.574+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=FLGKAXMP8TY3 type=del size=2510626 2024-09-14T11:17:49.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.575+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~Z7DX9B2TSDVZ.0 size=502399 2024-09-14T11:17:49.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.577+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=Z7DX9B2TSDVZ tag=WEBWUR7Q36R7 type=write size=1550975 2024-09-14T11:17:49.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.578+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=QRSYDPA1LFEF type=del size=2920163 2024-09-14T11:17:49.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.579+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~WVBIGH5TEGRE.0 size=451326 2024-09-14T11:17:49.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.581+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=WVBIGH5TEGRE tag=4EQPNQTLAT6C type=write size=1499902 2024-09-14T11:17:49.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.584+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.0 size=1048576 2024-09-14T11:17:49.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.586+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.1 size=1048576 2024-09-14T11:17:49.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.589+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.2 size=525556 2024-09-14T11:17:49.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.589+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=15EMGX2488YH tag=ZP4PR0H4NLO5 type=write size=3671284 2024-09-14T11:17:49.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.590+0000 7f1be8076780 -1 < failed to complete operation key=XI178717NOE8 tag=XUQX6HNBKO24 type=del size=2982518: (22) Invalid argument 2024-09-14T11:17:49.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.591+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=BCSRILELJK9G type=del size=3668007 2024-09-14T11:17:49.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.593+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=VGCTJNYWZX14 type=del 2024-09-14T11:17:49.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.595+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~CPCCSTO8CLVO.0 size=1048576 2024-09-14T11:17:49.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.596+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~CPCCSTO8CLVO.1 size=406377 2024-09-14T11:17:49.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.596+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=CPCCSTO8CLVO tag=44E1ORPJFJZV type=write size=2503529 2024-09-14T11:17:49.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.597+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~YYOIA8KCAPLR.0 size=1048576 2024-09-14T11:17:49.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.598+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~YYOIA8KCAPLR.1 size=909521 2024-09-14T11:17:49.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.600+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=YYOIA8KCAPLR tag=S9NXSILHXDCQ type=write size=3006673 2024-09-14T11:17:49.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.602+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=5CXKYLJA1WP5 type=del size=2302456 2024-09-14T11:17:49.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.604+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=ZA00TL0J2DV2 type=del size=3249122 2024-09-14T11:17:49.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.605+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=RY930PF47BLB type=write size=604866 2024-09-14T11:17:49.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.605+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~KGJOK6V1HYK8.0 size=112460 2024-09-14T11:17:49.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.607+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=KGJOK6V1HYK8 tag=69W0DONDMAZE type=write size=1161036 2024-09-14T11:17:49.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.610+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~1FTB06BUDT49.0 size=1048576 2024-09-14T11:17:49.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.611+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~1FTB06BUDT49.1 size=714426 2024-09-14T11:17:49.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.611+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=1FTB06BUDT49 tag=ROCMVV3XF0YK type=write size=2811578 2024-09-14T11:17:49.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.613+0000 7f1be8076780 1 < suggested remove operation key=RIYGSRWKVKFF tag=ULMXCL3GSUAT type=del 2024-09-14T11:17:49.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.615+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=P3KOZFVZJM6E type=del size=685946 2024-09-14T11:17:49.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.617+0000 7f1be8076780 1 < suggested remove operation key=SJES17ZIGRZE tag=TJU7G3K2V2MQ type=del 2024-09-14T11:17:49.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.618+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=MHEC9F7G5HSR type=del size=1999379 2024-09-14T11:17:49.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.618+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~A87BQLET67DK.0 size=1048576 2024-09-14T11:17:49.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.619+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~A87BQLET67DK.1 size=14333 2024-09-14T11:17:49.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.621+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=A87BQLET67DK tag=64DJX42O63X8 type=write size=2111485 2024-09-14T11:17:49.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.624+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.0 size=1048576 2024-09-14T11:17:49.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.625+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.1 size=1048576 2024-09-14T11:17:49.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.626+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.2 size=825854 2024-09-14T11:17:49.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.626+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=S4ICEOQ919SG tag=MC9SBVCQP2T0 type=write size=3971582 2024-09-14T11:17:49.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.627+0000 7f1be8076780 -1 < failed to complete operation key=JCDSP32N5C7M tag=ZC7X4FVD2MNJ type=del size=2184824: (22) Invalid argument 2024-09-14T11:17:49.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.630+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.0 size=1048576 2024-09-14T11:17:49.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.630+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.1 size=1048576 2024-09-14T11:17:49.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.631+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.2 size=774676 2024-09-14T11:17:49.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.631+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=43KEO0NMCDXB tag=KUZKIBTFOVFG type=write size=3920404 2024-09-14T11:17:49.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.633+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=08KQHEXHXFU6 type=del 2024-09-14T11:17:49.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.634+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=5J7WAD59EL8R type=del size=1227640 2024-09-14T11:17:49.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.635+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=F92SKB1MVJZ9 type=write size=126986 2024-09-14T11:17:49.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.637+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=U4LV2WXD6M0X type=del size=3712864 2024-09-14T11:17:49.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.638+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~Z6BSOK831VNY.0 size=560034 2024-09-14T11:17:49.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.640+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=Z6BSOK831VNY tag=VU5XPBVYNPMY type=write size=1608610 2024-09-14T11:17:49.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.641+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=9FW4JWN1POVK type=del size=2157184 2024-09-14T11:17:49.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.644+0000 7f1be8076780 1 < suggested update operation key=KQ479IOZ0108 tag=OV370YKZ6J6N type=write size=739221 2024-09-14T11:17:49.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.648+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~FSBP509PLI0H.0 size=1021678 2024-09-14T11:17:49.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.648+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=FSBP509PLI0H tag=86W7R64V2H7D type=write size=2070254 2024-09-14T11:17:49.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.649+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=FLGKAXMP8TY3 type=del 2024-09-14T11:17:49.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.650+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=7UL8JBFZ5I36 type=del size=3269979 2024-09-14T11:17:49.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.652+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=QRSYDPA1LFEF type=del 2024-09-14T11:17:49.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.653+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=4NXA48QROW33 type=del size=3630010 2024-09-14T11:17:49.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.654+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.0 size=1048576 2024-09-14T11:17:49.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.655+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.1 size=1048576 2024-09-14T11:17:49.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.656+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~15EMGX2488YH.2 size=525556 2024-09-14T11:17:49.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.659+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=15EMGX2488YH tag=ZP4PR0H4NLO5 type=write size=3671284 2024-09-14T11:17:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.661+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~5AIBGGQ1ONTX.0 size=659216 2024-09-14T11:17:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.661+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=5AIBGGQ1ONTX tag=O3N0THDJJD00 type=write size=1707792 2024-09-14T11:17:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.662+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=BCSRILELJK9G type=del 2024-09-14T11:17:49.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.664+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~GIRV9TRH5W31.0 size=363391 2024-09-14T11:17:49.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.664+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=GIRV9TRH5W31 tag=MH8KUH7VMC61 type=write size=1411967 2024-09-14T11:17:49.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.665+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~CPCCSTO8CLVO.0 size=1048576 2024-09-14T11:17:49.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.666+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~CPCCSTO8CLVO.1 size=406377 2024-09-14T11:17:49.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.668+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=CPCCSTO8CLVO tag=44E1ORPJFJZV type=write size=2503529 2024-09-14T11:17:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.671+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~N7K354YRANHA.0 size=636386 2024-09-14T11:17:49.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.671+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=N7K354YRANHA tag=P3BUXN3DU3HV type=write size=1684962 2024-09-14T11:17:49.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.672+0000 7f1be8076780 -1 < failed to complete operation key=QIEUKUQ8CS2U tag=5CXKYLJA1WP5 type=del size=2302456: (22) Invalid argument 2024-09-14T11:17:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.673+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=RWINTIHXLJDB type=del size=3605805 2024-09-14T11:17:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.675+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=RY930PF47BLB type=write size=604866 2024-09-14T11:17:49.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.676+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=TJAI40T21PIP type=del size=2119215 2024-09-14T11:17:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.677+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~1FTB06BUDT49.0 size=1048576 2024-09-14T11:17:49.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.678+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~1FTB06BUDT49.1 size=714426 2024-09-14T11:17:49.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.680+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=1FTB06BUDT49 tag=ROCMVV3XF0YK type=write size=2811578 2024-09-14T11:17:49.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.681+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=ELKYVOPQPZNB type=del size=1587042 2024-09-14T11:17:49.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.682+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=P3KOZFVZJM6E type=del size=685946 2024-09-14T11:17:49.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.683+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=QH30OVGM2QLE type=del size=3050881 2024-09-14T11:17:49.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.684+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=MHEC9F7G5HSR type=del 2024-09-14T11:17:49.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.685+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=QPO8KUP5D4T5 type=del size=1673509 2024-09-14T11:17:49.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.687+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.0 size=1048576 2024-09-14T11:17:49.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.688+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.1 size=1048576 2024-09-14T11:17:49.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.689+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~S4ICEOQ919SG.2 size=825854 2024-09-14T11:17:49.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.691+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=S4ICEOQ919SG tag=MC9SBVCQP2T0 type=write size=3971582 2024-09-14T11:17:49.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.693+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~NSJS2XTU1MXX.0 size=616352 2024-09-14T11:17:49.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.693+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=NSJS2XTU1MXX tag=84EGOZLRXTTC type=write size=1664928 2024-09-14T11:17:49.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.694+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.0 size=1048576 2024-09-14T11:17:49.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.695+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.1 size=1048576 2024-09-14T11:17:49.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.696+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~43KEO0NMCDXB.2 size=774676 2024-09-14T11:17:49.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.698+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=43KEO0NMCDXB tag=KUZKIBTFOVFG type=write size=3920404 2024-09-14T11:17:49.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.700+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=RBPVAH7LPB2L type=del size=3779872 2024-09-14T11:17:49.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.701+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=5J7WAD59EL8R type=del 2024-09-14T11:17:49.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.703+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.0 size=1048576 2024-09-14T11:17:49.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.706+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.1 size=1048576 2024-09-14T11:17:49.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.706+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.2 size=89647 2024-09-14T11:17:49.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.706+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=4G4T1R76CTWE tag=YHPN0TCFUBRD type=write size=3235375 2024-09-14T11:17:49.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.709+0000 7f1be8076780 1 < suggested update operation key=1X2EWK1Y2GE0 tag=U4LV2WXD6M0X type=del size=3712864 2024-09-14T11:17:49.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.710+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=WSQ7223ZXWBZ type=del size=2605222 2024-09-14T11:17:49.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.711+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=9FW4JWN1POVK type=del 2024-09-14T11:17:49.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.712+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=1WMTMEB138BC type=del size=153329 2024-09-14T11:17:49.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.714+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~FSBP509PLI0H.0 size=1021678 2024-09-14T11:17:49.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.716+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=FSBP509PLI0H tag=86W7R64V2H7D type=write size=2070254 2024-09-14T11:17:49.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.717+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=0UOIRROMP9EO type=del size=3937391 2024-09-14T11:17:49.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.718+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=7UL8JBFZ5I36 type=del 2024-09-14T11:17:49.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.720+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RJD242URHCOY.0 size=1048576 2024-09-14T11:17:49.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.721+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RJD242URHCOY.1 size=123682 2024-09-14T11:17:49.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.721+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=RJD242URHCOY tag=DXNCRCLZ72SD type=write size=2220834 2024-09-14T11:17:49.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.722+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=4NXA48QROW33 type=del 2024-09-14T11:17:49.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.723+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=CTSXHAAOGMU7 type=write size=583907 2024-09-14T11:17:49.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.724+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~5AIBGGQ1ONTX.0 size=659216 2024-09-14T11:17:49.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.726+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=5AIBGGQ1ONTX tag=O3N0THDJJD00 type=write size=1707792 2024-09-14T11:17:49.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.727+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=3533AO842FAK type=write size=902587 2024-09-14T11:17:49.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.729+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~GIRV9TRH5W31.0 size=363391 2024-09-14T11:17:49.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.732+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=GIRV9TRH5W31 tag=MH8KUH7VMC61 type=write size=1411967 2024-09-14T11:17:49.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.733+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=7U9HYJFJTPRU type=del size=3044417 2024-09-14T11:17:49.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.735+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~N7K354YRANHA.0 size=636386 2024-09-14T11:17:49.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.737+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=N7K354YRANHA tag=P3BUXN3DU3HV type=write size=1684962 2024-09-14T11:17:49.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.739+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~IT60NDPF3JQL.0 size=1048576 2024-09-14T11:17:49.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.739+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~IT60NDPF3JQL.1 size=635853 2024-09-14T11:17:49.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.739+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=IT60NDPF3JQL tag=64XNDC0SYJPO type=write size=2733005 2024-09-14T11:17:49.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.741+0000 7f1be8076780 1 < canceled operation key=SJES17ZIGRZE tag=RWINTIHXLJDB type=del size=3605805 2024-09-14T11:17:49.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.742+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=ZETTN6ZDPTXL type=del size=2537139 2024-09-14T11:17:49.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.743+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=TJAI40T21PIP type=del 2024-09-14T11:17:49.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.745+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9X95NUY2B8VJ.0 size=1048576 2024-09-14T11:17:49.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.746+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9X95NUY2B8VJ.1 size=863526 2024-09-14T11:17:49.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.746+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=9X95NUY2B8VJ tag=BUW1ES7IX9A1 type=write size=2960678 2024-09-14T11:17:49.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.747+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=ELKYVOPQPZNB type=del 2024-09-14T11:17:49.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.748+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=7K2S5IWZRT58 type=del size=2718929 2024-09-14T11:17:49.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.749+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=QH30OVGM2QLE type=del 2024-09-14T11:17:49.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.751+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=T3R4G7H0XI2L type=del size=828698 2024-09-14T11:17:49.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.753+0000 7f1be8076780 1 < suggested update operation key=9DRSDTGM7Y3F tag=QPO8KUP5D4T5 type=del size=1673509 2024-09-14T11:17:49.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.755+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~OTOJ6P1JEG0A.0 size=1048576 2024-09-14T11:17:49.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.756+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~OTOJ6P1JEG0A.1 size=18035 2024-09-14T11:17:49.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.756+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=OTOJ6P1JEG0A tag=COLC2L4EM9U1 type=write size=2115187 2024-09-14T11:17:49.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.757+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~NSJS2XTU1MXX.0 size=616352 2024-09-14T11:17:49.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.759+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=NSJS2XTU1MXX tag=84EGOZLRXTTC type=write size=1664928 2024-09-14T11:17:49.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.760+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=B2I2PQX5AB28 type=write size=910681 2024-09-14T11:17:49.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.761+0000 7f1be8076780 1 < canceled operation key=T70EFGHRQZQ7 tag=RBPVAH7LPB2L type=del size=3779872 2024-09-14T11:17:49.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.762+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=UV3PYJUPQU72 type=del size=4176148 2024-09-14T11:17:49.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.764+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.0 size=1048576 2024-09-14T11:17:49.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.765+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.1 size=1048576 2024-09-14T11:17:49.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.766+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~4G4T1R76CTWE.2 size=89647 2024-09-14T11:17:49.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.768+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=4G4T1R76CTWE tag=YHPN0TCFUBRD type=write size=3235375 2024-09-14T11:17:49.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.769+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=RV6LW8UV8PWZ type=del size=2829797 2024-09-14T11:17:49.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.772+0000 7f1be8076780 1 < suggested update operation key=3Z71PEWG5UMA tag=WSQ7223ZXWBZ type=del size=2605222 2024-09-14T11:17:49.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.774+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~N7PT24IFRE45.0 size=1048576 2024-09-14T11:17:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.775+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~N7PT24IFRE45.1 size=510597 2024-09-14T11:17:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.775+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=N7PT24IFRE45 tag=EBQD5IMZK5F2 type=write size=2607749 2024-09-14T11:17:49.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.777+0000 7f1be8076780 1 < suggested update operation key=SJES17ZIGRZE tag=1WMTMEB138BC type=del size=153329 2024-09-14T11:17:49.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.778+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=0FBOT90YJX6O type=write size=776333 2024-09-14T11:17:49.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.780+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=0UOIRROMP9EO type=del 2024-09-14T11:17:49.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.781+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=VGSEL7QBPLIH type=del size=1206588 2024-09-14T11:17:49.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.782+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RJD242URHCOY.0 size=1048576 2024-09-14T11:17:49.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.783+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RJD242URHCOY.1 size=123682 2024-09-14T11:17:49.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.785+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=RJD242URHCOY tag=DXNCRCLZ72SD type=write size=2220834 2024-09-14T11:17:49.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.786+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=3PU76JLZV471 type=del size=1692652 2024-09-14T11:17:49.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.788+0000 7f1be8076780 1 < completed write operation key=QC6MEJABT7IM tag=CTSXHAAOGMU7 type=write size=583907 2024-09-14T11:17:49.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.789+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=C0GDHS75BSAL type=write size=673445 2024-09-14T11:17:49.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.791+0000 7f1be8076780 1 < suggested remove operation key=JDKFKO39I56L tag=3533AO842FAK type=write 2024-09-14T11:17:49.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.792+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=SA8Z117SRAH4 type=del size=3307826 2024-09-14T11:17:49.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.794+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=7U9HYJFJTPRU type=del 2024-09-14T11:17:49.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.795+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=TWYISP3URQGU type=write size=292635 2024-09-14T11:17:49.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.796+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~IT60NDPF3JQL.0 size=1048576 2024-09-14T11:17:49.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.797+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~IT60NDPF3JQL.1 size=635853 2024-09-14T11:17:49.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.799+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=IT60NDPF3JQL tag=64XNDC0SYJPO type=write size=2733005 2024-09-14T11:17:49.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.800+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=LDZ7LYBAVU0A type=del size=8737 2024-09-14T11:17:49.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.801+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=ZETTN6ZDPTXL type=del 2024-09-14T11:17:49.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.802+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=Z0TQWLGHRY0K type=write size=1021478 2024-09-14T11:17:49.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.804+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9X95NUY2B8VJ.0 size=1048576 2024-09-14T11:17:49.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.805+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9X95NUY2B8VJ.1 size=863526 2024-09-14T11:17:49.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.806+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=9X95NUY2B8VJ tag=BUW1ES7IX9A1 type=write size=2960678 2024-09-14T11:17:49.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.808+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=E9STUU1C0ZEJ type=del size=4077676 2024-09-14T11:17:49.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.809+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=7K2S5IWZRT58 type=del 2024-09-14T11:17:49.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.811+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.0 size=1048576 2024-09-14T11:17:49.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.812+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.1 size=1048576 2024-09-14T11:17:49.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.812+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.2 size=821468 2024-09-14T11:17:49.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.812+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=UYTKYXJKVC06 tag=C4YIIJA023D3 type=write size=3967196 2024-09-14T11:17:49.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.814+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=T3R4G7H0XI2L type=del 2024-09-14T11:17:49.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.815+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=17GC7X5S6HT1 type=del size=543610 2024-09-14T11:17:49.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.815+0000 7f1be8076780 1 < canceled part key=_multipart_CQDRZMJAJ7FZ.2~OTOJ6P1JEG0A.0 size=1048576 2024-09-14T11:17:49.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.816+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~OTOJ6P1JEG0A.1 size=18035 2024-09-14T11:17:49.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.819+0000 7f1be8076780 1 < canceled multipart upload key=CQDRZMJAJ7FZ upload=OTOJ6P1JEG0A tag=COLC2L4EM9U1 type=write size=2115187 2024-09-14T11:17:49.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.822+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=GKOA0FYX2VC1 type=del size=1879929 2024-09-14T11:17:49.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.823+0000 7f1be8076780 1 < completed write operation key=QC6MEJABT7IM tag=B2I2PQX5AB28 type=write size=910681 2024-09-14T11:17:49.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.825+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.0 size=1048576 2024-09-14T11:17:49.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.826+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.1 size=1048576 2024-09-14T11:17:49.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.827+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.2 size=7140 2024-09-14T11:17:49.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.827+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=31MST8IT6PJ4 tag=AIGAPUZGSMRH type=write size=3152868 2024-09-14T11:17:49.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.829+0000 7f1be8076780 1 < suggested update operation key=JGEBWM9VRCFW tag=UV3PYJUPQU72 type=del size=4176148 2024-09-14T11:17:49.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.830+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=MIY3R25L2AFL type=del size=547666 2024-09-14T11:17:49.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.832+0000 7f1be8076780 1 < suggested remove operation key=JIWPGHQ3GEZB tag=RV6LW8UV8PWZ type=del 2024-09-14T11:17:49.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.833+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=0A9HWMZUOHJ8 type=write size=793392 2024-09-14T11:17:49.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.835+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~N7PT24IFRE45.0 size=1048576 2024-09-14T11:17:49.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.835+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~N7PT24IFRE45.1 size=510597 2024-09-14T11:17:49.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.837+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=N7PT24IFRE45 tag=EBQD5IMZK5F2 type=write size=2607749 2024-09-14T11:17:49.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.838+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=2Z4NKVVWAC2J type=del size=1609992 2024-09-14T11:17:49.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.839+0000 7f1be8076780 1 < completed write operation key=CQDRZMJAJ7FZ tag=0FBOT90YJX6O type=write size=776333 2024-09-14T11:17:49.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.840+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=RSYTN3K7R9QL type=del size=1696977 2024-09-14T11:17:49.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.842+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=VGSEL7QBPLIH type=del 2024-09-14T11:17:49.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.843+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=7YULO13VRP4V type=del size=2457858 2024-09-14T11:17:49.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.844+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=3PU76JLZV471 type=del 2024-09-14T11:17:49.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.846+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.0 size=1048576 2024-09-14T11:17:49.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.847+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.1 size=1048576 2024-09-14T11:17:49.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.848+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.2 size=781801 2024-09-14T11:17:49.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.848+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=GLNBI7Y62YF8 tag=VQQNT9WIOVFX type=write size=3927529 2024-09-14T11:17:49.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.850+0000 7f1be8076780 1 < suggested remove operation key=3Z71PEWG5UMA tag=C0GDHS75BSAL type=write 2024-09-14T11:17:49.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.851+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=4OPPK0SC6E3U type=del size=1709497 2024-09-14T11:17:49.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.852+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=SA8Z117SRAH4 type=del 2024-09-14T11:17:49.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.853+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=UHEX1QFZHVPB type=del size=1862094 2024-09-14T11:17:49.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.855+0000 7f1be8076780 -1 < failed to complete operation key=3Z71PEWG5UMA tag=TWYISP3URQGU type=write size=292635: (22) Invalid argument 2024-09-14T11:17:49.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.857+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~8LLJRRCVW6CZ.0 size=1048576 2024-09-14T11:17:49.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.858+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~8LLJRRCVW6CZ.1 size=44635 2024-09-14T11:17:49.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.858+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=8LLJRRCVW6CZ tag=8JP22ZNHOETW type=write size=2141787 2024-09-14T11:17:49.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.859+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=LDZ7LYBAVU0A type=del 2024-09-14T11:17:49.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.860+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=C9OYN0HJT3YP type=del size=87502 2024-09-14T11:17:49.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.861+0000 7f1be8076780 1 < completed write operation key=3YIK6B6Y2EU1 tag=Z0TQWLGHRY0K type=write size=1021478 2024-09-14T11:17:49.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.863+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=HVJ9XEHNRYOU type=del size=1119806 2024-09-14T11:17:49.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.864+0000 7f1be8076780 -1 < failed to complete operation key=3Z71PEWG5UMA tag=E9STUU1C0ZEJ type=del size=4077676: (22) Invalid argument 2024-09-14T11:17:49.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.866+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~LS7URSN9OBHY.0 size=1048576 2024-09-14T11:17:49.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.867+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~LS7URSN9OBHY.1 size=979381 2024-09-14T11:17:49.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.867+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=LS7URSN9OBHY tag=0D968G572Y6U type=write size=3076533 2024-09-14T11:17:49.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.868+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.0 size=1048576 2024-09-14T11:17:49.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.869+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.1 size=1048576 2024-09-14T11:17:49.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.870+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~UYTKYXJKVC06.2 size=821468 2024-09-14T11:17:49.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.872+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=UYTKYXJKVC06 tag=C4YIIJA023D3 type=write size=3967196 2024-09-14T11:17:49.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.873+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=VUQR7B78OURW type=del size=1871166 2024-09-14T11:17:49.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.874+0000 7f1be8076780 -1 < failed to complete operation key=JGEBWM9VRCFW tag=17GC7X5S6HT1 type=del size=543610: (22) Invalid argument 2024-09-14T11:17:49.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.875+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=LSG2WZLG5QXW type=write size=165219 2024-09-14T11:17:49.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.876+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=GKOA0FYX2VC1 type=del 2024-09-14T11:17:49.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.878+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=WB0GLQK18HWI type=del size=8788 2024-09-14T11:17:49.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.879+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.0 size=1048576 2024-09-14T11:17:49.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.880+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.1 size=1048576 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.881+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~31MST8IT6PJ4.2 size=7140 2024-09-14T11:17:49.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.882+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=31MST8IT6PJ4 tag=AIGAPUZGSMRH type=write size=3152868 2024-09-14T11:17:49.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.884+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=G1G03MJYE3WN type=del size=3531492 2024-09-14T11:17:49.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.885+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=MIY3R25L2AFL type=del 2024-09-14T11:17:49.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.887+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.0 size=1048576 2024-09-14T11:17:49.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.888+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.1 size=1048576 2024-09-14T11:17:49.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.889+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.2 size=406201 2024-09-14T11:17:49.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.889+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=1BBMERM9KON1 tag=OJ4NX195RD7A type=write size=3551929 2024-09-14T11:17:49.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.891+0000 7f1be8076780 1 < suggested update operation key=WQC5TVD66R0W tag=0A9HWMZUOHJ8 type=write size=793392 2024-09-14T11:17:49.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.892+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=OUP0RQL73FJ3 type=del size=1111875 2024-09-14T11:17:49.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.893+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=2Z4NKVVWAC2J type=del 2024-09-14T11:17:49.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.895+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~88S52I4X401P.0 size=232667 2024-09-14T11:17:49.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.895+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=88S52I4X401P tag=RJ8H8OZ5P93P type=write size=1281243 2024-09-14T11:17:49.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.896+0000 7f1be8076780 1 < canceled operation key=JQZ7C562TQ8D tag=RSYTN3K7R9QL type=del size=1696977 2024-09-14T11:17:49.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.897+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=KPZPIS4433NF type=write size=641614 2024-09-14T11:17:49.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.898+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=7YULO13VRP4V type=del 2024-09-14T11:17:49.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.901+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~VZ3YZTMUEVPQ.0 size=109024 2024-09-14T11:17:49.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.901+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=VZ3YZTMUEVPQ tag=C537SQO1BT3T type=write size=1157600 2024-09-14T11:17:49.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.902+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.0 size=1048576 2024-09-14T11:17:49.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.902+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.1 size=1048576 2024-09-14T11:17:49.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.903+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~GLNBI7Y62YF8.2 size=781801 2024-09-14T11:17:49.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.905+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=GLNBI7Y62YF8 tag=VQQNT9WIOVFX type=write size=3927529 2024-09-14T11:17:49.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.907+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~RS5X5R3RM0HG.0 size=1048576 2024-09-14T11:17:49.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.908+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~RS5X5R3RM0HG.1 size=688734 2024-09-14T11:17:49.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.908+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=RS5X5R3RM0HG tag=8ZJCDBZVQ58Y type=write size=2785886 2024-09-14T11:17:49.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.909+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=4OPPK0SC6E3U type=del 2024-09-14T11:17:49.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.912+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~HQBPQKO7NKNS.0 size=1048576 2024-09-14T11:17:49.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.913+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~HQBPQKO7NKNS.1 size=946548 2024-09-14T11:17:49.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.913+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=HQBPQKO7NKNS tag=JVB5KH7W22MA type=write size=3043700 2024-09-14T11:17:49.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.914+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=UHEX1QFZHVPB type=del 2024-09-14T11:17:49.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.915+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=K0KKGPGWJYRE type=del size=1274549 2024-09-14T11:17:49.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.917+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~8LLJRRCVW6CZ.0 size=1048576 2024-09-14T11:17:49.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.918+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~8LLJRRCVW6CZ.1 size=44635 2024-09-14T11:17:49.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.920+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=8LLJRRCVW6CZ tag=8JP22ZNHOETW type=write size=2141787 2024-09-14T11:17:49.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.922+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~YK5BCDR7Q356.0 size=132183 2024-09-14T11:17:49.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.922+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=YK5BCDR7Q356 tag=VHXK4H5HLGHQ type=write size=1180759 2024-09-14T11:17:49.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.924+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=C9OYN0HJT3YP type=del size=87502 2024-09-14T11:17:49.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.926+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.0 size=1048576 2024-09-14T11:17:49.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.927+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.1 size=1048576 2024-09-14T11:17:49.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.929+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.2 size=740908 2024-09-14T11:17:49.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.929+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=FWW1G78KATDC tag=NOBFXGCB4QE3 type=write size=3886636 2024-09-14T11:17:49.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.930+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=HVJ9XEHNRYOU type=del 2024-09-14T11:17:49.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.932+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=OS5ZO03CURUZ type=del size=3068525 2024-09-14T11:17:49.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.933+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~LS7URSN9OBHY.0 size=1048576 2024-09-14T11:17:49.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.934+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~LS7URSN9OBHY.1 size=979381 2024-09-14T11:17:49.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.936+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=LS7URSN9OBHY tag=0D968G572Y6U type=write size=3076533 2024-09-14T11:17:49.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.938+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.0 size=1048576 2024-09-14T11:17:49.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.939+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.1 size=1048576 2024-09-14T11:17:49.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.940+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.2 size=538366 2024-09-14T11:17:49.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.940+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=BZZ2VCYZ8QB4 tag=AWA30V64728S type=write size=3684094 2024-09-14T11:17:49.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.941+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=VUQR7B78OURW type=del 2024-09-14T11:17:49.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.942+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=XQARW0XP69ZI type=del size=3461432 2024-09-14T11:17:49.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.944+0000 7f1be8076780 1 < suggested remove operation key=QC6MEJABT7IM tag=LSG2WZLG5QXW type=write 2024-09-14T11:17:49.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.946+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~GAVDYRGN4CYV.0 size=1048576 2024-09-14T11:17:49.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.947+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~GAVDYRGN4CYV.1 size=496336 2024-09-14T11:17:49.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.947+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=GAVDYRGN4CYV tag=QQYLLKIOP2AW type=write size=2593488 2024-09-14T11:17:49.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.948+0000 7f1be8076780 1 < canceled operation key=AUCQC0OBQP7Z tag=WB0GLQK18HWI type=del size=8788 2024-09-14T11:17:49.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.950+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~72IZPZRNAQ9K.0 size=579013 2024-09-14T11:17:49.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.950+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=72IZPZRNAQ9K tag=PFLE9R0JYAEX type=write size=1627589 2024-09-14T11:17:49.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.952+0000 7f1be8076780 1 < suggested update operation key=3Z71PEWG5UMA tag=G1G03MJYE3WN type=del size=3531492 2024-09-14T11:17:49.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.955+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~0SAAO5095AEH.0 size=1048576 2024-09-14T11:17:49.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.955+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~0SAAO5095AEH.1 size=864417 2024-09-14T11:17:49.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.955+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=0SAAO5095AEH tag=RNB0L51XIW9H type=write size=2961569 2024-09-14T11:17:49.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.957+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.0 size=1048576 2024-09-14T11:17:49.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.958+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.1 size=1048576 2024-09-14T11:17:49.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.959+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~1BBMERM9KON1.2 size=406201 2024-09-14T11:17:49.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.960+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=1BBMERM9KON1 tag=OJ4NX195RD7A type=write size=3551929 2024-09-14T11:17:49.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.962+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~5OYJJH8JEIJ0.0 size=912165 2024-09-14T11:17:49.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.962+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=5OYJJH8JEIJ0 tag=ABLC9WQQY9CK type=write size=1960741 2024-09-14T11:17:49.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.964+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=OUP0RQL73FJ3 type=del 2024-09-14T11:17:49.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.967+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~88YU101OGONP.0 size=1048576 2024-09-14T11:17:49.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.968+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~88YU101OGONP.1 size=972054 2024-09-14T11:17:49.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.968+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=88YU101OGONP tag=F81O8IN002E6 type=write size=3069206 2024-09-14T11:17:49.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.969+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~88S52I4X401P.0 size=232667 2024-09-14T11:17:49.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.971+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=88S52I4X401P tag=RJ8H8OZ5P93P type=write size=1281243 2024-09-14T11:17:49.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.973+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=YDKDQFTI4MCP type=del size=3604062 2024-09-14T11:17:49.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.974+0000 7f1be8076780 -1 < failed to complete operation key=3Z71PEWG5UMA tag=KPZPIS4433NF type=write size=641614: (22) Invalid argument 2024-09-14T11:17:49.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.976+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~EUTAGNBHBPH0.0 size=18048 2024-09-14T11:17:49.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.976+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=EUTAGNBHBPH0 tag=INXJ409HEFL0 type=write size=1066624 2024-09-14T11:17:49.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.978+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~VZ3YZTMUEVPQ.0 size=109024 2024-09-14T11:17:49.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.979+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=VZ3YZTMUEVPQ tag=C537SQO1BT3T type=write size=1157600 2024-09-14T11:17:49.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.981+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=EZIADR3S8MXJ type=del size=859974 2024-09-14T11:17:49.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.982+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~RS5X5R3RM0HG.0 size=1048576 2024-09-14T11:17:49.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.983+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~RS5X5R3RM0HG.1 size=688734 2024-09-14T11:17:49.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.985+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=RS5X5R3RM0HG tag=8ZJCDBZVQ58Y type=write size=2785886 2024-09-14T11:17:49.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.986+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=VGV9GX9ISZUK type=del size=2363832 2024-09-14T11:17:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.987+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~HQBPQKO7NKNS.0 size=1048576 2024-09-14T11:17:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.988+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~HQBPQKO7NKNS.1 size=946548 2024-09-14T11:17:49.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.990+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=HQBPQKO7NKNS tag=JVB5KH7W22MA type=write size=3043700 2024-09-14T11:17:49.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.991+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=NFJPZTGCMKVG type=del size=848952 2024-09-14T11:17:49.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.993+0000 7f1be8076780 1 < suggested update operation key=JGEBWM9VRCFW tag=K0KKGPGWJYRE type=del size=1274549 2024-09-14T11:17:49.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.995+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=GLDCK2GQVCYJ type=write size=225245 2024-09-14T11:17:49.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.996+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~YK5BCDR7Q356.0 size=132183 2024-09-14T11:17:49.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.998+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=YK5BCDR7Q356 tag=VHXK4H5HLGHQ type=write size=1180759 2024-09-14T11:17:49.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:49.999+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=HQQPTC4WUV4A type=del size=1436074 2024-09-14T11:17:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.000+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.0 size=1048576 2024-09-14T11:17:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.000+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.1 size=1048576 2024-09-14T11:17:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.001+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~FWW1G78KATDC.2 size=740908 2024-09-14T11:17:50.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.004+0000 7f1be8076780 1 < canceled multipart upload key=MX5J0P18BM0D upload=FWW1G78KATDC tag=NOBFXGCB4QE3 type=write size=3886636 2024-09-14T11:17:50.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.005+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=4Q9HH236RYML type=del size=3518482 2024-09-14T11:17:50.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.006+0000 7f1be8076780 -1 < failed to complete operation key=JGEBWM9VRCFW tag=OS5ZO03CURUZ type=del size=3068525: (22) Invalid argument 2024-09-14T11:17:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.007+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=II0Y4GXF452J type=del size=1494418 2024-09-14T11:17:50.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.009+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.0 size=1048576 2024-09-14T11:17:50.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.010+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.1 size=1048576 2024-09-14T11:17:50.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.010+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~BZZ2VCYZ8QB4.2 size=538366 2024-09-14T11:17:50.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.012+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=BZZ2VCYZ8QB4 tag=AWA30V64728S type=write size=3684094 2024-09-14T11:17:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.013+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=LAK87DJUUDXL type=del size=3264454 2024-09-14T11:17:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.014+0000 7f1be8076780 -1 < failed to complete operation key=JGEBWM9VRCFW tag=XQARW0XP69ZI type=del size=3461432: (22) Invalid argument 2024-09-14T11:17:50.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.016+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=A42YIXSTQ3V5 type=del size=3122033 2024-09-14T11:17:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.017+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~GAVDYRGN4CYV.0 size=1048576 2024-09-14T11:17:50.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.018+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~GAVDYRGN4CYV.1 size=496336 2024-09-14T11:17:50.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.020+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=GAVDYRGN4CYV tag=QQYLLKIOP2AW type=write size=2593488 2024-09-14T11:17:50.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.022+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.0 size=1048576 2024-09-14T11:17:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.023+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.1 size=1048576 2024-09-14T11:17:50.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.024+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.2 size=1046915 2024-09-14T11:17:50.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.024+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=VAS6O7B9F7Q3 tag=1TSYUGWJZNC0 type=write size=4192643 2024-09-14T11:17:50.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.025+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~72IZPZRNAQ9K.0 size=579013 2024-09-14T11:17:50.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.027+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=72IZPZRNAQ9K tag=PFLE9R0JYAEX type=write size=1627589 2024-09-14T11:17:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.029+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=A3KOLKOEMVPM type=del size=1327213 2024-09-14T11:17:50.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.030+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~0SAAO5095AEH.0 size=1048576 2024-09-14T11:17:50.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.031+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~0SAAO5095AEH.1 size=864417 2024-09-14T11:17:50.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.033+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=0SAAO5095AEH tag=RNB0L51XIW9H type=write size=2961569 2024-09-14T11:17:50.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.034+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=WBBXTV8JNCKV type=write size=634245 2024-09-14T11:17:50.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.035+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~5OYJJH8JEIJ0.0 size=912165 2024-09-14T11:17:50.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.037+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=5OYJJH8JEIJ0 tag=ABLC9WQQY9CK type=write size=1960741 2024-09-14T11:17:50.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.038+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=3KGRRWW9UTVF type=del size=3163019 2024-09-14T11:17:50.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.041+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~88YU101OGONP.0 size=1048576 2024-09-14T11:17:50.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.042+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~88YU101OGONP.1 size=972054 2024-09-14T11:17:50.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.043+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=88YU101OGONP tag=F81O8IN002E6 type=write size=3069206 2024-09-14T11:17:50.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.045+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~LV9PU7RWX98S.0 size=465464 2024-09-14T11:17:50.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.045+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=LV9PU7RWX98S tag=9CBDSV6QQ24A type=write size=1514040 2024-09-14T11:17:50.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.047+0000 7f1be8076780 1 < canceled operation key=AUCQC0OBQP7Z tag=YDKDQFTI4MCP type=del size=3604062 2024-09-14T11:17:50.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.048+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=MYCR2YUQQCYN type=del size=2218462 2024-09-14T11:17:50.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.049+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~EUTAGNBHBPH0.0 size=18048 2024-09-14T11:17:50.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.051+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=EUTAGNBHBPH0 tag=INXJ409HEFL0 type=write size=1066624 2024-09-14T11:17:50.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.053+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~U3UAJP4COIOB.0 size=113375 2024-09-14T11:17:50.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.053+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=U3UAJP4COIOB tag=DFR2CNEDMW8V type=write size=1161951 2024-09-14T11:17:50.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.054+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=EZIADR3S8MXJ type=del 2024-09-14T11:17:50.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.055+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=40U55AWZPMVT type=write size=490427 2024-09-14T11:17:50.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.056+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=VGV9GX9ISZUK type=del 2024-09-14T11:17:50.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.057+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=9P1YOA1TZ22X type=del size=3749721 2024-09-14T11:17:50.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.059+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=NFJPZTGCMKVG type=del size=848952 2024-09-14T11:17:50.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.060+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=LIYV54YFJXY6 type=del size=3917109 2024-09-14T11:17:50.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.061+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=GLDCK2GQVCYJ type=write size=225245 2024-09-14T11:17:50.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.062+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=35E05L2Q8JPL type=del size=4188108 2024-09-14T11:17:50.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.063+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=HQQPTC4WUV4A type=del 2024-09-14T11:17:50.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.066+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~EPWYQ1N1RTOA.0 size=1048576 2024-09-14T11:17:50.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.066+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~EPWYQ1N1RTOA.1 size=949320 2024-09-14T11:17:50.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.066+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=EPWYQ1N1RTOA tag=4OY8C26TAHIW type=write size=3046472 2024-09-14T11:17:50.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.067+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=4Q9HH236RYML type=del 2024-09-14T11:17:50.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.070+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.0 size=1048576 2024-09-14T11:17:50.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.070+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.1 size=1048576 2024-09-14T11:17:50.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.071+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.2 size=946347 2024-09-14T11:17:50.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.071+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=1IRZJFEON95U tag=HRQ42GKEERN7 type=write size=4092075 2024-09-14T11:17:50.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.073+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=II0Y4GXF452J type=del 2024-09-14T11:17:50.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.074+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=R74F9BQ33TCR type=del size=3621989 2024-09-14T11:17:50.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.075+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=LAK87DJUUDXL type=del 2024-09-14T11:17:50.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.076+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=FCKOV121BI2C type=write size=272607 2024-09-14T11:17:50.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.078+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=A42YIXSTQ3V5 type=del 2024-09-14T11:17:50.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.080+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=R0G945BOJRRU type=del size=4048345 2024-09-14T11:17:50.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.081+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.0 size=1048576 2024-09-14T11:17:50.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.082+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.1 size=1048576 2024-09-14T11:17:50.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.083+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~VAS6O7B9F7Q3.2 size=1046915 2024-09-14T11:17:50.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.084+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=VAS6O7B9F7Q3 tag=1TSYUGWJZNC0 type=write size=4192643 2024-09-14T11:17:50.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.086+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~G31DQQTHVW4K.0 size=402717 2024-09-14T11:17:50.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.086+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=G31DQQTHVW4K tag=8TOJK22HK3S3 type=write size=1451293 2024-09-14T11:17:50.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.090+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=A3KOLKOEMVPM type=del size=1327213 2024-09-14T11:17:50.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.092+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=3ZO8MDKMNVFI type=write size=344258 2024-09-14T11:17:50.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.093+0000 7f1be8076780 1 < completed write operation key=3Z71PEWG5UMA tag=WBBXTV8JNCKV type=write size=634245 2024-09-14T11:17:50.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.095+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~J3T51AGS3IFK.0 size=1048576 2024-09-14T11:17:50.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.096+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~J3T51AGS3IFK.1 size=479738 2024-09-14T11:17:50.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.096+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=J3T51AGS3IFK tag=31NLO4T8KANE type=write size=2576890 2024-09-14T11:17:50.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.097+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=3KGRRWW9UTVF type=del 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.098+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=0TNPKPGE52HQ type=del size=2812872 2024-09-14T11:17:50.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.099+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~LV9PU7RWX98S.0 size=465464 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.101+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=LV9PU7RWX98S tag=9CBDSV6QQ24A type=write size=1514040 2024-09-14T11:17:50.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.102+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=MQVU534X9V3M type=del size=2711416 2024-09-14T11:17:50.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.103+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=MYCR2YUQQCYN type=del 2024-09-14T11:17:50.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.104+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=O0RW9SS9NI09 type=del size=517121 2024-09-14T11:17:50.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.105+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~U3UAJP4COIOB.0 size=113375 2024-09-14T11:17:50.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.107+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=U3UAJP4COIOB tag=DFR2CNEDMW8V type=write size=1161951 2024-09-14T11:17:50.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.108+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=HNIUCKP9HXDQ type=del size=417976 2024-09-14T11:17:50.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.110+0000 7f1be8076780 1 < completed write operation key=MVUN63538RAB tag=40U55AWZPMVT type=write size=490427 2024-09-14T11:17:50.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.111+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=C1342P7R90GB type=del size=3130033 2024-09-14T11:17:50.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.112+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=9P1YOA1TZ22X type=del 2024-09-14T11:17:50.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.114+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.0 size=1048576 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.115+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.1 size=1048576 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.116+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.2 size=976653 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.116+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=JCF10OEQ742B tag=48732RIUN1ZD type=write size=4122381 2024-09-14T11:17:50.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.117+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=LIYV54YFJXY6 type=del 2024-09-14T11:17:50.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.118+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=TF9T5MJ96O2Y type=del size=641744 2024-09-14T11:17:50.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.120+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=35E05L2Q8JPL type=del 2024-09-14T11:17:50.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.121+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=XC954E6EN39B type=del size=1600773 2024-09-14T11:17:50.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.122+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~EPWYQ1N1RTOA.0 size=1048576 2024-09-14T11:17:50.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.123+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~EPWYQ1N1RTOA.1 size=949320 2024-09-14T11:17:50.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.125+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=EPWYQ1N1RTOA tag=4OY8C26TAHIW type=write size=3046472 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.126+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=6BGX9LVWELSU type=write size=435083 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.127+0000 7f1be8076780 1 < canceled part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.0 size=1048576 2024-09-14T11:17:50.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.128+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.1 size=1048576 2024-09-14T11:17:50.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.129+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~1IRZJFEON95U.2 size=946347 2024-09-14T11:17:50.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.130+0000 7f1be8076780 1 < canceled multipart upload key=CQDRZMJAJ7FZ upload=1IRZJFEON95U tag=HRQ42GKEERN7 type=write size=4092075 2024-09-14T11:17:50.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.132+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=R377WU3V1K37 type=del size=836602 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.133+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=R74F9BQ33TCR type=del 2024-09-14T11:17:50.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.135+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.0 size=1048576 2024-09-14T11:17:50.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.136+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.1 size=1048576 2024-09-14T11:17:50.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.137+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.2 size=911879 2024-09-14T11:17:50.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.137+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=W8OGFIC2ZO7U tag=0RDR517DO75K type=write size=4057607 2024-09-14T11:17:50.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.138+0000 7f1be8076780 1 < completed write operation key=4ADXXTIO715C tag=FCKOV121BI2C type=write size=272607 2024-09-14T11:17:50.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.140+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~3HNJMW9CEIT3.0 size=1048576 2024-09-14T11:17:50.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.141+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~3HNJMW9CEIT3.1 size=395071 2024-09-14T11:17:50.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.141+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=3HNJMW9CEIT3 tag=TH017Z5UGK34 type=write size=2492223 2024-09-14T11:17:50.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.143+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=R0G945BOJRRU type=del size=4048345 2024-09-14T11:17:50.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.145+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~BN1X8M3R3WER.0 size=1048576 2024-09-14T11:17:50.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.146+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~BN1X8M3R3WER.1 size=134623 2024-09-14T11:17:50.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.146+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=BN1X8M3R3WER tag=21LE7242RZ0X type=write size=2231775 2024-09-14T11:17:50.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.147+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~G31DQQTHVW4K.0 size=402717 2024-09-14T11:17:50.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.150+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=G31DQQTHVW4K tag=8TOJK22HK3S3 type=write size=1451293 2024-09-14T11:17:50.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.152+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.0 size=1048576 2024-09-14T11:17:50.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.153+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.1 size=1048576 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.154+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.2 size=215584 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.154+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=WHEBCN0DQJIW tag=A1G3SKPO1LYW type=write size=3361312 2024-09-14T11:17:50.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.155+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=3ZO8MDKMNVFI type=write size=344258 2024-09-14T11:17:50.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.156+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=VVKODNW2DNMS type=del size=3913421 2024-09-14T11:17:50.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.157+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~J3T51AGS3IFK.0 size=1048576 2024-09-14T11:17:50.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.158+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~J3T51AGS3IFK.1 size=479738 2024-09-14T11:17:50.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.160+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=J3T51AGS3IFK tag=31NLO4T8KANE type=write size=2576890 2024-09-14T11:17:50.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.161+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=LX16DZI4YNKU type=del size=4064543 2024-09-14T11:17:50.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.163+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=0TNPKPGE52HQ type=del 2024-09-14T11:17:50.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.166+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.0 size=1048576 2024-09-14T11:17:50.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.167+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.1 size=1048576 2024-09-14T11:17:50.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.167+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.2 size=231520 2024-09-14T11:17:50.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.168+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=LO9WMV2NESVA tag=8RWENBWNCVSV type=write size=3377248 2024-09-14T11:17:50.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.169+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=MQVU534X9V3M type=del 2024-09-14T11:17:50.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.171+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.0 size=1048576 2024-09-14T11:17:50.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.172+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.1 size=1048576 2024-09-14T11:17:50.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.173+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.2 size=144534 2024-09-14T11:17:50.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.173+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=OPZB2I1I3MWP tag=2F2XY3WFMPXM type=write size=3290262 2024-09-14T11:17:50.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.174+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=O0RW9SS9NI09 type=del 2024-09-14T11:17:50.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.175+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=OLDTYUCGBGKT type=write size=122613 2024-09-14T11:17:50.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.176+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=HNIUCKP9HXDQ type=del 2024-09-14T11:17:50.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.178+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=0CXAQ6X73GBS type=del size=2560594 2024-09-14T11:17:50.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.179+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=C1342P7R90GB type=del 2024-09-14T11:17:50.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.180+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=YUZKU18S2PI2 type=del size=2638243 2024-09-14T11:17:50.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.180+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.0 size=1048576 2024-09-14T11:17:50.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.181+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.1 size=1048576 2024-09-14T11:17:50.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.182+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~JCF10OEQ742B.2 size=976653 2024-09-14T11:17:50.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.185+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=JCF10OEQ742B tag=48732RIUN1ZD type=write size=4122381 2024-09-14T11:17:50.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.186+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=6733YM1DK6HL type=write size=682737 2024-09-14T11:17:50.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.187+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=TF9T5MJ96O2Y type=del 2024-09-14T11:17:50.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.189+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=F14BO5NXKULE type=write size=398983 2024-09-14T11:17:50.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.190+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=XC954E6EN39B type=del 2024-09-14T11:17:50.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.192+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~JHPF6Q1F3982.0 size=222467 2024-09-14T11:17:50.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.192+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=JHPF6Q1F3982 tag=PEOHYVRAN00R type=write size=1271043 2024-09-14T11:17:50.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.195+0000 7f1be8076780 1 < suggested remove operation key=QC6MEJABT7IM tag=6BGX9LVWELSU type=write 2024-09-14T11:17:50.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.196+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=K25AISO1ZIS9 type=del size=1654582 2024-09-14T11:17:50.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.198+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=R377WU3V1K37 type=del size=836602 2024-09-14T11:17:50.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.199+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=Y3JJFR2NPYW2 type=del size=1164340 2024-09-14T11:17:50.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.201+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.0 size=1048576 2024-09-14T11:17:50.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.201+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.1 size=1048576 2024-09-14T11:17:50.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.202+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~W8OGFIC2ZO7U.2 size=911879 2024-09-14T11:17:50.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.204+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=W8OGFIC2ZO7U tag=0RDR517DO75K type=write size=4057607 2024-09-14T11:17:50.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.206+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=RW6UO3Y2N8NM type=del size=3962929 2024-09-14T11:17:50.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.207+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~3HNJMW9CEIT3.0 size=1048576 2024-09-14T11:17:50.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.208+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~3HNJMW9CEIT3.1 size=395071 2024-09-14T11:17:50.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.210+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=3HNJMW9CEIT3 tag=TH017Z5UGK34 type=write size=2492223 2024-09-14T11:17:50.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.212+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.0 size=1048576 2024-09-14T11:17:50.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.213+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.1 size=1048576 2024-09-14T11:17:50.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.214+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.2 size=722451 2024-09-14T11:17:50.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.214+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=XNELI2K4YVQ2 tag=QSURH3INLD6J type=write size=3868179 2024-09-14T11:17:50.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.215+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~BN1X8M3R3WER.0 size=1048576 2024-09-14T11:17:50.215 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.216+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~BN1X8M3R3WER.1 size=134623 2024-09-14T11:17:50.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.218+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=BN1X8M3R3WER tag=21LE7242RZ0X type=write size=2231775 2024-09-14T11:17:50.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.219+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=Z400XD2ROJNP type=del size=3363043 2024-09-14T11:17:50.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.220+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.0 size=1048576 2024-09-14T11:17:50.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.221+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.1 size=1048576 2024-09-14T11:17:50.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.222+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~WHEBCN0DQJIW.2 size=215584 2024-09-14T11:17:50.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.224+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=WHEBCN0DQJIW tag=A1G3SKPO1LYW type=write size=3361312 2024-09-14T11:17:50.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.226+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~YOMYBOGQ2JLX.0 size=804411 2024-09-14T11:17:50.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.226+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=YOMYBOGQ2JLX tag=7XHH8JI2V5J7 type=write size=1852987 2024-09-14T11:17:50.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.227+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=VVKODNW2DNMS type=del 2024-09-14T11:17:50.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.229+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=5ZWJBXHP8G0Y type=del size=663238 2024-09-14T11:17:50.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.230+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=LX16DZI4YNKU type=del 2024-09-14T11:17:50.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.231+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=SL3B89DVRVE1 type=del size=3978207 2024-09-14T11:17:50.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.232+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.0 size=1048576 2024-09-14T11:17:50.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.232+0000 7f1be8076780 1 < canceled part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.1 size=1048576 2024-09-14T11:17:50.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.233+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~LO9WMV2NESVA.2 size=231520 2024-09-14T11:17:50.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.235+0000 7f1be8076780 1 < canceled multipart upload key=JQZ7C562TQ8D upload=LO9WMV2NESVA tag=8RWENBWNCVSV type=write size=3377248 2024-09-14T11:17:50.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.236+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=8VNI3PMW7R2E type=del size=1235162 2024-09-14T11:17:50.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.238+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.0 size=1048576 2024-09-14T11:17:50.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.239+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.1 size=1048576 2024-09-14T11:17:50.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.239+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~OPZB2I1I3MWP.2 size=144534 2024-09-14T11:17:50.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.241+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=OPZB2I1I3MWP tag=2F2XY3WFMPXM type=write size=3290262 2024-09-14T11:17:50.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.243+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~DE2P72PY2KQN.0 size=19810 2024-09-14T11:17:50.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.243+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=DE2P72PY2KQN tag=TIJIHGA0ZDZF type=write size=1068386 2024-09-14T11:17:50.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.245+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=OLDTYUCGBGKT type=write size=122613 2024-09-14T11:17:50.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.246+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=3C08OBV99M9H type=del size=765602 2024-09-14T11:17:50.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.247+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=0CXAQ6X73GBS type=del 2024-09-14T11:17:50.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.248+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=R2M2BWC6CZ7A type=del size=2633476 2024-09-14T11:17:50.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.249+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=YUZKU18S2PI2 type=del 2024-09-14T11:17:50.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.251+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~00CTYME7RSEC.0 size=1048576 2024-09-14T11:17:50.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.252+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~00CTYME7RSEC.1 size=1008933 2024-09-14T11:17:50.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.252+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=00CTYME7RSEC tag=JI0Z3Y9JOWGV type=write size=3106085 2024-09-14T11:17:50.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.254+0000 7f1be8076780 1 < canceled operation key=KQ479IOZ0108 tag=6733YM1DK6HL type=write size=682737 2024-09-14T11:17:50.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.256+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.0 size=1048576 2024-09-14T11:17:50.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.257+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.1 size=1048576 2024-09-14T11:17:50.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.257+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.2 size=833359 2024-09-14T11:17:50.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.257+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=5294Z5YTO6ZS tag=G2OB81D3ER4W type=write size=3979087 2024-09-14T11:17:50.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.260+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=F14BO5NXKULE type=write size=398983 2024-09-14T11:17:50.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.261+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=1D8459PZO948 type=write size=6405 2024-09-14T11:17:50.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.262+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~JHPF6Q1F3982.0 size=222467 2024-09-14T11:17:50.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.264+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=JHPF6Q1F3982 tag=PEOHYVRAN00R type=write size=1271043 2024-09-14T11:17:50.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.265+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=INNPQ4DYXIUO type=del size=3767654 2024-09-14T11:17:50.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.266+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=K25AISO1ZIS9 type=del 2024-09-14T11:17:50.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.273+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~RVXJNAB2Z38Q.0 size=1048576 2024-09-14T11:17:50.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.274+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~RVXJNAB2Z38Q.1 size=66340 2024-09-14T11:17:50.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.274+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=RVXJNAB2Z38Q tag=20XXVF2ATP4L type=write size=2163492 2024-09-14T11:17:50.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.275+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=Y3JJFR2NPYW2 type=del 2024-09-14T11:17:50.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.277+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=884HVXPGHPNM type=del size=2670221 2024-09-14T11:17:50.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.278+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=RW6UO3Y2N8NM type=del 2024-09-14T11:17:50.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.280+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~4D1M7FPNXVIS.0 size=1048576 2024-09-14T11:17:50.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.281+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~4D1M7FPNXVIS.1 size=879360 2024-09-14T11:17:50.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.281+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=4D1M7FPNXVIS tag=YKJ8E0ZRKXCT type=write size=2976512 2024-09-14T11:17:50.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.282+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.0 size=1048576 2024-09-14T11:17:50.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.283+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.1 size=1048576 2024-09-14T11:17:50.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.285+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~XNELI2K4YVQ2.2 size=722451 2024-09-14T11:17:50.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.287+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=XNELI2K4YVQ2 tag=QSURH3INLD6J type=write size=3868179 2024-09-14T11:17:50.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.289+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~FQDDQU7Y52FL.0 size=1048576 2024-09-14T11:17:50.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.290+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~FQDDQU7Y52FL.1 size=894513 2024-09-14T11:17:50.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.290+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=FQDDQU7Y52FL tag=A1Y5ZGJVADBD type=write size=2991665 2024-09-14T11:17:50.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.291+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=Z400XD2ROJNP type=del 2024-09-14T11:17:50.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.292+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=ME7WRTONKL6F type=write size=420644 2024-09-14T11:17:50.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.293+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~YOMYBOGQ2JLX.0 size=804411 2024-09-14T11:17:50.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.295+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=YOMYBOGQ2JLX tag=7XHH8JI2V5J7 type=write size=1852987 2024-09-14T11:17:50.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.296+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=D9E79DQ7GCI1 type=del size=901089 2024-09-14T11:17:50.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.298+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=5ZWJBXHP8G0Y type=del 2024-09-14T11:17:50.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.300+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~QHIZ90RP4FEU.0 size=291528 2024-09-14T11:17:50.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.300+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=QHIZ90RP4FEU tag=LM3VXUZI6IWF type=write size=1340104 2024-09-14T11:17:50.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.301+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=SL3B89DVRVE1 type=del 2024-09-14T11:17:50.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.302+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=ZCN3SRKTRXC9 type=write size=948204 2024-09-14T11:17:50.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.305+0000 7f1be8076780 1 < suggested update operation key=KQ479IOZ0108 tag=8VNI3PMW7R2E type=del size=1235162 2024-09-14T11:17:50.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.307+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~FZGC5J24KEPH.0 size=1048576 2024-09-14T11:17:50.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.308+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~FZGC5J24KEPH.1 size=298299 2024-09-14T11:17:50.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.308+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=FZGC5J24KEPH tag=RGTZYS2LVFSQ type=write size=2395451 2024-09-14T11:17:50.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.308+0000 7f1be8076780 1 < canceled part key=_multipart_LNMGQ54S2CXX.2~DE2P72PY2KQN.0 size=19810 2024-09-14T11:17:50.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.310+0000 7f1be8076780 1 < canceled multipart upload key=LNMGQ54S2CXX upload=DE2P72PY2KQN tag=TIJIHGA0ZDZF type=write size=1068386 2024-09-14T11:17:50.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.312+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=46FT1GT08SLC type=del size=3011482 2024-09-14T11:17:50.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.313+0000 7f1be8076780 -1 < failed to complete operation key=KQ479IOZ0108 tag=3C08OBV99M9H type=del size=765602: (22) Invalid argument 2024-09-14T11:17:50.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.314+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=NRIKHPR10O6X type=del size=1831147 2024-09-14T11:17:50.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.316+0000 7f1be8076780 1 < suggested remove operation key=JDKFKO39I56L tag=R2M2BWC6CZ7A type=del 2024-09-14T11:17:50.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.317+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=IN1DI2SX8HR5 type=del size=3030985 2024-09-14T11:17:50.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.319+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~00CTYME7RSEC.0 size=1048576 2024-09-14T11:17:50.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.320+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~00CTYME7RSEC.1 size=1008933 2024-09-14T11:17:50.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.321+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=00CTYME7RSEC tag=JI0Z3Y9JOWGV type=write size=3106085 2024-09-14T11:17:50.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.323+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=AS2ZNDKUVCIL type=del size=3504860 2024-09-14T11:17:50.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.324+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.0 size=1048576 2024-09-14T11:17:50.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.326+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.1 size=1048576 2024-09-14T11:17:50.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.327+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~5294Z5YTO6ZS.2 size=833359 2024-09-14T11:17:50.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.328+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=5294Z5YTO6ZS tag=G2OB81D3ER4W type=write size=3979087 2024-09-14T11:17:50.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.330+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=PIJR0I64BYRE type=del size=3227761 2024-09-14T11:17:50.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.331+0000 7f1be8076780 1 < completed write operation key=4ADXXTIO715C tag=1D8459PZO948 type=write size=6405 2024-09-14T11:17:50.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.333+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.0 size=1048576 2024-09-14T11:17:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.334+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.1 size=1048576 2024-09-14T11:17:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.335+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.2 size=343019 2024-09-14T11:17:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.335+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=IASZ5MZYYP3P tag=4L69KNDKCQ5S type=write size=3488747 2024-09-14T11:17:50.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.336+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=INNPQ4DYXIUO type=del 2024-09-14T11:17:50.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.337+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=AF1V9E0PJTBB type=del size=758091 2024-09-14T11:17:50.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.338+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~RVXJNAB2Z38Q.0 size=1048576 2024-09-14T11:17:50.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.339+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~RVXJNAB2Z38Q.1 size=66340 2024-09-14T11:17:50.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.341+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=RVXJNAB2Z38Q tag=20XXVF2ATP4L type=write size=2163492 2024-09-14T11:17:50.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.343+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~YKSLPNJF7KLA.0 size=1048576 2024-09-14T11:17:50.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.344+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~YKSLPNJF7KLA.1 size=514935 2024-09-14T11:17:50.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.344+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=YKSLPNJF7KLA tag=7EK4DMUFVOOK type=write size=2612087 2024-09-14T11:17:50.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.345+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=884HVXPGHPNM type=del 2024-09-14T11:17:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.346+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=4MIT8AFLFVCG type=del size=917326 2024-09-14T11:17:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.348+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~4D1M7FPNXVIS.0 size=1048576 2024-09-14T11:17:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.349+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~4D1M7FPNXVIS.1 size=879360 2024-09-14T11:17:50.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.351+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=4D1M7FPNXVIS tag=YKJ8E0ZRKXCT type=write size=2976512 2024-09-14T11:17:50.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.353+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~HKN7TNAVEIU8.0 size=28322 2024-09-14T11:17:50.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.353+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=HKN7TNAVEIU8 tag=O7A758QIZK8E type=write size=1076898 2024-09-14T11:17:50.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.354+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~FQDDQU7Y52FL.0 size=1048576 2024-09-14T11:17:50.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.355+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~FQDDQU7Y52FL.1 size=894513 2024-09-14T11:17:50.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.357+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=FQDDQU7Y52FL tag=A1Y5ZGJVADBD type=write size=2991665 2024-09-14T11:17:50.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.359+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~SNRQS4H50S7W.0 size=278683 2024-09-14T11:17:50.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.359+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=SNRQS4H50S7W tag=72181QOOZCPE type=write size=1327259 2024-09-14T11:17:50.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.361+0000 7f1be8076780 1 < canceled operation key=SJES17ZIGRZE tag=ME7WRTONKL6F type=write size=420644 2024-09-14T11:17:50.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.362+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=AB5UC8I3HUFH type=del size=3100647 2024-09-14T11:17:50.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.363+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=D9E79DQ7GCI1 type=del 2024-09-14T11:17:50.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.364+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=KN0DRD7KASGM type=del size=1127265 2024-09-14T11:17:50.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.366+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~QHIZ90RP4FEU.0 size=291528 2024-09-14T11:17:50.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.368+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=QHIZ90RP4FEU tag=LM3VXUZI6IWF type=write size=1340104 2024-09-14T11:17:50.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.369+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=PJQ00NC2GV1J type=del size=1752923 2024-09-14T11:17:50.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.370+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=ZCN3SRKTRXC9 type=write size=948204 2024-09-14T11:17:50.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.372+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=35PSPLK4B73T type=del size=540074 2024-09-14T11:17:50.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.373+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~FZGC5J24KEPH.0 size=1048576 2024-09-14T11:17:50.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.373+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~FZGC5J24KEPH.1 size=298299 2024-09-14T11:17:50.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.375+0000 7f1be8076780 1 < canceled multipart upload key=QIEUKUQ8CS2U upload=FZGC5J24KEPH tag=RGTZYS2LVFSQ type=write size=2395451 2024-09-14T11:17:50.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.378+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.0 size=1048576 2024-09-14T11:17:50.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.379+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.1 size=1048576 2024-09-14T11:17:50.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.380+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.2 size=198145 2024-09-14T11:17:50.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.380+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=8NE8KA8GGAMT tag=9CQ3YVWGBP7X type=write size=3343873 2024-09-14T11:17:50.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.382+0000 7f1be8076780 1 < canceled operation key=0BX70Q8C1QL0 tag=46FT1GT08SLC type=del size=3011482 2024-09-14T11:17:50.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.384+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~BPWAQQW6W6SB.0 size=1048576 2024-09-14T11:17:50.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.385+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~BPWAQQW6W6SB.1 size=92652 2024-09-14T11:17:50.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.385+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=BPWAQQW6W6SB tag=G6FX2JRL2U4P type=write size=2189804 2024-09-14T11:17:50.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.386+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=NRIKHPR10O6X type=del 2024-09-14T11:17:50.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.388+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~OU95VN3ADMBP.0 size=1048576 2024-09-14T11:17:50.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.389+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~OU95VN3ADMBP.1 size=582751 2024-09-14T11:17:50.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.389+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=OU95VN3ADMBP tag=G47F1K000NW1 type=write size=2679903 2024-09-14T11:17:50.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.390+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=IN1DI2SX8HR5 type=del 2024-09-14T11:17:50.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.391+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=VIY9HE8239ZP type=del size=3426420 2024-09-14T11:17:50.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.393+0000 7f1be8076780 1 < suggested update operation key=JDKFKO39I56L tag=AS2ZNDKUVCIL type=del size=3504860 2024-09-14T11:17:50.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.394+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=S3B10H226ZV9 type=del size=3922690 2024-09-14T11:17:50.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.396+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=PIJR0I64BYRE type=del 2024-09-14T11:17:50.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.397+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=5YHF108TL16A type=del size=3662475 2024-09-14T11:17:50.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.398+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.0 size=1048576 2024-09-14T11:17:50.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.399+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.1 size=1048576 2024-09-14T11:17:50.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.399+0000 7f1be8076780 1 < canceled part key=_multipart_KQ479IOZ0108.2~IASZ5MZYYP3P.2 size=343019 2024-09-14T11:17:50.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.401+0000 7f1be8076780 1 < canceled multipart upload key=KQ479IOZ0108 upload=IASZ5MZYYP3P tag=4L69KNDKCQ5S type=write size=3488747 2024-09-14T11:17:50.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.402+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=ST0XQJN35VYR type=del size=3810756 2024-09-14T11:17:50.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.405+0000 7f1be8076780 1 < suggested remove operation key=3YIK6B6Y2EU1 tag=AF1V9E0PJTBB type=del 2024-09-14T11:17:50.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.406+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=H3SHIHD2NA4N type=del size=164898 2024-09-14T11:17:50.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.407+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~YKSLPNJF7KLA.0 size=1048576 2024-09-14T11:17:50.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.407+0000 7f1be8076780 1 < canceled part key=_multipart_7OUNKTS3X7DJ.2~YKSLPNJF7KLA.1 size=514935 2024-09-14T11:17:50.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.409+0000 7f1be8076780 1 < canceled multipart upload key=7OUNKTS3X7DJ upload=YKSLPNJF7KLA tag=7EK4DMUFVOOK type=write size=2612087 2024-09-14T11:17:50.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.412+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~GINC7F9JIUPN.0 size=487527 2024-09-14T11:17:50.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.412+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=GINC7F9JIUPN tag=32SWDSLR3IHB type=write size=1536103 2024-09-14T11:17:50.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.414+0000 7f1be8076780 1 < suggested remove operation key=LNMGQ54S2CXX tag=4MIT8AFLFVCG type=del 2024-09-14T11:17:50.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.416+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~0WWU0YW0AMF5.0 size=1048576 2024-09-14T11:17:50.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.417+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~0WWU0YW0AMF5.1 size=855663 2024-09-14T11:17:50.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.417+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=0WWU0YW0AMF5 tag=T0RXT75WT08P type=write size=2952815 2024-09-14T11:17:50.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.419+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~HKN7TNAVEIU8.0 size=28322 2024-09-14T11:17:50.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.421+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=HKN7TNAVEIU8 tag=O7A758QIZK8E type=write size=1076898 2024-09-14T11:17:50.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.423+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~28L8CVII8ODN.0 size=889307 2024-09-14T11:17:50.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.423+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=28L8CVII8ODN tag=9FPYVY4GW4FH type=write size=1937883 2024-09-14T11:17:50.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.424+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~SNRQS4H50S7W.0 size=278683 2024-09-14T11:17:50.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.426+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=SNRQS4H50S7W tag=72181QOOZCPE type=write size=1327259 2024-09-14T11:17:50.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.428+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~AH8C4468DST3.0 size=1048576 2024-09-14T11:17:50.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.429+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~AH8C4468DST3.1 size=652599 2024-09-14T11:17:50.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.429+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=AH8C4468DST3 tag=O8G1BM3CB1PU type=write size=2749751 2024-09-14T11:17:50.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.431+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=AB5UC8I3HUFH type=del size=3100647 2024-09-14T11:17:50.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.432+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=Y9NCMSGTB0DG type=write size=290692 2024-09-14T11:17:50.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.433+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=KN0DRD7KASGM type=del 2024-09-14T11:17:50.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.434+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=OK53ZNTQO6ZM type=del size=3220508 2024-09-14T11:17:50.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.436+0000 7f1be8076780 -1 < failed to complete operation key=3YIK6B6Y2EU1 tag=PJQ00NC2GV1J type=del size=1752923: (22) Invalid argument 2024-09-14T11:17:50.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.437+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=9OV3JAQHJBBI type=del size=3524254 2024-09-14T11:17:50.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.438+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=35PSPLK4B73T type=del 2024-09-14T11:17:50.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.440+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~89TUMXFBSDWM.0 size=1048576 2024-09-14T11:17:50.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.441+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~89TUMXFBSDWM.1 size=371856 2024-09-14T11:17:50.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.441+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=89TUMXFBSDWM tag=VRKR99YGSKNA type=write size=2469008 2024-09-14T11:17:50.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.444+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.0 size=1048576 2024-09-14T11:17:50.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.445+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.1 size=1048576 2024-09-14T11:17:50.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.446+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~8NE8KA8GGAMT.2 size=198145 2024-09-14T11:17:50.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.448+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=8NE8KA8GGAMT tag=9CQ3YVWGBP7X type=write size=3343873 2024-09-14T11:17:50.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.449+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=LNLAKX92OT2P type=del size=35475 2024-09-14T11:17:50.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.450+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~BPWAQQW6W6SB.0 size=1048576 2024-09-14T11:17:50.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.451+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~BPWAQQW6W6SB.1 size=92652 2024-09-14T11:17:50.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.453+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=BPWAQQW6W6SB tag=G6FX2JRL2U4P type=write size=2189804 2024-09-14T11:17:50.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.454+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=1CYMGOBSYAPM type=del size=225809 2024-09-14T11:17:50.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.455+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~OU95VN3ADMBP.0 size=1048576 2024-09-14T11:17:50.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.455+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~OU95VN3ADMBP.1 size=582751 2024-09-14T11:17:50.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.457+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=OU95VN3ADMBP tag=G47F1K000NW1 type=write size=2679903 2024-09-14T11:17:50.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.459+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=COD1MQJI46YF type=del size=2408605 2024-09-14T11:17:50.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.460+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=VIY9HE8239ZP type=del 2024-09-14T11:17:50.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.461+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=MB5C04AJI81C type=del size=2212601 2024-09-14T11:17:50.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.464+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=S3B10H226ZV9 type=del 2024-09-14T11:17:50.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.465+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=UV1N308E8EYS type=del size=1882333 2024-09-14T11:17:50.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.466+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=5YHF108TL16A type=del 2024-09-14T11:17:50.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.468+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.0 size=1048576 2024-09-14T11:17:50.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.469+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.1 size=1048576 2024-09-14T11:17:50.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.470+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.2 size=431738 2024-09-14T11:17:50.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.470+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=CQS394DE8DT5 tag=DM4OV0GFJ5PM type=write size=3577466 2024-09-14T11:17:50.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.472+0000 7f1be8076780 1 < suggested remove operation key=XB3M4CI0ERWP tag=ST0XQJN35VYR type=del 2024-09-14T11:17:50.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.473+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=II82JWDWGITN type=del size=3930827 2024-09-14T11:17:50.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.474+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=H3SHIHD2NA4N type=del 2024-09-14T11:17:50.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.475+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=37W4L2NB2YXZ type=del size=378601 2024-09-14T11:17:50.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.477+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~GINC7F9JIUPN.0 size=487527 2024-09-14T11:17:50.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.478+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=GINC7F9JIUPN tag=32SWDSLR3IHB type=write size=1536103 2024-09-14T11:17:50.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.480+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~9WWF0ZJO85W3.0 size=1048576 2024-09-14T11:17:50.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.481+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~9WWF0ZJO85W3.1 size=138896 2024-09-14T11:17:50.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.481+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=9WWF0ZJO85W3 tag=T7Y0X6EXNYSE type=write size=2236048 2024-09-14T11:17:50.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.483+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~0WWU0YW0AMF5.0 size=1048576 2024-09-14T11:17:50.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.484+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~0WWU0YW0AMF5.1 size=855663 2024-09-14T11:17:50.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.485+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=0WWU0YW0AMF5 tag=T0RXT75WT08P type=write size=2952815 2024-09-14T11:17:50.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.487+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=7EAVBFRBR2M3 type=del size=2244446 2024-09-14T11:17:50.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.488+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~28L8CVII8ODN.0 size=889307 2024-09-14T11:17:50.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.490+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=28L8CVII8ODN tag=9FPYVY4GW4FH type=write size=1937883 2024-09-14T11:17:50.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.494+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~2XCKHHPBHDHV.0 size=1048576 2024-09-14T11:17:50.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.494+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~2XCKHHPBHDHV.1 size=485667 2024-09-14T11:17:50.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.494+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=2XCKHHPBHDHV tag=WPQNJGIAAN73 type=write size=2582819 2024-09-14T11:17:50.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.496+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~AH8C4468DST3.0 size=1048576 2024-09-14T11:17:50.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.497+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~AH8C4468DST3.1 size=652599 2024-09-14T11:17:50.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.498+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=AH8C4468DST3 tag=O8G1BM3CB1PU type=write size=2749751 2024-09-14T11:17:50.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.500+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=YF0H9KSOHLRD type=del size=3472474 2024-09-14T11:17:50.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.501+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=Y9NCMSGTB0DG type=write size=290692 2024-09-14T11:17:50.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.502+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=E6TYLUOW6POL type=del size=1681025 2024-09-14T11:17:50.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.503+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=OK53ZNTQO6ZM type=del 2024-09-14T11:17:50.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.505+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=4VD3AKY2ZLYM type=del size=3208920 2024-09-14T11:17:50.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.506+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=9OV3JAQHJBBI type=del 2024-09-14T11:17:50.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.508+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~P8LZZJUTEJ5O.0 size=590167 2024-09-14T11:17:50.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.508+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=P8LZZJUTEJ5O tag=WTVPSRBG9EBK type=write size=1638743 2024-09-14T11:17:50.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.509+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~89TUMXFBSDWM.0 size=1048576 2024-09-14T11:17:50.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.510+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~89TUMXFBSDWM.1 size=371856 2024-09-14T11:17:50.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.512+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=89TUMXFBSDWM tag=VRKR99YGSKNA type=write size=2469008 2024-09-14T11:17:50.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.513+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=T9J8KD27AKHL type=del size=3714025 2024-09-14T11:17:50.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.514+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=LNLAKX92OT2P type=del 2024-09-14T11:17:50.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.516+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~GDFLYYAMYKC4.0 size=1048576 2024-09-14T11:17:50.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.517+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~GDFLYYAMYKC4.1 size=102720 2024-09-14T11:17:50.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.517+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=GDFLYYAMYKC4 tag=DCQLBJKR2GWQ type=write size=2199872 2024-09-14T11:17:50.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.518+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=1CYMGOBSYAPM type=del 2024-09-14T11:17:50.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.520+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=4QB7GMA8J1VT type=del size=486893 2024-09-14T11:17:50.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.522+0000 7f1be8076780 1 < suggested remove operation key=4ADXXTIO715C tag=COD1MQJI46YF type=del 2024-09-14T11:17:50.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.523+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=CIYIGK9CP1OW type=del size=2885066 2024-09-14T11:17:50.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.525+0000 7f1be8076780 1 < suggested update operation key=1RUE5J1DYH2C tag=MB5C04AJI81C type=del size=2212601 2024-09-14T11:17:50.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.527+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=HEU4249V3JLB type=del size=826463 2024-09-14T11:17:50.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.529+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=UV1N308E8EYS type=del 2024-09-14T11:17:50.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.531+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~DECTI1L2C69D.0 size=1048576 2024-09-14T11:17:50.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.532+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~DECTI1L2C69D.1 size=103272 2024-09-14T11:17:50.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.532+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=DECTI1L2C69D tag=SIV8TRPFJ0PC type=write size=2200424 2024-09-14T11:17:50.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.532+0000 7f1be8076780 1 < canceled part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.0 size=1048576 2024-09-14T11:17:50.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.533+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.1 size=1048576 2024-09-14T11:17:50.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.534+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~CQS394DE8DT5.2 size=431738 2024-09-14T11:17:50.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.537+0000 7f1be8076780 1 < canceled multipart upload key=JIWPGHQ3GEZB upload=CQS394DE8DT5 tag=DM4OV0GFJ5PM type=write size=3577466 2024-09-14T11:17:50.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.538+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=1D0AVKFHDGFT type=del size=4065296 2024-09-14T11:17:50.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.540+0000 7f1be8076780 1 < suggested remove operation key=RIYGSRWKVKFF tag=II82JWDWGITN type=del 2024-09-14T11:17:50.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.541+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=7Z90L1EVCAGS type=del size=754406 2024-09-14T11:17:50.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.542+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=37W4L2NB2YXZ type=del size=378601 2024-09-14T11:17:50.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.544+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=SZR64N245E5M type=write size=203566 2024-09-14T11:17:50.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.545+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~9WWF0ZJO85W3.0 size=1048576 2024-09-14T11:17:50.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.546+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~9WWF0ZJO85W3.1 size=138896 2024-09-14T11:17:50.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.548+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=9WWF0ZJO85W3 tag=T7Y0X6EXNYSE type=write size=2236048 2024-09-14T11:17:50.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.549+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=ETSAA7XXE7CN type=del size=1737930 2024-09-14T11:17:50.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.550+0000 7f1be8076780 -1 < failed to complete operation key=4ADXXTIO715C tag=7EAVBFRBR2M3 type=del size=2244446: (22) Invalid argument 2024-09-14T11:17:50.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.552+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~OLOIXI6XLX3L.0 size=1048576 2024-09-14T11:17:50.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.553+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~OLOIXI6XLX3L.1 size=336476 2024-09-14T11:17:50.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.553+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=OLOIXI6XLX3L tag=KJ94ZWRSNGG4 type=write size=2433628 2024-09-14T11:17:50.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.554+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~2XCKHHPBHDHV.0 size=1048576 2024-09-14T11:17:50.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.555+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~2XCKHHPBHDHV.1 size=485667 2024-09-14T11:17:50.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.557+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=2XCKHHPBHDHV tag=WPQNJGIAAN73 type=write size=2582819 2024-09-14T11:17:50.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.559+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~ES0T80477XDP.0 size=1047403 2024-09-14T11:17:50.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.559+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=ES0T80477XDP tag=7B5YFX348BU8 type=write size=2095979 2024-09-14T11:17:50.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.560+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=YF0H9KSOHLRD type=del 2024-09-14T11:17:50.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.562+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=7T56UXMD6TQU type=del size=175168 2024-09-14T11:17:50.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.563+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=E6TYLUOW6POL type=del 2024-09-14T11:17:50.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.564+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=3ZTPYYKUZRMO type=write size=1020558 2024-09-14T11:17:50.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.565+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=4VD3AKY2ZLYM type=del 2024-09-14T11:17:50.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.566+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=W6Y2032KHEYF type=del size=3808100 2024-09-14T11:17:50.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.567+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~P8LZZJUTEJ5O.0 size=590167 2024-09-14T11:17:50.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.569+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=P8LZZJUTEJ5O tag=WTVPSRBG9EBK type=write size=1638743 2024-09-14T11:17:50.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.571+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.0 size=1048576 2024-09-14T11:17:50.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.572+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.1 size=1048576 2024-09-14T11:17:50.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.573+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.2 size=65543 2024-09-14T11:17:50.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.573+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=DE35T8XYBCZU tag=1023R85NDXH0 type=write size=3211271 2024-09-14T11:17:50.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.574+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=T9J8KD27AKHL type=del 2024-09-14T11:17:50.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.576+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~B9S7RCFHPELJ.0 size=1048576 2024-09-14T11:17:50.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.577+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~B9S7RCFHPELJ.1 size=386293 2024-09-14T11:17:50.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.577+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=B9S7RCFHPELJ tag=OMDAOP33C9MN type=write size=2483445 2024-09-14T11:17:50.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.579+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~GDFLYYAMYKC4.0 size=1048576 2024-09-14T11:17:50.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.580+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~GDFLYYAMYKC4.1 size=102720 2024-09-14T11:17:50.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.583+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=GDFLYYAMYKC4 tag=DCQLBJKR2GWQ type=write size=2199872 2024-09-14T11:17:50.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.584+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=V6CT7H2J6U6Z type=del size=2313716 2024-09-14T11:17:50.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.586+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=4QB7GMA8J1VT type=del size=486893 2024-09-14T11:17:50.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.588+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.0 size=1048576 2024-09-14T11:17:50.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.589+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.1 size=1048576 2024-09-14T11:17:50.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.590+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.2 size=378300 2024-09-14T11:17:50.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.590+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=EZDVO128K3ZL tag=6W3IY1ZIKRVX type=write size=3524028 2024-09-14T11:17:50.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.591+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=CIYIGK9CP1OW type=del 2024-09-14T11:17:50.591 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.592+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=2BGHQYMS8GFG type=del size=2283465 2024-09-14T11:17:50.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.594+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=HEU4249V3JLB type=del 2024-09-14T11:17:50.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.596+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=7BBC0XXEL5L2 type=write size=884723 2024-09-14T11:17:50.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.597+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~DECTI1L2C69D.0 size=1048576 2024-09-14T11:17:50.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.598+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~DECTI1L2C69D.1 size=103272 2024-09-14T11:17:50.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.600+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=DECTI1L2C69D tag=SIV8TRPFJ0PC type=write size=2200424 2024-09-14T11:17:50.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.603+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.0 size=1048576 2024-09-14T11:17:50.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.603+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.1 size=1048576 2024-09-14T11:17:50.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.604+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.2 size=335695 2024-09-14T11:17:50.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.604+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=PT8MKTAULLZC tag=U5Y6DKWC36MR type=write size=3481423 2024-09-14T11:17:50.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.607+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=1D0AVKFHDGFT type=del size=4065296 2024-09-14T11:17:50.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.609+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.0 size=1048576 2024-09-14T11:17:50.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.610+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.1 size=1048576 2024-09-14T11:17:50.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.611+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.2 size=902522 2024-09-14T11:17:50.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.611+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=RQ9MXHKI29WN tag=ISL7WIJB6GQJ type=write size=4048250 2024-09-14T11:17:50.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.612+0000 7f1be8076780 1 < canceled operation key=SJES17ZIGRZE tag=7Z90L1EVCAGS type=del size=754406 2024-09-14T11:17:50.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.613+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=CVT95ID0RZPC type=del size=2882580 2024-09-14T11:17:50.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.616+0000 7f1be8076780 1 < suggested remove operation key=1RUE5J1DYH2C tag=SZR64N245E5M type=write 2024-09-14T11:17:50.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.617+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=3MSLGUCRN6WN type=del size=3829612 2024-09-14T11:17:50.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.618+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=ETSAA7XXE7CN type=del 2024-09-14T11:17:50.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.619+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=5UI5U59HHBID type=del size=1140305 2024-09-14T11:17:50.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.620+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~OLOIXI6XLX3L.0 size=1048576 2024-09-14T11:17:50.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.621+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~OLOIXI6XLX3L.1 size=336476 2024-09-14T11:17:50.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.623+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=OLOIXI6XLX3L tag=KJ94ZWRSNGG4 type=write size=2433628 2024-09-14T11:17:50.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.624+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=12YQW7BUEPZ0 type=del size=1417309 2024-09-14T11:17:50.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.626+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~ES0T80477XDP.0 size=1047403 2024-09-14T11:17:50.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.628+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=ES0T80477XDP tag=7B5YFX348BU8 type=write size=2095979 2024-09-14T11:17:50.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.629+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=C0AT5TTG5KXZ type=del size=620173 2024-09-14T11:17:50.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.629+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=1RUE5J1DYH2C tag=7T56UXMD6TQU type=del size=175168: (2) No such file or directory 2024-09-14T11:17:50.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.630+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=NRFQQ2GP9K3K type=del size=3099869 2024-09-14T11:17:50.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.633+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=3ZTPYYKUZRMO type=write 2024-09-14T11:17:50.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.634+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=DATGQ2VDXUT7 type=del size=1959416 2024-09-14T11:17:50.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.636+0000 7f1be8076780 1 < suggested remove operation key=CQDRZMJAJ7FZ tag=W6Y2032KHEYF type=del 2024-09-14T11:17:50.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.639+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~OT243MKYW9YQ.0 size=1048576 2024-09-14T11:17:50.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.640+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~OT243MKYW9YQ.1 size=99021 2024-09-14T11:17:50.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.640+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=OT243MKYW9YQ tag=C319ZG7MJYQ6 type=write size=2196173 2024-09-14T11:17:50.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.640+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.0 size=1048576 2024-09-14T11:17:50.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.641+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.1 size=1048576 2024-09-14T11:17:50.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.642+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~DE35T8XYBCZU.2 size=65543 2024-09-14T11:17:50.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.644+0000 7f1be8076780 1 < canceled multipart upload key=JCDSP32N5C7M upload=DE35T8XYBCZU tag=1023R85NDXH0 type=write size=3211271 2024-09-14T11:17:50.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.646+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~C62IQIZF2150.0 size=361113 2024-09-14T11:17:50.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.646+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=C62IQIZF2150 tag=0BBL9YXH3XLQ type=write size=1409689 2024-09-14T11:17:50.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.647+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~B9S7RCFHPELJ.0 size=1048576 2024-09-14T11:17:50.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.648+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~B9S7RCFHPELJ.1 size=386293 2024-09-14T11:17:50.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.649+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=B9S7RCFHPELJ tag=OMDAOP33C9MN type=write size=2483445 2024-09-14T11:17:50.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.651+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~91CA5ACDDCJO.0 size=1048576 2024-09-14T11:17:50.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.652+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~91CA5ACDDCJO.1 size=969844 2024-09-14T11:17:50.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.652+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=91CA5ACDDCJO tag=STHM5SKLBQTO type=write size=3066996 2024-09-14T11:17:50.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.654+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=V6CT7H2J6U6Z type=del 2024-09-14T11:17:50.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.655+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.0 size=1048576 2024-09-14T11:17:50.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.656+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.1 size=1048576 2024-09-14T11:17:50.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.657+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.2 size=1028101 2024-09-14T11:17:50.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.657+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=S5R5JKM2WQL0 tag=1DAF9ZDS5L6Y type=write size=4173829 2024-09-14T11:17:50.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.658+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.0 size=1048576 2024-09-14T11:17:50.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.659+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.1 size=1048576 2024-09-14T11:17:50.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.660+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~EZDVO128K3ZL.2 size=378300 2024-09-14T11:17:50.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.662+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=EZDVO128K3ZL tag=6W3IY1ZIKRVX type=write size=3524028 2024-09-14T11:17:50.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.663+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=YIOTUMD1YH6Z type=del size=3390266 2024-09-14T11:17:50.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.665+0000 7f1be8076780 -1 < failed to complete operation key=JQZ7C562TQ8D tag=2BGHQYMS8GFG type=del size=2283465: (22) Invalid argument 2024-09-14T11:17:50.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.666+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=3YTNSB97KYNI type=del size=3361251 2024-09-14T11:17:50.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.667+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=7BBC0XXEL5L2 type=write size=884723 2024-09-14T11:17:50.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.668+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=7RFUZ8V460W6 type=del size=2377085 2024-09-14T11:17:50.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.671+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.0 size=1048576 2024-09-14T11:17:50.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.672+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.1 size=1048576 2024-09-14T11:17:50.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.673+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~PT8MKTAULLZC.2 size=335695 2024-09-14T11:17:50.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.675+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=PT8MKTAULLZC tag=U5Y6DKWC36MR type=write size=3481423 2024-09-14T11:17:50.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.677+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~15WOFQG7MHBE.0 size=1048576 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.678+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~15WOFQG7MHBE.1 size=302445 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.678+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=15WOFQG7MHBE tag=DR5CO9NHXMP8 type=write size=2399597 2024-09-14T11:17:50.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.680+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.0 size=1048576 2024-09-14T11:17:50.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.680+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.1 size=1048576 2024-09-14T11:17:50.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.681+0000 7f1be8076780 1 < canceled part key=_multipart_JDKFKO39I56L.2~RQ9MXHKI29WN.2 size=902522 2024-09-14T11:17:50.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.682+0000 7f1be8076780 1 < canceled multipart upload key=JDKFKO39I56L upload=RQ9MXHKI29WN tag=ISL7WIJB6GQJ type=write size=4048250 2024-09-14T11:17:50.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.683+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=QW9Z2T020PEY type=del size=3291329 2024-09-14T11:17:50.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.685+0000 7f1be8076780 -1 < failed to complete operation key=1RUE5J1DYH2C tag=CVT95ID0RZPC type=del size=2882580: (22) Invalid argument 2024-09-14T11:17:50.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.686+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=WXI011FKZTBD type=write size=500589 2024-09-14T11:17:50.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.687+0000 7f1be8076780 -1 < failed to complete operation key=AUCQC0OBQP7Z tag=3MSLGUCRN6WN type=del size=3829612: (22) Invalid argument 2024-09-14T11:17:50.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.688+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=ESNXNTW16RLS type=write size=490447 2024-09-14T11:17:50.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.689+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=5UI5U59HHBID type=del 2024-09-14T11:17:50.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.693+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.0 size=1048576 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.694+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.1 size=1048576 2024-09-14T11:17:50.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.695+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.2 size=64125 2024-09-14T11:17:50.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.695+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=TM2W3M3Y5NVI tag=QMVZIP4TGT08 type=write size=3209853 2024-09-14T11:17:50.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.696+0000 7f1be8076780 1 < canceled operation key=JCDSP32N5C7M tag=12YQW7BUEPZ0 type=del size=1417309 2024-09-14T11:17:50.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.698+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~ULJJ3O75CRHR.0 size=964959 2024-09-14T11:17:50.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.698+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=ULJJ3O75CRHR tag=BJ7TB07AQ1AL type=write size=2013535 2024-09-14T11:17:50.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.699+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=C0AT5TTG5KXZ type=del 2024-09-14T11:17:50.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.700+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=ZKDC7FIN0NOW type=del size=2446111 2024-09-14T11:17:50.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.701+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=NRFQQ2GP9K3K type=del 2024-09-14T11:17:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.703+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~WFEWQ0ABCIUD.0 size=647764 2024-09-14T11:17:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.703+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=WFEWQ0ABCIUD tag=H1H0QU56UBA4 type=write size=1696340 2024-09-14T11:17:50.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.706+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=DATGQ2VDXUT7 type=del size=1959416 2024-09-14T11:17:50.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.707+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=6U6DRX62SOOD type=del size=2321802 2024-09-14T11:17:50.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.708+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~OT243MKYW9YQ.0 size=1048576 2024-09-14T11:17:50.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.709+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~OT243MKYW9YQ.1 size=99021 2024-09-14T11:17:50.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.711+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=OT243MKYW9YQ tag=C319ZG7MJYQ6 type=write size=2196173 2024-09-14T11:17:50.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.713+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=7IXHL8QBKZ0N type=del size=1622451 2024-09-14T11:17:50.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.714+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~C62IQIZF2150.0 size=361113 2024-09-14T11:17:50.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.716+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=C62IQIZF2150 tag=0BBL9YXH3XLQ type=write size=1409689 2024-09-14T11:17:50.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.718+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.0 size=1048576 2024-09-14T11:17:50.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.719+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.1 size=1048576 2024-09-14T11:17:50.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.720+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.2 size=212175 2024-09-14T11:17:50.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.720+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=TI4477M5HFJX tag=OA4908GT81LM type=write size=3357903 2024-09-14T11:17:50.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.721+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~91CA5ACDDCJO.0 size=1048576 2024-09-14T11:17:50.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.722+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~91CA5ACDDCJO.1 size=969844 2024-09-14T11:17:50.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.724+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=91CA5ACDDCJO tag=STHM5SKLBQTO type=write size=3066996 2024-09-14T11:17:50.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.726+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~BD9J76MDAUZH.0 size=778368 2024-09-14T11:17:50.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.726+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=BD9J76MDAUZH tag=PA4FKEQAKJEC type=write size=1826944 2024-09-14T11:17:50.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.727+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.0 size=1048576 2024-09-14T11:17:50.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.930+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.1 size=1048576 2024-09-14T11:17:50.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.930+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~S5R5JKM2WQL0.2 size=1028101 2024-09-14T11:17:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.932+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=S5R5JKM2WQL0 tag=1DAF9ZDS5L6Y type=write size=4173829 2024-09-14T11:17:50.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.933+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=62SX9JKNMZI8 type=del size=3152072 2024-09-14T11:17:50.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.934+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=YIOTUMD1YH6Z type=del 2024-09-14T11:17:50.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.935+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=GM17PUFSLB60 type=del size=1012715 2024-09-14T11:17:50.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.938+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=3YTNSB97KYNI type=del size=3361251 2024-09-14T11:17:50.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.939+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=A6QJO2RTYTDY type=del size=619678 2024-09-14T11:17:50.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.941+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=7RFUZ8V460W6 type=del 2024-09-14T11:17:50.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.942+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=50WWRBULM38P type=write size=407297 2024-09-14T11:17:50.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.944+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~15WOFQG7MHBE.0 size=1048576 2024-09-14T11:17:50.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.945+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~15WOFQG7MHBE.1 size=302445 2024-09-14T11:17:50.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.947+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=15WOFQG7MHBE tag=DR5CO9NHXMP8 type=write size=2399597 2024-09-14T11:17:50.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.948+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=VR2WB2XAUSJG type=del size=2589567 2024-09-14T11:17:50.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.949+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=QW9Z2T020PEY type=del 2024-09-14T11:17:50.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.950+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=JQ749J4JQI1F type=del size=2738782 2024-09-14T11:17:50.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.952+0000 7f1be8076780 1 < suggested update operation key=XB3M4CI0ERWP tag=WXI011FKZTBD type=write size=500589 2024-09-14T11:17:50.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.954+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=6C93SNRFH5DG type=del size=2100865 2024-09-14T11:17:50.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.955+0000 7f1be8076780 -1 < failed to complete operation key=XB3M4CI0ERWP tag=ESNXNTW16RLS type=write size=490447: (22) Invalid argument 2024-09-14T11:17:50.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.956+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=QTV6KDLX3FF1 type=del size=4010767 2024-09-14T11:17:50.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.957+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.0 size=1048576 2024-09-14T11:17:50.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.958+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.1 size=1048576 2024-09-14T11:17:50.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.959+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~TM2W3M3Y5NVI.2 size=64125 2024-09-14T11:17:50.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.961+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=TM2W3M3Y5NVI tag=QMVZIP4TGT08 type=write size=3209853 2024-09-14T11:17:50.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.965+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~DXSL1NQLP0DN.0 size=1048576 2024-09-14T11:17:50.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.966+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~DXSL1NQLP0DN.1 size=769636 2024-09-14T11:17:50.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.966+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=DXSL1NQLP0DN tag=QA6HGF9DIE2H type=write size=2866788 2024-09-14T11:17:50.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.966+0000 7f1be8076780 1 < canceled part key=_multipart_INU0TV92GXSP.2~ULJJ3O75CRHR.0 size=964959 2024-09-14T11:17:50.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.968+0000 7f1be8076780 1 < canceled multipart upload key=INU0TV92GXSP upload=ULJJ3O75CRHR tag=BJ7TB07AQ1AL type=write size=2013535 2024-09-14T11:17:50.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.969+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=1MLE0MR8QCJU type=del size=859509 2024-09-14T11:17:50.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.970+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=ZKDC7FIN0NOW type=del 2024-09-14T11:17:50.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.971+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=MSX3BI33D10P type=del size=3735770 2024-09-14T11:17:50.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.973+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~WFEWQ0ABCIUD.0 size=647764 2024-09-14T11:17:50.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.975+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=WFEWQ0ABCIUD tag=H1H0QU56UBA4 type=write size=1696340 2024-09-14T11:17:50.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.976+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=F53TBDODAEGT type=write size=339479 2024-09-14T11:17:50.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.977+0000 7f1be8076780 -1 < failed to complete operation key=JCDSP32N5C7M tag=6U6DRX62SOOD type=del size=2321802: (22) Invalid argument 2024-09-14T11:17:50.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.978+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=CTJL3Y2N6UCV type=del size=369790 2024-09-14T11:17:50.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.979+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=7IXHL8QBKZ0N type=del 2024-09-14T11:17:50.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.980+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=PTOUUBX06WIZ type=del size=2859814 2024-09-14T11:17:50.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.982+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.0 size=1048576 2024-09-14T11:17:50.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.983+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.1 size=1048576 2024-09-14T11:17:50.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.984+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~TI4477M5HFJX.2 size=212175 2024-09-14T11:17:50.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.986+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=TI4477M5HFJX tag=OA4908GT81LM type=write size=3357903 2024-09-14T11:17:50.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.987+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=0CZ8Q4WKKJP6 type=del size=559541 2024-09-14T11:17:50.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.988+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~BD9J76MDAUZH.0 size=778368 2024-09-14T11:17:50.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.990+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=BD9J76MDAUZH tag=PA4FKEQAKJEC type=write size=1826944 2024-09-14T11:17:50.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.991+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=5UZAXY8V6FNO type=del size=2313538 2024-09-14T11:17:50.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.992+0000 7f1be8076780 -1 < failed to complete operation key=AUCQC0OBQP7Z tag=62SX9JKNMZI8 type=del size=3152072: (22) Invalid argument 2024-09-14T11:17:50.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.994+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~NATUS5LUM8BH.0 size=1048576 2024-09-14T11:17:50.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.995+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~NATUS5LUM8BH.1 size=144847 2024-09-14T11:17:50.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.995+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=NATUS5LUM8BH tag=W5BPM7Z1UVDA type=write size=2241999 2024-09-14T11:17:50.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.996+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=GM17PUFSLB60 type=del 2024-09-14T11:17:50.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.998+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=PPP0ND0S2OF0 type=write size=667499 2024-09-14T11:17:50.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:50.999+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=A6QJO2RTYTDY type=del 2024-09-14T11:17:50.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.000+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=7NP3CTLZJHQH type=del size=3000303 2024-09-14T11:17:51.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.001+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=50WWRBULM38P type=write size=407297 2024-09-14T11:17:51.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.002+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=24EW41U2LC45 type=del size=2087624 2024-09-14T11:17:51.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.003+0000 7f1be8076780 -1 < failed to complete operation key=XB3M4CI0ERWP tag=VR2WB2XAUSJG type=del size=2589567: (22) Invalid argument 2024-09-14T11:17:51.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.006+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.0 size=1048576 2024-09-14T11:17:51.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.007+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.1 size=1048576 2024-09-14T11:17:51.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.007+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.2 size=943750 2024-09-14T11:17:51.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.007+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=Q8WCYF05L5BW tag=T9GH8O8XTM1D type=write size=4089478 2024-09-14T11:17:51.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.009+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=JQ749J4JQI1F type=del 2024-09-14T11:17:51.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.010+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=DQHCGG35NFDI type=del size=227359 2024-09-14T11:17:51.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.012+0000 7f1be8076780 1 < suggested remove operation key=KQ479IOZ0108 tag=6C93SNRFH5DG type=del 2024-09-14T11:17:51.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.013+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=UOVAKQX99XVU type=del size=3964284 2024-09-14T11:17:51.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.016+0000 7f1be8076780 1 < suggested remove operation key=UB0SEYZ7ITU1 tag=QTV6KDLX3FF1 type=del 2024-09-14T11:17:51.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.018+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~VN8P6LL752WZ.0 size=953560 2024-09-14T11:17:51.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.018+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=VN8P6LL752WZ tag=N0YFFYIX2L6K type=write size=2002136 2024-09-14T11:17:51.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.018+0000 7f1be8076780 1 < canceled part key=_multipart_4AY6ZXFKO1YQ.2~DXSL1NQLP0DN.0 size=1048576 2024-09-14T11:17:51.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.019+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~DXSL1NQLP0DN.1 size=769636 2024-09-14T11:17:51.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.021+0000 7f1be8076780 1 < canceled multipart upload key=4AY6ZXFKO1YQ upload=DXSL1NQLP0DN tag=QA6HGF9DIE2H type=write size=2866788 2024-09-14T11:17:51.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.023+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~2ME2EA9X1BO9.0 size=948754 2024-09-14T11:17:51.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.023+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=2ME2EA9X1BO9 tag=FMAAJ28I651L type=write size=1997330 2024-09-14T11:17:51.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.024+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=1MLE0MR8QCJU type=del 2024-09-14T11:17:51.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.029+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~SW9NHNZJL9RA.0 size=300686 2024-09-14T11:17:51.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.029+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=SW9NHNZJL9RA tag=UJRIUUQV37XG type=write size=1349262 2024-09-14T11:17:51.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.031+0000 7f1be8076780 1 < canceled operation key=MVUN63538RAB tag=MSX3BI33D10P type=del size=3735770 2024-09-14T11:17:51.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.033+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=IYZF56ARH3IC type=write size=1010228 2024-09-14T11:17:51.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.035+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=F53TBDODAEGT type=write size=339479 2024-09-14T11:17:51.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.036+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=94CNDVAIDIE4 type=del size=2070914 2024-09-14T11:17:51.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.039+0000 7f1be8076780 1 < suggested update operation key=9DRSDTGM7Y3F tag=CTJL3Y2N6UCV type=del size=369790 2024-09-14T11:17:51.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.040+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=UWWIL37S3Y52 type=write size=197369 2024-09-14T11:17:51.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.041+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=PTOUUBX06WIZ type=del 2024-09-14T11:17:51.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.042+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=XO0UVS872YQV type=del size=3016028 2024-09-14T11:17:51.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.043+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=0CZ8Q4WKKJP6 type=del 2024-09-14T11:17:51.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.045+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=DCHOEZ2I9IDW type=del size=3092770 2024-09-14T11:17:51.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.046+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=5UZAXY8V6FNO type=del 2024-09-14T11:17:51.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.047+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=8CR2ZME4WGFH type=del size=247976 2024-09-14T11:17:51.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.049+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~NATUS5LUM8BH.0 size=1048576 2024-09-14T11:17:51.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.050+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~NATUS5LUM8BH.1 size=144847 2024-09-14T11:17:51.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.052+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=NATUS5LUM8BH tag=W5BPM7Z1UVDA type=write size=2241999 2024-09-14T11:17:51.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.054+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.0 size=1048576 2024-09-14T11:17:51.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.055+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.1 size=1048576 2024-09-14T11:17:51.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.056+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.2 size=714096 2024-09-14T11:17:51.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.056+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=INS2438KSF8K tag=Q1EFSHK561EU type=write size=3859824 2024-09-14T11:17:51.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.057+0000 7f1be8076780 1 < completed write operation key=2RJYZ1CRDVEP tag=PPP0ND0S2OF0 type=write size=667499 2024-09-14T11:17:51.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.059+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=RTO56ROHE6ZF type=del size=1367648 2024-09-14T11:17:51.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.060+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=7NP3CTLZJHQH type=del 2024-09-14T11:17:51.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.062+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~H9X2NPJ2YWFP.0 size=144790 2024-09-14T11:17:51.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.062+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=H9X2NPJ2YWFP tag=ILRACTMORF89 type=write size=1193366 2024-09-14T11:17:51.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.063+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=24EW41U2LC45 type=del 2024-09-14T11:17:51.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.064+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=PCM36QX47ER4 type=write size=567528 2024-09-14T11:17:51.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.065+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.0 size=1048576 2024-09-14T11:17:51.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.066+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.1 size=1048576 2024-09-14T11:17:51.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.067+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~Q8WCYF05L5BW.2 size=943750 2024-09-14T11:17:51.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.069+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=Q8WCYF05L5BW tag=T9GH8O8XTM1D type=write size=4089478 2024-09-14T11:17:51.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.072+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~DTXPBPPGYPLC.0 size=1012032 2024-09-14T11:17:51.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.072+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=DTXPBPPGYPLC tag=8XKAAJ95LRSG type=write size=2060608 2024-09-14T11:17:51.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.073+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=DQHCGG35NFDI type=del 2024-09-14T11:17:51.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.074+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=AZ1KUYE00FYN type=del size=1165705 2024-09-14T11:17:51.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.075+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=UOVAKQX99XVU type=del 2024-09-14T11:17:51.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.077+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=31HCPTQKCEVQ type=del size=1619313 2024-09-14T11:17:51.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.077+0000 7f1be8076780 1 < canceled part key=_multipart_KQ479IOZ0108.2~VN8P6LL752WZ.0 size=953560 2024-09-14T11:17:51.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.079+0000 7f1be8076780 1 < canceled multipart upload key=KQ479IOZ0108 upload=VN8P6LL752WZ tag=N0YFFYIX2L6K type=write size=2002136 2024-09-14T11:17:51.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.080+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=LBHOV3A3PIDW type=del size=1692715 2024-09-14T11:17:51.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.081+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~2ME2EA9X1BO9.0 size=948754 2024-09-14T11:17:51.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.083+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=2ME2EA9X1BO9 tag=FMAAJ28I651L type=write size=1997330 2024-09-14T11:17:51.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.086+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~7GWGZHZSGNIA.0 size=827413 2024-09-14T11:17:51.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.086+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=7GWGZHZSGNIA tag=CUM3C047BKZO type=write size=1875989 2024-09-14T11:17:51.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.087+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~SW9NHNZJL9RA.0 size=300686 2024-09-14T11:17:51.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.089+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=SW9NHNZJL9RA tag=UJRIUUQV37XG type=write size=1349262 2024-09-14T11:17:51.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.091+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~HW15T6ITCZZ0.0 size=229737 2024-09-14T11:17:51.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.091+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=HW15T6ITCZZ0 tag=FID34622REUX type=write size=1278313 2024-09-14T11:17:51.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.093+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=IYZF56ARH3IC type=write size=1010228 2024-09-14T11:17:51.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.095+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~GFGU4E874EPY.0 size=604323 2024-09-14T11:17:51.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.095+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=GFGU4E874EPY tag=6CKQPWB19GQO type=write size=1652899 2024-09-14T11:17:51.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.096+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=94CNDVAIDIE4 type=del 2024-09-14T11:17:51.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.098+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=WNUFGR3KOJT6 type=del size=278061 2024-09-14T11:17:51.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.099+0000 7f1be8076780 1 < canceled operation key=9DRSDTGM7Y3F tag=UWWIL37S3Y52 type=write size=197369 2024-09-14T11:17:51.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.101+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.0 size=1048576 2024-09-14T11:17:51.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.102+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.1 size=1048576 2024-09-14T11:17:51.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.103+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.2 size=267090 2024-09-14T11:17:51.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.103+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=UHN7BBJG6K35 tag=5PKLPMFD48HU type=write size=3412818 2024-09-14T11:17:51.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.104+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=XO0UVS872YQV type=del 2024-09-14T11:17:51.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.105+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=B8VLPEJPKRPW type=write size=932513 2024-09-14T11:17:51.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.107+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=DCHOEZ2I9IDW type=del 2024-09-14T11:17:51.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.108+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=3AJY5LJXUTDD type=del size=3479328 2024-09-14T11:17:51.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.109+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=8CR2ZME4WGFH type=del 2024-09-14T11:17:51.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.110+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=UJJZ4IUJTYE5 type=del size=1224001 2024-09-14T11:17:51.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.112+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.0 size=1048576 2024-09-14T11:17:51.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.112+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.1 size=1048576 2024-09-14T11:17:51.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.113+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~INS2438KSF8K.2 size=714096 2024-09-14T11:17:51.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.115+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=INS2438KSF8K tag=Q1EFSHK561EU type=write size=3859824 2024-09-14T11:17:51.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.117+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=GDW3JAPZQ4EZ type=del size=2248358 2024-09-14T11:17:51.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.118+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=RTO56ROHE6ZF type=del 2024-09-14T11:17:51.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.120+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~UGW73J1E8Z2S.0 size=2803 2024-09-14T11:17:51.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.120+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=UGW73J1E8Z2S tag=SN6NPB5PBZ2W type=write size=1051379 2024-09-14T11:17:51.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.121+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~H9X2NPJ2YWFP.0 size=144790 2024-09-14T11:17:51.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.123+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=H9X2NPJ2YWFP tag=ILRACTMORF89 type=write size=1193366 2024-09-14T11:17:51.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.124+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=9D4Q8L8A7XLK type=del size=2497343 2024-09-14T11:17:51.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.125+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=PCM36QX47ER4 type=write size=567528 2024-09-14T11:17:51.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.127+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=5P2MS279PBMZ type=del size=563333 2024-09-14T11:17:51.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.128+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~DTXPBPPGYPLC.0 size=1012032 2024-09-14T11:17:51.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.130+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=DTXPBPPGYPLC tag=8XKAAJ95LRSG type=write size=2060608 2024-09-14T11:17:51.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.131+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=69ESAX7ATXKJ type=del size=3285891 2024-09-14T11:17:51.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.133+0000 7f1be8076780 1 < suggested update operation key=XB3M4CI0ERWP tag=AZ1KUYE00FYN type=del size=1165705 2024-09-14T11:17:51.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.135+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~EN1XKL5YQAZU.0 size=1048576 2024-09-14T11:17:51.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.136+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~EN1XKL5YQAZU.1 size=922611 2024-09-14T11:17:51.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.136+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=EN1XKL5YQAZU tag=52HIZPHGQBYG type=write size=3019763 2024-09-14T11:17:51.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.137+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=31HCPTQKCEVQ type=del 2024-09-14T11:17:51.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.139+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=W41TT0SLDTXF type=del size=1433517 2024-09-14T11:17:51.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.140+0000 7f1be8076780 1 < canceled operation key=INU0TV92GXSP tag=LBHOV3A3PIDW type=del size=1692715 2024-09-14T11:17:51.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.142+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~OIOCEP185ZMB.0 size=1048576 2024-09-14T11:17:51.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.144+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~OIOCEP185ZMB.1 size=680194 2024-09-14T11:17:51.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.144+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=OIOCEP185ZMB tag=GKMV7WLGHOC1 type=write size=2777346 2024-09-14T11:17:51.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.146+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~7GWGZHZSGNIA.0 size=827413 2024-09-14T11:17:51.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.148+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=7GWGZHZSGNIA tag=CUM3C047BKZO type=write size=1875989 2024-09-14T11:17:51.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.150+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=D4PWPTBH327Y type=del size=1801882 2024-09-14T11:17:51.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.151+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~HW15T6ITCZZ0.0 size=229737 2024-09-14T11:17:51.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.153+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=HW15T6ITCZZ0 tag=FID34622REUX type=write size=1278313 2024-09-14T11:17:51.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.154+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=1MSM0OI0R519 type=write size=633938 2024-09-14T11:17:51.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.155+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~GFGU4E874EPY.0 size=604323 2024-09-14T11:17:51.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.157+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=GFGU4E874EPY tag=6CKQPWB19GQO type=write size=1652899 2024-09-14T11:17:51.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.159+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=NGAJOP0N1KHU type=del size=119395 2024-09-14T11:17:51.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.160+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=WNUFGR3KOJT6 type=del 2024-09-14T11:17:51.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.161+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=7MX9FL18H61Q type=write size=453919 2024-09-14T11:17:51.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.162+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.0 size=1048576 2024-09-14T11:17:51.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.163+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.1 size=1048576 2024-09-14T11:17:51.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.164+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~UHN7BBJG6K35.2 size=267090 2024-09-14T11:17:51.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.166+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=UHN7BBJG6K35 tag=5PKLPMFD48HU type=write size=3412818 2024-09-14T11:17:51.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.167+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=VDNB1UI9OB8B type=del size=1667755 2024-09-14T11:17:51.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.168+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=B8VLPEJPKRPW type=write size=932513 2024-09-14T11:17:51.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.169+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=QCCKN5I0YQF5 type=del size=2843898 2024-09-14T11:17:51.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.171+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=3AJY5LJXUTDD type=del 2024-09-14T11:17:51.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.173+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.0 size=1048576 2024-09-14T11:17:51.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.174+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.1 size=1048576 2024-09-14T11:17:51.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.175+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.2 size=408377 2024-09-14T11:17:51.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.175+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=XT50H8ZPEMI1 tag=1J2VSB7WNXU8 type=write size=3554105 2024-09-14T11:17:51.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.176+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=UJJZ4IUJTYE5 type=del 2024-09-14T11:17:51.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.178+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~L8PGF3RAOI8I.0 size=1048576 2024-09-14T11:17:51.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.179+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~L8PGF3RAOI8I.1 size=21149 2024-09-14T11:17:51.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.179+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=L8PGF3RAOI8I tag=GFN80QV93KD1 type=write size=2118301 2024-09-14T11:17:51.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.180+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=GDW3JAPZQ4EZ type=del 2024-09-14T11:17:51.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.182+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.0 size=1048576 2024-09-14T11:17:51.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.183+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.1 size=1048576 2024-09-14T11:17:51.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.184+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.2 size=953190 2024-09-14T11:17:51.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.184+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=UPBLVKL1ZIYO tag=VFXM5M87FY8I type=write size=4098918 2024-09-14T11:17:51.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.185+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~UGW73J1E8Z2S.0 size=2803 2024-09-14T11:17:51.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.187+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=UGW73J1E8Z2S tag=SN6NPB5PBZ2W type=write size=1051379 2024-09-14T11:17:51.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.189+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~HLY8KXKZ8NOO.0 size=1048576 2024-09-14T11:17:51.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.190+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~HLY8KXKZ8NOO.1 size=731634 2024-09-14T11:17:51.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.190+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=HLY8KXKZ8NOO tag=3NPL2UC3G2NJ type=write size=2828786 2024-09-14T11:17:51.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.191+0000 7f1be8076780 1 < canceled operation key=3YIK6B6Y2EU1 tag=9D4Q8L8A7XLK type=del size=2497343 2024-09-14T11:17:51.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.192+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=5XM9S3YVGV12 type=del size=373260 2024-09-14T11:17:51.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.193+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=5P2MS279PBMZ type=del 2024-09-14T11:17:51.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.195+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=E0FCH3SF6NG5 type=del size=3844277 2024-09-14T11:17:51.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.196+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=69ESAX7ATXKJ type=del 2024-09-14T11:17:51.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.197+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=M8MKCV0014Q0 type=write size=911591 2024-09-14T11:17:51.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.198+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~EN1XKL5YQAZU.0 size=1048576 2024-09-14T11:17:51.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.198+0000 7f1be8076780 1 < canceled part key=_multipart_9DRSDTGM7Y3F.2~EN1XKL5YQAZU.1 size=922611 2024-09-14T11:17:51.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.200+0000 7f1be8076780 1 < canceled multipart upload key=9DRSDTGM7Y3F upload=EN1XKL5YQAZU tag=52HIZPHGQBYG type=write size=3019763 2024-09-14T11:17:51.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.202+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.0 size=1048576 2024-09-14T11:17:51.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.203+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.1 size=1048576 2024-09-14T11:17:51.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.204+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.2 size=563818 2024-09-14T11:17:51.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.204+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=86NVKDZBQTJW tag=7XOWND2OPW7R type=write size=3709546 2024-09-14T11:17:51.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.205+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=W41TT0SLDTXF type=del 2024-09-14T11:17:51.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.206+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=VJ9HEVCS9MKD type=del size=362733 2024-09-14T11:17:51.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.207+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~OIOCEP185ZMB.0 size=1048576 2024-09-14T11:17:51.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.208+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~OIOCEP185ZMB.1 size=680194 2024-09-14T11:17:51.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.210+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=OIOCEP185ZMB tag=GKMV7WLGHOC1 type=write size=2777346 2024-09-14T11:17:51.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.211+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=LC30Q0WGS225 type=del size=4185421 2024-09-14T11:17:51.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.212+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=D4PWPTBH327Y type=del 2024-09-14T11:17:51.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.213+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=1W2RHFGKA43H type=del size=3364259 2024-09-14T11:17:51.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.214+0000 7f1be8076780 1 < completed write operation key=1X2EWK1Y2GE0 tag=1MSM0OI0R519 type=write size=633938 2024-09-14T11:17:51.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.216+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=RY6DA74DBMLX type=del size=1357988 2024-09-14T11:17:51.215 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.217+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=NGAJOP0N1KHU type=del 2024-09-14T11:17:51.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.219+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~GUQCX8KXLQWF.0 size=1048576 2024-09-14T11:17:51.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.220+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~GUQCX8KXLQWF.1 size=365233 2024-09-14T11:17:51.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.220+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=GUQCX8KXLQWF tag=5FO459JS10TH type=write size=2462385 2024-09-14T11:17:51.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.221+0000 7f1be8076780 1 < completed write operation key=0BX70Q8C1QL0 tag=7MX9FL18H61Q type=write size=453919 2024-09-14T11:17:51.220 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.222+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=1X1LLFMORZK2 type=del size=213982 2024-09-14T11:17:51.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.223+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=VDNB1UI9OB8B type=del 2024-09-14T11:17:51.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.224+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=A48O44HHEML8 type=write size=995959 2024-09-14T11:17:51.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.226+0000 7f1be8076780 1 < suggested update operation key=3YIK6B6Y2EU1 tag=QCCKN5I0YQF5 type=del size=2843898 2024-09-14T11:17:51.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.227+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=BQ9VYSU15TYC type=del size=925917 2024-09-14T11:17:51.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.229+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.0 size=1048576 2024-09-14T11:17:51.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.230+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.1 size=1048576 2024-09-14T11:17:51.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.231+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~XT50H8ZPEMI1.2 size=408377 2024-09-14T11:17:51.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.233+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=XT50H8ZPEMI1 tag=1J2VSB7WNXU8 type=write size=3554105 2024-09-14T11:17:51.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.235+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.0 size=1048576 2024-09-14T11:17:51.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.236+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.1 size=1048576 2024-09-14T11:17:51.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.237+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.2 size=593632 2024-09-14T11:17:51.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.237+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=F7QBX6ZXLRAM tag=M5H7IDQETP8F type=write size=3739360 2024-09-14T11:17:51.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.238+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~L8PGF3RAOI8I.0 size=1048576 2024-09-14T11:17:51.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.239+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~L8PGF3RAOI8I.1 size=21149 2024-09-14T11:17:51.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.241+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=L8PGF3RAOI8I tag=GFN80QV93KD1 type=write size=2118301 2024-09-14T11:17:51.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.243+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=2ET319CKDW21 type=del size=2449634 2024-09-14T11:17:51.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.244+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.0 size=1048576 2024-09-14T11:17:51.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.245+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.1 size=1048576 2024-09-14T11:17:51.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.246+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~UPBLVKL1ZIYO.2 size=953190 2024-09-14T11:17:51.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.249+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=UPBLVKL1ZIYO tag=VFXM5M87FY8I type=write size=4098918 2024-09-14T11:17:51.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.250+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=FXCGIDTJFSJY type=del size=82063 2024-09-14T11:17:51.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.251+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~HLY8KXKZ8NOO.0 size=1048576 2024-09-14T11:17:51.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.252+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~HLY8KXKZ8NOO.1 size=731634 2024-09-14T11:17:51.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.256+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=HLY8KXKZ8NOO tag=3NPL2UC3G2NJ type=write size=2828786 2024-09-14T11:17:51.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.258+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=SBU9QMSLRSVA type=del size=177903 2024-09-14T11:17:51.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.259+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=5XM9S3YVGV12 type=del 2024-09-14T11:17:51.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.261+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=ILGAYR2OI6Z8 type=del size=241404 2024-09-14T11:17:51.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.262+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=E0FCH3SF6NG5 type=del 2024-09-14T11:17:51.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.264+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~M5A7Z292JXUN.0 size=121948 2024-09-14T11:17:51.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.264+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=M5A7Z292JXUN tag=EH12YUGDLGUE type=write size=1170524 2024-09-14T11:17:51.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.266+0000 7f1be8076780 1 < suggested remove operation key=LNMGQ54S2CXX tag=M8MKCV0014Q0 type=write 2024-09-14T11:17:51.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.268+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~XTGUZX375K8C.0 size=679553 2024-09-14T11:17:51.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.268+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=XTGUZX375K8C tag=PX66FBGSLC8C type=write size=1728129 2024-09-14T11:17:51.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.269+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.0 size=1048576 2024-09-14T11:17:51.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.270+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.1 size=1048576 2024-09-14T11:17:51.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.271+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~86NVKDZBQTJW.2 size=563818 2024-09-14T11:17:51.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.273+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=86NVKDZBQTJW tag=7XOWND2OPW7R type=write size=3709546 2024-09-14T11:17:51.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.275+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~KVYZBG5M0TK6.0 size=876355 2024-09-14T11:17:51.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.275+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=KVYZBG5M0TK6 tag=I4BN3W8YCD8O type=write size=1924931 2024-09-14T11:17:51.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.276+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=VJ9HEVCS9MKD type=del 2024-09-14T11:17:51.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.277+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=1NZ5QRXXYPDX type=write size=301608 2024-09-14T11:17:51.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.279+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=LC30Q0WGS225 type=del 2024-09-14T11:17:51.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.280+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=NOGUY3NJF8N6 type=del size=3883768 2024-09-14T11:17:51.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.283+0000 7f1be8076780 1 < suggested remove operation key=SJES17ZIGRZE tag=1W2RHFGKA43H type=del 2024-09-14T11:17:51.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.284+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=41VSPE6VGY31 type=del size=1767075 2024-09-14T11:17:51.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.285+0000 7f1be8076780 1 < canceled operation key=2RJYZ1CRDVEP tag=RY6DA74DBMLX type=del size=1357988 2024-09-14T11:17:51.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.287+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~5WKNH8JDKXE8.0 size=824933 2024-09-14T11:17:51.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.288+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=5WKNH8JDKXE8 tag=W1Z0UEK2LI4Y type=write size=1873509 2024-09-14T11:17:51.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.289+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~GUQCX8KXLQWF.0 size=1048576 2024-09-14T11:17:51.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.290+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~GUQCX8KXLQWF.1 size=365233 2024-09-14T11:17:51.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.292+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=GUQCX8KXLQWF tag=5FO459JS10TH type=write size=2462385 2024-09-14T11:17:51.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.295+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.0 size=1048576 2024-09-14T11:17:51.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.295+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.1 size=1048576 2024-09-14T11:17:51.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.296+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.2 size=804194 2024-09-14T11:17:51.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.296+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=IWCH0UUB2URE tag=MRTA9KQEDVN8 type=write size=3949922 2024-09-14T11:17:51.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.298+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=1X1LLFMORZK2 type=del 2024-09-14T11:17:51.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.299+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=PU2DUVJFCAJZ type=del size=3639007 2024-09-14T11:17:51.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.301+0000 7f1be8076780 1 < completed write operation key=UB0SEYZ7ITU1 tag=A48O44HHEML8 type=write size=995959 2024-09-14T11:17:51.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.302+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=3R3D5SMWLK4Z type=del size=458946 2024-09-14T11:17:51.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.303+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=BQ9VYSU15TYC type=del 2024-09-14T11:17:51.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.304+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=YG3UYHX04MSU type=del size=4088374 2024-09-14T11:17:51.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.306+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.0 size=1048576 2024-09-14T11:17:51.305 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.307+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.1 size=1048576 2024-09-14T11:17:51.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.308+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~F7QBX6ZXLRAM.2 size=593632 2024-09-14T11:17:51.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.310+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=F7QBX6ZXLRAM tag=M5H7IDQETP8F type=write size=3739360 2024-09-14T11:17:51.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.311+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=YHBSKYZHMQCL type=write size=839672 2024-09-14T11:17:51.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.312+0000 7f1be8076780 1 < canceled operation key=INU0TV92GXSP tag=2ET319CKDW21 type=del size=2449634 2024-09-14T11:17:51.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.313+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=NIK02QXNWYV8 type=del size=1952271 2024-09-14T11:17:51.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.315+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=FXCGIDTJFSJY type=del 2024-09-14T11:17:51.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.317+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~0NQAJN9JG4PV.0 size=1048576 2024-09-14T11:17:51.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.317+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~0NQAJN9JG4PV.1 size=256820 2024-09-14T11:17:51.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.317+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=0NQAJN9JG4PV tag=EQ7TVLMF4S7G type=write size=2353972 2024-09-14T11:17:51.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.320+0000 7f1be8076780 1 < suggested update operation key=9DRSDTGM7Y3F tag=SBU9QMSLRSVA type=del size=177903 2024-09-14T11:17:51.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.321+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=ELTBZQQV0TK7 type=write size=668746 2024-09-14T11:17:51.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.322+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=ILGAYR2OI6Z8 type=del 2024-09-14T11:17:51.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.323+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=G23L8BDL0EEM type=del size=659335 2024-09-14T11:17:51.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.324+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~M5A7Z292JXUN.0 size=121948 2024-09-14T11:17:51.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.326+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=M5A7Z292JXUN tag=EH12YUGDLGUE type=write size=1170524 2024-09-14T11:17:51.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.327+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=55Y6DRDX4O6T type=del size=2480485 2024-09-14T11:17:51.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.329+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~XTGUZX375K8C.0 size=679553 2024-09-14T11:17:51.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.331+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=XTGUZX375K8C tag=PX66FBGSLC8C type=write size=1728129 2024-09-14T11:17:51.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.332+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=PJQNZSFIHC1T type=del size=3418977 2024-09-14T11:17:51.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.333+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~KVYZBG5M0TK6.0 size=876355 2024-09-14T11:17:51.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.335+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=KVYZBG5M0TK6 tag=I4BN3W8YCD8O type=write size=1924931 2024-09-14T11:17:51.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.336+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=113G0Y962QBZ type=del size=2527774 2024-09-14T11:17:51.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.338+0000 7f1be8076780 1 < suggested remove operation key=XB3M4CI0ERWP tag=1NZ5QRXXYPDX type=write 2024-09-14T11:17:51.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.341+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.0 size=1048576 2024-09-14T11:17:51.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.342+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.1 size=1048576 2024-09-14T11:17:51.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.342+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.2 size=557813 2024-09-14T11:17:51.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.342+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=OHUUD088XJNJ tag=6G5M5Q2W8Z7R type=write size=3703541 2024-09-14T11:17:51.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.344+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=NOGUY3NJF8N6 type=del 2024-09-14T11:17:51.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.345+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=YSZ6Z43DXDMS type=del size=2457392 2024-09-14T11:17:51.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.346+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=41VSPE6VGY31 type=del 2024-09-14T11:17:51.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.347+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=YNNEWPCH3JUP type=del size=380430 2024-09-14T11:17:51.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.349+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~5WKNH8JDKXE8.0 size=824933 2024-09-14T11:17:51.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.351+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=5WKNH8JDKXE8 tag=W1Z0UEK2LI4Y type=write size=1873509 2024-09-14T11:17:51.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.352+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=3PP6BL3SZW5F type=write size=335735 2024-09-14T11:17:51.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.353+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.0 size=1048576 2024-09-14T11:17:51.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.354+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.1 size=1048576 2024-09-14T11:17:51.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.354+0000 7f1be8076780 1 < canceled part key=_multipart_JDKFKO39I56L.2~IWCH0UUB2URE.2 size=804194 2024-09-14T11:17:51.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.356+0000 7f1be8076780 1 < canceled multipart upload key=JDKFKO39I56L upload=IWCH0UUB2URE tag=MRTA9KQEDVN8 type=write size=3949922 2024-09-14T11:17:51.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.357+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=ZAFKBL0ENDZV type=del size=1475421 2024-09-14T11:17:51.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.359+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=PU2DUVJFCAJZ type=del 2024-09-14T11:17:51.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.361+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~F292ERKHAJ43.0 size=798663 2024-09-14T11:17:51.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.361+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=F292ERKHAJ43 tag=WC2FASBNX671 type=write size=1847239 2024-09-14T11:17:51.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.362+0000 7f1be8076780 1 < completed delete operation key=4ADXXTIO715C tag=3R3D5SMWLK4Z type=del 2024-09-14T11:17:51.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.363+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=HJ47UZV293DD type=del size=3183154 2024-09-14T11:17:51.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.364+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=YG3UYHX04MSU type=del 2024-09-14T11:17:51.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.366+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=VWGTMFM01VUH type=del size=667926 2024-09-14T11:17:51.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.369+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=YHBSKYZHMQCL type=write 2024-09-14T11:17:51.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.372+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~EH4130O9N514.0 size=1048576 2024-09-14T11:17:51.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.373+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~EH4130O9N514.1 size=528152 2024-09-14T11:17:51.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.373+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=EH4130O9N514 tag=D84L5QV796IX type=write size=2625304 2024-09-14T11:17:51.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.374+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=NIK02QXNWYV8 type=del 2024-09-14T11:17:51.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.376+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~RF82T6RCU1VL.0 size=1048576 2024-09-14T11:17:51.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.377+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~RF82T6RCU1VL.1 size=1021545 2024-09-14T11:17:51.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.377+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=RF82T6RCU1VL tag=SJ7L5XFWEDZ9 type=write size=3118697 2024-09-14T11:17:51.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.378+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~0NQAJN9JG4PV.0 size=1048576 2024-09-14T11:17:51.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.379+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~0NQAJN9JG4PV.1 size=256820 2024-09-14T11:17:51.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.381+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=0NQAJN9JG4PV tag=EQ7TVLMF4S7G type=write size=2353972 2024-09-14T11:17:51.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.383+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=524GAUW0CZ3M type=del size=2126545 2024-09-14T11:17:51.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.384+0000 7f1be8076780 1 < completed write operation key=4ADXXTIO715C tag=ELTBZQQV0TK7 type=write size=668746 2024-09-14T11:17:51.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.385+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=6A19QIV75F4I type=write size=639939 2024-09-14T11:17:51.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.387+0000 7f1be8076780 1 < suggested remove operation key=JDKFKO39I56L tag=G23L8BDL0EEM type=del 2024-09-14T11:17:51.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.389+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=DD61Z2O64NQB type=write size=615874 2024-09-14T11:17:51.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.390+0000 7f1be8076780 1 < canceled operation key=3Z71PEWG5UMA tag=55Y6DRDX4O6T type=del size=2480485 2024-09-14T11:17:51.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.391+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=QXSAMA8MP6JQ type=del size=1358076 2024-09-14T11:17:51.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.392+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=PJQNZSFIHC1T type=del 2024-09-14T11:17:51.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.394+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~1EO5VS939C6P.0 size=1048576 2024-09-14T11:17:51.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.395+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~1EO5VS939C6P.1 size=520084 2024-09-14T11:17:51.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.395+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=1EO5VS939C6P tag=AC9RXZ7R9E4X type=write size=2617236 2024-09-14T11:17:51.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.396+0000 7f1be8076780 1 < canceled operation key=MVUN63538RAB tag=113G0Y962QBZ type=del size=2527774 2024-09-14T11:17:51.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.397+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=AIS93Y6AJI5I type=del size=1430349 2024-09-14T11:17:51.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.399+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.0 size=1048576 2024-09-14T11:17:51.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.400+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.1 size=1048576 2024-09-14T11:17:51.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.401+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~OHUUD088XJNJ.2 size=557813 2024-09-14T11:17:51.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.403+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=OHUUD088XJNJ tag=6G5M5Q2W8Z7R type=write size=3703541 2024-09-14T11:17:51.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.405+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=S0BOK8V9NK5K type=del size=2707869 2024-09-14T11:17:51.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.406+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=YSZ6Z43DXDMS type=del 2024-09-14T11:17:51.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.408+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~B3PJXMBIHAZE.0 size=1048576 2024-09-14T11:17:51.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.409+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~B3PJXMBIHAZE.1 size=555003 2024-09-14T11:17:51.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.409+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=B3PJXMBIHAZE tag=7M7L90NKQF4F type=write size=2652155 2024-09-14T11:17:51.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.410+0000 7f1be8076780 -1 < failed to complete operation key=JDKFKO39I56L tag=YNNEWPCH3JUP type=del size=380430: (22) Invalid argument 2024-09-14T11:17:51.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.412+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~LU2S7QL69L0C.0 size=1048576 2024-09-14T11:17:51.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.413+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~LU2S7QL69L0C.1 size=804062 2024-09-14T11:17:51.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.413+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=LU2S7QL69L0C tag=0DOXZ9L3UJW1 type=write size=2901214 2024-09-14T11:17:51.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.415+0000 7f1be8076780 1 < completed write operation key=7OUNKTS3X7DJ tag=3PP6BL3SZW5F type=write size=335735 2024-09-14T11:17:51.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.416+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=4O8JR1L7EJLG type=del size=3764105 2024-09-14T11:17:51.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.417+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=ZAFKBL0ENDZV type=del 2024-09-14T11:17:51.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.419+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~DUVFFQNIGJOQ.0 size=1048576 2024-09-14T11:17:51.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.420+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~DUVFFQNIGJOQ.1 size=479874 2024-09-14T11:17:51.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.420+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=DUVFFQNIGJOQ tag=HTO8SYBEVR3F type=write size=2577026 2024-09-14T11:17:51.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.421+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~F292ERKHAJ43.0 size=798663 2024-09-14T11:17:51.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.423+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=F292ERKHAJ43 tag=WC2FASBNX671 type=write size=1847239 2024-09-14T11:17:51.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.425+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.0 size=1048576 2024-09-14T11:17:51.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.426+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.1 size=1048576 2024-09-14T11:17:51.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.427+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.2 size=1038386 2024-09-14T11:17:51.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.427+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=2S3C4IKN5JAD tag=F6UOFVYNDCP7 type=write size=4184114 2024-09-14T11:17:51.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.428+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=HJ47UZV293DD type=del 2024-09-14T11:17:51.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.430+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.0 size=1048576 2024-09-14T11:17:51.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.431+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.1 size=1048576 2024-09-14T11:17:51.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.432+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.2 size=469634 2024-09-14T11:17:51.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.432+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=DDYEOVVICC33 tag=28WUSARUVDTJ type=write size=3615362 2024-09-14T11:17:51.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.434+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=VWGTMFM01VUH type=del 2024-09-14T11:17:51.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.435+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=MUWKLRO1YT4S type=write size=12134 2024-09-14T11:17:51.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.436+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~EH4130O9N514.0 size=1048576 2024-09-14T11:17:51.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.437+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~EH4130O9N514.1 size=528152 2024-09-14T11:17:51.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.439+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=EH4130O9N514 tag=D84L5QV796IX type=write size=2625304 2024-09-14T11:17:51.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.440+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=CNG3HMPVAOL2 type=del size=890162 2024-09-14T11:17:51.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.441+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~RF82T6RCU1VL.0 size=1048576 2024-09-14T11:17:51.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.442+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~RF82T6RCU1VL.1 size=1021545 2024-09-14T11:17:51.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.444+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=RF82T6RCU1VL tag=SJ7L5XFWEDZ9 type=write size=3118697 2024-09-14T11:17:51.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.445+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=8ZL5EXL6CSC7 type=del size=1370195 2024-09-14T11:17:51.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.446+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=524GAUW0CZ3M type=del 2024-09-14T11:17:51.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.449+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.0 size=1048576 2024-09-14T11:17:51.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.450+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.1 size=1048576 2024-09-14T11:17:51.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.451+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.2 size=339933 2024-09-14T11:17:51.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.451+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=YE9D8A2FG3UU tag=RPK7VBWNHOG0 type=write size=3485661 2024-09-14T11:17:51.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.453+0000 7f1be8076780 1 < suggested update operation key=JCDSP32N5C7M tag=6A19QIV75F4I type=write size=639939 2024-09-14T11:17:51.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.455+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=1AOX2SA14G6V type=del size=2012595 2024-09-14T11:17:51.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.456+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=DD61Z2O64NQB type=write size=615874 2024-09-14T11:17:51.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.457+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=30BAE5DIJEZC type=del size=2747278 2024-09-14T11:17:51.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.459+0000 7f1be8076780 1 < suggested update operation key=4ADXXTIO715C tag=QXSAMA8MP6JQ type=del size=1358076 2024-09-14T11:17:51.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.461+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~DZEINVAUAF2F.0 size=855500 2024-09-14T11:17:51.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.461+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=DZEINVAUAF2F tag=W9HDR33NK75Y type=write size=1904076 2024-09-14T11:17:51.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.463+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~1EO5VS939C6P.0 size=1048576 2024-09-14T11:17:51.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.463+0000 7f1be8076780 1 < canceled part key=_multipart_JCDSP32N5C7M.2~1EO5VS939C6P.1 size=520084 2024-09-14T11:17:51.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.464+0000 7f1be8076780 1 < canceled multipart upload key=JCDSP32N5C7M upload=1EO5VS939C6P tag=AC9RXZ7R9E4X type=write size=2617236 2024-09-14T11:17:51.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.466+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=M4A5IDUNAQH3 type=del size=255942 2024-09-14T11:17:51.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.467+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=AIS93Y6AJI5I type=del 2024-09-14T11:17:51.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.468+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=KX2QYLEH1BJP type=del size=2381864 2024-09-14T11:17:51.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.469+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=S0BOK8V9NK5K type=del 2024-09-14T11:17:51.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.472+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.0 size=1048576 2024-09-14T11:17:51.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.473+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.1 size=1048576 2024-09-14T11:17:51.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.474+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.2 size=143518 2024-09-14T11:17:51.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.474+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=7HA337LJSA3N tag=E802CS1W2ZGM type=write size=3289246 2024-09-14T11:17:51.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.475+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~B3PJXMBIHAZE.0 size=1048576 2024-09-14T11:17:51.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.476+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~B3PJXMBIHAZE.1 size=555003 2024-09-14T11:17:51.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.478+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=B3PJXMBIHAZE tag=7M7L90NKQF4F type=write size=2652155 2024-09-14T11:17:51.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.480+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.0 size=1048576 2024-09-14T11:17:51.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.483+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.1 size=1048576 2024-09-14T11:17:51.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.484+0000 7f1be8076780 1 > prepared part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.2 size=756756 2024-09-14T11:17:51.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.484+0000 7f1be8076780 1 > prepared multipart upload key=MX5J0P18BM0D upload=MAHIJHXOD8NB tag=RXDY4EEXLJHJ type=write size=3902484 2024-09-14T11:17:51.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.485+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~LU2S7QL69L0C.0 size=1048576 2024-09-14T11:17:51.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.486+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~LU2S7QL69L0C.1 size=804062 2024-09-14T11:17:51.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.488+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=LU2S7QL69L0C tag=0DOXZ9L3UJW1 type=write size=2901214 2024-09-14T11:17:51.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.490+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.0 size=1048576 2024-09-14T11:17:51.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.491+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.1 size=1048576 2024-09-14T11:17:51.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.492+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.2 size=556562 2024-09-14T11:17:51.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.492+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=JAT2B9CW71RN tag=0R53DTLAG6D3 type=write size=3702290 2024-09-14T11:17:51.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.493+0000 7f1be8076780 1 < completed delete operation key=UB0SEYZ7ITU1 tag=4O8JR1L7EJLG type=del 2024-09-14T11:17:51.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.494+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=FHZZZ655ZLH8 type=del size=3153069 2024-09-14T11:17:51.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.495+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~DUVFFQNIGJOQ.0 size=1048576 2024-09-14T11:17:51.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.496+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~DUVFFQNIGJOQ.1 size=479874 2024-09-14T11:17:51.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.498+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=DUVFFQNIGJOQ tag=HTO8SYBEVR3F type=write size=2577026 2024-09-14T11:17:51.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.499+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=O4M16JD9U5KK type=del size=217013 2024-09-14T11:17:51.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.500+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.0 size=1048576 2024-09-14T11:17:51.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.501+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.1 size=1048576 2024-09-14T11:17:51.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.502+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~2S3C4IKN5JAD.2 size=1038386 2024-09-14T11:17:51.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.506+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=2S3C4IKN5JAD tag=F6UOFVYNDCP7 type=write size=4184114 2024-09-14T11:17:51.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.507+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=STA2EXV4K9W0 type=del size=2935808 2024-09-14T11:17:51.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.508+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.0 size=1048576 2024-09-14T11:17:51.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.508+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.1 size=1048576 2024-09-14T11:17:51.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.509+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~DDYEOVVICC33.2 size=469634 2024-09-14T11:17:51.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.511+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=DDYEOVVICC33 tag=28WUSARUVDTJ type=write size=3615362 2024-09-14T11:17:51.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.512+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=57G52W48XRB9 type=del size=3303636 2024-09-14T11:17:51.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.515+0000 7f1be8076780 1 < suggested update operation key=T70EFGHRQZQ7 tag=MUWKLRO1YT4S type=write size=12134 2024-09-14T11:17:51.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.517+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.0 size=1048576 2024-09-14T11:17:51.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.518+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.1 size=1048576 2024-09-14T11:17:51.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.519+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.2 size=365035 2024-09-14T11:17:51.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.519+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=8ESFS4B8JKEU tag=IX0217MRZVOB type=write size=3510763 2024-09-14T11:17:51.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.520+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=CNG3HMPVAOL2 type=del 2024-09-14T11:17:51.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.522+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.0 size=1048576 2024-09-14T11:17:51.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.523+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.1 size=1048576 2024-09-14T11:17:51.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.524+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.2 size=711473 2024-09-14T11:17:51.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.524+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=IQYTGO75HXB3 tag=PUK244XJ8D48 type=write size=3857201 2024-09-14T11:17:51.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.525+0000 7f1be8076780 1 < canceled operation key=UB0SEYZ7ITU1 tag=8ZL5EXL6CSC7 type=del size=1370195 2024-09-14T11:17:51.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.526+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=KVB6RY3OB722 type=del size=1725389 2024-09-14T11:17:51.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.528+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.0 size=1048576 2024-09-14T11:17:51.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.528+0000 7f1be8076780 1 < canceled part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.1 size=1048576 2024-09-14T11:17:51.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.529+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~YE9D8A2FG3UU.2 size=339933 2024-09-14T11:17:51.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.530+0000 7f1be8076780 1 < canceled multipart upload key=MX5J0P18BM0D upload=YE9D8A2FG3UU tag=RPK7VBWNHOG0 type=write size=3485661 2024-09-14T11:17:51.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.532+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=BZHR7VLWLIKS type=del size=3709355 2024-09-14T11:17:51.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.533+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=1AOX2SA14G6V type=del 2024-09-14T11:17:51.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.535+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.0 size=1048576 2024-09-14T11:17:51.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.536+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.1 size=1048576 2024-09-14T11:17:51.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.537+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.2 size=926052 2024-09-14T11:17:51.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.537+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=QFUA4TH5BRVL tag=6AB2DCB5SLG6 type=write size=4071780 2024-09-14T11:17:51.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.539+0000 7f1be8076780 1 < suggested update operation key=MX5J0P18BM0D tag=30BAE5DIJEZC type=del size=2747278 2024-09-14T11:17:51.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.540+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=GK7VJ19S19CW type=del size=725153 2024-09-14T11:17:51.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.541+0000 7f1be8076780 1 < canceled part key=_multipart_JIWPGHQ3GEZB.2~DZEINVAUAF2F.0 size=855500 2024-09-14T11:17:51.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.543+0000 7f1be8076780 1 < canceled multipart upload key=JIWPGHQ3GEZB upload=DZEINVAUAF2F tag=W9HDR33NK75Y type=write size=1904076 2024-09-14T11:17:51.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.545+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~HFE7ARB83OWQ.0 size=1048576 2024-09-14T11:17:51.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.546+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~HFE7ARB83OWQ.1 size=697356 2024-09-14T11:17:51.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.546+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=HFE7ARB83OWQ tag=8R66VVXUCDUK type=write size=2794508 2024-09-14T11:17:51.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.547+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=M4A5IDUNAQH3 type=del size=255942 2024-09-14T11:17:51.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.550+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~PYWOGSIASUIW.0 size=1048576 2024-09-14T11:17:51.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.550+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~PYWOGSIASUIW.1 size=885712 2024-09-14T11:17:51.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.550+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=PYWOGSIASUIW tag=39QLVEUUW4L0 type=write size=2982864 2024-09-14T11:17:51.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.553+0000 7f1be8076780 1 < suggested remove operation key=KQ479IOZ0108 tag=KX2QYLEH1BJP type=del 2024-09-14T11:17:51.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.555+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9R91KH10VFR0.0 size=1048576 2024-09-14T11:17:51.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.556+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~9R91KH10VFR0.1 size=765551 2024-09-14T11:17:51.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.556+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=9R91KH10VFR0 tag=L6X9WOVUMDC1 type=write size=2862703 2024-09-14T11:17:51.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.558+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.0 size=1048576 2024-09-14T11:17:51.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.558+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.1 size=1048576 2024-09-14T11:17:51.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.560+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~7HA337LJSA3N.2 size=143518 2024-09-14T11:17:51.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.562+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=7HA337LJSA3N tag=E802CS1W2ZGM type=write size=3289246 2024-09-14T11:17:51.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.564+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.0 size=1048576 2024-09-14T11:17:51.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.565+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.1 size=1048576 2024-09-14T11:17:51.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.566+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.2 size=677109 2024-09-14T11:17:51.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.566+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=RNMCSFU88751 tag=7D4L8102BBWV type=write size=3822837 2024-09-14T11:17:51.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.567+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.0 size=1048576 2024-09-14T11:17:51.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.568+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.1 size=1048576 2024-09-14T11:17:51.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.569+0000 7f1be8076780 1 < completed part key=_multipart_MX5J0P18BM0D.2~MAHIJHXOD8NB.2 size=756756 2024-09-14T11:17:51.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.571+0000 7f1be8076780 1 < completed multipart upload key=MX5J0P18BM0D upload=MAHIJHXOD8NB tag=RXDY4EEXLJHJ type=write size=3902484 2024-09-14T11:17:51.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.572+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=D2X8K2DF2QOE type=del size=1005800 2024-09-14T11:17:51.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.574+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.0 size=1048576 2024-09-14T11:17:51.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.574+0000 7f1be8076780 1 < canceled part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.1 size=1048576 2024-09-14T11:17:51.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.575+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~JAT2B9CW71RN.2 size=556562 2024-09-14T11:17:51.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.577+0000 7f1be8076780 1 < canceled multipart upload key=INU0TV92GXSP upload=JAT2B9CW71RN tag=0R53DTLAG6D3 type=write size=3702290 2024-09-14T11:17:51.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.579+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~1FM75UO1YUNW.0 size=949123 2024-09-14T11:17:51.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.579+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=1FM75UO1YUNW tag=AWVZ9S99AU50 type=write size=1997699 2024-09-14T11:17:51.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.580+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=FHZZZ655ZLH8 type=del 2024-09-14T11:17:51.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.582+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~6TIXPT37NWFZ.0 size=24817 2024-09-14T11:17:51.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.582+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=6TIXPT37NWFZ tag=O7056CSMEIEN type=write size=1073393 2024-09-14T11:17:51.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.583+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=O4M16JD9U5KK type=del 2024-09-14T11:17:51.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.585+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=9OYUUMF515RV type=write size=617259 2024-09-14T11:17:51.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.586+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=STA2EXV4K9W0 type=del 2024-09-14T11:17:51.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.588+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~PU7CK8KUVRGQ.0 size=1048576 2024-09-14T11:17:51.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.589+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~PU7CK8KUVRGQ.1 size=709756 2024-09-14T11:17:51.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.589+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=PU7CK8KUVRGQ tag=W2QPBYKV9KW9 type=write size=2806908 2024-09-14T11:17:51.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.590+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=57G52W48XRB9 type=del 2024-09-14T11:17:51.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.591+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=8NCQYYITCJL2 type=del size=3091220 2024-09-14T11:17:51.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.594+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.0 size=1048576 2024-09-14T11:17:51.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.595+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.1 size=1048576 2024-09-14T11:17:51.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.596+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~8ESFS4B8JKEU.2 size=365035 2024-09-14T11:17:51.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.598+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=8ESFS4B8JKEU tag=IX0217MRZVOB type=write size=3510763 2024-09-14T11:17:51.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.599+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3KF3RVDFVGSN.0 size=454246 2024-09-14T11:17:51.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.599+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=3KF3RVDFVGSN tag=5WTXHOU7TWXK type=write size=1502822 2024-09-14T11:17:51.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.601+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.0 size=1048576 2024-09-14T11:17:51.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.602+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.1 size=1048576 2024-09-14T11:17:51.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.602+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~IQYTGO75HXB3.2 size=711473 2024-09-14T11:17:51.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.604+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=IQYTGO75HXB3 tag=PUK244XJ8D48 type=write size=3857201 2024-09-14T11:17:51.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.606+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~N3WKTRZPVXW2.0 size=555338 2024-09-14T11:17:51.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.606+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=N3WKTRZPVXW2 tag=LM8W1Q72ZXFO type=write size=1603914 2024-09-14T11:17:51.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.607+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=KVB6RY3OB722 type=del 2024-09-14T11:17:51.607 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.609+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=UVXK5BTXYRV9 type=del size=329362 2024-09-14T11:17:51.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.611+0000 7f1be8076780 1 < suggested remove operation key=CQDRZMJAJ7FZ tag=BZHR7VLWLIKS type=del 2024-09-14T11:17:51.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.613+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.0 size=1048576 2024-09-14T11:17:51.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.614+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.1 size=1048576 2024-09-14T11:17:51.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.614+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.2 size=635473 2024-09-14T11:17:51.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.614+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=G4DBOZGAIJM8 tag=T4FXVX6Q9QNE type=write size=3781201 2024-09-14T11:17:51.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.615+0000 7f1be8076780 1 < canceled part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.0 size=1048576 2024-09-14T11:17:51.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.616+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.1 size=1048576 2024-09-14T11:17:51.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.616+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~QFUA4TH5BRVL.2 size=926052 2024-09-14T11:17:51.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.618+0000 7f1be8076780 1 < canceled multipart upload key=3YIK6B6Y2EU1 upload=QFUA4TH5BRVL tag=6AB2DCB5SLG6 type=write size=4071780 2024-09-14T11:17:51.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.619+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=VMYD18DWF69H type=write size=890230 2024-09-14T11:17:51.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.622+0000 7f1be8076780 1 < suggested remove operation key=XB3M4CI0ERWP tag=GK7VJ19S19CW type=del 2024-09-14T11:17:51.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.624+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~TYJJ0N1F0Z58.0 size=154431 2024-09-14T11:17:51.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.624+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=TYJJ0N1F0Z58 tag=PAVCE0WQJNX5 type=write size=1203007 2024-09-14T11:17:51.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.625+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~HFE7ARB83OWQ.0 size=1048576 2024-09-14T11:17:51.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.626+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~HFE7ARB83OWQ.1 size=697356 2024-09-14T11:17:51.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.629+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=HFE7ARB83OWQ tag=8R66VVXUCDUK type=write size=2794508 2024-09-14T11:17:51.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.630+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=PMF2U02KT9ER type=del size=1424346 2024-09-14T11:17:51.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.632+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~PYWOGSIASUIW.0 size=1048576 2024-09-14T11:17:51.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.632+0000 7f1be8076780 1 < canceled part key=_multipart_1X2EWK1Y2GE0.2~PYWOGSIASUIW.1 size=885712 2024-09-14T11:17:51.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.634+0000 7f1be8076780 1 < canceled multipart upload key=1X2EWK1Y2GE0 upload=PYWOGSIASUIW tag=39QLVEUUW4L0 type=write size=2982864 2024-09-14T11:17:51.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.635+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=W84TV6AA0RTQ type=del size=1532189 2024-09-14T11:17:51.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.636+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9R91KH10VFR0.0 size=1048576 2024-09-14T11:17:51.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.637+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~9R91KH10VFR0.1 size=765551 2024-09-14T11:17:51.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.639+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=9R91KH10VFR0 tag=L6X9WOVUMDC1 type=write size=2862703 2024-09-14T11:17:51.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.641+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.0 size=1048576 2024-09-14T11:17:51.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.642+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.1 size=1048576 2024-09-14T11:17:51.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.643+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.2 size=668786 2024-09-14T11:17:51.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.643+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=S0322LD1FHGR tag=0A2GUX8TFF9X type=write size=3814514 2024-09-14T11:17:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.644+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.0 size=1048576 2024-09-14T11:17:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.645+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.1 size=1048576 2024-09-14T11:17:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.646+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~RNMCSFU88751.2 size=677109 2024-09-14T11:17:51.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.648+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=RNMCSFU88751 tag=7D4L8102BBWV type=write size=3822837 2024-09-14T11:17:51.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.649+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=GDVO6OBVK0V3 type=del size=2800340 2024-09-14T11:17:51.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.650+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=D2X8K2DF2QOE type=del 2024-09-14T11:17:51.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.652+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~YBDRGA5VAOGA.0 size=206820 2024-09-14T11:17:51.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.652+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=YBDRGA5VAOGA tag=KSGO0FA4B980 type=write size=1255396 2024-09-14T11:17:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.653+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~1FM75UO1YUNW.0 size=949123 2024-09-14T11:17:51.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.655+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=1FM75UO1YUNW tag=AWVZ9S99AU50 type=write size=1997699 2024-09-14T11:17:51.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.656+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=MWMHFPEXHP38 type=del size=4173136 2024-09-14T11:17:51.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.658+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~6TIXPT37NWFZ.0 size=24817 2024-09-14T11:17:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.660+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=6TIXPT37NWFZ tag=O7056CSMEIEN type=write size=1073393 2024-09-14T11:17:51.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.662+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8L8UR6TIOGVN.0 size=1048576 2024-09-14T11:17:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.663+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~8L8UR6TIOGVN.1 size=543144 2024-09-14T11:17:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.663+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=8L8UR6TIOGVN tag=R8VB9M9VVWDD type=write size=2640296 2024-09-14T11:17:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.664+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=XB3M4CI0ERWP tag=9OYUUMF515RV type=write size=617259: (2) No such file or directory 2024-09-14T11:17:51.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.666+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~K85FEPQGCA0R.0 size=1048576 2024-09-14T11:17:51.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.667+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~K85FEPQGCA0R.1 size=100832 2024-09-14T11:17:51.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.667+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=K85FEPQGCA0R tag=DK9UGWCLKOUZ type=write size=2197984 2024-09-14T11:17:51.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.668+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~PU7CK8KUVRGQ.0 size=1048576 2024-09-14T11:17:51.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.669+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~PU7CK8KUVRGQ.1 size=709756 2024-09-14T11:17:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.671+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=PU7CK8KUVRGQ tag=W2QPBYKV9KW9 type=write size=2806908 2024-09-14T11:17:51.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.672+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=0NFHUUVA7N2H type=write size=343285 2024-09-14T11:17:51.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.673+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=8NCQYYITCJL2 type=del 2024-09-14T11:17:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.674+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=SE69DGJUE7JF type=write size=858834 2024-09-14T11:17:51.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.675+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~3KF3RVDFVGSN.0 size=454246 2024-09-14T11:17:51.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.677+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=3KF3RVDFVGSN tag=5WTXHOU7TWXK type=write size=1502822 2024-09-14T11:17:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.679+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~4VQGEHUXI7UF.0 size=1048576 2024-09-14T11:17:51.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.680+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~4VQGEHUXI7UF.1 size=49172 2024-09-14T11:17:51.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.680+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=4VQGEHUXI7UF tag=0U6O7CETX5KP type=write size=2146324 2024-09-14T11:17:51.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.682+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~N3WKTRZPVXW2.0 size=555338 2024-09-14T11:17:51.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.683+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=N3WKTRZPVXW2 tag=LM8W1Q72ZXFO type=write size=1603914 2024-09-14T11:17:51.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.684+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=K61Y7B1B7V3A type=write size=467276 2024-09-14T11:17:51.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.686+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=UVXK5BTXYRV9 type=del 2024-09-14T11:17:51.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.688+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~FBMP0RZB022E.0 size=962166 2024-09-14T11:17:51.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.688+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=FBMP0RZB022E tag=GIZB0YAZJZTE type=write size=2010742 2024-09-14T11:17:51.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.689+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.0 size=1048576 2024-09-14T11:17:51.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.690+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.1 size=1048576 2024-09-14T11:17:51.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.691+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~G4DBOZGAIJM8.2 size=635473 2024-09-14T11:17:51.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.693+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=G4DBOZGAIJM8 tag=T4FXVX6Q9QNE type=write size=3781201 2024-09-14T11:17:51.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.694+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=WKJZGTZR1WWV type=del size=483980 2024-09-14T11:17:51.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.695+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=VMYD18DWF69H type=write size=890230 2024-09-14T11:17:51.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.697+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=JFTPMTMI1BEY type=del size=3870201 2024-09-14T11:17:51.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.698+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~TYJJ0N1F0Z58.0 size=154431 2024-09-14T11:17:51.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.701+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=TYJJ0N1F0Z58 tag=PAVCE0WQJNX5 type=write size=1203007 2024-09-14T11:17:51.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.702+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=R5A8ZG02XOZ0 type=del size=740077 2024-09-14T11:17:51.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.703+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=PMF2U02KT9ER type=del 2024-09-14T11:17:51.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.704+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=WTRFIIKS3XGO type=write size=759764 2024-09-14T11:17:51.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.705+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=W84TV6AA0RTQ type=del 2024-09-14T11:17:51.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.708+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.0 size=1048576 2024-09-14T11:17:51.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.708+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.1 size=1048576 2024-09-14T11:17:51.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.709+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.2 size=1042215 2024-09-14T11:17:51.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.709+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=LXIOBAIW42IC tag=PK9JHQLBRG1Z type=write size=4187943 2024-09-14T11:17:51.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.710+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.0 size=1048576 2024-09-14T11:17:51.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.711+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.1 size=1048576 2024-09-14T11:17:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.712+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~S0322LD1FHGR.2 size=668786 2024-09-14T11:17:51.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.714+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=S0322LD1FHGR tag=0A2GUX8TFF9X type=write size=3814514 2024-09-14T11:17:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.716+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~EH5RT2K0OXLJ.0 size=1048576 2024-09-14T11:17:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.717+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~EH5RT2K0OXLJ.1 size=1035826 2024-09-14T11:17:51.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.717+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=EH5RT2K0OXLJ tag=U6T1Q37AJ68O type=write size=3132978 2024-09-14T11:17:51.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.718+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=GDVO6OBVK0V3 type=del 2024-09-14T11:17:51.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.719+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=ORR4L4ZIYP8V type=del size=3920151 2024-09-14T11:17:51.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.720+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~YBDRGA5VAOGA.0 size=206820 2024-09-14T11:17:51.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.722+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=YBDRGA5VAOGA tag=KSGO0FA4B980 type=write size=1255396 2024-09-14T11:17:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.724+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~CS23U2H3O45R.0 size=670087 2024-09-14T11:17:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.724+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=CS23U2H3O45R tag=BIDA9D9S020W type=write size=1718663 2024-09-14T11:17:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.726+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=MWMHFPEXHP38 type=del 2024-09-14T11:17:51.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.727+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=CWZNI0MRSLZQ type=write size=720688 2024-09-14T11:17:51.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.728+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8L8UR6TIOGVN.0 size=1048576 2024-09-14T11:17:51.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.729+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~8L8UR6TIOGVN.1 size=543144 2024-09-14T11:17:51.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.731+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=8L8UR6TIOGVN tag=R8VB9M9VVWDD type=write size=2640296 2024-09-14T11:17:51.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.732+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=62NR0PTI4DC4 type=del size=3015260 2024-09-14T11:17:51.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.734+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~K85FEPQGCA0R.0 size=1048576 2024-09-14T11:17:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.734+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~K85FEPQGCA0R.1 size=100832 2024-09-14T11:17:51.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.736+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=K85FEPQGCA0R tag=DK9UGWCLKOUZ type=write size=2197984 2024-09-14T11:17:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.738+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=OV9VVS23C6LZ type=del size=2912224 2024-09-14T11:17:51.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.739+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=0NFHUUVA7N2H type=write size=343285 2024-09-14T11:17:51.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.740+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=XNVUKJ0ORVD9 type=del size=804396 2024-09-14T11:17:51.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.742+0000 7f1be8076780 1 < completed write operation key=3YIK6B6Y2EU1 tag=SE69DGJUE7JF type=write size=858834 2024-09-14T11:17:51.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.743+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=Q7LXRPBS71CZ type=write size=280375 2024-09-14T11:17:51.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.744+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~4VQGEHUXI7UF.0 size=1048576 2024-09-14T11:17:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.745+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~4VQGEHUXI7UF.1 size=49172 2024-09-14T11:17:51.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.747+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=4VQGEHUXI7UF tag=0U6O7CETX5KP type=write size=2146324 2024-09-14T11:17:51.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.749+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=TK9982D60KBU type=del size=2947853 2024-09-14T11:17:51.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.751+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=K61Y7B1B7V3A type=write 2024-09-14T11:17:51.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.752+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=TRZ32HP9ZF8C type=del size=628440 2024-09-14T11:17:51.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.754+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~FBMP0RZB022E.0 size=962166 2024-09-14T11:17:51.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.756+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=FBMP0RZB022E tag=GIZB0YAZJZTE type=write size=2010742 2024-09-14T11:17:51.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.757+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=D3M3E9KGJ7S6 type=del size=1649354 2024-09-14T11:17:51.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.760+0000 7f1be8076780 1 < suggested remove operation key=4AY6ZXFKO1YQ tag=WKJZGTZR1WWV type=del 2024-09-14T11:17:51.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.762+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.0 size=1048576 2024-09-14T11:17:51.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.763+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.1 size=1048576 2024-09-14T11:17:51.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.764+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.2 size=10131 2024-09-14T11:17:51.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.764+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=IUR9717TG3Y5 tag=CJ9A02XVNKCK type=write size=3155859 2024-09-14T11:17:51.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.767+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=JFTPMTMI1BEY type=del size=3870201 2024-09-14T11:17:51.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.769+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~ID3DPKH4JD2B.0 size=179973 2024-09-14T11:17:51.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.769+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=ID3DPKH4JD2B tag=NVNZJZ8389TR type=write size=1228549 2024-09-14T11:17:51.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.771+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=R5A8ZG02XOZ0 type=del 2024-09-14T11:17:51.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.773+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~ARPTR817CMCX.0 size=716988 2024-09-14T11:17:51.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.773+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=ARPTR817CMCX tag=95W2LXDABY7F type=write size=1765564 2024-09-14T11:17:51.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.774+0000 7f1be8076780 1 < completed write operation key=XB3M4CI0ERWP tag=WTRFIIKS3XGO type=write size=759764 2024-09-14T11:17:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.776+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=QFK1DTTKJBKY type=del size=2753503 2024-09-14T11:17:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.776+0000 7f1be8076780 1 < canceled part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.0 size=1048576 2024-09-14T11:17:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.777+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.1 size=1048576 2024-09-14T11:17:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.777+0000 7f1be8076780 1 < canceled part key=_multipart_RIYGSRWKVKFF.2~LXIOBAIW42IC.2 size=1042215 2024-09-14T11:17:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.779+0000 7f1be8076780 1 < canceled multipart upload key=RIYGSRWKVKFF upload=LXIOBAIW42IC tag=PK9JHQLBRG1Z type=write size=4187943 2024-09-14T11:17:51.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.781+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=2WFAHBLDVWAT type=del size=2147460 2024-09-14T11:17:51.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.782+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~EH5RT2K0OXLJ.0 size=1048576 2024-09-14T11:17:51.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.782+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~EH5RT2K0OXLJ.1 size=1035826 2024-09-14T11:17:51.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.784+0000 7f1be8076780 1 < canceled multipart upload key=0BX70Q8C1QL0 upload=EH5RT2K0OXLJ tag=U6T1Q37AJ68O type=write size=3132978 2024-09-14T11:17:51.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.785+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=ZX3TZDTUUYC6 type=del size=1240298 2024-09-14T11:17:51.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.786+0000 7f1be8076780 -1 < no bi entry to suggest for operation key=0BX70Q8C1QL0 tag=ORR4L4ZIYP8V type=del size=3920151: (2) No such file or directory 2024-09-14T11:17:51.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.788+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.0 size=1048576 2024-09-14T11:17:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.789+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.1 size=1048576 2024-09-14T11:17:51.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.790+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.2 size=387458 2024-09-14T11:17:51.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.790+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=HI3YTH8EPPD9 tag=KRJHT9YFLMFF type=write size=3533186 2024-09-14T11:17:51.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.792+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~CS23U2H3O45R.0 size=670087 2024-09-14T11:17:51.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.793+0000 7f1be8076780 1 < completed multipart upload key=1X2EWK1Y2GE0 upload=CS23U2H3O45R tag=BIDA9D9S020W type=write size=1718663 2024-09-14T11:17:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.796+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~YO5D4SK12NKK.0 size=759618 2024-09-14T11:17:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.796+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=YO5D4SK12NKK tag=RSWTI1HLLGXM type=write size=1808194 2024-09-14T11:17:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.797+0000 7f1be8076780 1 < completed write operation key=AUCQC0OBQP7Z tag=CWZNI0MRSLZQ type=write size=720688 2024-09-14T11:17:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.798+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=HW9ARUMS3X7F type=write size=98823 2024-09-14T11:17:51.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.800+0000 7f1be8076780 1 < suggested remove operation key=SJES17ZIGRZE tag=62NR0PTI4DC4 type=del 2024-09-14T11:17:51.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.802+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=IOTYQ6HIDSX7 type=del size=264283 2024-09-14T11:17:51.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.803+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=OV9VVS23C6LZ type=del 2024-09-14T11:17:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.804+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=YH6WA0NN56QA type=del size=3956115 2024-09-14T11:17:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.805+0000 7f1be8076780 -1 < failed to complete operation key=2RJYZ1CRDVEP tag=XNVUKJ0ORVD9 type=del size=804396: (22) Invalid argument 2024-09-14T11:17:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.807+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=R4ZS1WMPV4IT type=del size=937676 2024-09-14T11:17:51.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.808+0000 7f1be8076780 1 < canceled operation key=26WW5JFVB36U tag=Q7LXRPBS71CZ type=write size=280375 2024-09-14T11:17:51.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.809+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=17PTOJ67WUGR type=del size=3371408 2024-09-14T11:17:51.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.812+0000 7f1be8076780 1 < suggested update operation key=XI178717NOE8 tag=TK9982D60KBU type=del size=2947853 2024-09-14T11:17:51.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.814+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.0 size=1048576 2024-09-14T11:17:51.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.815+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.1 size=1048576 2024-09-14T11:17:51.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.817+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.2 size=770416 2024-09-14T11:17:51.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.817+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=P7FAARBFCBWC tag=34486VZABP5F type=write size=3916144 2024-09-14T11:17:51.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.818+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=TRZ32HP9ZF8C type=del 2024-09-14T11:17:51.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.819+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=YJUELE2WN373 type=del size=505657 2024-09-14T11:17:51.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.821+0000 7f1be8076780 1 < suggested remove operation key=CQDRZMJAJ7FZ tag=D3M3E9KGJ7S6 type=del 2024-09-14T11:17:51.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.823+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~15I44GQE0110.0 size=1048576 2024-09-14T11:17:51.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.824+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~15I44GQE0110.1 size=758059 2024-09-14T11:17:51.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.824+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=15I44GQE0110 tag=MEO3SHN88HI3 type=write size=2855211 2024-09-14T11:17:51.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.825+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.0 size=1048576 2024-09-14T11:17:51.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.826+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.1 size=1048576 2024-09-14T11:17:51.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.827+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~IUR9717TG3Y5.2 size=10131 2024-09-14T11:17:51.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.829+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=IUR9717TG3Y5 tag=CJ9A02XVNKCK type=write size=3155859 2024-09-14T11:17:51.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.831+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.0 size=1048576 2024-09-14T11:17:51.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.832+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.1 size=1048576 2024-09-14T11:17:51.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.833+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.2 size=585513 2024-09-14T11:17:51.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.833+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=LAS3OAX0VWYK tag=X3UESU253OJ6 type=write size=3731241 2024-09-14T11:17:51.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.834+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~ID3DPKH4JD2B.0 size=179973 2024-09-14T11:17:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.836+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=ID3DPKH4JD2B tag=NVNZJZ8389TR type=write size=1228549 2024-09-14T11:17:51.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.837+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=OGO3G1GMKYAV type=del size=815495 2024-09-14T11:17:51.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.838+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~ARPTR817CMCX.0 size=716988 2024-09-14T11:17:51.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.840+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=ARPTR817CMCX tag=95W2LXDABY7F type=write size=1765564 2024-09-14T11:17:51.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.841+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=T3TDMN7TBUUT type=del size=2420794 2024-09-14T11:17:51.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.842+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=QFK1DTTKJBKY type=del 2024-09-14T11:17:51.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.844+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=KJFKBVZJJCU0 type=del size=1168889 2024-09-14T11:17:51.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.845+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=2WFAHBLDVWAT type=del 2024-09-14T11:17:51.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.847+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~VP01TWAN3S0K.0 size=1048576 2024-09-14T11:17:51.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.848+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~VP01TWAN3S0K.1 size=750075 2024-09-14T11:17:51.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.848+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=VP01TWAN3S0K tag=ORUOU826BF7G type=write size=2847227 2024-09-14T11:17:51.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.849+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=ZX3TZDTUUYC6 type=del 2024-09-14T11:17:51.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.850+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=O9JILU5OK7EO type=del size=3781345 2024-09-14T11:17:51.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.851+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.0 size=1048576 2024-09-14T11:17:51.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.852+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.1 size=1048576 2024-09-14T11:17:51.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.853+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~HI3YTH8EPPD9.2 size=387458 2024-09-14T11:17:51.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.855+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=HI3YTH8EPPD9 tag=KRJHT9YFLMFF type=write size=3533186 2024-09-14T11:17:51.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.857+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.0 size=1048576 2024-09-14T11:17:51.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.858+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.1 size=1048576 2024-09-14T11:17:51.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.859+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.2 size=537165 2024-09-14T11:17:51.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.859+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=4KV7IDKZ1PNB tag=YQMUWWPQXPU9 type=write size=3682893 2024-09-14T11:17:51.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.860+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~YO5D4SK12NKK.0 size=759618 2024-09-14T11:17:51.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.862+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=YO5D4SK12NKK tag=RSWTI1HLLGXM type=write size=1808194 2024-09-14T11:17:51.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.865+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.0 size=1048576 2024-09-14T11:17:51.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.866+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.1 size=1048576 2024-09-14T11:17:51.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.867+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.2 size=789399 2024-09-14T11:17:51.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.867+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=LMKHPO78T6WF tag=D05JWGTSV0IO type=write size=3935127 2024-09-14T11:17:51.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.868+0000 7f1be8076780 1 < completed write operation key=QIEUKUQ8CS2U tag=HW9ARUMS3X7F type=write size=98823 2024-09-14T11:17:51.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.870+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~81B9BLHEYC5B.0 size=482407 2024-09-14T11:17:51.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.870+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=81B9BLHEYC5B tag=KJVMJTN08MPD type=write size=1530983 2024-09-14T11:17:51.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.871+0000 7f1be8076780 1 < completed delete operation key=26WW5JFVB36U tag=IOTYQ6HIDSX7 type=del 2024-09-14T11:17:51.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.872+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=V73VNSH471W1 type=del size=1741097 2024-09-14T11:17:51.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.875+0000 7f1be8076780 1 < suggested update operation key=2RJYZ1CRDVEP tag=YH6WA0NN56QA type=del size=3956115 2024-09-14T11:17:51.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.877+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.0 size=1048576 2024-09-14T11:17:51.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.878+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.1 size=1048576 2024-09-14T11:17:51.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.879+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.2 size=571952 2024-09-14T11:17:51.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.879+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=KBDVOIIY9LS0 tag=4M0K77O0UXM7 type=write size=3717680 2024-09-14T11:17:51.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.880+0000 7f1be8076780 1 < canceled operation key=LNMGQ54S2CXX tag=R4ZS1WMPV4IT type=del size=937676 2024-09-14T11:17:51.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.882+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~VHWJSZVO0ZPA.0 size=1048576 2024-09-14T11:17:51.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.883+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~VHWJSZVO0ZPA.1 size=486922 2024-09-14T11:17:51.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.883+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=VHWJSZVO0ZPA tag=SZNMXT8ZG3LM type=write size=2584074 2024-09-14T11:17:51.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.884+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=17PTOJ67WUGR type=del 2024-09-14T11:17:51.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.885+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=0O4YZZZ0SDEN type=write size=389168 2024-09-14T11:17:51.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.887+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.0 size=1048576 2024-09-14T11:17:51.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.887+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.1 size=1048576 2024-09-14T11:17:51.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.888+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~P7FAARBFCBWC.2 size=770416 2024-09-14T11:17:51.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.890+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=P7FAARBFCBWC tag=34486VZABP5F type=write size=3916144 2024-09-14T11:17:51.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.891+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=LOGAK4GL5OZX type=del size=2508522 2024-09-14T11:17:51.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.894+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=YJUELE2WN373 type=del 2024-09-14T11:17:51.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.895+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=VFK5IO6PAS24 type=del size=2489957 2024-09-14T11:17:51.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.895+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~15I44GQE0110.0 size=1048576 2024-09-14T11:17:51.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.896+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~15I44GQE0110.1 size=758059 2024-09-14T11:17:51.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.898+0000 7f1be8076780 1 < canceled multipart upload key=MVUN63538RAB upload=15I44GQE0110 tag=MEO3SHN88HI3 type=write size=2855211 2024-09-14T11:17:51.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.899+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=9NKY4S57OS6K type=del size=337872 2024-09-14T11:17:51.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.900+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.0 size=1048576 2024-09-14T11:17:51.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.901+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.1 size=1048576 2024-09-14T11:17:51.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.902+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~LAS3OAX0VWYK.2 size=585513 2024-09-14T11:17:51.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.904+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=LAS3OAX0VWYK tag=X3UESU253OJ6 type=write size=3731241 2024-09-14T11:17:51.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.906+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~QLMY2S2Y5WGN.0 size=1048576 2024-09-14T11:17:51.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.907+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~QLMY2S2Y5WGN.1 size=944695 2024-09-14T11:17:51.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.907+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=QLMY2S2Y5WGN tag=UDC1E0X2CLM2 type=write size=3041847 2024-09-14T11:17:51.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.909+0000 7f1be8076780 1 < suggested update operation key=JDKFKO39I56L tag=OGO3G1GMKYAV type=del size=815495 2024-09-14T11:17:51.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.911+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.0 size=1048576 2024-09-14T11:17:51.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.912+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.1 size=1048576 2024-09-14T11:17:51.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.913+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.2 size=663410 2024-09-14T11:17:51.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.913+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=X0TE9102V0AA tag=SE1O27BAW8IG type=write size=3809138 2024-09-14T11:17:51.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.914+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=T3TDMN7TBUUT type=del 2024-09-14T11:17:51.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.916+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=FJO2C9XIHVQK type=del size=522939 2024-09-14T11:17:51.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.917+0000 7f1be8076780 -1 < failed to complete operation key=JQZ7C562TQ8D tag=KJFKBVZJJCU0 type=del size=1168889: (22) Invalid argument 2024-09-14T11:17:51.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.918+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=BKB08AUYTX13 type=del size=3012549 2024-09-14T11:17:51.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.918+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~VP01TWAN3S0K.0 size=1048576 2024-09-14T11:17:51.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.919+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~VP01TWAN3S0K.1 size=750075 2024-09-14T11:17:51.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.922+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=VP01TWAN3S0K tag=ORUOU826BF7G type=write size=2847227 2024-09-14T11:17:51.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.924+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=NKC1BF23D037 type=del size=1697898 2024-09-14T11:17:51.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.925+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=O9JILU5OK7EO type=del 2024-09-14T11:17:51.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.928+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.0 size=1048576 2024-09-14T11:17:51.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.929+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.1 size=1048576 2024-09-14T11:17:51.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.930+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.2 size=383559 2024-09-14T11:17:51.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.930+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=APURZV3FFNBJ tag=M5ESMK79V7KJ type=write size=3529287 2024-09-14T11:17:51.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.931+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.0 size=1048576 2024-09-14T11:17:51.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.932+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.1 size=1048576 2024-09-14T11:17:51.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.933+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~4KV7IDKZ1PNB.2 size=537165 2024-09-14T11:17:51.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.935+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=4KV7IDKZ1PNB tag=YQMUWWPQXPU9 type=write size=3682893 2024-09-14T11:17:51.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.936+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=TUMVBNMT1COQ type=del size=2141253 2024-09-14T11:17:51.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.940+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.0 size=1048576 2024-09-14T11:17:51.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.940+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.1 size=1048576 2024-09-14T11:17:51.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.942+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~LMKHPO78T6WF.2 size=789399 2024-09-14T11:17:51.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.944+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=LMKHPO78T6WF tag=D05JWGTSV0IO type=write size=3935127 2024-09-14T11:17:51.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.946+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.0 size=1048576 2024-09-14T11:17:51.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.947+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.1 size=1048576 2024-09-14T11:17:51.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.948+0000 7f1be8076780 1 > prepared part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.2 size=259253 2024-09-14T11:17:51.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.948+0000 7f1be8076780 1 > prepared multipart upload key=JCDSP32N5C7M upload=AZYQW3YAEZ0Q tag=05Y16CNM5N2A type=write size=3404981 2024-09-14T11:17:51.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.949+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~81B9BLHEYC5B.0 size=482407 2024-09-14T11:17:51.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.951+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=81B9BLHEYC5B tag=KJVMJTN08MPD type=write size=1530983 2024-09-14T11:17:51.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.953+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~7B343Z6UBMJC.0 size=1005159 2024-09-14T11:17:51.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.953+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=7B343Z6UBMJC tag=25QTZAT55YEE type=write size=2053735 2024-09-14T11:17:51.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.954+0000 7f1be8076780 -1 < failed to complete operation key=JQZ7C562TQ8D tag=V73VNSH471W1 type=del size=1741097: (22) Invalid argument 2024-09-14T11:17:51.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.955+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=9330TNY8C408 type=write size=438618 2024-09-14T11:17:51.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.956+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.0 size=1048576 2024-09-14T11:17:51.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.957+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.1 size=1048576 2024-09-14T11:17:51.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.957+0000 7f1be8076780 1 < canceled part key=_multipart_WQC5TVD66R0W.2~KBDVOIIY9LS0.2 size=571952 2024-09-14T11:17:51.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.959+0000 7f1be8076780 1 < canceled multipart upload key=WQC5TVD66R0W upload=KBDVOIIY9LS0 tag=4M0K77O0UXM7 type=write size=3717680 2024-09-14T11:17:51.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.961+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.0 size=1048576 2024-09-14T11:17:51.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.962+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.1 size=1048576 2024-09-14T11:17:51.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.963+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.2 size=422679 2024-09-14T11:17:51.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.963+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=9NSTX59IIHUQ tag=ZII9LKPZL1D0 type=write size=3568407 2024-09-14T11:17:51.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.963+0000 7f1be8076780 1 < canceled part key=_multipart_CQDRZMJAJ7FZ.2~VHWJSZVO0ZPA.0 size=1048576 2024-09-14T11:17:51.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.964+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~VHWJSZVO0ZPA.1 size=486922 2024-09-14T11:17:51.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.966+0000 7f1be8076780 1 < canceled multipart upload key=CQDRZMJAJ7FZ upload=VHWJSZVO0ZPA tag=SZNMXT8ZG3LM type=write size=2584074 2024-09-14T11:17:51.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.968+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~8WVR7LOB0FC1.0 size=353684 2024-09-14T11:17:51.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.968+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=8WVR7LOB0FC1 tag=4AOYNKK530OA type=write size=1402260 2024-09-14T11:17:51.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.969+0000 7f1be8076780 1 < canceled operation key=XI178717NOE8 tag=0O4YZZZ0SDEN type=write size=389168 2024-09-14T11:17:51.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.971+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.0 size=1048576 2024-09-14T11:17:51.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.972+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.1 size=1048576 2024-09-14T11:17:51.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.973+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.2 size=112072 2024-09-14T11:17:51.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.973+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=C7WO92PW377I tag=45ZZMNFRP1X7 type=write size=3257800 2024-09-14T11:17:51.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.974+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=LOGAK4GL5OZX type=del 2024-09-14T11:17:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.976+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=9PP4WQTFFT69 type=del size=765613 2024-09-14T11:17:51.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.977+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=VFK5IO6PAS24 type=del 2024-09-14T11:17:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.978+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=YPU6V2AS52T9 type=del size=29520 2024-09-14T11:17:51.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.979+0000 7f1be8076780 1 < canceled operation key=LNMGQ54S2CXX tag=9NKY4S57OS6K type=del size=337872 2024-09-14T11:17:51.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.981+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=ZQIQZBETK276 type=del size=1380517 2024-09-14T11:17:51.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.981+0000 7f1be8076780 1 < canceled part key=_multipart_XI178717NOE8.2~QLMY2S2Y5WGN.0 size=1048576 2024-09-14T11:17:51.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.982+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~QLMY2S2Y5WGN.1 size=944695 2024-09-14T11:17:51.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.984+0000 7f1be8076780 1 < canceled multipart upload key=XI178717NOE8 upload=QLMY2S2Y5WGN tag=UDC1E0X2CLM2 type=write size=3041847 2024-09-14T11:17:51.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.986+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.0 size=1048576 2024-09-14T11:17:51.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.987+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.1 size=1048576 2024-09-14T11:17:51.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.988+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.2 size=388074 2024-09-14T11:17:51.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.988+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=VOUB9U5X2ALW tag=1O69HB8J3TY1 type=write size=3533802 2024-09-14T11:17:51.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.989+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.0 size=1048576 2024-09-14T11:17:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.990+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.1 size=1048576 2024-09-14T11:17:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.990+0000 7f1be8076780 1 < canceled part key=_multipart_LNMGQ54S2CXX.2~X0TE9102V0AA.2 size=663410 2024-09-14T11:17:51.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.992+0000 7f1be8076780 1 < canceled multipart upload key=LNMGQ54S2CXX upload=X0TE9102V0AA tag=SE1O27BAW8IG type=write size=3809138 2024-09-14T11:17:51.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.994+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=THBOARH13BA9 type=del size=2097948 2024-09-14T11:17:51.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.996+0000 7f1be8076780 1 < suggested remove operation key=CQDRZMJAJ7FZ tag=FJO2C9XIHVQK type=del 2024-09-14T11:17:51.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.998+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~25SBUDW8J0YL.0 size=1048576 2024-09-14T11:17:51.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.999+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~25SBUDW8J0YL.1 size=212783 2024-09-14T11:17:51.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:51.999+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=25SBUDW8J0YL tag=I0EET5FULBVN type=write size=2309935 2024-09-14T11:17:51.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.000+0000 7f1be8076780 1 < canceled operation key=WQC5TVD66R0W tag=BKB08AUYTX13 type=del size=3012549 2024-09-14T11:17:52.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.002+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~06P4LLS5W093.0 size=125638 2024-09-14T11:17:52.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.002+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=06P4LLS5W093 tag=CDL4MP16201J type=write size=1174214 2024-09-14T11:17:52.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.003+0000 7f1be8076780 1 < canceled operation key=1X2EWK1Y2GE0 tag=NKC1BF23D037 type=del size=1697898 2024-09-14T11:17:52.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.005+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=REI9B5LT7DVQ type=del size=1996124 2024-09-14T11:17:52.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.005+0000 7f1be8076780 1 < canceled part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.0 size=1048576 2024-09-14T11:17:52.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.006+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.1 size=1048576 2024-09-14T11:17:52.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.007+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~APURZV3FFNBJ.2 size=383559 2024-09-14T11:17:52.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.009+0000 7f1be8076780 1 < canceled multipart upload key=0BX70Q8C1QL0 upload=APURZV3FFNBJ tag=M5ESMK79V7KJ type=write size=3529287 2024-09-14T11:17:52.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.010+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=4T1Q8QIHDV2T type=del size=2346672 2024-09-14T11:17:52.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.011+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=TUMVBNMT1COQ type=del 2024-09-14T11:17:52.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.012+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=GNMR7H42C13R type=del size=634218 2024-09-14T11:17:52.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.013+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.0 size=1048576 2024-09-14T11:17:52.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.014+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.1 size=1048576 2024-09-14T11:17:52.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.015+0000 7f1be8076780 1 < completed part key=_multipart_JCDSP32N5C7M.2~AZYQW3YAEZ0Q.2 size=259253 2024-09-14T11:17:52.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.017+0000 7f1be8076780 1 < completed multipart upload key=JCDSP32N5C7M upload=AZYQW3YAEZ0Q tag=05Y16CNM5N2A type=write size=3404981 2024-09-14T11:17:52.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.018+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=7QN11N3WUUT0 type=del size=2474839 2024-09-14T11:17:52.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.019+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~7B343Z6UBMJC.0 size=1005159 2024-09-14T11:17:52.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.021+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=7B343Z6UBMJC tag=25QTZAT55YEE type=write size=2053735 2024-09-14T11:17:52.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.023+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~XVW8183WGZXM.0 size=1048576 2024-09-14T11:17:52.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.024+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~XVW8183WGZXM.1 size=377506 2024-09-14T11:17:52.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.024+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=XVW8183WGZXM tag=AJZM4QP0O07M type=write size=2474658 2024-09-14T11:17:52.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.026+0000 7f1be8076780 1 < completed write operation key=JCDSP32N5C7M tag=9330TNY8C408 type=write size=438618 2024-09-14T11:17:52.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.028+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.0 size=1048576 2024-09-14T11:17:52.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.029+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.1 size=1048576 2024-09-14T11:17:52.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.030+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.2 size=266399 2024-09-14T11:17:52.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.030+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=R18F1CR3XP1W tag=203DD75Z6JY2 type=write size=3412127 2024-09-14T11:17:52.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.030+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.0 size=1048576 2024-09-14T11:17:52.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.030+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.1 size=1048576 2024-09-14T11:17:52.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.031+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~9NSTX59IIHUQ.2 size=422679 2024-09-14T11:17:52.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.034+0000 7f1be8076780 1 < canceled multipart upload key=QIEUKUQ8CS2U upload=9NSTX59IIHUQ tag=ZII9LKPZL1D0 type=write size=3568407 2024-09-14T11:17:52.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.036+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~EJI758XXVNOI.0 size=1048576 2024-09-14T11:17:52.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.037+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~EJI758XXVNOI.1 size=419624 2024-09-14T11:17:52.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.037+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=EJI758XXVNOI tag=31L3XI38OAQR type=write size=2516776 2024-09-14T11:17:52.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.038+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~8WVR7LOB0FC1.0 size=353684 2024-09-14T11:17:52.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.040+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=8WVR7LOB0FC1 tag=4AOYNKK530OA type=write size=1402260 2024-09-14T11:17:52.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.041+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=CCGO6VEO3E0I type=del size=2205541 2024-09-14T11:17:52.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.042+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.0 size=1048576 2024-09-14T11:17:52.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.043+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.1 size=1048576 2024-09-14T11:17:52.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.044+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~C7WO92PW377I.2 size=112072 2024-09-14T11:17:52.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.046+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=C7WO92PW377I tag=45ZZMNFRP1X7 type=write size=3257800 2024-09-14T11:17:52.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.047+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=3KGPYNT9WIRM type=write size=662982 2024-09-14T11:17:52.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.048+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=9PP4WQTFFT69 type=del 2024-09-14T11:17:52.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.049+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=R5PBR4V3AHNI type=write size=690473 2024-09-14T11:17:52.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.050+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=YPU6V2AS52T9 type=del 2024-09-14T11:17:52.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.052+0000 7f1be8076780 1 > prepared part key=_multipart_T70EFGHRQZQ7.2~CVPA0C0AN2VU.0 size=55475 2024-09-14T11:17:52.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.052+0000 7f1be8076780 1 > prepared multipart upload key=T70EFGHRQZQ7 upload=CVPA0C0AN2VU tag=2EO428X8NLMQ type=write size=1104051 2024-09-14T11:17:52.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.053+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=ZQIQZBETK276 type=del 2024-09-14T11:17:52.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.055+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~BBE9T6OTRJGS.0 size=97828 2024-09-14T11:17:52.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.055+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=BBE9T6OTRJGS tag=99PVA3PVUOI4 type=write size=1146404 2024-09-14T11:17:52.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.056+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.0 size=1048576 2024-09-14T11:17:52.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.057+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.1 size=1048576 2024-09-14T11:17:52.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.058+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~VOUB9U5X2ALW.2 size=388074 2024-09-14T11:17:52.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.060+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=VOUB9U5X2ALW tag=1O69HB8J3TY1 type=write size=3533802 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.061+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=4HARAT39D3OR type=write size=741733 2024-09-14T11:17:52.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.062+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=THBOARH13BA9 type=del 2024-09-14T11:17:52.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.064+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~HRU8S8W3ZBK7.0 size=552883 2024-09-14T11:17:52.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.064+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=HRU8S8W3ZBK7 tag=SINSDSLAE89K type=write size=1601459 2024-09-14T11:17:52.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.065+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~25SBUDW8J0YL.0 size=1048576 2024-09-14T11:17:52.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.066+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~25SBUDW8J0YL.1 size=212783 2024-09-14T11:17:52.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.068+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=25SBUDW8J0YL tag=I0EET5FULBVN type=write size=2309935 2024-09-14T11:17:52.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.069+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=E6FKKHZ3KH37 type=del size=120754 2024-09-14T11:17:52.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.070+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~06P4LLS5W093.0 size=125638 2024-09-14T11:17:52.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.072+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=06P4LLS5W093 tag=CDL4MP16201J type=write size=1174214 2024-09-14T11:17:52.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.074+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.0 size=1048576 2024-09-14T11:17:52.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.075+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.1 size=1048576 2024-09-14T11:17:52.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.076+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.2 size=324327 2024-09-14T11:17:52.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.076+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=JLPQ9Q4PK003 tag=HM7PZMA6WTWO type=write size=3470055 2024-09-14T11:17:52.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.077+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=REI9B5LT7DVQ type=del 2024-09-14T11:17:52.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.079+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.0 size=1048576 2024-09-14T11:17:52.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.080+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.1 size=1048576 2024-09-14T11:17:52.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.081+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.2 size=493469 2024-09-14T11:17:52.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.081+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=2X8V6H0R9AEG tag=IS3IUNLCO36O type=write size=3639197 2024-09-14T11:17:52.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.083+0000 7f1be8076780 1 < suggested update operation key=MVUN63538RAB tag=4T1Q8QIHDV2T type=del size=2346672 2024-09-14T11:17:52.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.085+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~WMIQHREVCUD0.0 size=117677 2024-09-14T11:17:52.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.085+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=WMIQHREVCUD0 tag=P9P4M8X5364B type=write size=1166253 2024-09-14T11:17:52.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.088+0000 7f1be8076780 1 < suggested update operation key=WQC5TVD66R0W tag=GNMR7H42C13R type=del size=634218 2024-09-14T11:17:52.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.090+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~K4D760ET9HNM.0 size=510165 2024-09-14T11:17:52.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.090+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=K4D760ET9HNM tag=IC2K0U0345CD type=write size=1558741 2024-09-14T11:17:52.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.091+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=7QN11N3WUUT0 type=del 2024-09-14T11:17:52.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.092+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=FNRYR9S4QCTE type=del size=2648702 2024-09-14T11:17:52.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.093+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~XVW8183WGZXM.0 size=1048576 2024-09-14T11:17:52.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.094+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~XVW8183WGZXM.1 size=377506 2024-09-14T11:17:52.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.097+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=XVW8183WGZXM tag=AJZM4QP0O07M type=write size=2474658 2024-09-14T11:17:52.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.099+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~83AVHI6HEED1.0 size=467631 2024-09-14T11:17:52.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.099+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=83AVHI6HEED1 tag=OIL5SECQ8O5O type=write size=1516207 2024-09-14T11:17:52.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.100+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.0 size=1048576 2024-09-14T11:17:52.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.101+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.1 size=1048576 2024-09-14T11:17:52.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.102+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~R18F1CR3XP1W.2 size=266399 2024-09-14T11:17:52.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.104+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=R18F1CR3XP1W tag=203DD75Z6JY2 type=write size=3412127 2024-09-14T11:17:52.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.105+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=I8JGU1FC8WBV type=del size=587995 2024-09-14T11:17:52.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.106+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~EJI758XXVNOI.0 size=1048576 2024-09-14T11:17:52.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.107+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~EJI758XXVNOI.1 size=419624 2024-09-14T11:17:52.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.109+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=EJI758XXVNOI tag=31L3XI38OAQR type=write size=2516776 2024-09-14T11:17:52.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.110+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=6AC2NSORFXNL type=del size=4049428 2024-09-14T11:17:52.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.111+0000 7f1be8076780 1 < completed delete operation key=9DRSDTGM7Y3F tag=CCGO6VEO3E0I type=del 2024-09-14T11:17:52.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.112+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=KBI3IRJR60TY type=del size=622123 2024-09-14T11:17:52.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.114+0000 7f1be8076780 1 < canceled operation key=4ADXXTIO715C tag=3KGPYNT9WIRM type=write size=662982 2024-09-14T11:17:52.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.115+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=NIZYDE0FEDD5 type=del size=475273 2024-09-14T11:17:52.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.116+0000 7f1be8076780 1 < completed write operation key=KQ479IOZ0108 tag=R5PBR4V3AHNI type=write size=690473 2024-09-14T11:17:52.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.118+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.0 size=1048576 2024-09-14T11:17:52.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.119+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.1 size=1048576 2024-09-14T11:17:52.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.120+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.2 size=588166 2024-09-14T11:17:52.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.120+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=WQRBTWEQPR1N tag=SN6T0ZB13ASW type=write size=3733894 2024-09-14T11:17:52.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.121+0000 7f1be8076780 1 < completed part key=_multipart_T70EFGHRQZQ7.2~CVPA0C0AN2VU.0 size=55475 2024-09-14T11:17:52.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.123+0000 7f1be8076780 1 < completed multipart upload key=T70EFGHRQZQ7 upload=CVPA0C0AN2VU tag=2EO428X8NLMQ type=write size=1104051 2024-09-14T11:17:52.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.124+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=N03HGKZCISAN type=del size=430060 2024-09-14T11:17:52.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.125+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~BBE9T6OTRJGS.0 size=97828 2024-09-14T11:17:52.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.127+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=BBE9T6OTRJGS tag=99PVA3PVUOI4 type=write size=1146404 2024-09-14T11:17:52.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.129+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.0 size=1048576 2024-09-14T11:17:52.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.130+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.1 size=1048576 2024-09-14T11:17:52.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.131+0000 7f1be8076780 1 > prepared part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.2 size=359875 2024-09-14T11:17:52.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.131+0000 7f1be8076780 1 > prepared multipart upload key=1X2EWK1Y2GE0 upload=T997HSKBDPWZ tag=YQ6L4UDCJLU7 type=write size=3505603 2024-09-14T11:17:52.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.132+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=4HARAT39D3OR type=write size=741733 2024-09-14T11:17:52.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.134+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~16A2O9C5TM2G.0 size=952666 2024-09-14T11:17:52.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.134+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=16A2O9C5TM2G tag=VAXHNEMBBSSU type=write size=2001242 2024-09-14T11:17:52.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.135+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~HRU8S8W3ZBK7.0 size=552883 2024-09-14T11:17:52.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.139+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=HRU8S8W3ZBK7 tag=SINSDSLAE89K type=write size=1601459 2024-09-14T11:17:52.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.141+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~K7F0L8OC78LO.0 size=1048576 2024-09-14T11:17:52.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.142+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~K7F0L8OC78LO.1 size=221331 2024-09-14T11:17:52.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.142+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=K7F0L8OC78LO tag=7PZP7CYDRKFG type=write size=2318483 2024-09-14T11:17:52.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.144+0000 7f1be8076780 1 < suggested remove operation key=0BX70Q8C1QL0 tag=E6FKKHZ3KH37 type=del 2024-09-14T11:17:52.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.146+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=SSM7T6QCSDQY type=del size=3232012 2024-09-14T11:17:52.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.147+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.0 size=1048576 2024-09-14T11:17:52.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.148+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.1 size=1048576 2024-09-14T11:17:52.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.149+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~JLPQ9Q4PK003.2 size=324327 2024-09-14T11:17:52.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.150+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=JLPQ9Q4PK003 tag=HM7PZMA6WTWO type=write size=3470055 2024-09-14T11:17:52.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.152+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=1DRV9TUNCWHE type=del size=3524855 2024-09-14T11:17:52.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.153+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.0 size=1048576 2024-09-14T11:17:52.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.154+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.1 size=1048576 2024-09-14T11:17:52.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.154+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~2X8V6H0R9AEG.2 size=493469 2024-09-14T11:17:52.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.156+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=2X8V6H0R9AEG tag=IS3IUNLCO36O type=write size=3639197 2024-09-14T11:17:52.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.158+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~HLJ39CIYYFUR.0 size=782666 2024-09-14T11:17:52.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.158+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=HLJ39CIYYFUR tag=6E2OQUJX2DN5 type=write size=1831242 2024-09-14T11:17:52.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.159+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~WMIQHREVCUD0.0 size=117677 2024-09-14T11:17:52.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.161+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=WMIQHREVCUD0 tag=P9P4M8X5364B type=write size=1166253 2024-09-14T11:17:52.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.163+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.0 size=1048576 2024-09-14T11:17:52.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.164+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.1 size=1048576 2024-09-14T11:17:52.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.165+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.2 size=700256 2024-09-14T11:17:52.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.165+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=VI5CH497ZV8Y tag=7BS86C684OSU type=write size=3845984 2024-09-14T11:17:52.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.166+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~K4D760ET9HNM.0 size=510165 2024-09-14T11:17:52.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.168+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=K4D760ET9HNM tag=IC2K0U0345CD type=write size=1558741 2024-09-14T11:17:52.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.171+0000 7f1be8076780 1 > prepared part key=_multipart_4AY6ZXFKO1YQ.2~OCNFBLY8HDN4.0 size=548598 2024-09-14T11:17:52.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.171+0000 7f1be8076780 1 > prepared multipart upload key=4AY6ZXFKO1YQ upload=OCNFBLY8HDN4 tag=7U07K9S8H8FW type=write size=1597174 2024-09-14T11:17:52.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.172+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=FNRYR9S4QCTE type=del 2024-09-14T11:17:52.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.173+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=GECQCKP707OH type=write size=412644 2024-09-14T11:17:52.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.174+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~83AVHI6HEED1.0 size=467631 2024-09-14T11:17:52.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.176+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=83AVHI6HEED1 tag=OIL5SECQ8O5O type=write size=1516207 2024-09-14T11:17:52.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.178+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~WGQ2XDWNRPYY.0 size=1048576 2024-09-14T11:17:52.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.179+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~WGQ2XDWNRPYY.1 size=367016 2024-09-14T11:17:52.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.179+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=WGQ2XDWNRPYY tag=ZNNTYZW6XA4T type=write size=2464168 2024-09-14T11:17:52.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.180+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=I8JGU1FC8WBV type=del 2024-09-14T11:17:52.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.182+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=OVYWHEQD3UE5 type=write size=57061 2024-09-14T11:17:52.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.184+0000 7f1be8076780 1 < suggested remove operation key=2RJYZ1CRDVEP tag=6AC2NSORFXNL type=del 2024-09-14T11:17:52.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.185+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=31HL08W0PYPX type=del size=2488909 2024-09-14T11:17:52.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.186+0000 7f1be8076780 1 < completed delete operation key=INU0TV92GXSP tag=KBI3IRJR60TY type=del 2024-09-14T11:17:52.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.187+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=YAO6OPM008HM type=del size=718486 2024-09-14T11:17:52.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.189+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=NIZYDE0FEDD5 type=del 2024-09-14T11:17:52.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.190+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=8THNZC6YXPWW type=del size=1566340 2024-09-14T11:17:52.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.191+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.0 size=1048576 2024-09-14T11:17:52.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.192+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.1 size=1048576 2024-09-14T11:17:52.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.192+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~WQRBTWEQPR1N.2 size=588166 2024-09-14T11:17:52.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.194+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=WQRBTWEQPR1N tag=SN6T0ZB13ASW type=write size=3733894 2024-09-14T11:17:52.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.196+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.0 size=1048576 2024-09-14T11:17:52.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.197+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.1 size=1048576 2024-09-14T11:17:52.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.198+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.2 size=309088 2024-09-14T11:17:52.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.198+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=2JXHN0GUUHDZ tag=RQNLAXNNMJEW type=write size=3454816 2024-09-14T11:17:52.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.199+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=N03HGKZCISAN type=del 2024-09-14T11:17:52.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.201+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~W89TC9072RQ4.0 size=1048576 2024-09-14T11:17:52.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.202+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~W89TC9072RQ4.1 size=602029 2024-09-14T11:17:52.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.202+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=W89TC9072RQ4 tag=RJKQ1KGB1HS9 type=write size=2699181 2024-09-14T11:17:52.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.204+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.0 size=1048576 2024-09-14T11:17:52.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.205+0000 7f1be8076780 1 < completed part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.1 size=1048576 2024-09-14T11:17:52.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.205+0000 7f1be8076780 1 < canceled part key=_multipart_1X2EWK1Y2GE0.2~T997HSKBDPWZ.2 size=359875 2024-09-14T11:17:52.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.207+0000 7f1be8076780 1 < canceled multipart upload key=1X2EWK1Y2GE0 upload=T997HSKBDPWZ tag=YQ6L4UDCJLU7 type=write size=3505603 2024-09-14T11:17:52.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.208+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=O9N31JPCI50Z type=del size=1122242 2024-09-14T11:17:52.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.209+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~16A2O9C5TM2G.0 size=952666 2024-09-14T11:17:52.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.211+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=16A2O9C5TM2G tag=VAXHNEMBBSSU type=write size=2001242 2024-09-14T11:17:52.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.212+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=IOJD0MNR0XGU type=del size=830697 2024-09-14T11:17:52.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.213+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~K7F0L8OC78LO.0 size=1048576 2024-09-14T11:17:52.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.214+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~K7F0L8OC78LO.1 size=221331 2024-09-14T11:17:52.215 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.216+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=K7F0L8OC78LO tag=7PZP7CYDRKFG type=write size=2318483 2024-09-14T11:17:52.216 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.217+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=V7LOAPDMN3QJ type=del size=1943321 2024-09-14T11:17:52.217 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.219+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=SSM7T6QCSDQY type=del 2024-09-14T11:17:52.218 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.220+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=1XF6Y8JBC1X3 type=del size=1680738 2024-09-14T11:17:52.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.221+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=1DRV9TUNCWHE type=del 2024-09-14T11:17:52.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.222+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=PDSR3LON36LB type=del size=1770682 2024-09-14T11:17:52.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.223+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~HLJ39CIYYFUR.0 size=782666 2024-09-14T11:17:52.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.225+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=HLJ39CIYYFUR tag=6E2OQUJX2DN5 type=write size=1831242 2024-09-14T11:17:52.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.227+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=WBU59P4PWPFI type=del size=2022019 2024-09-14T11:17:52.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.228+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.0 size=1048576 2024-09-14T11:17:52.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.229+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.1 size=1048576 2024-09-14T11:17:52.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.230+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~VI5CH497ZV8Y.2 size=700256 2024-09-14T11:17:52.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.232+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=VI5CH497ZV8Y tag=7BS86C684OSU type=write size=3845984 2024-09-14T11:17:52.231 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.233+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=X9C9JRIU4YTG type=write size=3233 2024-09-14T11:17:52.232 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.234+0000 7f1be8076780 1 < completed part key=_multipart_4AY6ZXFKO1YQ.2~OCNFBLY8HDN4.0 size=548598 2024-09-14T11:17:52.234 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.236+0000 7f1be8076780 1 < completed multipart upload key=4AY6ZXFKO1YQ upload=OCNFBLY8HDN4 tag=7U07K9S8H8FW type=write size=1597174 2024-09-14T11:17:52.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.238+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.0 size=1048576 2024-09-14T11:17:52.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.239+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.1 size=1048576 2024-09-14T11:17:52.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.240+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.2 size=21693 2024-09-14T11:17:52.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.240+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=K2P6EPA22P0D tag=LXXJFSU3LW3U type=write size=3167421 2024-09-14T11:17:52.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.241+0000 7f1be8076780 1 < completed write operation key=4AY6ZXFKO1YQ tag=GECQCKP707OH type=write size=412644 2024-09-14T11:17:52.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.243+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~DZTUMV25JN3F.0 size=724606 2024-09-14T11:17:52.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.243+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=DZTUMV25JN3F tag=7DEPVTCF6I62 type=write size=1773182 2024-09-14T11:17:52.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.245+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~WGQ2XDWNRPYY.0 size=1048576 2024-09-14T11:17:52.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.246+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~WGQ2XDWNRPYY.1 size=367016 2024-09-14T11:17:52.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.249+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=WGQ2XDWNRPYY tag=ZNNTYZW6XA4T type=write size=2464168 2024-09-14T11:17:52.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.250+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=C4GA9MTILD9A type=del size=3422741 2024-09-14T11:17:52.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.251+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=OVYWHEQD3UE5 type=write size=57061 2024-09-14T11:17:52.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.252+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=LJXS6V1GW8DS type=del size=287811 2024-09-14T11:17:52.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.253+0000 7f1be8076780 1 < canceled operation key=3YIK6B6Y2EU1 tag=31HL08W0PYPX type=del size=2488909 2024-09-14T11:17:52.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.254+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=5FLFJM4RO74F type=del size=1025935 2024-09-14T11:17:52.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.256+0000 7f1be8076780 1 < completed delete operation key=1X2EWK1Y2GE0 tag=YAO6OPM008HM type=del 2024-09-14T11:17:52.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.257+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=K093D282UGFK type=del size=351826 2024-09-14T11:17:52.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.258+0000 7f1be8076780 1 < canceled operation key=JDKFKO39I56L tag=8THNZC6YXPWW type=del size=1566340 2024-09-14T11:17:52.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.259+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=1FMWTKWO9XMM type=del size=3402841 2024-09-14T11:17:52.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.260+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.0 size=1048576 2024-09-14T11:17:52.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.261+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.1 size=1048576 2024-09-14T11:17:52.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.262+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~2JXHN0GUUHDZ.2 size=309088 2024-09-14T11:17:52.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.264+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=2JXHN0GUUHDZ tag=RQNLAXNNMJEW type=write size=3454816 2024-09-14T11:17:52.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.265+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=948580GPEIP5 type=del size=2353889 2024-09-14T11:17:52.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.266+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~W89TC9072RQ4.0 size=1048576 2024-09-14T11:17:52.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.266+0000 7f1be8076780 1 < canceled part key=_multipart_3Z71PEWG5UMA.2~W89TC9072RQ4.1 size=602029 2024-09-14T11:17:52.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.268+0000 7f1be8076780 1 < canceled multipart upload key=3Z71PEWG5UMA upload=W89TC9072RQ4 tag=RJKQ1KGB1HS9 type=write size=2699181 2024-09-14T11:17:52.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.269+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=HG1CJKZZLO73 type=del size=4033270 2024-09-14T11:17:52.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.272+0000 7f1be8076780 1 < suggested update operation key=4AY6ZXFKO1YQ tag=O9N31JPCI50Z type=del size=1122242 2024-09-14T11:17:52.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.275+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.0 size=1048576 2024-09-14T11:17:52.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.276+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.1 size=1048576 2024-09-14T11:17:52.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.277+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.2 size=240641 2024-09-14T11:17:52.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.277+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=00BBL2F1ZC1P tag=8UIS931DVB8I type=write size=3386369 2024-09-14T11:17:52.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.278+0000 7f1be8076780 1 < canceled operation key=RIYGSRWKVKFF tag=IOJD0MNR0XGU type=del size=830697 2024-09-14T11:17:52.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.281+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~NZ2DFXDE98VQ.0 size=1048576 2024-09-14T11:17:52.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.281+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~NZ2DFXDE98VQ.1 size=788339 2024-09-14T11:17:52.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.281+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=NZ2DFXDE98VQ tag=AKA7AL0EZLN2 type=write size=2885491 2024-09-14T11:17:52.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.283+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=V7LOAPDMN3QJ type=del 2024-09-14T11:17:52.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.285+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~X1ODF05N2WUX.0 size=1048576 2024-09-14T11:17:52.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.286+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~X1ODF05N2WUX.1 size=989191 2024-09-14T11:17:52.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.286+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=X1ODF05N2WUX tag=ZJYL9BB5OE9S type=write size=3086343 2024-09-14T11:17:52.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.288+0000 7f1be8076780 1 < suggested update operation key=XI178717NOE8 tag=1XF6Y8JBC1X3 type=del size=1680738 2024-09-14T11:17:52.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.290+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WPQHTHWMQY8P.0 size=1048576 2024-09-14T11:17:52.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.291+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~WPQHTHWMQY8P.1 size=470031 2024-09-14T11:17:52.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.291+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=WPQHTHWMQY8P tag=XCRM4NJVLEKC type=write size=2567183 2024-09-14T11:17:52.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.292+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=PDSR3LON36LB type=del 2024-09-14T11:17:52.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.294+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=TIL03IKPFBB1 type=del size=2585788 2024-09-14T11:17:52.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.296+0000 7f1be8076780 1 < suggested remove operation key=4ADXXTIO715C tag=WBU59P4PWPFI type=del 2024-09-14T11:17:52.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.297+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=5JFYCFQ8LFI5 type=write size=658341 2024-09-14T11:17:52.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.299+0000 7f1be8076780 -1 < failed to complete operation key=4AY6ZXFKO1YQ tag=X9C9JRIU4YTG type=write size=3233: (22) Invalid argument 2024-09-14T11:17:52.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.300+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=5Z0NJGO5XTSX type=del size=3347765 2024-09-14T11:17:52.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.301+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.0 size=1048576 2024-09-14T11:17:52.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.302+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.1 size=1048576 2024-09-14T11:17:52.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.303+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~K2P6EPA22P0D.2 size=21693 2024-09-14T11:17:52.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.305+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=K2P6EPA22P0D tag=LXXJFSU3LW3U type=write size=3167421 2024-09-14T11:17:52.305 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.307+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=84DVBO8MNKEH type=del size=4027614 2024-09-14T11:17:52.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.308+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~DZTUMV25JN3F.0 size=724606 2024-09-14T11:17:52.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.310+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=DZTUMV25JN3F tag=7DEPVTCF6I62 type=write size=1773182 2024-09-14T11:17:52.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.312+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~PILEVCAN19EN.0 size=276168 2024-09-14T11:17:52.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.312+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=PILEVCAN19EN tag=CS9MRJI4X5R2 type=write size=1324744 2024-09-14T11:17:52.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.313+0000 7f1be8076780 1 < canceled operation key=RIYGSRWKVKFF tag=C4GA9MTILD9A type=del size=3422741 2024-09-14T11:17:52.314 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.315+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.0 size=1048576 2024-09-14T11:17:52.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.316+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.1 size=1048576 2024-09-14T11:17:52.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.317+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.2 size=1006164 2024-09-14T11:17:52.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.317+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=LYO9ZTLZH743 tag=23PMZBDXX3EQ type=write size=4151892 2024-09-14T11:17:52.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.318+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=LJXS6V1GW8DS type=del 2024-09-14T11:17:52.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.320+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=2IZNIIPG9P45 type=del size=3475416 2024-09-14T11:17:52.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.322+0000 7f1be8076780 1 < suggested update operation key=3Z71PEWG5UMA tag=5FLFJM4RO74F type=del size=1025935 2024-09-14T11:17:52.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.323+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=RO397XDJ4FZF type=del size=2591749 2024-09-14T11:17:52.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.325+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=K093D282UGFK type=del size=351826 2024-09-14T11:17:52.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.327+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=J25PDN0DVCDL type=write size=284946 2024-09-14T11:17:52.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.328+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=1FMWTKWO9XMM type=del 2024-09-14T11:17:52.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.329+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=G0ROQUKHFHER type=del size=1643595 2024-09-14T11:17:52.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.331+0000 7f1be8076780 1 < suggested update operation key=9DRSDTGM7Y3F tag=948580GPEIP5 type=del size=2353889 2024-09-14T11:17:52.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.333+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=8A639A2FSRCB type=del size=1572630 2024-09-14T11:17:52.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.334+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=HG1CJKZZLO73 type=del 2024-09-14T11:17:52.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.336+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~5A2MEJKIR27I.0 size=1048576 2024-09-14T11:17:52.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.337+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~5A2MEJKIR27I.1 size=751395 2024-09-14T11:17:52.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.337+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=5A2MEJKIR27I tag=OROZDM7Q8MY3 type=write size=2848547 2024-09-14T11:17:52.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.338+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.0 size=1048576 2024-09-14T11:17:52.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.339+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.1 size=1048576 2024-09-14T11:17:52.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.340+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~00BBL2F1ZC1P.2 size=240641 2024-09-14T11:17:52.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.342+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=00BBL2F1ZC1P tag=8UIS931DVB8I type=write size=3386369 2024-09-14T11:17:52.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.344+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=2BQ2DM5SLZ1Y type=del size=4140178 2024-09-14T11:17:52.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.345+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~NZ2DFXDE98VQ.0 size=1048576 2024-09-14T11:17:52.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.346+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~NZ2DFXDE98VQ.1 size=788339 2024-09-14T11:17:52.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.348+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=NZ2DFXDE98VQ tag=AKA7AL0EZLN2 type=write size=2885491 2024-09-14T11:17:52.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.350+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~18Y60D8HJ7HQ.0 size=1048576 2024-09-14T11:17:52.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.350+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~18Y60D8HJ7HQ.1 size=1007905 2024-09-14T11:17:52.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.350+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=18Y60D8HJ7HQ tag=HQCW316T6I75 type=write size=3105057 2024-09-14T11:17:52.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.352+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~X1ODF05N2WUX.0 size=1048576 2024-09-14T11:17:52.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.352+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~X1ODF05N2WUX.1 size=989191 2024-09-14T11:17:52.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.354+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=X1ODF05N2WUX tag=ZJYL9BB5OE9S type=write size=3086343 2024-09-14T11:17:52.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.356+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=ACYMYVCWWRSY type=write size=197391 2024-09-14T11:17:52.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.357+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~WPQHTHWMQY8P.0 size=1048576 2024-09-14T11:17:52.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.358+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~WPQHTHWMQY8P.1 size=470031 2024-09-14T11:17:52.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.361+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=WPQHTHWMQY8P tag=XCRM4NJVLEKC type=write size=2567183 2024-09-14T11:17:52.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.363+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~UH5VN4Q0RUPR.0 size=910719 2024-09-14T11:17:52.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.363+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=UH5VN4Q0RUPR tag=F5ZHK4MPMSR9 type=write size=1959295 2024-09-14T11:17:52.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.364+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=TIL03IKPFBB1 type=del 2024-09-14T11:17:52.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.365+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=U9HO9WQI6ZI4 type=del size=1600069 2024-09-14T11:17:52.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.367+0000 7f1be8076780 1 < suggested update operation key=QIEUKUQ8CS2U tag=5JFYCFQ8LFI5 type=write size=658341 2024-09-14T11:17:52.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.369+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=E25PRNEWLYTW type=write size=250505 2024-09-14T11:17:52.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.370+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=5Z0NJGO5XTSX type=del 2024-09-14T11:17:52.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.372+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~3Q5CQFHQWGB6.0 size=834154 2024-09-14T11:17:52.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.372+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=3Q5CQFHQWGB6 tag=MWNQJHZJ87DQ type=write size=1882730 2024-09-14T11:17:52.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.373+0000 7f1be8076780 -1 < failed to complete operation key=9DRSDTGM7Y3F tag=84DVBO8MNKEH type=del size=4027614: (22) Invalid argument 2024-09-14T11:17:52.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.374+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=W3OVHM51B8FI type=write size=537786 2024-09-14T11:17:52.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.375+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~PILEVCAN19EN.0 size=276168 2024-09-14T11:17:52.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.377+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=PILEVCAN19EN tag=CS9MRJI4X5R2 type=write size=1324744 2024-09-14T11:17:52.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.378+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=TRVW55JWPMU5 type=del size=2445602 2024-09-14T11:17:52.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.379+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.0 size=1048576 2024-09-14T11:17:52.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.380+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.1 size=1048576 2024-09-14T11:17:52.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.381+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~LYO9ZTLZH743.2 size=1006164 2024-09-14T11:17:52.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.383+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=LYO9ZTLZH743 tag=23PMZBDXX3EQ type=write size=4151892 2024-09-14T11:17:52.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.384+0000 7f1be8076780 1 > prepared operation key=9DRSDTGM7Y3F tag=XMXR2EPUHDA2 type=write size=311399 2024-09-14T11:17:52.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.385+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=2IZNIIPG9P45 type=del 2024-09-14T11:17:52.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.387+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=RNPJCOEDQXHX type=del size=1929249 2024-09-14T11:17:52.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.388+0000 7f1be8076780 1 < completed delete operation key=CQDRZMJAJ7FZ tag=RO397XDJ4FZF type=del 2024-09-14T11:17:52.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.389+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=ZCHGZ7VGXKCD type=write size=1048340 2024-09-14T11:17:52.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.390+0000 7f1be8076780 1 < completed write operation key=RIYGSRWKVKFF tag=J25PDN0DVCDL type=write size=284946 2024-09-14T11:17:52.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.392+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=Y1H6KMEZ2KWC type=del size=252523 2024-09-14T11:17:52.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.393+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=G0ROQUKHFHER type=del 2024-09-14T11:17:52.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.395+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~DCYSGG12O1K8.0 size=358369 2024-09-14T11:17:52.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.395+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=DCYSGG12O1K8 tag=UPN31M8ZOBVT type=write size=1406945 2024-09-14T11:17:52.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.396+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=8A639A2FSRCB type=del 2024-09-14T11:17:52.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.398+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~WDHR30LOPFHM.0 size=830778 2024-09-14T11:17:52.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.398+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=WDHR30LOPFHM tag=GNP3KOOSIJRH type=write size=1879354 2024-09-14T11:17:52.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.399+0000 7f1be8076780 1 < canceled part key=_multipart_MVUN63538RAB.2~5A2MEJKIR27I.0 size=1048576 2024-09-14T11:17:52.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.400+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~5A2MEJKIR27I.1 size=751395 2024-09-14T11:17:52.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.402+0000 7f1be8076780 1 < canceled multipart upload key=MVUN63538RAB upload=5A2MEJKIR27I tag=OROZDM7Q8MY3 type=write size=2848547 2024-09-14T11:17:52.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.403+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=9SLA16QDCYTH type=del size=263754 2024-09-14T11:17:52.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.405+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=2BQ2DM5SLZ1Y type=del 2024-09-14T11:17:52.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.407+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~6DQGWFIIJGU0.0 size=1048576 2024-09-14T11:17:52.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.408+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~6DQGWFIIJGU0.1 size=303109 2024-09-14T11:17:52.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.408+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=6DQGWFIIJGU0 tag=NY4HH3F0UFL0 type=write size=2400261 2024-09-14T11:17:52.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.410+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~18Y60D8HJ7HQ.0 size=1048576 2024-09-14T11:17:52.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.411+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~18Y60D8HJ7HQ.1 size=1007905 2024-09-14T11:17:52.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.413+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=18Y60D8HJ7HQ tag=HQCW316T6I75 type=write size=3105057 2024-09-14T11:17:52.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.415+0000 7f1be8076780 1 > prepared part key=_multipart_3Z71PEWG5UMA.2~0UM3Z4I6C35O.0 size=114637 2024-09-14T11:17:52.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.415+0000 7f1be8076780 1 > prepared multipart upload key=3Z71PEWG5UMA upload=0UM3Z4I6C35O tag=QFDK8TD3DC32 type=write size=1163213 2024-09-14T11:17:52.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.416+0000 7f1be8076780 1 < canceled operation key=JIWPGHQ3GEZB tag=ACYMYVCWWRSY type=write size=197391 2024-09-14T11:17:52.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.417+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=NFLRK30FOD1H type=write size=915984 2024-09-14T11:17:52.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.419+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~UH5VN4Q0RUPR.0 size=910719 2024-09-14T11:17:52.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.421+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=UH5VN4Q0RUPR tag=F5ZHK4MPMSR9 type=write size=1959295 2024-09-14T11:17:52.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.422+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=60BG09MC4W5K type=del size=3006129 2024-09-14T11:17:52.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.423+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=U9HO9WQI6ZI4 type=del 2024-09-14T11:17:52.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.425+0000 7f1be8076780 1 > prepared part key=_multipart_LNMGQ54S2CXX.2~5GGD0FLYY0G8.0 size=530730 2024-09-14T11:17:52.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.425+0000 7f1be8076780 1 > prepared multipart upload key=LNMGQ54S2CXX upload=5GGD0FLYY0G8 tag=2ESU49I87GHP type=write size=1579306 2024-09-14T11:17:52.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.426+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=E25PRNEWLYTW type=write size=250505 2024-09-14T11:17:52.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.429+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~027AOJ829BCR.0 size=316537 2024-09-14T11:17:52.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.429+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=027AOJ829BCR tag=PXP7R62HBKJZ type=write size=1365113 2024-09-14T11:17:52.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.430+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~3Q5CQFHQWGB6.0 size=834154 2024-09-14T11:17:52.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.432+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=3Q5CQFHQWGB6 tag=MWNQJHZJ87DQ type=write size=1882730 2024-09-14T11:17:52.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.434+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.0 size=1048576 2024-09-14T11:17:52.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.435+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.1 size=1048576 2024-09-14T11:17:52.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.436+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.2 size=206036 2024-09-14T11:17:52.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.436+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=PJ0UPO8EPA0C tag=CGZIRFE1U94K type=write size=3351764 2024-09-14T11:17:52.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.438+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=W3OVHM51B8FI type=write size=537786 2024-09-14T11:17:52.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.439+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=XJXTB0TSD1SR type=del size=1093845 2024-09-14T11:17:52.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.440+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=TRVW55JWPMU5 type=del 2024-09-14T11:17:52.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.442+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.0 size=1048576 2024-09-14T11:17:52.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.444+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.1 size=1048576 2024-09-14T11:17:52.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.444+0000 7f1be8076780 1 > prepared part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.2 size=895935 2024-09-14T11:17:52.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.444+0000 7f1be8076780 1 > prepared multipart upload key=RIYGSRWKVKFF upload=PRUPQ3AFF8SI tag=M88E5MP6R098 type=write size=4041663 2024-09-14T11:17:52.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.446+0000 7f1be8076780 1 < completed write operation key=9DRSDTGM7Y3F tag=XMXR2EPUHDA2 type=write size=311399 2024-09-14T11:17:52.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.447+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=JU9VHFOYHKZO type=del size=901357 2024-09-14T11:17:52.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.448+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=RNPJCOEDQXHX type=del 2024-09-14T11:17:52.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.450+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~0DL0P2AGYCV9.0 size=857320 2024-09-14T11:17:52.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.450+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=0DL0P2AGYCV9 tag=FUSWQIY24T0V type=write size=1905896 2024-09-14T11:17:52.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.452+0000 7f1be8076780 1 < suggested update operation key=JGEBWM9VRCFW tag=ZCHGZ7VGXKCD type=write size=1048340 2024-09-14T11:17:52.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.454+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=PIQX1PHJNLH0 type=del size=716899 2024-09-14T11:17:52.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.455+0000 7f1be8076780 1 < canceled operation key=JCDSP32N5C7M tag=Y1H6KMEZ2KWC type=del size=252523 2024-09-14T11:17:52.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.456+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=BC1HV9L3I2HK type=del size=2006298 2024-09-14T11:17:52.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.457+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~DCYSGG12O1K8.0 size=358369 2024-09-14T11:17:52.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.459+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=DCYSGG12O1K8 tag=UPN31M8ZOBVT type=write size=1406945 2024-09-14T11:17:52.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.461+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~7KHRV4Z6FT0K.0 size=34902 2024-09-14T11:17:52.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.461+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=7KHRV4Z6FT0K tag=BJCL958QJIBP type=write size=1083478 2024-09-14T11:17:52.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.462+0000 7f1be8076780 1 < completed part key=_multipart_JDKFKO39I56L.2~WDHR30LOPFHM.0 size=830778 2024-09-14T11:17:52.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.464+0000 7f1be8076780 1 < completed multipart upload key=JDKFKO39I56L upload=WDHR30LOPFHM tag=GNP3KOOSIJRH type=write size=1879354 2024-09-14T11:17:52.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.466+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~XECQIXYXQAZV.0 size=1048576 2024-09-14T11:17:52.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.467+0000 7f1be8076780 1 > prepared part key=_multipart_MVUN63538RAB.2~XECQIXYXQAZV.1 size=845109 2024-09-14T11:17:52.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.467+0000 7f1be8076780 1 > prepared multipart upload key=MVUN63538RAB upload=XECQIXYXQAZV tag=45YRFPTI81H5 type=write size=2942261 2024-09-14T11:17:52.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.469+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=9SLA16QDCYTH type=del 2024-09-14T11:17:52.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.471+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~30TS787T2RN7.0 size=1048576 2024-09-14T11:17:52.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.473+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~30TS787T2RN7.1 size=17036 2024-09-14T11:17:52.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.473+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=30TS787T2RN7 tag=VJZA2C0EH2QD type=write size=2114188 2024-09-14T11:17:52.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.474+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~6DQGWFIIJGU0.0 size=1048576 2024-09-14T11:17:52.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.477+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~6DQGWFIIJGU0.1 size=303109 2024-09-14T11:17:52.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.479+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=6DQGWFIIJGU0 tag=NY4HH3F0UFL0 type=write size=2400261 2024-09-14T11:17:52.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.480+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=C4OT3ZMZLQRN type=del size=1219079 2024-09-14T11:17:52.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.481+0000 7f1be8076780 1 < completed part key=_multipart_3Z71PEWG5UMA.2~0UM3Z4I6C35O.0 size=114637 2024-09-14T11:17:52.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.483+0000 7f1be8076780 1 < completed multipart upload key=3Z71PEWG5UMA upload=0UM3Z4I6C35O tag=QFDK8TD3DC32 type=write size=1163213 2024-09-14T11:17:52.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.485+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=N5K63G8ATMNC type=del size=3518223 2024-09-14T11:17:52.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.486+0000 7f1be8076780 1 < completed write operation key=MVUN63538RAB tag=NFLRK30FOD1H type=write size=915984 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.488+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.0 size=1048576 2024-09-14T11:17:52.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.489+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.1 size=1048576 2024-09-14T11:17:52.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.489+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.2 size=720039 2024-09-14T11:17:52.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.489+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=8Z5KMIAJOD3Z tag=HP2LHZ10KUFE type=write size=3865767 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.492+0000 7f1be8076780 1 < suggested remove operation key=SJES17ZIGRZE tag=60BG09MC4W5K type=del 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.493+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=MP0LEE7792TC type=write size=101644 2024-09-14T11:17:52.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.494+0000 7f1be8076780 1 < completed part key=_multipart_LNMGQ54S2CXX.2~5GGD0FLYY0G8.0 size=530730 2024-09-14T11:17:52.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.496+0000 7f1be8076780 1 < completed multipart upload key=LNMGQ54S2CXX upload=5GGD0FLYY0G8 tag=2ESU49I87GHP type=write size=1579306 2024-09-14T11:17:52.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.497+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=IU1YIQ4ZRSZ2 type=del size=1495698 2024-09-14T11:17:52.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.498+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~027AOJ829BCR.0 size=316537 2024-09-14T11:17:52.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.500+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=027AOJ829BCR tag=PXP7R62HBKJZ type=write size=1365113 2024-09-14T11:17:52.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.501+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=11Q7E0U0853N type=del size=2271530 2024-09-14T11:17:52.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.503+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.0 size=1048576 2024-09-14T11:17:52.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.503+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.1 size=1048576 2024-09-14T11:17:52.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.504+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~PJ0UPO8EPA0C.2 size=206036 2024-09-14T11:17:52.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.506+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=PJ0UPO8EPA0C tag=CGZIRFE1U94K type=write size=3351764 2024-09-14T11:17:52.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.508+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.0 size=1048576 2024-09-14T11:17:52.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.509+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.1 size=1048576 2024-09-14T11:17:52.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.510+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.2 size=366151 2024-09-14T11:17:52.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.510+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=15F7A8495EXV tag=0TCEYD3LXQF4 type=write size=3511879 2024-09-14T11:17:52.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.511+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=XJXTB0TSD1SR type=del 2024-09-14T11:17:52.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.514+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.0 size=1048576 2024-09-14T11:17:52.513 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.514+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.1 size=1048576 2024-09-14T11:17:52.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.515+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.2 size=570072 2024-09-14T11:17:52.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.515+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=RG3F9355GK25 tag=EE8SRY171AKC type=write size=3715800 2024-09-14T11:17:52.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.516+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.0 size=1048576 2024-09-14T11:17:52.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.517+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.1 size=1048576 2024-09-14T11:17:52.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.518+0000 7f1be8076780 1 < completed part key=_multipart_RIYGSRWKVKFF.2~PRUPQ3AFF8SI.2 size=895935 2024-09-14T11:17:52.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.520+0000 7f1be8076780 1 < completed multipart upload key=RIYGSRWKVKFF upload=PRUPQ3AFF8SI tag=M88E5MP6R098 type=write size=4041663 2024-09-14T11:17:52.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.521+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=7R4MWIKG1G34 type=del size=2947647 2024-09-14T11:17:52.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.522+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=JU9VHFOYHKZO type=del 2024-09-14T11:17:52.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.524+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=YWKPK5OU0RD3 type=del size=3146968 2024-09-14T11:17:52.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.525+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~0DL0P2AGYCV9.0 size=857320 2024-09-14T11:17:52.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.527+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=0DL0P2AGYCV9 tag=FUSWQIY24T0V type=write size=1905896 2024-09-14T11:17:52.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.528+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=HNUDUSKSIBS3 type=del size=1376910 2024-09-14T11:17:52.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.529+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=PIQX1PHJNLH0 type=del 2024-09-14T11:17:52.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.530+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=5FVKF6OMTR9R type=del size=2706443 2024-09-14T11:17:52.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.531+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=BC1HV9L3I2HK type=del 2024-09-14T11:17:52.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.532+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=N0CHCIRZNVHE type=del size=3956889 2024-09-14T11:17:52.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.534+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~7KHRV4Z6FT0K.0 size=34902 2024-09-14T11:17:52.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.535+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=7KHRV4Z6FT0K tag=BJCL958QJIBP type=write size=1083478 2024-09-14T11:17:52.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.536+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=ENNA28A48IR2 type=del size=459482 2024-09-14T11:17:52.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.538+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~XECQIXYXQAZV.0 size=1048576 2024-09-14T11:17:52.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.539+0000 7f1be8076780 1 < completed part key=_multipart_MVUN63538RAB.2~XECQIXYXQAZV.1 size=845109 2024-09-14T11:17:52.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.540+0000 7f1be8076780 1 < completed multipart upload key=MVUN63538RAB upload=XECQIXYXQAZV tag=45YRFPTI81H5 type=write size=2942261 2024-09-14T11:17:52.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.541+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=7BSRC17Y7BFG type=del size=3976633 2024-09-14T11:17:52.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.543+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~30TS787T2RN7.0 size=1048576 2024-09-14T11:17:52.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.543+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~30TS787T2RN7.1 size=17036 2024-09-14T11:17:52.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.545+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=30TS787T2RN7 tag=VJZA2C0EH2QD type=write size=2114188 2024-09-14T11:17:52.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.546+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=9PBAZHHJY4QV type=del size=2455280 2024-09-14T11:17:52.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.548+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=C4OT3ZMZLQRN type=del 2024-09-14T11:17:52.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.550+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=V9KXDAPOORBK type=del size=1241653 2024-09-14T11:17:52.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.551+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=N5K63G8ATMNC type=del 2024-09-14T11:17:52.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.553+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=MHMDC1NLN65B type=write size=871105 2024-09-14T11:17:52.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.554+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.0 size=1048576 2024-09-14T11:17:52.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.555+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.1 size=1048576 2024-09-14T11:17:52.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.556+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~8Z5KMIAJOD3Z.2 size=720039 2024-09-14T11:17:52.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.558+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=8Z5KMIAJOD3Z tag=HP2LHZ10KUFE type=write size=3865767 2024-09-14T11:17:52.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.559+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=NT26H78M2PA8 type=del size=2726874 2024-09-14T11:17:52.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.560+0000 7f1be8076780 1 < completed write operation key=XI178717NOE8 tag=MP0LEE7792TC type=write size=101644 2024-09-14T11:17:52.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.561+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=V1ZZ3RGAKNFA type=del size=3269351 2024-09-14T11:17:52.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.562+0000 7f1be8076780 1 < canceled operation key=UB0SEYZ7ITU1 tag=IU1YIQ4ZRSZ2 type=del size=1495698 2024-09-14T11:17:52.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.563+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=68RMQONR7X08 type=del size=3031324 2024-09-14T11:17:52.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.565+0000 7f1be8076780 1 < canceled operation key=3YIK6B6Y2EU1 tag=11Q7E0U0853N type=del size=2271530 2024-09-14T11:17:52.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.566+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=NU3RCIE4K9F6 type=del size=1684683 2024-09-14T11:17:52.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.567+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.0 size=1048576 2024-09-14T11:17:52.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.568+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.1 size=1048576 2024-09-14T11:17:52.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.569+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~15F7A8495EXV.2 size=366151 2024-09-14T11:17:52.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.571+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=15F7A8495EXV tag=0TCEYD3LXQF4 type=write size=3511879 2024-09-14T11:17:52.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.573+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~3BTRHD2Z42KH.0 size=1048576 2024-09-14T11:17:52.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.573+0000 7f1be8076780 1 > prepared part key=_multipart_0BX70Q8C1QL0.2~3BTRHD2Z42KH.1 size=759894 2024-09-14T11:17:52.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.574+0000 7f1be8076780 1 > prepared multipart upload key=0BX70Q8C1QL0 upload=3BTRHD2Z42KH tag=H9O6COH6CFM4 type=write size=2857046 2024-09-14T11:17:52.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.575+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.0 size=1048576 2024-09-14T11:17:52.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.576+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.1 size=1048576 2024-09-14T11:17:52.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.577+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~RG3F9355GK25.2 size=570072 2024-09-14T11:17:52.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.578+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=RG3F9355GK25 tag=EE8SRY171AKC type=write size=3715800 2024-09-14T11:17:52.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.580+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=2F18WC8OKZWS type=del size=2450244 2024-09-14T11:17:52.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.583+0000 7f1be8076780 1 < suggested update operation key=XB3M4CI0ERWP tag=7R4MWIKG1G34 type=del size=2947647 2024-09-14T11:17:52.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.584+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=D958ZD72VT7J type=del size=1613335 2024-09-14T11:17:52.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.586+0000 7f1be8076780 1 < suggested update operation key=LNMGQ54S2CXX tag=YWKPK5OU0RD3 type=del size=3146968 2024-09-14T11:17:52.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.588+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~9YEYAY4CO2Q0.0 size=286651 2024-09-14T11:17:52.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.588+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=9YEYAY4CO2Q0 tag=V2PLYQ7BN3WX type=write size=1335227 2024-09-14T11:17:52.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.590+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=HNUDUSKSIBS3 type=del 2024-09-14T11:17:52.589 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.591+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=IO8J3KAJWI73 type=write size=345177 2024-09-14T11:17:52.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.592+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=5FVKF6OMTR9R type=del 2024-09-14T11:17:52.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.594+0000 7f1be8076780 1 > prepared part key=_multipart_INU0TV92GXSP.2~W4B634X3K52N.0 size=628519 2024-09-14T11:17:52.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.594+0000 7f1be8076780 1 > prepared multipart upload key=INU0TV92GXSP upload=W4B634X3K52N tag=OSL1AJ8CCEDF type=write size=1677095 2024-09-14T11:17:52.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.596+0000 7f1be8076780 1 < suggested update operation key=7OUNKTS3X7DJ tag=N0CHCIRZNVHE type=del size=3956889 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.598+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~B1SWYNDONMUH.0 size=76812 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.598+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=B1SWYNDONMUH tag=FS1IYP25T1FN type=write size=1125388 2024-09-14T11:17:52.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.599+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=ENNA28A48IR2 type=del 2024-09-14T11:17:52.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.601+0000 7f1be8076780 1 > prepared operation key=1X2EWK1Y2GE0 tag=9RW2UYDQ5GZ1 type=del size=2430951 2024-09-14T11:17:52.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.602+0000 7f1be8076780 1 < canceled operation key=WQC5TVD66R0W tag=7BSRC17Y7BFG type=del size=3976633 2024-09-14T11:17:52.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.604+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~YZHRFTE0UCC9.0 size=1048576 2024-09-14T11:17:52.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.605+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~YZHRFTE0UCC9.1 size=201310 2024-09-14T11:17:52.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.605+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=YZHRFTE0UCC9 tag=SG7LWE1G3SGY type=write size=2298462 2024-09-14T11:17:52.606 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.607+0000 7f1be8076780 1 < suggested update operation key=0BX70Q8C1QL0 tag=9PBAZHHJY4QV type=del size=2455280 2024-09-14T11:17:52.607 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.608+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=4ZHIN6XN2I5D type=write size=283019 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.610+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=V9KXDAPOORBK type=del 2024-09-14T11:17:52.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.611+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=213TM0F6DBID type=del size=332480 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.612+0000 7f1be8076780 1 < completed write operation key=JQZ7C562TQ8D tag=MHMDC1NLN65B type=write size=871105 2024-09-14T11:17:52.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.613+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=MOQHH6L0CQWA type=del size=4092692 2024-09-14T11:17:52.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.614+0000 7f1be8076780 1 < completed delete operation key=JGEBWM9VRCFW tag=NT26H78M2PA8 type=del 2024-09-14T11:17:52.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.618+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~6Y02L74CXM12.0 size=1048576 2024-09-14T11:17:52.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.619+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~6Y02L74CXM12.1 size=688660 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.619+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=6Y02L74CXM12 tag=MAWBJSQU9M7N type=write size=2785812 2024-09-14T11:17:52.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.621+0000 7f1be8076780 1 < suggested remove operation key=MX5J0P18BM0D tag=V1ZZ3RGAKNFA type=del 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.623+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.0 size=1048576 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.624+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.1 size=1048576 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.625+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.2 size=634280 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.625+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=VLW03U061MJP tag=HJ6MLI1NXEY3 type=write size=3780008 2024-09-14T11:17:52.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.627+0000 7f1be8076780 1 < suggested remove operation key=JQZ7C562TQ8D tag=68RMQONR7X08 type=del 2024-09-14T11:17:52.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.629+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.0 size=1048576 2024-09-14T11:17:52.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.630+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.1 size=1048576 2024-09-14T11:17:52.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.631+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.2 size=703856 2024-09-14T11:17:52.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.631+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=MFJB8ZIKWGHY tag=QD3XQ83BMS3D type=write size=3849584 2024-09-14T11:17:52.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.632+0000 7f1be8076780 -1 < failed to complete operation key=7OUNKTS3X7DJ tag=NU3RCIE4K9F6 type=del size=1684683: (22) Invalid argument 2024-09-14T11:17:52.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.633+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=SU86XTN2KPH8 type=del size=1067339 2024-09-14T11:17:52.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.635+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~3BTRHD2Z42KH.0 size=1048576 2024-09-14T11:17:52.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.636+0000 7f1be8076780 1 < completed part key=_multipart_0BX70Q8C1QL0.2~3BTRHD2Z42KH.1 size=759894 2024-09-14T11:17:52.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.638+0000 7f1be8076780 1 < completed multipart upload key=0BX70Q8C1QL0 upload=3BTRHD2Z42KH tag=H9O6COH6CFM4 type=write size=2857046 2024-09-14T11:17:52.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.640+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~7U1ZD1MVIWEZ.0 size=1048576 2024-09-14T11:17:52.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.641+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~7U1ZD1MVIWEZ.1 size=333372 2024-09-14T11:17:52.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.641+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=7U1ZD1MVIWEZ tag=58NVS5AXZD3P type=write size=2430524 2024-09-14T11:17:52.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.642+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=2F18WC8OKZWS type=del 2024-09-14T11:17:52.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.643+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=Y7LTVQKG05O0 type=del size=214577 2024-09-14T11:17:52.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.645+0000 7f1be8076780 1 < suggested update operation key=QC6MEJABT7IM tag=D958ZD72VT7J type=del size=1613335 2024-09-14T11:17:52.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.647+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.0 size=1048576 2024-09-14T11:17:52.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.648+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.1 size=1048576 2024-09-14T11:17:52.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.649+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.2 size=638101 2024-09-14T11:17:52.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.649+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=Y4VN5Q94UI4A tag=SV0O8M1ZXE6I type=write size=3783829 2024-09-14T11:17:52.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.650+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~9YEYAY4CO2Q0.0 size=286651 2024-09-14T11:17:52.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.652+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=9YEYAY4CO2Q0 tag=V2PLYQ7BN3WX type=write size=1335227 2024-09-14T11:17:52.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.653+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=WPXKR8KKG1V3 type=del size=1099039 2024-09-14T11:17:52.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.655+0000 7f1be8076780 1 < completed write operation key=INU0TV92GXSP tag=IO8J3KAJWI73 type=write size=345177 2024-09-14T11:17:52.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.657+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~QRSQCJG3HB9M.0 size=1048576 2024-09-14T11:17:52.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.658+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~QRSQCJG3HB9M.1 size=961901 2024-09-14T11:17:52.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.658+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=QRSQCJG3HB9M tag=E1OOKRFRTHT1 type=write size=3059053 2024-09-14T11:17:52.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.660+0000 7f1be8076780 1 < completed part key=_multipart_INU0TV92GXSP.2~W4B634X3K52N.0 size=628519 2024-09-14T11:17:52.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.662+0000 7f1be8076780 1 < completed multipart upload key=INU0TV92GXSP upload=W4B634X3K52N tag=OSL1AJ8CCEDF type=write size=1677095 2024-09-14T11:17:52.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.665+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~21OGF5BOFUJH.0 size=824198 2024-09-14T11:17:52.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.665+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=21OGF5BOFUJH tag=UXSPZL2OMLJE type=write size=1872774 2024-09-14T11:17:52.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.666+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~B1SWYNDONMUH.0 size=76812 2024-09-14T11:17:52.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.668+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=B1SWYNDONMUH tag=FS1IYP25T1FN type=write size=1125388 2024-09-14T11:17:52.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.669+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=JQ5O32LTAL1J type=del size=2101434 2024-09-14T11:17:52.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.672+0000 7f1be8076780 1 < suggested remove operation key=1X2EWK1Y2GE0 tag=9RW2UYDQ5GZ1 type=del 2024-09-14T11:17:52.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.673+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=6JYUOS0LNR33 type=del size=1137261 2024-09-14T11:17:52.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.674+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~YZHRFTE0UCC9.0 size=1048576 2024-09-14T11:17:52.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.675+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~YZHRFTE0UCC9.1 size=201310 2024-09-14T11:17:52.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.677+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=YZHRFTE0UCC9 tag=SG7LWE1G3SGY type=write size=2298462 2024-09-14T11:17:52.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.678+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=74D3ZY7RW5RN type=del size=2755182 2024-09-14T11:17:52.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.679+0000 7f1be8076780 1 < completed write operation key=7OUNKTS3X7DJ tag=4ZHIN6XN2I5D type=write size=283019 2024-09-14T11:17:52.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.681+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=ZG5NJJCB3EGV type=write size=874409 2024-09-14T11:17:52.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.682+0000 7f1be8076780 1 < completed delete operation key=4AY6ZXFKO1YQ tag=213TM0F6DBID type=del 2024-09-14T11:17:52.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.683+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=37GD062ACBWZ type=del size=982961 2024-09-14T11:17:52.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.685+0000 7f1be8076780 1 < suggested update operation key=RIYGSRWKVKFF tag=MOQHH6L0CQWA type=del size=4092692 2024-09-14T11:17:52.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.687+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=YHJL6TVYF4JG type=del size=2811791 2024-09-14T11:17:52.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.688+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~6Y02L74CXM12.0 size=1048576 2024-09-14T11:17:52.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.689+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~6Y02L74CXM12.1 size=688660 2024-09-14T11:17:52.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.691+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=6Y02L74CXM12 tag=MAWBJSQU9M7N type=write size=2785812 2024-09-14T11:17:52.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.692+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=T6D580OUS10B type=del size=439705 2024-09-14T11:17:52.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.694+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.0 size=1048576 2024-09-14T11:17:52.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.696+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.1 size=1048576 2024-09-14T11:17:52.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.696+0000 7f1be8076780 1 < canceled part key=_multipart_JGEBWM9VRCFW.2~VLW03U061MJP.2 size=634280 2024-09-14T11:17:52.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.698+0000 7f1be8076780 1 < canceled multipart upload key=JGEBWM9VRCFW upload=VLW03U061MJP tag=HJ6MLI1NXEY3 type=write size=3780008 2024-09-14T11:17:52.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.701+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=QIV0THSM0YD8 type=del size=1947200 2024-09-14T11:17:52.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.702+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.0 size=1048576 2024-09-14T11:17:52.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.703+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.1 size=1048576 2024-09-14T11:17:52.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.704+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~MFJB8ZIKWGHY.2 size=703856 2024-09-14T11:17:52.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.706+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=MFJB8ZIKWGHY tag=QD3XQ83BMS3D type=write size=3849584 2024-09-14T11:17:52.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.708+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.0 size=1048576 2024-09-14T11:17:52.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.709+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.1 size=1048576 2024-09-14T11:17:52.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.710+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.2 size=955880 2024-09-14T11:17:52.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.710+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=6JTS1UQVZ5SH tag=O5A4NCD47PNW type=write size=4101608 2024-09-14T11:17:52.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.711+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=SU86XTN2KPH8 type=del 2024-09-14T11:17:52.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.713+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~4OW5DR3PHG7Y.0 size=1048576 2024-09-14T11:17:52.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.714+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~4OW5DR3PHG7Y.1 size=535247 2024-09-14T11:17:52.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.714+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=4OW5DR3PHG7Y tag=JJK7IC7TXO49 type=write size=2632399 2024-09-14T11:17:52.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.716+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~7U1ZD1MVIWEZ.0 size=1048576 2024-09-14T11:17:52.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.717+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~7U1ZD1MVIWEZ.1 size=333372 2024-09-14T11:17:52.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.719+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=7U1ZD1MVIWEZ tag=58NVS5AXZD3P type=write size=2430524 2024-09-14T11:17:52.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.721+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~OQNL6O638XA9.0 size=1048576 2024-09-14T11:17:52.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.722+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~OQNL6O638XA9.1 size=181736 2024-09-14T11:17:52.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.722+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=OQNL6O638XA9 tag=9GHIL0EG3GA1 type=write size=2278888 2024-09-14T11:17:52.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.723+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=Y7LTVQKG05O0 type=del 2024-09-14T11:17:52.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.725+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=VQJY38M0L8Q0 type=del size=1940092 2024-09-14T11:17:52.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.726+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.0 size=1048576 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.727+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.1 size=1048576 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.728+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~Y4VN5Q94UI4A.2 size=638101 2024-09-14T11:17:52.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.730+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=Y4VN5Q94UI4A tag=SV0O8M1ZXE6I type=write size=3783829 2024-09-14T11:17:52.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.731+0000 7f1be8076780 1 > prepared operation key=JQZ7C562TQ8D tag=NQU6YFSHNWLQ type=del size=3849760 2024-09-14T11:17:52.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.734+0000 7f1be8076780 1 < suggested remove operation key=T70EFGHRQZQ7 tag=WPXKR8KKG1V3 type=del 2024-09-14T11:17:52.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.735+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=NK47EBJGI8RQ type=del size=565929 2024-09-14T11:17:52.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.736+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~QRSQCJG3HB9M.0 size=1048576 2024-09-14T11:17:52.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.737+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~QRSQCJG3HB9M.1 size=961901 2024-09-14T11:17:52.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.739+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=QRSQCJG3HB9M tag=E1OOKRFRTHT1 type=write size=3059053 2024-09-14T11:17:52.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.742+0000 7f1be8076780 1 > prepared part key=_multipart_9DRSDTGM7Y3F.2~ZMJOW6N32G1L.0 size=363775 2024-09-14T11:17:52.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.742+0000 7f1be8076780 1 > prepared multipart upload key=9DRSDTGM7Y3F upload=ZMJOW6N32G1L tag=BD9XUB2I5ILA type=write size=1412351 2024-09-14T11:17:52.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.743+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~21OGF5BOFUJH.0 size=824198 2024-09-14T11:17:52.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.745+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=21OGF5BOFUJH tag=UXSPZL2OMLJE type=write size=1872774 2024-09-14T11:17:52.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.746+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=041BWB2QKYBX type=write size=1379 2024-09-14T11:17:52.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.747+0000 7f1be8076780 1 < completed delete operation key=QIEUKUQ8CS2U tag=JQ5O32LTAL1J type=del 2024-09-14T11:17:52.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.749+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~U8EZ9FDQO395.0 size=1048576 2024-09-14T11:17:52.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.750+0000 7f1be8076780 1 > prepared part key=_multipart_UB0SEYZ7ITU1.2~U8EZ9FDQO395.1 size=61557 2024-09-14T11:17:52.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.750+0000 7f1be8076780 1 > prepared multipart upload key=UB0SEYZ7ITU1 upload=U8EZ9FDQO395 tag=LTA1J5XRBF62 type=write size=2158709 2024-09-14T11:17:52.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.752+0000 7f1be8076780 1 < suggested remove operation key=AUCQC0OBQP7Z tag=6JYUOS0LNR33 type=del 2024-09-14T11:17:52.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.754+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.0 size=1048576 2024-09-14T11:17:52.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.755+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.1 size=1048576 2024-09-14T11:17:52.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.756+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.2 size=38305 2024-09-14T11:17:52.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.756+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=YUDLL2VTSICG tag=SUH8VSC1AMR8 type=write size=3184033 2024-09-14T11:17:52.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.757+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=74D3ZY7RW5RN type=del 2024-09-14T11:17:52.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.758+0000 7f1be8076780 1 > prepared operation key=0BX70Q8C1QL0 tag=95KE7M82M7JZ type=del size=2180045 2024-09-14T11:17:52.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.759+0000 7f1be8076780 -1 < failed to complete operation key=T70EFGHRQZQ7 tag=ZG5NJJCB3EGV type=write size=874409: (22) Invalid argument 2024-09-14T11:17:52.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.760+0000 7f1be8076780 1 > prepared operation key=JDKFKO39I56L tag=XYJZRLGE0C83 type=del size=4117103 2024-09-14T11:17:52.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.762+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=37GD062ACBWZ type=del 2024-09-14T11:17:52.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.763+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=0VWMGIFQAAT1 type=del size=2791340 2024-09-14T11:17:52.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.764+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=YHJL6TVYF4JG type=del 2024-09-14T11:17:52.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.765+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=67Z31LK3H92T type=del size=2509926 2024-09-14T11:17:52.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.767+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=T6D580OUS10B type=del 2024-09-14T11:17:52.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.768+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=7UDXJA32585P type=del size=381126 2024-09-14T11:17:52.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.770+0000 7f1be8076780 1 < suggested remove operation key=MVUN63538RAB tag=QIV0THSM0YD8 type=del 2024-09-14T11:17:52.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.771+0000 7f1be8076780 1 > prepared operation key=JCDSP32N5C7M tag=K8K7Q59ZGXP2 type=write size=1020 2024-09-14T11:17:52.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.771+0000 7f1be8076780 1 < canceled part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.0 size=1048576 2024-09-14T11:17:52.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.772+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.1 size=1048576 2024-09-14T11:17:52.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.773+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~6JTS1UQVZ5SH.2 size=955880 2024-09-14T11:17:52.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.775+0000 7f1be8076780 1 < canceled multipart upload key=1RUE5J1DYH2C upload=6JTS1UQVZ5SH tag=O5A4NCD47PNW type=write size=4101608 2024-09-14T11:17:52.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.777+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~L4JUF162B4RD.0 size=1048576 2024-09-14T11:17:52.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.778+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~L4JUF162B4RD.1 size=37020 2024-09-14T11:17:52.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.778+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=L4JUF162B4RD tag=36H0NAYM3RZB type=write size=2134172 2024-09-14T11:17:52.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.780+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~4OW5DR3PHG7Y.0 size=1048576 2024-09-14T11:17:52.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.781+0000 7f1be8076780 1 < completed part key=_multipart_26WW5JFVB36U.2~4OW5DR3PHG7Y.1 size=535247 2024-09-14T11:17:52.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.783+0000 7f1be8076780 1 < completed multipart upload key=26WW5JFVB36U upload=4OW5DR3PHG7Y tag=JJK7IC7TXO49 type=write size=2632399 2024-09-14T11:17:52.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.785+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~BQKO0R10FH5F.0 size=912267 2024-09-14T11:17:52.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.785+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=BQKO0R10FH5F tag=7FJMWL8V90LU type=write size=1960843 2024-09-14T11:17:52.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.786+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~OQNL6O638XA9.0 size=1048576 2024-09-14T11:17:52.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.787+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~OQNL6O638XA9.1 size=181736 2024-09-14T11:17:52.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.789+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=OQNL6O638XA9 tag=9GHIL0EG3GA1 type=write size=2278888 2024-09-14T11:17:52.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.791+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.0 size=1048576 2024-09-14T11:17:52.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.792+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.1 size=1048576 2024-09-14T11:17:52.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.793+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.2 size=592608 2024-09-14T11:17:52.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.793+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=P3BTW2W42A6O tag=7SCQDELHW25L type=write size=3738336 2024-09-14T11:17:52.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.794+0000 7f1be8076780 1 < completed delete operation key=3Z71PEWG5UMA tag=VQJY38M0L8Q0 type=del 2024-09-14T11:17:52.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.796+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.0 size=1048576 2024-09-14T11:17:52.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.797+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.1 size=1048576 2024-09-14T11:17:52.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.798+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.2 size=37002 2024-09-14T11:17:52.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.798+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=0K3RA70O6MXB tag=20GUEM4OV1DO type=write size=3182730 2024-09-14T11:17:52.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.799+0000 7f1be8076780 1 < completed delete operation key=JQZ7C562TQ8D tag=NQU6YFSHNWLQ type=del 2024-09-14T11:17:52.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.800+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=DPAIQ453C6VB type=write size=752875 2024-09-14T11:17:52.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.801+0000 7f1be8076780 1 < completed delete operation key=JCDSP32N5C7M tag=NK47EBJGI8RQ type=del 2024-09-14T11:17:52.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.803+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.0 size=1048576 2024-09-14T11:17:52.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.804+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.1 size=1048576 2024-09-14T11:17:52.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.806+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.2 size=161354 2024-09-14T11:17:52.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.806+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=9D5IBT8K0N8D tag=3L9754TRXZO2 type=write size=3307082 2024-09-14T11:17:52.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.808+0000 7f1be8076780 1 < completed part key=_multipart_9DRSDTGM7Y3F.2~ZMJOW6N32G1L.0 size=363775 2024-09-14T11:17:52.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.810+0000 7f1be8076780 1 < completed multipart upload key=9DRSDTGM7Y3F upload=ZMJOW6N32G1L tag=BD9XUB2I5ILA type=write size=1412351 2024-09-14T11:17:52.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.811+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=Y3E99MMKNTF1 type=del size=1879668 2024-09-14T11:17:52.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.813+0000 7f1be8076780 1 < completed write operation key=JDKFKO39I56L tag=041BWB2QKYBX type=write size=1379 2024-09-14T11:17:52.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.814+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=DW037L1O3DWS type=write size=706751 2024-09-14T11:17:52.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.815+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~U8EZ9FDQO395.0 size=1048576 2024-09-14T11:17:52.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.816+0000 7f1be8076780 1 < completed part key=_multipart_UB0SEYZ7ITU1.2~U8EZ9FDQO395.1 size=61557 2024-09-14T11:17:52.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.818+0000 7f1be8076780 1 < completed multipart upload key=UB0SEYZ7ITU1 upload=U8EZ9FDQO395 tag=LTA1J5XRBF62 type=write size=2158709 2024-09-14T11:17:52.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.820+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.0 size=1048576 2024-09-14T11:17:52.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.821+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.1 size=1048576 2024-09-14T11:17:52.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.822+0000 7f1be8076780 1 > prepared part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.2 size=852719 2024-09-14T11:17:52.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.822+0000 7f1be8076780 1 > prepared multipart upload key=SJES17ZIGRZE upload=1TA9BHSW83X2 tag=6ONA9V8H8R9A type=write size=3998447 2024-09-14T11:17:52.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.823+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.0 size=1048576 2024-09-14T11:17:52.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.824+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.1 size=1048576 2024-09-14T11:17:52.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.825+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~YUDLL2VTSICG.2 size=38305 2024-09-14T11:17:52.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.826+0000 7f1be8076780 1 < completed multipart upload key=AUCQC0OBQP7Z upload=YUDLL2VTSICG tag=SUH8VSC1AMR8 type=write size=3184033 2024-09-14T11:17:52.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.828+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=WQYXYNR8EOZG type=del size=1589145 2024-09-14T11:17:52.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.829+0000 7f1be8076780 1 < completed delete operation key=0BX70Q8C1QL0 tag=95KE7M82M7JZ type=del 2024-09-14T11:17:52.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.830+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=313IA67PUH9V type=del size=2079111 2024-09-14T11:17:52.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.831+0000 7f1be8076780 1 < completed delete operation key=JDKFKO39I56L tag=XYJZRLGE0C83 type=del 2024-09-14T11:17:52.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.833+0000 7f1be8076780 1 > prepared part key=_multipart_CQDRZMJAJ7FZ.2~81810AAYPG50.0 size=707135 2024-09-14T11:17:52.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.833+0000 7f1be8076780 1 > prepared multipart upload key=CQDRZMJAJ7FZ upload=81810AAYPG50 tag=PEC7E1K2BYFC type=write size=1755711 2024-09-14T11:17:52.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.835+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=0VWMGIFQAAT1 type=del 2024-09-14T11:17:52.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.837+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.0 size=1048576 2024-09-14T11:17:52.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.838+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.1 size=1048576 2024-09-14T11:17:52.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.839+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.2 size=966847 2024-09-14T11:17:52.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.839+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=ZQI9W09CAJMD tag=QJ4WQOV8Z3VJ type=write size=4112575 2024-09-14T11:17:52.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.840+0000 7f1be8076780 1 < completed delete operation key=XI178717NOE8 tag=67Z31LK3H92T type=del 2024-09-14T11:17:52.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.841+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=LP08G7VL24SE type=del size=3393201 2024-09-14T11:17:52.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.842+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=7UDXJA32585P type=del 2024-09-14T11:17:52.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.844+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.0 size=1048576 2024-09-14T11:17:52.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.845+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.1 size=1048576 2024-09-14T11:17:52.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.846+0000 7f1be8076780 1 > prepared part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.2 size=919328 2024-09-14T11:17:52.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.846+0000 7f1be8076780 1 > prepared multipart upload key=2RJYZ1CRDVEP upload=TZS2T8VDEDNY tag=6Y7ODGA3IR2F type=write size=4065056 2024-09-14T11:17:52.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.849+0000 7f1be8076780 1 < suggested remove operation key=JCDSP32N5C7M tag=K8K7Q59ZGXP2 type=write 2024-09-14T11:17:52.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.850+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=P0OKKG6D07PE type=del size=1974861 2024-09-14T11:17:52.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.850+0000 7f1be8076780 1 < canceled part key=_multipart_QIEUKUQ8CS2U.2~L4JUF162B4RD.0 size=1048576 2024-09-14T11:17:52.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.851+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~L4JUF162B4RD.1 size=37020 2024-09-14T11:17:52.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.853+0000 7f1be8076780 1 < canceled multipart upload key=QIEUKUQ8CS2U upload=L4JUF162B4RD tag=36H0NAYM3RZB type=write size=2134172 2024-09-14T11:17:52.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.855+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~4YB1U5MZVOQ6.0 size=1048576 2024-09-14T11:17:52.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.856+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~4YB1U5MZVOQ6.1 size=328393 2024-09-14T11:17:52.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.856+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=4YB1U5MZVOQ6 tag=YBJI3IU8B4Y7 type=write size=2425545 2024-09-14T11:17:52.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.857+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~BQKO0R10FH5F.0 size=912267 2024-09-14T11:17:52.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.859+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=BQKO0R10FH5F tag=7FJMWL8V90LU type=write size=1960843 2024-09-14T11:17:52.860 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.861+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~TJTKT65CI30C.0 size=1048576 2024-09-14T11:17:52.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.862+0000 7f1be8076780 1 > prepared part key=_multipart_JGEBWM9VRCFW.2~TJTKT65CI30C.1 size=719086 2024-09-14T11:17:52.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.862+0000 7f1be8076780 1 > prepared multipart upload key=JGEBWM9VRCFW upload=TJTKT65CI30C tag=3ESY4840QZT0 type=write size=2816238 2024-09-14T11:17:52.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.863+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.0 size=1048576 2024-09-14T11:17:52.863 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.864+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.1 size=1048576 2024-09-14T11:17:52.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.865+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~P3BTW2W42A6O.2 size=592608 2024-09-14T11:17:52.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.867+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=P3BTW2W42A6O tag=7SCQDELHW25L type=write size=3738336 2024-09-14T11:17:52.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.869+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~UZPWS7YAKDT8.0 size=1048576 2024-09-14T11:17:52.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.870+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~UZPWS7YAKDT8.1 size=395935 2024-09-14T11:17:52.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.870+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=UZPWS7YAKDT8 tag=PNT1AU5H679N type=write size=2493087 2024-09-14T11:17:52.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.871+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.0 size=1048576 2024-09-14T11:17:52.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.871+0000 7f1be8076780 1 < canceled part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.1 size=1048576 2024-09-14T11:17:52.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.872+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~0K3RA70O6MXB.2 size=37002 2024-09-14T11:17:52.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.874+0000 7f1be8076780 1 < canceled multipart upload key=SJES17ZIGRZE upload=0K3RA70O6MXB tag=20GUEM4OV1DO type=write size=3182730 2024-09-14T11:17:52.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.875+0000 7f1be8076780 1 > prepared operation key=SJES17ZIGRZE tag=8VLF9Z6E2TTE type=del size=2233518 2024-09-14T11:17:52.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.877+0000 7f1be8076780 1 < completed write operation key=LNMGQ54S2CXX tag=DPAIQ453C6VB type=write size=752875 2024-09-14T11:17:52.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.878+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=0OZK638MLA71 type=del size=1575521 2024-09-14T11:17:52.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.879+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.0 size=1048576 2024-09-14T11:17:52.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.880+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.1 size=1048576 2024-09-14T11:17:52.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.881+0000 7f1be8076780 1 < completed part key=_multipart_7OUNKTS3X7DJ.2~9D5IBT8K0N8D.2 size=161354 2024-09-14T11:17:52.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.883+0000 7f1be8076780 1 < completed multipart upload key=7OUNKTS3X7DJ upload=9D5IBT8K0N8D tag=3L9754TRXZO2 type=write size=3307082 2024-09-14T11:17:52.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.885+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~LIO8GHTPF0Q3.0 size=1048576 2024-09-14T11:17:52.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.887+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~LIO8GHTPF0Q3.1 size=476444 2024-09-14T11:17:52.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.887+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=LIO8GHTPF0Q3 tag=18JXPDD9JU61 type=write size=2573596 2024-09-14T11:17:52.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.888+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=Y3E99MMKNTF1 type=del 2024-09-14T11:17:52.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.890+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~TBHX3C6ZIQG2.0 size=1048576 2024-09-14T11:17:52.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.891+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~TBHX3C6ZIQG2.1 size=460271 2024-09-14T11:17:52.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.891+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=TBHX3C6ZIQG2 tag=AN720ZD6GZ31 type=write size=2557423 2024-09-14T11:17:52.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.892+0000 7f1be8076780 1 < completed write operation key=JGEBWM9VRCFW tag=DW037L1O3DWS type=write size=706751 2024-09-14T11:17:52.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.893+0000 7f1be8076780 1 > prepared operation key=MVUN63538RAB tag=MR333VGUPXAL type=del size=4135079 2024-09-14T11:17:52.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.894+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.0 size=1048576 2024-09-14T11:17:52.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.895+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.1 size=1048576 2024-09-14T11:17:52.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.896+0000 7f1be8076780 1 < completed part key=_multipart_SJES17ZIGRZE.2~1TA9BHSW83X2.2 size=852719 2024-09-14T11:17:52.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.898+0000 7f1be8076780 1 < completed multipart upload key=SJES17ZIGRZE upload=1TA9BHSW83X2 tag=6ONA9V8H8R9A type=write size=3998447 2024-09-14T11:17:52.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.899+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=O5LKOR6YCYFG type=write size=883534 2024-09-14T11:17:52.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.901+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=WQYXYNR8EOZG type=del 2024-09-14T11:17:52.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.902+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=Q31YKZKIHPTW type=write size=705486 2024-09-14T11:17:52.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.903+0000 7f1be8076780 1 < completed delete operation key=QC6MEJABT7IM tag=313IA67PUH9V type=del 2024-09-14T11:17:52.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.905+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.0 size=1048576 2024-09-14T11:17:52.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.906+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.1 size=1048576 2024-09-14T11:17:52.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.907+0000 7f1be8076780 1 > prepared part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.2 size=538526 2024-09-14T11:17:52.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.907+0000 7f1be8076780 1 > prepared multipart upload key=AUCQC0OBQP7Z upload=8YI828L3MEX9 tag=IYLOUK4M1U3B type=write size=3684254 2024-09-14T11:17:52.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.908+0000 7f1be8076780 1 < completed part key=_multipart_CQDRZMJAJ7FZ.2~81810AAYPG50.0 size=707135 2024-09-14T11:17:52.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.910+0000 7f1be8076780 1 < completed multipart upload key=CQDRZMJAJ7FZ upload=81810AAYPG50 tag=PEC7E1K2BYFC type=write size=1755711 2024-09-14T11:17:52.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.912+0000 7f1be8076780 1 > prepared part key=_multipart_WQC5TVD66R0W.2~5UF2R6H7DWGA.0 size=968686 2024-09-14T11:17:52.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.912+0000 7f1be8076780 1 > prepared multipart upload key=WQC5TVD66R0W upload=5UF2R6H7DWGA tag=Z6L8SA6L7898 type=write size=2017262 2024-09-14T11:17:52.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.915+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.0 size=1048576 2024-09-14T11:17:52.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.916+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.1 size=1048576 2024-09-14T11:17:52.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.917+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~ZQI9W09CAJMD.2 size=966847 2024-09-14T11:17:52.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.919+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=ZQI9W09CAJMD tag=QJ4WQOV8Z3VJ type=write size=4112575 2024-09-14T11:17:52.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.920+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=PWEW9A15OUWD type=write size=997578 2024-09-14T11:17:52.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.921+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=LP08G7VL24SE type=del 2024-09-14T11:17:52.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.922+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=W1AC1GP2IEVS type=write size=160354 2024-09-14T11:17:52.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.923+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.0 size=1048576 2024-09-14T11:17:52.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.924+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.1 size=1048576 2024-09-14T11:17:52.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.925+0000 7f1be8076780 1 < completed part key=_multipart_2RJYZ1CRDVEP.2~TZS2T8VDEDNY.2 size=919328 2024-09-14T11:17:52.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.927+0000 7f1be8076780 1 < completed multipart upload key=2RJYZ1CRDVEP upload=TZS2T8VDEDNY tag=6Y7ODGA3IR2F type=write size=4065056 2024-09-14T11:17:52.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.928+0000 7f1be8076780 1 > prepared operation key=KQ479IOZ0108 tag=AVS97X2MHR3M type=del size=1561839 2024-09-14T11:17:52.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.931+0000 7f1be8076780 1 < suggested remove operation key=INU0TV92GXSP tag=P0OKKG6D07PE type=del 2024-09-14T11:17:52.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.932+0000 7f1be8076780 1 > prepared operation key=JGEBWM9VRCFW tag=IGOWT5F6WIVK type=del size=4043253 2024-09-14T11:17:52.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.932+0000 7f1be8076780 1 < canceled part key=_multipart_XB3M4CI0ERWP.2~4YB1U5MZVOQ6.0 size=1048576 2024-09-14T11:17:52.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.933+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~4YB1U5MZVOQ6.1 size=328393 2024-09-14T11:17:52.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.935+0000 7f1be8076780 1 < canceled multipart upload key=XB3M4CI0ERWP upload=4YB1U5MZVOQ6 tag=YBJI3IU8B4Y7 type=write size=2425545 2024-09-14T11:17:52.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.936+0000 7f1be8076780 1 > prepared operation key=4AY6ZXFKO1YQ tag=NF696Z18I4TU type=del size=660439 2024-09-14T11:17:52.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.937+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~TJTKT65CI30C.0 size=1048576 2024-09-14T11:17:52.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.938+0000 7f1be8076780 1 < completed part key=_multipart_JGEBWM9VRCFW.2~TJTKT65CI30C.1 size=719086 2024-09-14T11:17:52.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.940+0000 7f1be8076780 1 < completed multipart upload key=JGEBWM9VRCFW upload=TJTKT65CI30C tag=3ESY4840QZT0 type=write size=2816238 2024-09-14T11:17:52.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.943+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.0 size=1048576 2024-09-14T11:17:52.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.944+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.1 size=1048576 2024-09-14T11:17:52.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.945+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.2 size=761475 2024-09-14T11:17:52.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.945+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=0M2DP2J1SU5Y tag=ABT7U1DPWRJY type=write size=3907203 2024-09-14T11:17:52.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.946+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~UZPWS7YAKDT8.0 size=1048576 2024-09-14T11:17:52.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.947+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~UZPWS7YAKDT8.1 size=395935 2024-09-14T11:17:52.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.949+0000 7f1be8076780 1 < completed multipart upload key=XI178717NOE8 upload=UZPWS7YAKDT8 tag=PNT1AU5H679N type=write size=2493087 2024-09-14T11:17:52.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.950+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=QPZZYVWPC0H7 type=del size=719021 2024-09-14T11:17:52.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.951+0000 7f1be8076780 1 < completed delete operation key=SJES17ZIGRZE tag=8VLF9Z6E2TTE type=del 2024-09-14T11:17:52.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.952+0000 7f1be8076780 1 > prepared operation key=QIEUKUQ8CS2U tag=50WYR7WCWY32 type=del size=2134570 2024-09-14T11:17:52.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.953+0000 7f1be8076780 1 < completed delete operation key=AUCQC0OBQP7Z tag=0OZK638MLA71 type=del 2024-09-14T11:17:52.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.954+0000 7f1be8076780 1 > prepared operation key=2RJYZ1CRDVEP tag=RG3P38U39Z8O type=del size=3649890 2024-09-14T11:17:52.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.955+0000 7f1be8076780 1 < completed part key=_multipart_XI178717NOE8.2~LIO8GHTPF0Q3.0 size=1048576 2024-09-14T11:17:52.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.955+0000 7f1be8076780 1 < canceled part key=_multipart_XI178717NOE8.2~LIO8GHTPF0Q3.1 size=476444 2024-09-14T11:17:52.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.957+0000 7f1be8076780 1 < canceled multipart upload key=XI178717NOE8 upload=LIO8GHTPF0Q3 tag=18JXPDD9JU61 type=write size=2573596 2024-09-14T11:17:52.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.958+0000 7f1be8076780 1 > prepared operation key=RIYGSRWKVKFF tag=0WC1PSW70N95 type=del size=2644531 2024-09-14T11:17:52.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.960+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~TBHX3C6ZIQG2.0 size=1048576 2024-09-14T11:17:52.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.960+0000 7f1be8076780 1 < canceled part key=_multipart_QC6MEJABT7IM.2~TBHX3C6ZIQG2.1 size=460271 2024-09-14T11:17:52.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.961+0000 7f1be8076780 1 < canceled multipart upload key=QC6MEJABT7IM upload=TBHX3C6ZIQG2 tag=AN720ZD6GZ31 type=write size=2557423 2024-09-14T11:17:52.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.963+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~89ND1H1F3KX7.0 size=758109 2024-09-14T11:17:52.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.963+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=89ND1H1F3KX7 tag=KWQVRQR7A7R1 type=write size=1806685 2024-09-14T11:17:52.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.964+0000 7f1be8076780 1 < completed delete operation key=MVUN63538RAB tag=MR333VGUPXAL type=del 2024-09-14T11:17:52.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.966+0000 7f1be8076780 1 > prepared part key=_multipart_QC6MEJABT7IM.2~NSJJM7I42F85.0 size=489152 2024-09-14T11:17:52.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.966+0000 7f1be8076780 1 > prepared multipart upload key=QC6MEJABT7IM upload=NSJJM7I42F85 tag=99G3YWK18IU5 type=write size=1537728 2024-09-14T11:17:52.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.967+0000 7f1be8076780 1 < completed write operation key=MX5J0P18BM0D tag=O5LKOR6YCYFG type=write size=883534 2024-09-14T11:17:52.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.969+0000 7f1be8076780 1 > prepared operation key=UB0SEYZ7ITU1 tag=QSAAB811MON7 type=del size=1880968 2024-09-14T11:17:52.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.970+0000 7f1be8076780 1 < completed write operation key=JIWPGHQ3GEZB tag=Q31YKZKIHPTW type=write size=705486 2024-09-14T11:17:52.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.971+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=OYT08BQRHXXN type=del size=2431831 2024-09-14T11:17:52.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.972+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.0 size=1048576 2024-09-14T11:17:52.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.972+0000 7f1be8076780 1 < canceled part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.1 size=1048576 2024-09-14T11:17:52.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.973+0000 7f1be8076780 1 < completed part key=_multipart_AUCQC0OBQP7Z.2~8YI828L3MEX9.2 size=538526 2024-09-14T11:17:52.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.975+0000 7f1be8076780 1 < canceled multipart upload key=AUCQC0OBQP7Z upload=8YI828L3MEX9 tag=IYLOUK4M1U3B type=write size=3684254 2024-09-14T11:17:52.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.976+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=VSFS81BOFIHY type=del size=3308877 2024-09-14T11:17:52.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.977+0000 7f1be8076780 1 < completed part key=_multipart_WQC5TVD66R0W.2~5UF2R6H7DWGA.0 size=968686 2024-09-14T11:17:52.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.979+0000 7f1be8076780 1 < completed multipart upload key=WQC5TVD66R0W upload=5UF2R6H7DWGA tag=Z6L8SA6L7898 type=write size=2017262 2024-09-14T11:17:52.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.980+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=H0W1J5ZCC2K0 type=del size=1968963 2024-09-14T11:17:52.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.981+0000 7f1be8076780 1 < completed write operation key=26WW5JFVB36U tag=PWEW9A15OUWD type=write size=997578 2024-09-14T11:17:52.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.982+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=MKTC9EC0QR6N type=del size=2956527 2024-09-14T11:17:52.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.983+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=W1AC1GP2IEVS type=write size=160354 2024-09-14T11:17:52.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.984+0000 7f1be8076780 1 > prepared operation key=WQC5TVD66R0W tag=MSCULZFH49N0 type=del size=1461991 2024-09-14T11:17:52.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.985+0000 7f1be8076780 1 < completed delete operation key=KQ479IOZ0108 tag=AVS97X2MHR3M type=del 2024-09-14T11:17:52.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.987+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.0 size=1048576 2024-09-14T11:17:52.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.988+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.1 size=1048576 2024-09-14T11:17:52.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.989+0000 7f1be8076780 1 > prepared part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.2 size=261911 2024-09-14T11:17:52.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.989+0000 7f1be8076780 1 > prepared multipart upload key=JQZ7C562TQ8D upload=LT76GIJ5G9LT tag=86BQA3M8ODWT type=write size=3407639 2024-09-14T11:17:52.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.990+0000 7f1be8076780 1 < canceled operation key=JGEBWM9VRCFW tag=IGOWT5F6WIVK type=del size=4043253 2024-09-14T11:17:52.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.991+0000 7f1be8076780 1 > prepared operation key=3Z71PEWG5UMA tag=GQIFUWDQQN33 type=write size=509125 2024-09-14T11:17:52.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.993+0000 7f1be8076780 1 < suggested update operation key=4AY6ZXFKO1YQ tag=NF696Z18I4TU type=del size=660439 2024-09-14T11:17:52.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.995+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~3PEWWQI61NUJ.0 size=338623 2024-09-14T11:17:52.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.995+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=3PEWWQI61NUJ tag=9U6NSZNZHL28 type=write size=1387199 2024-09-14T11:17:52.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.996+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.0 size=1048576 2024-09-14T11:17:52.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.997+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.1 size=1048576 2024-09-14T11:17:52.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:52.998+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~0M2DP2J1SU5Y.2 size=761475 2024-09-14T11:17:52.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.000+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=0M2DP2J1SU5Y tag=ABT7U1DPWRJY type=write size=3907203 2024-09-14T11:17:53.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.001+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=N7MX6SCU5Y8V type=del size=3264990 2024-09-14T11:17:53.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.002+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=QPZZYVWPC0H7 type=del 2024-09-14T11:17:53.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.004+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~8RUWOFLK17JO.0 size=1048576 2024-09-14T11:17:53.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.005+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~8RUWOFLK17JO.1 size=586353 2024-09-14T11:17:53.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.005+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=8RUWOFLK17JO tag=S5OVWER9C0CF type=write size=2683505 2024-09-14T11:17:53.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.006+0000 7f1be8076780 1 < canceled operation key=QIEUKUQ8CS2U tag=50WYR7WCWY32 type=del size=2134570 2024-09-14T11:17:53.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.008+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=JF818T8U1AU4 type=del size=2429089 2024-09-14T11:17:53.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.009+0000 7f1be8076780 1 < completed delete operation key=2RJYZ1CRDVEP tag=RG3P38U39Z8O type=del 2024-09-14T11:17:53.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.013+0000 7f1be8076780 1 > prepared part key=_multipart_QIEUKUQ8CS2U.2~TE1JVFO2167L.0 size=306108 2024-09-14T11:17:53.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.013+0000 7f1be8076780 1 > prepared multipart upload key=QIEUKUQ8CS2U upload=TE1JVFO2167L tag=03TS5NFWMXVI type=write size=1354684 2024-09-14T11:17:53.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.014+0000 7f1be8076780 1 < completed delete operation key=RIYGSRWKVKFF tag=0WC1PSW70N95 type=del 2024-09-14T11:17:53.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.016+0000 7f1be8076780 1 > prepared part key=_multipart_JIWPGHQ3GEZB.2~TAZ3RFVBR35L.0 size=320766 2024-09-14T11:17:53.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.016+0000 7f1be8076780 1 > prepared multipart upload key=JIWPGHQ3GEZB upload=TAZ3RFVBR35L tag=TQNDKT95A2CL type=write size=1369342 2024-09-14T11:17:53.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.017+0000 7f1be8076780 1 < completed part key=_multipart_1RUE5J1DYH2C.2~89ND1H1F3KX7.0 size=758109 2024-09-14T11:17:53.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.019+0000 7f1be8076780 1 < completed multipart upload key=1RUE5J1DYH2C upload=89ND1H1F3KX7 tag=KWQVRQR7A7R1 type=write size=1806685 2024-09-14T11:17:53.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.020+0000 7f1be8076780 1 > prepared operation key=JIWPGHQ3GEZB tag=MKAOCA3LAR7P type=del size=4031642 2024-09-14T11:17:53.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.022+0000 7f1be8076780 1 < completed part key=_multipart_QC6MEJABT7IM.2~NSJJM7I42F85.0 size=489152 2024-09-14T11:17:53.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.024+0000 7f1be8076780 1 < completed multipart upload key=QC6MEJABT7IM upload=NSJJM7I42F85 tag=99G3YWK18IU5 type=write size=1537728 2024-09-14T11:17:53.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.026+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.0 size=1048576 2024-09-14T11:17:53.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.027+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.1 size=1048576 2024-09-14T11:17:53.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.028+0000 7f1be8076780 1 > prepared part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.2 size=338197 2024-09-14T11:17:53.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.028+0000 7f1be8076780 1 > prepared multipart upload key=4ADXXTIO715C upload=3F0O8UB9DVME tag=MS514P21EGPO type=write size=3483925 2024-09-14T11:17:53.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.030+0000 7f1be8076780 1 < suggested update operation key=UB0SEYZ7ITU1 tag=QSAAB811MON7 type=del size=1880968 2024-09-14T11:17:53.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.032+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~T7KX8DL6ZYHT.0 size=945179 2024-09-14T11:17:53.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.032+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=T7KX8DL6ZYHT tag=V36FF27W9H8E type=write size=1993755 2024-09-14T11:17:53.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.034+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=OYT08BQRHXXN type=del 2024-09-14T11:17:53.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.035+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=XYJU50M4EUG9 type=del size=1538287 2024-09-14T11:17:53.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.036+0000 7f1be8076780 1 < canceled operation key=26WW5JFVB36U tag=VSFS81BOFIHY type=del size=3308877 2024-09-14T11:17:53.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.037+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=Z4WBZLYT77A2 type=del size=4140102 2024-09-14T11:17:53.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.038+0000 7f1be8076780 1 < completed delete operation key=7OUNKTS3X7DJ tag=H0W1J5ZCC2K0 type=del 2024-09-14T11:17:53.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.040+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=N2C2Z7CX9NL4 type=write size=444667 2024-09-14T11:17:53.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.041+0000 7f1be8076780 1 < completed delete operation key=LNMGQ54S2CXX tag=MKTC9EC0QR6N type=del 2024-09-14T11:17:53.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.042+0000 7f1be8076780 1 > prepared operation key=CQDRZMJAJ7FZ tag=F1F3S4P8DG1F type=del size=1104921 2024-09-14T11:17:53.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.043+0000 7f1be8076780 1 < completed delete operation key=WQC5TVD66R0W tag=MSCULZFH49N0 type=del 2024-09-14T11:17:53.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.044+0000 7f1be8076780 1 > prepared operation key=LNMGQ54S2CXX tag=KF5H8JHAO146 type=del size=3728250 2024-09-14T11:17:53.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.046+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.0 size=1048576 2024-09-14T11:17:53.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.047+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.1 size=1048576 2024-09-14T11:17:53.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.047+0000 7f1be8076780 1 < completed part key=_multipart_JQZ7C562TQ8D.2~LT76GIJ5G9LT.2 size=261911 2024-09-14T11:17:53.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.049+0000 7f1be8076780 1 < completed multipart upload key=JQZ7C562TQ8D upload=LT76GIJ5G9LT tag=86BQA3M8ODWT type=write size=3407639 2024-09-14T11:17:53.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.051+0000 7f1be8076780 1 > prepared operation key=1RUE5J1DYH2C tag=7VQT36WCLT59 type=del size=710156 2024-09-14T11:17:53.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.053+0000 7f1be8076780 1 < suggested update operation key=3Z71PEWG5UMA tag=GQIFUWDQQN33 type=write size=509125 2024-09-14T11:17:53.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.054+0000 7f1be8076780 1 > prepared operation key=T70EFGHRQZQ7 tag=RY51WZ8DJLFU type=del size=899481 2024-09-14T11:17:53.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.055+0000 7f1be8076780 1 < completed part key=_multipart_KQ479IOZ0108.2~3PEWWQI61NUJ.0 size=338623 2024-09-14T11:17:53.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.057+0000 7f1be8076780 1 < completed multipart upload key=KQ479IOZ0108 upload=3PEWWQI61NUJ tag=9U6NSZNZHL28 type=write size=1387199 2024-09-14T11:17:53.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.059+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.0 size=1048576 2024-09-14T11:17:53.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.060+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.1 size=1048576 2024-09-14T11:17:53.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.061+0000 7f1be8076780 1 > prepared part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.2 size=874089 2024-09-14T11:17:53.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.061+0000 7f1be8076780 1 > prepared multipart upload key=3YIK6B6Y2EU1 upload=WPG6WHOMFGPS tag=YU737OF3NEYD type=write size=4019817 2024-09-14T11:17:53.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.062+0000 7f1be8076780 1 < completed delete operation key=1RUE5J1DYH2C tag=N7MX6SCU5Y8V type=del 2024-09-14T11:17:53.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.063+0000 7f1be8076780 1 > prepared operation key=XB3M4CI0ERWP tag=REQ4HMSMSV2J type=del size=1991523 2024-09-14T11:17:53.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.064+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~8RUWOFLK17JO.0 size=1048576 2024-09-14T11:17:53.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.065+0000 7f1be8076780 1 < completed part key=_multipart_XB3M4CI0ERWP.2~8RUWOFLK17JO.1 size=586353 2024-09-14T11:17:53.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.067+0000 7f1be8076780 1 < completed multipart upload key=XB3M4CI0ERWP upload=8RUWOFLK17JO tag=S5OVWER9C0CF type=write size=2683505 2024-09-14T11:17:53.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.069+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~2K6PA48YWQKL.0 size=1048576 2024-09-14T11:17:53.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.070+0000 7f1be8076780 1 > prepared part key=_multipart_XI178717NOE8.2~2K6PA48YWQKL.1 size=964382 2024-09-14T11:17:53.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.070+0000 7f1be8076780 1 > prepared multipart upload key=XI178717NOE8 upload=2K6PA48YWQKL tag=3VNXT87KKKOO type=write size=3061534 2024-09-14T11:17:53.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.071+0000 7f1be8076780 1 < completed delete operation key=MX5J0P18BM0D tag=JF818T8U1AU4 type=del 2024-09-14T11:17:53.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.072+0000 7f1be8076780 1 > prepared operation key=QC6MEJABT7IM tag=06P43ANXQ6F8 type=del size=3606018 2024-09-14T11:17:53.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.073+0000 7f1be8076780 1 < completed part key=_multipart_QIEUKUQ8CS2U.2~TE1JVFO2167L.0 size=306108 2024-09-14T11:17:53.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.075+0000 7f1be8076780 1 < completed multipart upload key=QIEUKUQ8CS2U upload=TE1JVFO2167L tag=03TS5NFWMXVI type=write size=1354684 2024-09-14T11:17:53.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.076+0000 7f1be8076780 1 > prepared operation key=4ADXXTIO715C tag=GJ2B7E0HFW3Q type=del size=1800959 2024-09-14T11:17:53.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.077+0000 7f1be8076780 1 < completed part key=_multipart_JIWPGHQ3GEZB.2~TAZ3RFVBR35L.0 size=320766 2024-09-14T11:17:53.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.079+0000 7f1be8076780 1 < completed multipart upload key=JIWPGHQ3GEZB upload=TAZ3RFVBR35L tag=TQNDKT95A2CL type=write size=1369342 2024-09-14T11:17:53.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.080+0000 7f1be8076780 1 > prepared operation key=MX5J0P18BM0D tag=SRGUBJPDPZJB type=del size=3967074 2024-09-14T11:17:53.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.081+0000 7f1be8076780 1 < completed delete operation key=JIWPGHQ3GEZB tag=MKAOCA3LAR7P type=del 2024-09-14T11:17:53.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.083+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~DSVX98V45P1F.0 size=1048576 2024-09-14T11:17:53.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.084+0000 7f1be8076780 1 > prepared part key=_multipart_KQ479IOZ0108.2~DSVX98V45P1F.1 size=401166 2024-09-14T11:17:53.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.084+0000 7f1be8076780 1 > prepared multipart upload key=KQ479IOZ0108 upload=DSVX98V45P1F tag=B8QEHV8NCYBJ type=write size=2498318 2024-09-14T11:17:53.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.085+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.0 size=1048576 2024-09-14T11:17:53.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.086+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.1 size=1048576 2024-09-14T11:17:53.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.087+0000 7f1be8076780 1 < completed part key=_multipart_4ADXXTIO715C.2~3F0O8UB9DVME.2 size=338197 2024-09-14T11:17:53.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.089+0000 7f1be8076780 1 < completed multipart upload key=4ADXXTIO715C upload=3F0O8UB9DVME tag=MS514P21EGPO type=write size=3483925 2024-09-14T11:17:53.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.091+0000 7f1be8076780 1 > prepared part key=_multipart_JDKFKO39I56L.2~5WDP6AUKMHSX.0 size=437466 2024-09-14T11:17:53.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.091+0000 7f1be8076780 1 > prepared multipart upload key=JDKFKO39I56L upload=5WDP6AUKMHSX tag=HV3KMA5IS61E type=write size=1486042 2024-09-14T11:17:53.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.091+0000 7f1be8076780 1 < canceled part key=_multipart_7OUNKTS3X7DJ.2~T7KX8DL6ZYHT.0 size=945179 2024-09-14T11:17:53.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.093+0000 7f1be8076780 1 < canceled multipart upload key=7OUNKTS3X7DJ upload=T7KX8DL6ZYHT tag=V36FF27W9H8E type=write size=1993755 2024-09-14T11:17:53.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.095+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~VPKNEEB25WVX.0 size=1048576 2024-09-14T11:17:53.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.096+0000 7f1be8076780 1 > prepared part key=_multipart_7OUNKTS3X7DJ.2~VPKNEEB25WVX.1 size=494135 2024-09-14T11:17:53.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.096+0000 7f1be8076780 1 > prepared multipart upload key=7OUNKTS3X7DJ upload=VPKNEEB25WVX tag=XWAO66APRCAB type=write size=2591287 2024-09-14T11:17:53.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.098+0000 7f1be8076780 1 < suggested remove operation key=XI178717NOE8 tag=XYJU50M4EUG9 type=del 2024-09-14T11:17:53.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.100+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~V305ADP7R8I3.0 size=1048576 2024-09-14T11:17:53.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.101+0000 7f1be8076780 1 > prepared part key=_multipart_1RUE5J1DYH2C.2~V305ADP7R8I3.1 size=37235 2024-09-14T11:17:53.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.101+0000 7f1be8076780 1 > prepared multipart upload key=1RUE5J1DYH2C upload=V305ADP7R8I3 tag=GH51LKI47A42 type=write size=2134387 2024-09-14T11:17:53.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.103+0000 7f1be8076780 1 < completed delete operation key=3YIK6B6Y2EU1 tag=Z4WBZLYT77A2 type=del 2024-09-14T11:17:53.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.105+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~48J200QX4NVT.0 size=1048576 2024-09-14T11:17:53.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.106+0000 7f1be8076780 1 > prepared part key=_multipart_26WW5JFVB36U.2~48J200QX4NVT.1 size=550935 2024-09-14T11:17:53.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.106+0000 7f1be8076780 1 > prepared multipart upload key=26WW5JFVB36U upload=48J200QX4NVT tag=XSMHIN7TY2PK type=write size=2648087 2024-09-14T11:17:53.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.107+0000 7f1be8076780 1 < completed write operation key=1RUE5J1DYH2C tag=N2C2Z7CX9NL4 type=write size=444667 2024-09-14T11:17:53.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.108+0000 7f1be8076780 1 > prepared operation key=26WW5JFVB36U tag=V5F5AHERID9Z type=del size=1138467 2024-09-14T11:17:53.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.109+0000 7f1be8076780 1 < canceled operation key=CQDRZMJAJ7FZ tag=F1F3S4P8DG1F type=del size=1104921 2024-09-14T11:17:53.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.111+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VYICFNOOILFY.0 size=1048576 2024-09-14T11:17:53.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.112+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VYICFNOOILFY.1 size=1048576 2024-09-14T11:17:53.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.113+0000 7f1be8076780 1 > prepared part key=_multipart_XB3M4CI0ERWP.2~VYICFNOOILFY.2 size=67680 2024-09-14T11:17:53.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.113+0000 7f1be8076780 1 > prepared multipart upload key=XB3M4CI0ERWP upload=VYICFNOOILFY tag=V3E4AJLFXF2L type=write size=3213408 2024-09-14T11:17:53.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.115+0000 7f1be8076780 1 < suggested remove operation key=LNMGQ54S2CXX tag=KF5H8JHAO146 type=del 2024-09-14T11:17:53.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.117+0000 7f1be8076780 1 > prepared operation key=INU0TV92GXSP tag=YXRIBV5INXPK type=del size=1996669 2024-09-14T11:17:53.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.119+0000 7f1be8076780 1 < suggested remove operation key=1RUE5J1DYH2C tag=7VQT36WCLT59 type=del 2024-09-14T11:17:53.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.120+0000 7f1be8076780 1 > prepared operation key=3YIK6B6Y2EU1 tag=HXDWBU0J0ZDO type=write size=375192 2024-09-14T11:17:53.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.121+0000 7f1be8076780 1 < completed delete operation key=T70EFGHRQZQ7 tag=RY51WZ8DJLFU type=del 2024-09-14T11:17:53.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.122+0000 7f1be8076780 1 > prepared operation key=AUCQC0OBQP7Z tag=IQ5YHCM185XW type=del size=1144080 2024-09-14T11:17:53.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.124+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.0 size=1048576 2024-09-14T11:17:53.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.125+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.1 size=1048576 2024-09-14T11:17:53.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.126+0000 7f1be8076780 1 < completed part key=_multipart_3YIK6B6Y2EU1.2~WPG6WHOMFGPS.2 size=874089 2024-09-14T11:17:53.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.129+0000 7f1be8076780 1 < completed multipart upload key=3YIK6B6Y2EU1 upload=WPG6WHOMFGPS tag=YU737OF3NEYD type=write size=4019817 2024-09-14T11:17:53.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.130+0000 7f1be8076780 1 > prepared operation key=7OUNKTS3X7DJ tag=0Y4FOI9ZEZZR type=write size=801298 2024-09-14T11:17:53.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.131+0000 7f1be8076780 1 < completed delete operation key=XB3M4CI0ERWP tag=REQ4HMSMSV2J type=del 2024-09-14T11:17:53.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:17:53.132+0000 7f1be8076780 1 > prepared operation key=XI178717NOE8 tag=7J40LZ51I50Z type=del size=3653655 2024-09-14T11:17:53.131 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] cls_rgw_stats.simulate (9215 ms) 2024-09-14T11:17:53.131 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 1 test from cls_rgw_stats (9215 ms total) 2024-09-14T11:17:53.131 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:17:53.131 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:53.312 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 1 test from 1 test suite ran. (11269 ms total) 2024-09-14T11:17:53.313 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 1 test. 2024-09-14T11:17:53.316 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:53.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:53.395 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:17:53.396 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:17:53.397 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:17:53.479 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:53.479 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:17:53.479 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:55.338 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:17:55.338 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:17:55.354 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2024-09-14T11:17:55.354 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:17:55.363 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (8 ms) 2024-09-14T11:17:55.363 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:17:55.365 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T11:17:55.365 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:17:55.368 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-14T11:17:55.369 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:17:55.374 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-14T11:17:55.374 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:17:55.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2024-09-14T11:17:55.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:17:55.383 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-14T11:17:55.383 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:17:55.589 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (206 ms) 2024-09-14T11:17:55.590 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:17:55.593 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:17:55.594 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:17:55.599 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (6 ms) 2024-09-14T11:17:55.599 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:17:55.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2024-09-14T11:17:55.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:17:55.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T11:17:55.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:17:55.608 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:17:55.608 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:17:55.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-14T11:17:55.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:17:55.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (9 ms) 2024-09-14T11:17:55.624 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:17:55.631 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-14T11:17:55.631 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:17:55.639 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-14T11:17:55.639 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:17:55.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (10 ms) 2024-09-14T11:17:55.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:17:55.652 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:17:55.652 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:17:55.654 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-14T11:17:55.654 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:17:55.655 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:17:55.655 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:17:55.656 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-14T11:17:55.656 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:17:55.663 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-14T11:17:55.663 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:17:55.669 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T11:17:55.670 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:17:55.677 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:17:55.677 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:17:55.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-14T11:17:55.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:17:55.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (3 ms) 2024-09-14T11:17:55.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:17:55.690 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (2 ms) 2024-09-14T11:17:55.690 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:17:55.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:17:55.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:17:55.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-14T11:17:55.691 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:17:55.698 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-14T11:17:55.698 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 31 tests from CmpOmap (361 ms total) 2024-09-14T11:17:55.698 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:17:55.699 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:56.345 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 31 tests from 1 test suite ran. (2866 ms total) 2024-09-14T11:17:56.345 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 31 tests. 2024-09-14T11:17:56.349 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:56.349 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:56.434 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:17:56.435 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:17:56.435 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:17:56.520 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:56.520 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:17:56.520 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:56.520 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:17:56.520 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:17:59.367 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2847 ms) 2024-09-14T11:17:59.367 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:18:02.389 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3022 ms) 2024-09-14T11:18:02.389 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:18:05.413 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.Reserve (3024 ms) 2024-09-14T11:18:05.413 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:18:08.433 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3020 ms) 2024-09-14T11:18:08.433 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:18:11.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.Commit (3020 ms) 2024-09-14T11:18:11.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:18:14.474 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.Stats (3021 ms) 2024-09-14T11:18:14.474 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:18:18.507 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4034 ms) 2024-09-14T11:18:18.507 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:18:21.528 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.Abort (3020 ms) 2024-09-14T11:18:21.528 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:18:24.538 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.ReserveError (3011 ms) 2024-09-14T11:18:24.539 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:18:27.550 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.CommitError (3011 ms) 2024-09-14T11:18:27.551 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:18:30.587 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.AbortError (3036 ms) 2024-09-14T11:18:30.587 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:18:33.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3014 ms) 2024-09-14T11:18:33.600 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:18:36.623 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3023 ms) 2024-09-14T11:18:36.623 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:18:39.639 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3016 ms) 2024-09-14T11:18:39.640 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:18:42.670 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3031 ms) 2024-09-14T11:18:42.670 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:18:45.682 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3012 ms) 2024-09-14T11:18:45.682 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:18:48.710 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3028 ms) 2024-09-14T11:18:48.710 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:18:51.722 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.Cleanup (3011 ms) 2024-09-14T11:18:51.722 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:19:01.761 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10040 ms) 2024-09-14T11:19:01.761 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:19:04.786 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3025 ms) 2024-09-14T11:19:04.786 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:19:18.826 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14040 ms) 2024-09-14T11:19:18.826 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:19:22.861 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4034 ms) 2024-09-14T11:19:22.861 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:19:28.887 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6026 ms) 2024-09-14T11:19:28.887 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5039 ms) 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from TestCls2PCQueue (97406 ms total) 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 24 tests from 1 test suite ran. (97406 ms total) 2024-09-14T11:19:33.926 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 24 tests. 2024-09-14T11:19:33.929 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:33.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:33.973 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:19:33.974 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:19:33.975 DEBUG:teuthology.orchestra.run.smithi130:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:19:34.067 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:34.067 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:34.068 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:34.068 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:35.933 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:19:35.933 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:19:35.954 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsAccount.add (22 ms) 2024-09-14T11:19:35.955 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:19:35.959 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:19:35.959 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:19:35.966 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsAccount.rm (6 ms) 2024-09-14T11:19:35.966 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:19:35.983 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] ClsAccount.list (17 ms) 2024-09-14T11:19:35.983 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from ClsAccount (50 ms total) 2024-09-14T11:19:35.983 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:19:35.983 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:36.948 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 4 tests from 1 test suite ran. (2880 ms total) 2024-09-14T11:19:36.948 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:36.952 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:36.952 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:36.994 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:19:36.995 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:19:36.996 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:19:37.089 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:37.089 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:37.089 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:19:37.089 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:38.959 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:19:38.959 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:19:38.978 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.init_existing_queue (19 ms) 2024-09-14T11:19:38.978 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:19:38.981 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-14T11:19:38.982 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:19:38.985 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:19:38.985 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:19:38.986 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-14T11:19:38.986 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:19:38.989 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-14T11:19:38.989 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:19:38.990 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:19:38.990 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 6 tests from rgw_gc_log (32 ms total) 2024-09-14T11:19:38.991 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:19:38.991 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:39.961 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 6 tests from 1 test suite ran. (2872 ms total) 2024-09-14T11:19:39.961 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 6 tests. 2024-09-14T11:19:39.964 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:39.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:40.006 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:19:40.007 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:19:40.008 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:19:40.106 INFO:tasks.workunit.client.0.smithi130.stdout:Running main() from gmock_main.cc 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i= 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.107 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i= 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i= 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.108 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.109 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.110 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.111 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.112 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.113 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.114 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i= 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.115 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.116 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.117 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.118 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.119 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.120 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.121 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns= i=v1 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.122 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.123 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.124 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.125 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.126 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.127 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.128 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: _obj[v1] 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.129 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.130 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.131 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.132 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.133 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.134 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_obj", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.135 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i= 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.136 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i= 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i= 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.137 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.138 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.139 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.140 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.141 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.142 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.143 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i= 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.144 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.145 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.146 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.147 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.148 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.149 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.150 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns= i=v1 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.151 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.152 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.153 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.154 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.155 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.156 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.157 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:parsed: obj[v1] 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout: "obj1": { 2024-09-14T11:19:40.158 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.159 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "obj2": { 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.160 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.161 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3": { 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.162 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "obj3-2": { 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.163 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "obj", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "v1", 2024-09-14T11:19:40.164 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.165 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.166 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.167 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker_myobj", 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.168 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.169 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.170 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.171 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.172 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.173 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker_myobj", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.174 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.175 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.176 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.177 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.178 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.179 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.180 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.181 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.182 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.183 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.184 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.185 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.186 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.187 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.188 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.189 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.190 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.191 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.192 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.193 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.194 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.195 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.196 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.197 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.198 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.199 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.200 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.201 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.202 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.203 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.204 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.205 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.206 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.207 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj", 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.208 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.209 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.210 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.211 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.212 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj", 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.213 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.214 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.215 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.216 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.217 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.218 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.219 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.220 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.221 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.222 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.223 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.224 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.225 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.226 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:40.227 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.228 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.229 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.230 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.231 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.232 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.233 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.234 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.235 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.236 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.237 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.238 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.239 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.240 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.241 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.242 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.243 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.244 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.245 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.246 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.247 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.248 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.249 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.250 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.251 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.252 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.253 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.254 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.255 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.256 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.257 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.258 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.259 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.260 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.261 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.262 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.263 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.264 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.265 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.266 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.267 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.268 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.269 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.270 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.271 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.272 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.273 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.274 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.275 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.276 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.277 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": "default-placement.data", 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.278 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "test", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": "", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.279 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": "" 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.280 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.281 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "obj": { 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.282 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:40.283 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.284 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:19:40.285 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker_myobj", 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.286 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.287 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker_myobj", 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.288 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.289 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.290 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.291 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.292 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.293 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.294 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.295 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.296 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.297 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.298 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:40.299 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.300 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:40.301 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.302 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "myobj", 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.303 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj", 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.304 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.305 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj", 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.306 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.307 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.308 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.309 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.310 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.311 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.312 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.313 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.314 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.315 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj" 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.316 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.317 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.318 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.319 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.320 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.321 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj", 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.322 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.323 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.324 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.325 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker___myobj_", 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.326 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.327 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.328 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.329 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.330 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.331 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "", 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:19:40.332 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.333 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.334 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "marker__myobj_" 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.335 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.336 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "" 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj": { 2024-09-14T11:19:40.337 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj": { 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.338 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.339 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: "raw_obj2": { 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: "pool": ".data-pool", 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: "loc": "" 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.340 INFO:tasks.workunit.client.0.smithi130.stdout: "new_obj2": { 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket": { 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "ebtest", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "marker": "marker", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_id": "bucket-id", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "tenant": "", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "explicit_placement": { 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "data_pool": ".data-pool", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "data_extra_pool": "", 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: "index_pool": ".index-pool" 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.341 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: "key": { 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: "name": "_myobj_", 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: "instance": "inst", 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: "ns": "ns" 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:40.342 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:19:40.343 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 4 tests. 2024-09-14T11:19:40.343 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:19:40.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:19:40.383 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:19:40.384 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:19:40.384 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:19:40.499 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:40.499 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:40.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.537+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 realm 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.539+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.540+0000 7fd219135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:40.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.540+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.541+0000 7fd219135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.541+0000 7fd219135800 20 searching for the correct realm 2024-09-14T11:19:40.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.544+0000 7fd2156e5640 0 -- 172.21.15.130:0/3260645246 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd1fc017070 msgr2=0x7fd1fc0611a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.751+0000 7fd2156e5640 0 -- 172.21.15.130:0/3260645246 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd1fc017070 msgr2=0x7fd1fc0611a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:19:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:40.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:19:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.755+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:40.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:40.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 zone default found 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 4 Realm: () 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 zonegroup default 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.756+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.757+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.757+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.757+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.757+0000 7fd219135800 20 started sync module instance, tier type = 2024-09-14T11:19:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.757+0000 7fd219135800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=0 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=1 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=2 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=3 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=4 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=5 2024-09-14T11:19:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.767+0000 7fd219135800 20 add_watcher() i=6 2024-09-14T11:19:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.768+0000 7fd219135800 20 add_watcher() i=7 2024-09-14T11:19:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.768+0000 7fd219135800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:40.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.770+0000 7fd0cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:40.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.770+0000 7fd219135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:40.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.770+0000 7fd219135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:40.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.770+0000 7fd219135800 5 note: GC not initialized 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd0c9fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 20 Filter name: none 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd03b7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:19:40.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.771+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 cache get: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= : miss 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= info.flags=0x0 2024-09-14T11:19:40.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 adding default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= to cache LRU end 2024-09-14T11:19:40.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 cache get: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= : hit (negative entry) 2024-09-14T11:19:40.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.772+0000 7fd219135800 10 cache get: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= : hit (negative entry) 2024-09-14T11:19:40.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.773+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:40.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.773+0000 7fd219135800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:40.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.773+0000 7fd219135800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:19:40.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.774+0000 7fd0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94071958894768 notifier 5592 bl.length()=697 2024-09-14T11:19:40.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.774+0000 7fd0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:19:40.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.774+0000 7fd0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.775+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.775+0000 7fd219135800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.775+0000 7fd219135800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.776+0000 7fd0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856707 cookie 94071958887232 notifier 5592 bl.length()=194 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.776+0000 7fd0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:19:40.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.776+0000 7fd0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:19:40.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.777+0000 7fd219135800 10 cache put: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= info.flags=0x7 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.777+0000 7fd219135800 10 moving default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= to cache LRU end 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.777+0000 7fd219135800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:+E6CE/kZN5jAcAJQ3h0v56JVIds=, ofs0, ns] 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.778+0000 7fd0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94071958911152 notifier 5592 bl.length()=203 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.778+0000 7fd0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= info.flags=0x7 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.778+0000 7fd0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys++E6CE/kZN5jAcAJQ3h0v56JVIds= to cache LRU end 2024-09-14T11:19:40.777 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "display_name": "librgw test user", 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "email": "librgw@example.com", 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "suspended": 0, 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "subusers": [], 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "keys": [ 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: { 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:19:40.778 INFO:tasks.workunit.client.0.smithi130.stdout: "access_key": "+E6CE/kZN5jAcAJQ3h0v56JVIds=", 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "secret_key": "fWFvCa5EoR3N67fEkIfqVjQZVY+1bUTNH3CrDVOv+GnBLUAvxre7sA==", 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "active": true, 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:19:40.773616Z" 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: ], 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "swift_keys": [], 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "caps": [], 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "default_placement": "", 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "placement_tags": [], 2024-09-14T11:19:40.779 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_quota": { 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "user_quota": { 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:19:40.780 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "type": "rgw", 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "account_id": "", 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "path": "/", 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:19:40.773605Z", 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "tags": [], 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: "group_ids": [] 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:19:40.781 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:19:40.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.779+0000 7fd0cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:40.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.781+0000 7fd219135800 20 remove_watcher() i=0 2024-09-14T11:19:40.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.781+0000 7fd219135800 2 removed watcher, disabling cache 2024-09-14T11:19:40.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.782+0000 7fd219135800 20 remove_watcher() i=1 2024-09-14T11:19:40.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.784+0000 7fd219135800 20 remove_watcher() i=2 2024-09-14T11:19:40.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.785+0000 7fd219135800 20 remove_watcher() i=3 2024-09-14T11:19:40.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.786+0000 7fd219135800 20 remove_watcher() i=4 2024-09-14T11:19:40.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.787+0000 7fd219135800 20 remove_watcher() i=5 2024-09-14T11:19:40.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.788+0000 7fd219135800 20 remove_watcher() i=6 2024-09-14T11:19:40.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:40.789+0000 7fd219135800 20 remove_watcher() i=7 2024-09-14T11:19:40.798 INFO:tasks.workunit.client.0.smithi130.stdout:phase 1.1 2024-09-14T11:19:40.819 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:19:40.819 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:40.819 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:19:40.819 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:40.830 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:40.830 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:41.204 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (384 ms) 2024-09-14T11:19:41.204 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:19:41.205 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:19:41.205 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:41.205 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:19:41.205 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:19:41.213 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:19:41.218 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/f1 2024-09-14T11:19:41.221 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/f2 2024-09-14T11:19:41.224 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:19:41.227 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:19:41.231 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:19:41.234 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:19:41.237 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:19:41.240 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:19:41.243 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:19:41.246 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:19:41.249 INFO:tasks.workunit.client.0.smithi130.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:19:41.252 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2024-09-14T11:19:41.252 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:19:41.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_DIRS1 (106 ms) 2024-09-14T11:19:41.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:19:41.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:19:41.358 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:19:41.376 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-14T11:19:41.376 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:19:41.419 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (43 ms) 2024-09-14T11:19:41.419 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:19:41.419 INFO:tasks.workunit.client.0.smithi130.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:19:41.426 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-14T11:19:41.426 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:19:41.426 INFO:tasks.workunit.client.0.smithi130.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:19:41.433 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2024-09-14T11:19:41.433 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:19:41.433 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:19:41.434 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:19:41.435 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:19:41.435 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:19:41.435 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:19:41.435 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:41.435 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:19:41.437 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:41.437 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:19:41.438 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:19:41.439 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:41.439 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:19:41.440 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:41.440 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:19:41.440 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:19:41.442 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:19:41.442 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:19:41.443 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:19:41.443 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-14T11:19:41.444 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_SETUP1 (172 ms) 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:41.616 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:19:41.617 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:19:41.622 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:19:41.623 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:19:41.626 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:19:41.627 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:19:41.630 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:41.630 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:19:41.631 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:19:41.631 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:19:41.632 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:41.632 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:19:41.633 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-14T11:19:41.635 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:41.636 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:41.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:41.636+0000 7fac54b528c0 -1 shutting down 2024-09-14T11:19:41.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:19:41.637+0000 7fab2e891640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64534, si_uid : 1000, si_addr0x3e80000fc16, si_status0 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (29882 ms) 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW (30697 ms total) 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 24 tests from 1 test suite ran. (30697 ms total) 2024-09-14T11:20:11.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:11.523 INFO:tasks.workunit.client.0.smithi130.stdout:phase 1.2 2024-09-14T11:20:11.546 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:20:11.547 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:11.547 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:20:11.547 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:11.555 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:11.555 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:11.934 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-09-14T11:20:11.934 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:20:11.935 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:20:11.936 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:20:11.937 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:11.938 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:11.939 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:11.939 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:11.939 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:11.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:20:11.936+0000 7f7d477278c0 -1 shutting down 2024-09-14T11:20:11.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:20:11.937+0000 7f7c1f6bd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65163, si_uid : 1000, si_addr0x3e80000fe8b, si_status0 2024-09-14T11:20:42.177 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30242 ms) 2024-09-14T11:20:42.178 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW (30630 ms total) 2024-09-14T11:20:42.178 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:20:42.178 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:42.178 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 24 tests from 1 test suite ran. (30630 ms total) 2024-09-14T11:20:42.178 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 24 tests. 2024-09-14T11:20:42.183 INFO:tasks.workunit.client.0.smithi130.stdout:phase 1.3 2024-09-14T11:20:42.208 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:20:42.208 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:42.208 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:20:42.208 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:42.219 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:42.219 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:42.614 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (405 ms) 2024-09-14T11:20:42.614 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:20:42.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT_NOROOT (0 ms) 2024-09-14T11:20:42.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:42.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:20:42.615 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:20:42.620 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-14T11:20:42.620 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:20:42.683 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETUP_DIRS1 (63 ms) 2024-09-14T11:20:42.683 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:20:42.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:20:42.685 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.686 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:42.687 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:20:42.688 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:42.688 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:20:42.688 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:20:42.688 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:42.688 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:20:42.689 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:42.689 INFO:tasks.workunit.client.0.smithi130.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:20:42.689 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:20:42.692 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:20:42.692 INFO:tasks.workunit.client.0.smithi130.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:42.693 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:20:42.694 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:20:42.700 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:20:42.700 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:20:42.703 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:20:42.705 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:20:42.708 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:42.708 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:20:42.708 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:20:42.709 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:20:42.709 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:42.710 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:20:42.710 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:20:42.713 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:42.714 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:42.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:20:42.714+0000 7f01dcf528c0 -1 shutting down 2024-09-14T11:20:42.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:20:42.715+0000 7f00b6c91640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65782, si_uid : 1000, si_addr0x3e8000100f6, si_status0 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30101 ms) 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 24 tests from LibRGW (30605 ms total) 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 24 tests from 1 test suite ran. (30605 ms total) 2024-09-14T11:21:12.814 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 24 tests. 2024-09-14T11:21:12.820 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2.1 2024-09-14T11:21:12.845 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:21:12.845 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:12.845 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:21:12.845 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:12.854 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:12.854 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:13.028 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (184 ms) 2024-09-14T11:21:13.029 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:13.029 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:21:13.029 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:13.038 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:21:13.038 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:13.038 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:21:13.038 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:21:13.045 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave0 2024-09-14T11:21:13.054 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave1 2024-09-14T11:21:13.061 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave2 2024-09-14T11:21:13.069 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave3 2024-09-14T11:21:13.078 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave4 2024-09-14T11:21:13.085 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave5 2024-09-14T11:21:13.093 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave6 2024-09-14T11:21:13.105 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave7 2024-09-14T11:21:13.113 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave8 2024-09-14T11:21:13.120 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave9 2024-09-14T11:21:13.120 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (83 ms) 2024-09-14T11:21:13.120 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:21:13.387 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (266 ms) 2024-09-14T11:21:13.387 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:13.387 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-14T11:21:13.387 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:13.387 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:13.388 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:13.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:21:13.388+0000 7f1d3433d8c0 -1 shutting down 2024-09-14T11:21:13.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:21:13.389+0000 7f1c0e07a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66408, si_uid : 1000, si_addr0x3e800010368, si_status0 2024-09-14T11:21:43.086 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (29698 ms) 2024-09-14T11:21:43.086 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from LibRGW (30241 ms total) 2024-09-14T11:21:43.086 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:21:43.086 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:43.086 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 9 tests from 1 test suite ran. (30241 ms total) 2024-09-14T11:21:43.087 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 9 tests. 2024-09-14T11:21:43.092 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2.2 2024-09-14T11:21:43.117 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:21:43.117 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:43.117 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:21:43.117 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:43.126 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:43.126 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:43.504 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-14T11:21:43.505 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:43.505 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:21:43.505 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:21:43.505 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:21:43.505 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:21:43.534 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-09-14T11:21:43.534 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:21:43.542 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave0 2024-09-14T11:21:43.549 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave1 2024-09-14T11:21:43.559 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave2 2024-09-14T11:21:43.567 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave3 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave4 2024-09-14T11:21:43.583 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave5 2024-09-14T11:21:43.593 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave6 2024-09-14T11:21:43.603 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave7 2024-09-14T11:21:43.611 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave8 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi130.stdout:created: sorrydave9 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (83 ms) 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:21:43.879 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (261 ms) 2024-09-14T11:21:43.879 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:43.879 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:43.879 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:43.879 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:43.880 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:43.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:21:43.880+0000 7fdb58b208c0 -1 shutting down 2024-09-14T11:21:43.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:21:43.881+0000 7fda30b22640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67029, si_uid : 1000, si_addr0x3e8000105d5, si_status0 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (29769 ms) 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 9 tests from LibRGW (30531 ms total) 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 9 tests from 1 test suite ran. (30531 ms total) 2024-09-14T11:22:13.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 9 tests. 2024-09-14T11:22:13.654 INFO:tasks.workunit.client.0.smithi130.stdout:phase 3.1 2024-09-14T11:22:13.974 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:22:13.974 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:13.974 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:22:13.974 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:13.983 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:13.983 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:14.385 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (411 ms) 2024-09-14T11:22:14.385 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:14.386 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:14.386 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:14.394 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:22:14.394 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:14.397 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:22:14.397 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:14.399 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:22:14.399 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:22:14.466 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LARGE1 (68 ms) 2024-09-14T11:22:14.466 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LARGE2 (50 ms) 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:14.517 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:14.518 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:14.518 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:14.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:22:14.519+0000 7f4067b228c0 -1 shutting down 2024-09-14T11:22:14.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:22:14.521+0000 7f3f3fabd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67648, si_uid : 1000, si_addr0x3e800010840, si_status0 2024-09-14T11:22:44.541 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30024 ms) 2024-09-14T11:22:44.542 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 13 tests from LibRGW (30567 ms total) 2024-09-14T11:22:44.542 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:22:44.542 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:44.542 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 13 tests from 1 test suite ran. (30567 ms total) 2024-09-14T11:22:44.542 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 13 tests. 2024-09-14T11:22:44.549 INFO:tasks.workunit.client.0.smithi130.stdout:phase 3.2 2024-09-14T11:22:44.868 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:22:44.868 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:44.868 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:22:44.868 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:44.876 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:44.876 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:45.269 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-14T11:22:45.269 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:45.270 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:45.270 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:45.270 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:22:45.270 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:45.275 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:22:45.275 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:45.278 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:22:45.279 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LARGE1 (68 ms) 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:45.347 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:45.354 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-14T11:22:45.354 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (26 ms) 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:45.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:22:45.381+0000 7fe94c12f8c0 -1 shutting down 2024-09-14T11:22:45.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:22:45.382+0000 7fe8240c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68267, si_uid : 1000, si_addr0x3e800010aab, si_status0 2024-09-14T11:23:15.535 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30155 ms) 2024-09-14T11:23:15.535 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 13 tests from LibRGW (30666 ms total) 2024-09-14T11:23:15.535 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:23:15.535 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:15.535 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 13 tests from 1 test suite ran. (30667 ms total) 2024-09-14T11:23:15.536 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 13 tests. 2024-09-14T11:23:15.542 INFO:tasks.workunit.client.0.smithi130.stdout:phase 4.1 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:read i1: 64001 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:read s1: blunderbuss 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:23:15.568 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:15.579 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:15.579 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:15.962 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-14T11:23:15.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:15.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:23:15.963 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:15.980 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-14T11:23:15.980 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_0 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_1 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_2 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_3 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_4 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_5 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_6 2024-09-14T11:23:16.442 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_7 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_8 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_9 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_10 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_11 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_12 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_13 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_14 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_15 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_16 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_17 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_18 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_19 2024-09-14T11:23:16.443 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_20 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_21 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_22 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_23 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_24 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_25 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_26 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_27 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_28 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_29 2024-09-14T11:23:16.444 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_30 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_31 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_32 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_33 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_34 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_35 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_36 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_37 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_38 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_39 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_40 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_41 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_42 2024-09-14T11:23:16.445 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_43 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_44 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_45 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_46 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_47 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_48 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_49 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_50 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_51 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_52 2024-09-14T11:23:16.446 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_53 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_54 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_55 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_56 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_57 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_58 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_59 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_60 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_61 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_62 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_63 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_64 2024-09-14T11:23:16.447 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_65 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_66 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_67 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_68 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_69 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_70 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_71 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_72 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_73 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_74 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_75 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_76 2024-09-14T11:23:16.448 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_77 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_78 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_79 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_80 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_81 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_82 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_83 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_84 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_85 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_86 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_87 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_88 2024-09-14T11:23:16.449 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_89 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_90 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_91 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_92 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_93 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_94 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_95 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_96 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_97 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_98 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:created: dmarker:f_99 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (461 ms) 2024-09-14T11:23:16.450 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:16.452 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:16.453 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:16.454 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:16.455 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:16.456 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:16.457 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:16.458 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:16.459 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-14T11:23:16.460 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:16.461 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:16.462 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:16.463 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:16.464 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:16.465 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:16.466 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:16.467 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:16.468 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:23:16.448+0000 7fe6fed4f8c0 -1 shutting down 2024-09-14T11:23:16.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:23:16.449+0000 7fe5d6d4c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68886, si_uid : 1000, si_addr0x3e800010d16, si_status0 2024-09-14T11:23:46.320 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (29873 ms) 2024-09-14T11:23:46.320 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from LibRGW (30752 ms total) 2024-09-14T11:23:46.320 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:23:46.321 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:46.321 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 11 tests from 1 test suite ran. (30752 ms total) 2024-09-14T11:23:46.321 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 11 tests. 2024-09-14T11:23:46.327 INFO:tasks.workunit.client.0.smithi130.stdout:phase 4.2 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:read i1: 64001 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:read s1: blunderbuss 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:23:46.351 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:46.359 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:46.360 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:46.741 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (390 ms) 2024-09-14T11:23:46.741 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:46.741 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:23:46.742 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:23:46.750 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-14T11:23:46.750 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:23:46.750 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:23:46.750 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:23:46.750 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:23:46.751 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:23:46.753 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:23:46.753 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:23:46.753 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:23:46.754 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:23:46.755 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:23:46.756 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:23:46.757 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:23:46.758 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:23:46.759 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:23:46.760 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:23:46.761 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:46.762 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:46.763 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:23:46.754+0000 7fb17ce538c0 -1 shutting down 2024-09-14T11:23:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:23:46.755+0000 7fb056b92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69505, si_uid : 1000, si_addr0x3e800010f81, si_status0 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30250 ms) 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 11 tests from LibRGW (30652 ms total) 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 11 tests from 1 test suite ran. (30652 ms total) 2024-09-14T11:24:17.003 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 11 tests. 2024-09-14T11:24:17.009 INFO:tasks.workunit.client.0.smithi130.stdout:phase 5.1 2024-09-14T11:24:17.041 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:24:17.041 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:17.042 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:24:17.042 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:17.052 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:17.052 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:17.431 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-14T11:24:17.431 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:17.432 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:24:17.432 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:17.440 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-14T11:24:17.441 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:17.443 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:24:17.444 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:24:17.444 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:24:17.444 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:17.445 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:24:17.445 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:24:17.445 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:24:17.446 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:24:17.448 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.PUT_OBJECT (3 ms) 2024-09-14T11:24:17.448 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:24:17.451 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-14T11:24:17.451 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:24:17.452 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:24:17.453+0000 7ff4a24db8c0 -1 shutting down 2024-09-14T11:24:17.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:24:17.454+0000 7ff37c218640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70124, si_uid : 1000, si_addr0x3e8000111ec, si_status0 2024-09-14T11:24:47.629 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30177 ms) 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 19 tests from LibRGW (30587 ms total) 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 19 tests from 1 test suite ran. (30587 ms total) 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 19 tests. 2024-09-14T11:24:47.648 INFO:tasks.workunit.client.0.smithi130.stdout:phase 5.2 2024-09-14T11:24:47.668 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:24:47.668 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:24:47.668 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:24:47.668 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:24:47.675 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:47.676 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:48.055 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (387 ms) 2024-09-14T11:24:48.055 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:24:48.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:24:48.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:24:48.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:24:48.056 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:24:48.061 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:24:48.062 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:24:48.064 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T11:24:48.064 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.DELETE_BUCKET (29 ms) 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:24:48.094 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:24:48.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:24:48.095+0000 7fdb987308c0 -1 shutting down 2024-09-14T11:24:48.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:24:48.096+0000 7fda7060e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70745, si_uid : 1000, si_addr0x3e800011459, si_status0 2024-09-14T11:25:18.105 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30011 ms) 2024-09-14T11:25:18.105 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 19 tests from LibRGW (30436 ms total) 2024-09-14T11:25:18.105 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:25:18.105 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:18.106 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 19 tests from 1 test suite ran. (30436 ms total) 2024-09-14T11:25:18.106 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 19 tests. 2024-09-14T11:25:18.111 INFO:tasks.workunit.client.0.smithi130.stdout:phase 6.1 2024-09-14T11:25:18.137 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:25:18.137 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment set-up. 2024-09-14T11:25:18.137 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:25:18.137 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:25:18.145 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:18.145 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:18.549 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.INIT (411 ms) 2024-09-14T11:25:18.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:25:18.684 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:25:18.685 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CREATE_BUCKETS (17 ms) 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (5 ms) 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.TOPDIR_RENAME (19 ms) 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SUBDIR_RENAME (22 ms) 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:25:18.686 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:18.634+0000 7f7f6f2c18c0 -1 shutting down 2024-09-14T11:25:18.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:18.636+0000 7f7e462d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71364, si_uid : 1000, si_addr0x3e8000116c4, si_status0 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout:[ OK ] LibRGW.SHUTDOWN (30061 ms) 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] 10 tests from LibRGW (30556 ms total) 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout:[----------] Global test environment tear-down 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout:[==========] 10 tests from 1 test suite ran. (30556 ms total) 2024-09-14T11:25:48.695 INFO:tasks.workunit.client.0.smithi130.stdout:[ PASSED ] 10 tests. 2024-09-14T11:25:48.702 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:25:48.702 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:25:48.745 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:25:48.746 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:25:48.747 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z ']' 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:48.820 INFO:tasks.workunit.client.0.smithi130.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:25:48.857 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:48.857 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:48.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.896+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 realm 2024-09-14T11:25:48.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.897+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.898+0000 7f85f6f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:48.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.898+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.899+0000 7f85f6f24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:48.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.899+0000 7f85f6f24800 20 searching for the correct realm 2024-09-14T11:25:48.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.902+0000 7f85f3303640 0 -- 172.21.15.130:0/2522738245 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f85dc013030 msgr2=0x7f85dc06aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:48.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.907+0000 7f85f3303640 0 -- 172.21.15.130:0/2522738245 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f84bc084f40 msgr2=0x7f84bc087370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:25:48.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.910+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 zone default found 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 4 Realm: () 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 zonegroup default 2024-09-14T11:25:48.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.911+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.912+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.912+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.912+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.912+0000 7f85f6f24800 20 started sync module instance, tier type = 2024-09-14T11:25:48.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.912+0000 7f85f6f24800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:25:48.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=0 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=1 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=2 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=3 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=4 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=5 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.922+0000 7f85f6f24800 20 add_watcher() i=6 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.923+0000 7f85f6f24800 20 add_watcher() i=7 2024-09-14T11:25:48.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.923+0000 7f85f6f24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:48.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.924+0000 7f84a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 5 note: GC not initialized 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f8423fff640 20 reqs_thread_entry: start 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 20 Filter name: none 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f8421ffb640 20 reqs_thread_entry: start 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.925+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 20 rados->read ofs=0 len=0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:48.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.926+0000 7f85f6f24800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.927+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.927+0000 7f85f6f24800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.927+0000 7f85f6f24800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.928+0000 7f84d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856756 cookie 93876959014832 notifier 5829 bl.length()=677 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.928+0000 7f84d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:25:48.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.928+0000 7f84d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f85f6f24800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f85f6f24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f84d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856712 cookie 93876958997424 notifier 5829 bl.length()=187 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f84d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:25:48.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.929+0000 7f84d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f85f6f24800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f85f6f24800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f85f6f24800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f84d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 93876958997424 notifier 5829 bl.length()=197 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f84d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.931+0000 7f84d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:25:48.930 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "display_name": "maven test user", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "email": "sigv4@example.com", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "suspended": 0, 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "subusers": [], 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "keys": [ 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: { 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "user": "ceph-test-maven", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:25:48.931 INFO:tasks.workunit.client.0.smithi130.stdout: "active": true, 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:25:48.927723Z" 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: ], 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "swift_keys": [], 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "caps": [], 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "default_placement": "", 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "placement_tags": [], 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_quota": { 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:25:48.932 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "user_quota": { 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "type": "rgw", 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "account_id": "", 2024-09-14T11:25:48.933 INFO:tasks.workunit.client.0.smithi130.stdout: "path": "/", 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:25:48.927711Z", 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stdout: "tags": [], 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stdout: "group_ids": [] 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:25:48.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.932+0000 7f84a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:48.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.935+0000 7f85f6f24800 20 remove_watcher() i=0 2024-09-14T11:25:48.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.935+0000 7f85f6f24800 2 removed watcher, disabling cache 2024-09-14T11:25:48.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.936+0000 7f85f6f24800 20 remove_watcher() i=1 2024-09-14T11:25:48.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.936+0000 7f85f6f24800 20 remove_watcher() i=2 2024-09-14T11:25:48.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.937+0000 7f85f6f24800 20 remove_watcher() i=3 2024-09-14T11:25:48.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.939+0000 7f85f6f24800 20 remove_watcher() i=4 2024-09-14T11:25:48.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.940+0000 7f85f6f24800 20 remove_watcher() i=5 2024-09-14T11:25:48.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.941+0000 7f85f6f24800 20 remove_watcher() i=6 2024-09-14T11:25:48.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:25:48.942+0000 7f85f6f24800 20 remove_watcher() i=7 2024-09-14T11:25:48.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z ']' 2024-09-14T11:25:48.951 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:25:48.951 INFO:tasks.workunit.client.0.smithi130.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:25:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi130.front.sepia.ceph.com:443 2024-09-14T11:25:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi130.front.sepia.ceph.com:443 2024-09-14T11:25:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:25:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:25:48.952 INFO:tasks.workunit.client.0.smithi130.stderr:+ ./mvnw clean package 2024-09-14T11:25:48.961 INFO:tasks.workunit.client.0.smithi130.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:50.358 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:50.513 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:25:50.595 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-14T11:25:50.609 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:25:50.649 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:25:50.660 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:25:50.680 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.7 MB/s) 2024-09-14T11:25:50.712 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:50.712 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:50.712 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:50.712 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] from pom.xml 2024-09-14T11:25:50.712 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:50.714 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:25:50.729 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:25:50.738 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:25:50.754 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T11:25:50.757 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:25:50.772 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:25:50.779 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:25:50.794 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:50.809 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:25:50.826 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-14T11:25:50.833 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:25:50.848 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:25:50.852 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:25:50.866 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:25:50.869 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:25:50.883 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-14T11:25:50.887 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:25:50.901 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:50.907 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:25:50.923 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-14T11:25:50.931 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:25:50.946 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:25:50.955 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:25:50.972 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:25:50.981 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:25:50.997 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-14T11:25:51.000 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:25:51.017 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-14T11:25:51.022 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:25:51.039 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-14T11:25:51.045 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:25:51.061 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:25:51.068 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:25:51.083 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-14T11:25:51.088 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:25:51.103 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:25:51.110 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:25:51.124 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:25:51.128 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:25:51.142 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-14T11:25:51.144 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:25:51.159 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-14T11:25:51.163 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:25:51.178 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-14T11:25:51.184 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:25:51.198 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:25:51.212 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:25:51.230 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 320 kB/s) 2024-09-14T11:25:51.232 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:25:51.247 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.5 MB/s) 2024-09-14T11:25:51.251 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:25:51.266 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:25:51.274 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:25:51.289 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-14T11:25:51.292 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:25:51.307 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:25:51.309 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:25:51.323 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-14T11:25:51.328 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:25:51.343 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-14T11:25:51.349 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:25:51.365 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T11:25:51.370 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:25:51.385 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:25:51.390 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:25:51.404 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T11:25:51.408 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:25:51.422 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 273 kB/s) 2024-09-14T11:25:51.426 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:25:51.440 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T11:25:51.443 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:25:51.458 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:25:51.460 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:25:51.474 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 295 kB/s) 2024-09-14T11:25:51.475 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:25:51.489 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:25:51.492 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:25:51.506 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:25:51.511 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:25:51.526 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-14T11:25:51.529 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:25:51.543 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:25:51.546 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:25:51.561 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T11:25:51.565 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:25:51.581 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-14T11:25:51.586 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:25:51.600 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-14T11:25:51.605 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:25:51.620 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-14T11:25:51.622 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:25:51.637 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:25:51.640 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:25:51.654 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:25:51.660 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:25:51.715 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 108 kB/s) 2024-09-14T11:25:51.719 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:25:51.733 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-14T11:25:51.736 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:25:51.751 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-14T11:25:51.754 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:25:51.768 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 292 kB/s) 2024-09-14T11:25:51.770 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:25:51.784 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:25:51.788 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:25:51.801 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-14T11:25:51.803 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:25:51.817 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-14T11:25:51.819 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:25:51.834 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-14T11:25:51.837 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:25:51.851 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:51.854 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:25:51.868 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 382 kB/s) 2024-09-14T11:25:51.869 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:25:51.884 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-14T11:25:51.888 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:25:51.902 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-14T11:25:51.904 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:25:51.919 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:25:51.924 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:25:51.938 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T11:25:51.942 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:25:51.955 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:51.957 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:25:51.973 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:25:51.978 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:25:51.993 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-14T11:25:51.997 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:25:52.011 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-14T11:25:52.014 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:25:52.030 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-14T11:25:52.035 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:25:52.049 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:25:52.051 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:25:52.066 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:25:52.069 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:25:52.083 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:52.085 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:25:52.099 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 227 kB/s) 2024-09-14T11:25:52.101 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:25:52.114 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:25:52.116 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:25:52.131 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:25:52.133 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:25:52.147 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 117 kB/s) 2024-09-14T11:25:52.149 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:25:52.163 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T11:25:52.165 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:25:52.179 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:52.181 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:25:52.195 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 214 kB/s) 2024-09-14T11:25:52.198 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:25:52.213 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-14T11:25:52.216 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:25:52.230 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:25:52.232 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:25:52.247 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:25:52.249 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:25:52.262 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:25:52.264 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:25:52.278 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:25:52.280 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:25:52.294 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:25:52.296 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:25:52.310 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:25:52.326 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:25:52.408 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-14T11:25:52.409 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:25:52.409 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:25:52.409 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:25:52.409 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:25:52.409 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:25:52.428 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 66/98 kB Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.9 MB/s) 2024-09-14T11:25:52.428 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:25:52.443 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 486 kB/s) 2024-09-14T11:25:52.443 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:25:52.460 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/49 kB Progress (2): 1.4/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 1.4/35 kB Progress (2): 2.8/49 kB | 2.8/35 kB Progress (3): 2.8/49 kB | 2.8/35 kB | 1.4/16 kB Progress (3): 2.8/49 kB | 4.1/35 kB | 1.4/16 kB Progress (4): 2.8/49 kB | 4.1/35 kB | 1.4/16 kB | 1.4/71 kB Progress (4): 4.1/49 kB | 4.1/35 kB | 1.4/16 kB | 1.4/71 kB Progress (4): 4.1/49 kB | 4.1/35 kB | 1.4/16 kB | 2.8/71 kB Progress (4): 4.1/49 kB | 5.5/35 kB | 1.4/16 kB | 2.8/71 kB Progress (4): 4.1/49 kB | 5.5/35 kB | 1.4/16 kB | 4.1/71 kB Progress (4): 4.1/49 kB | 5.5/35 kB | 2.8/16 kB | 4.1/71 kB Progress (4): 4.1/49 kB | 5.5/35 kB | 2.8/16 kB | 5.5/71 kB Progress (4): 4.1/49 kB | 5.5/35 kB | 4.1/16 kB | 5.5/71 kB Progress (4): 4.1/49 kB | 6.9/35 kB | 4.1/16 kB | 5.5/71 kB Progress (4): 5.5/49 kB | 6.9/35 kB | 4.1/16 kB | 5.5/71 kB Progress (4): 5.5/49 kB | 8.3/35 kB | 4.1/16 kB | 5.5/71 kB Progress (4): 5.5/49 kB | 8.3/35 kB | 5.5/16 kB | 5.5/71 kB Progress (4): 5.5/49 kB | 8.3/35 kB | 5.5/16 kB | 6.9/71 kB Progress (4): 5.5/49 kB | 8.3/35 kB | 6.9/16 kB | 6.9/71 kB Progress (4): 5.5/49 kB | 8.3/35 kB | 6.9/16 kB | 8.3/71 kB Progress (4): 5.5/49 kB | 9.7/35 kB | 6.9/16 kB | 8.3/71 kB Progress (4): 6.9/49 kB | 9.7/35 kB | 6.9/16 kB | 8.3/71 kB Progress (4): 6.9/49 kB | 11/35 kB | 6.9/16 kB | 8.3/71 kB Progress (4): 6.9/49 kB | 11/35 kB | 6.9/16 kB | 9.7/71 kB Progress (4): 6.9/49 kB | 11/35 kB | 8.3/16 kB | 9.7/71 kB Progress (4): 6.9/49 kB | 12/35 kB | 8.3/16 kB | 9.7/71 kB Progress (4): 8.3/49 kB | 12/35 kB | 8.3/16 kB | 9.7/71 kB Progress (4): 8.3/49 kB | 14/35 kB | 8.3/16 kB | 9.7/71 kB Progress (4): 8.3/49 kB | 14/35 kB | 9.7/16 kB | 9.7/71 kB Progress (4): 8.3/49 kB | 14/35 kB | 9.7/16 kB | 11/71 kB Progress (4): 8.3/49 kB | 14/35 kB | 11/16 kB | 11/71 kB Progress (4): 9.7/49 kB | 14/35 kB | 11/16 kB | 11/71 kB Progress (4): 9.7/49 kB | 15/35 kB | 11/16 kB | 11/71 kB Progress (4): 9.7/49 kB | 15/35 kB | 12/16 kB | 11/71 kB Progress (4): 9.7/49 kB | 15/35 kB | 12/16 kB | 12/71 kB Progress (4): 9.7/49 kB | 15/35 kB | 14/16 kB | 12/71 kB Progress (4): 9.7/49 kB | 16/35 kB | 14/16 kB | 12/71 kB Progress (4): 11/49 kB | 16/35 kB | 14/16 kB | 12/71 kB Progress (4): 11/49 kB | 16/35 kB | 15/16 kB | 12/71 kB Progress (4): 11/49 kB | 16/35 kB | 15/16 kB | 14/71 kB Progress (4): 11/49 kB | 16/35 kB | 16 kB | 14/71 kB Progress (4): 12/49 kB | 16/35 kB | 16 kB | 14/71 kB Progress (4): 12/49 kB | 17/35 kB | 16 kB | 14/71 kB Progress (4): 14/49 kB | 17/35 kB | 16 kB | 14/71 kB Progress (4): 14/49 kB | 17/35 kB | 16 kB | 15/71 kB Progress (4): 15/49 kB | 17/35 kB | 16 kB | 15/71 kB Progress (4): 15/49 kB | 19/35 kB | 16 kB | 15/71 kB Progress (4): 17/49 kB | 19/35 kB | 16 kB | 15/71 kB Progress (4): 17/49 kB | 19/35 kB | 16 kB | 16/71 kB Progress (4): 18/49 kB | 19/35 kB | 16 kB | 16/71 kB Progress (4): 18/49 kB | 20/35 kB | 16 kB | 16/71 kB Progress (4): 19/49 kB | 20/35 kB | 16 kB | 16/71 kB Progress (4): 19/49 kB | 21/35 kB | 16 kB | 16/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 322 kB/s) 2024-09-14T11:25:52.460 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 19/49 kB | 23/35 kB | 16/71 kB Progress (3): 21/49 kB | 23/35 kB | 16/71 kB Progress (3): 21/49 kB | 24/35 kB | 16/71 kB Progress (3): 22/49 kB | 24/35 kB | 16/71 kB Progress (3): 22/49 kB | 25/35 kB | 16/71 kB Progress (3): 23/49 kB | 25/35 kB | 16/71 kB Progress (3): 25/49 kB | 25/35 kB | 16/71 kB Progress (3): 26/49 kB | 25/35 kB | 16/71 kB Progress (3): 28/49 kB | 25/35 kB | 16/71 kB Progress (3): 29/49 kB | 25/35 kB | 16/71 kB Progress (3): 30/49 kB | 25/35 kB | 16/71 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:25:52.466 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (4): 30/49 kB | 25/35 kB | 16/71 kB | 16/782 kB Progress (4): 30/49 kB | 27/35 kB | 16/71 kB | 16/782 kB Progress (4): 30/49 kB | 28/35 kB | 16/71 kB | 16/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 16/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 33/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 49/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 66/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 82/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 98/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 115/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 131/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 147/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 164/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 180/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 197/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 213/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 229/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 246/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 256/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 272/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 289/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 305/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 321/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 338/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 354/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 370/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 387/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 403/782 kB Progress (4): 30/49 kB | 30/35 kB | 16/71 kB | 420/782 kB Progress (4): 30/49 kB | 31/35 kB | 16/71 kB | 420/782 kB Progress (4): 30/49 kB | 32/35 kB | 16/71 kB | 420/782 kB Progress (4): 32/49 kB | 32/35 kB | 16/71 kB | 420/782 kB Progress (4): 32/49 kB | 32/35 kB | 16/71 kB | 436/782 kB Progress (4): 33/49 kB | 32/35 kB | 16/71 kB | 436/782 kB Progress (4): 33/49 kB | 34/35 kB | 16/71 kB | 436/782 kB Progress (4): 34/49 kB | 34/35 kB | 16/71 kB | 436/782 kB Progress (4): 34/49 kB | 35/35 kB | 16/71 kB | 436/782 kB Progress (4): 36/49 kB | 35/35 kB | 16/71 kB | 436/782 kB Progress (4): 36/49 kB | 35 kB | 16/71 kB | 436/782 kB Progress (4): 36/49 kB | 35 kB | 16/71 kB | 452/782 kB Progress (4): 37/49 kB | 35 kB | 16/71 kB | 452/782 kB Progress (4): 37/49 kB | 35 kB | 32/71 kB | 452/782 kB Progress (4): 37/49 kB | 35 kB | 32/71 kB | 469/782 kB Progress (4): 39/49 kB | 35 kB | 32/71 kB | 469/782 kB Progress (4): 40/49 kB | 35 kB | 32/71 kB | 469/782 kB Progress (4): 41/49 kB | 35 kB | 32/71 kB | 469/782 kB Progress (4): 43/49 kB | 35 kB | 32/71 kB | 469/782 kB Progress (4): 43/49 kB | 35 kB | 32/71 kB | 485/782 kB Progress (4): 44/49 kB | 35 kB | 32/71 kB | 485/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 606 kB/s) 2024-09-14T11:25:52.467 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:25:52.468 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 44/49 kB | 32/71 kB | 502/782 kB Progress (3): 46/49 kB | 32/71 kB | 502/782 kB Progress (3): 46/49 kB | 32/71 kB | 518/782 kB Progress (3): 46/49 kB | 32/71 kB | 534/782 kB Progress (3): 46/49 kB | 32/71 kB | 551/782 kB Progress (3): 46/49 kB | 49/71 kB | 551/782 kB Progress (3): 47/49 kB | 49/71 kB | 551/782 kB Progress (3): 47/49 kB | 49/71 kB | 567/782 kB Progress (3): 48/49 kB | 49/71 kB | 567/782 kB Progress (3): 49 kB | 49/71 kB | 567/782 kB Progress (3): 49 kB | 49/71 kB | 583/782 kB Progress (3): 49 kB | 49/71 kB | 600/782 kB Progress (3): 49 kB | 49/71 kB | 616/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-14T11:25:52.468 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:25:52.471 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 49/71 kB | 633/782 kB Progress (2): 49/71 kB | 649/782 kB Progress (2): 49/71 kB | 665/782 kB Progress (2): 49/71 kB | 682/782 kB Progress (2): 49/71 kB | 698/782 kB Progress (2): 49/71 kB | 715/782 kB Progress (2): 49/71 kB | 731/782 kB Progress (2): 49/71 kB | 747/782 kB Progress (2): 49/71 kB | 764/782 kB Progress (2): 49/71 kB | 780/782 kB Progress (2): 49/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 13 MB/s) 2024-09-14T11:25:52.471 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:25:52.474 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 49/71 kB | 1.4/11 kB Progress (2): 49/71 kB | 2.8/11 kB Progress (2): 49/71 kB | 4.1/11 kB Progress (2): 49/71 kB | 5.5/11 kB Progress (2): 49/71 kB | 6.9/11 kB Progress (2): 49/71 kB | 8.3/11 kB Progress (2): 49/71 kB | 9.7/11 kB Progress (2): 49/71 kB | 11/11 kB Progress (2): 49/71 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 178 kB/s) 2024-09-14T11:25:52.474 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:25:52.477 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 65/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-14T11:25:52.477 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:25:52.485 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 16/205 kB | 30 kB Progress (3): 16/205 kB | 30 kB | 16/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 403 kB/s) 2024-09-14T11:25:52.485 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:25:52.486 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 16/205 kB | 33/81 kB Progress (2): 16/205 kB | 49/81 kB Progress (2): 16/205 kB | 66/81 kB Progress (2): 16/205 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 1.1 MB/s) 2024-09-14T11:25:52.486 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:25:52.492 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 16/205 kB | 16/798 kB Progress (3): 16/205 kB | 16/798 kB | 13 kB Progress (3): 33/205 kB | 16/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 163 kB/s) 2024-09-14T11:25:52.492 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:25:52.502 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 49/205 kB | 16/798 kB Progress (2): 66/205 kB | 16/798 kB Progress (2): 82/205 kB | 16/798 kB Progress (2): 98/205 kB | 16/798 kB Progress (2): 115/205 kB | 16/798 kB Progress (3): 115/205 kB | 16/798 kB | 16/182 kB Progress (4): 115/205 kB | 16/798 kB | 16/182 kB | 16/151 kB Progress (4): 115/205 kB | 16/798 kB | 16/182 kB | 33/151 kB Progress (4): 115/205 kB | 16/798 kB | 16/182 kB | 49/151 kB Progress (4): 115/205 kB | 33/798 kB | 16/182 kB | 49/151 kB Progress (4): 115/205 kB | 33/798 kB | 16/182 kB | 66/151 kB Progress (4): 115/205 kB | 33/798 kB | 16/182 kB | 82/151 kB Progress (4): 115/205 kB | 33/798 kB | 16/182 kB | 98/151 kB Progress (4): 115/205 kB | 33/798 kB | 16/182 kB | 115/151 kB Progress (4): 115/205 kB | 33/798 kB | 33/182 kB | 115/151 kB Progress (4): 115/205 kB | 33/798 kB | 33/182 kB | 131/151 kB Progress (4): 115/205 kB | 49/798 kB | 33/182 kB | 131/151 kB Progress (4): 115/205 kB | 49/798 kB | 33/182 kB | 147/151 kB Progress (4): 115/205 kB | 49/798 kB | 33/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.6 MB/s) 2024-09-14T11:25:52.502 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:25:52.507 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 131/205 kB | 49/798 kB | 33/182 kB Progress (3): 131/205 kB | 49/798 kB | 49/182 kB Progress (3): 131/205 kB | 66/798 kB | 49/182 kB Progress (3): 147/205 kB | 66/798 kB | 49/182 kB Progress (3): 147/205 kB | 66/798 kB | 66/182 kB Progress (3): 164/205 kB | 66/798 kB | 66/182 kB Progress (3): 164/205 kB | 82/798 kB | 66/182 kB Progress (3): 180/205 kB | 82/798 kB | 66/182 kB Progress (4): 180/205 kB | 82/798 kB | 66/182 kB | 16/27 kB Progress (4): 197/205 kB | 82/798 kB | 66/182 kB | 16/27 kB Progress (4): 197/205 kB | 98/798 kB | 66/182 kB | 16/27 kB Progress (4): 205 kB | 98/798 kB | 66/182 kB | 16/27 kB Progress (4): 205 kB | 98/798 kB | 66/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-14T11:25:52.507 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 281 kB/s) 2024-09-14T11:25:52.507 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:25:52.507 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:25:52.517 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 98/798 kB | 82/182 kB Progress (2): 98/798 kB | 98/182 kB Progress (2): 115/798 kB | 98/182 kB Progress (2): 115/798 kB | 115/182 kB Progress (2): 131/798 kB | 115/182 kB Progress (2): 131/798 kB | 131/182 kB Progress (2): 147/798 kB | 131/182 kB Progress (2): 147/798 kB | 147/182 kB Progress (2): 164/798 kB | 147/182 kB Progress (2): 164/798 kB | 164/182 kB Progress (3): 164/798 kB | 164/182 kB | 16/30 kB Progress (3): 164/798 kB | 180/182 kB | 16/30 kB Progress (3): 164/798 kB | 182 kB | 16/30 kB Progress (3): 180/798 kB | 182 kB | 16/30 kB Progress (3): 180/798 kB | 182 kB | 30 kB Progress (3): 197/798 kB | 182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 284 kB/s) 2024-09-14T11:25:52.517 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:25:52.517 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:25:52.517 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:25:52.522 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 213/798 kB Progress (1): 229/798 kB Progress (2): 229/798 kB | 16/385 kB Progress (3): 229/798 kB | 16/385 kB | 13 kB Progress (3): 229/798 kB | 33/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 117 kB/s) 2024-09-14T11:25:52.523 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:25:52.533 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 229/798 kB | 49/385 kB Progress (2): 229/798 kB | 66/385 kB Progress (2): 229/798 kB | 82/385 kB Progress (2): 229/798 kB | 98/385 kB Progress (2): 246/798 kB | 98/385 kB Progress (2): 256/798 kB | 98/385 kB Progress (2): 256/798 kB | 115/385 kB Progress (2): 256/798 kB | 131/385 kB Progress (2): 256/798 kB | 147/385 kB Progress (2): 272/798 kB | 147/385 kB Progress (2): 272/798 kB | 164/385 kB Progress (2): 289/798 kB | 164/385 kB Progress (2): 289/798 kB | 180/385 kB Progress (2): 305/798 kB | 180/385 kB Progress (2): 321/798 kB | 180/385 kB Progress (2): 321/798 kB | 197/385 kB Progress (2): 338/798 kB | 197/385 kB Progress (2): 338/798 kB | 213/385 kB Progress (2): 354/798 kB | 213/385 kB Progress (2): 354/798 kB | 229/385 kB Progress (2): 354/798 kB | 246/385 kB Progress (2): 354/798 kB | 262/385 kB Progress (2): 370/798 kB | 262/385 kB Progress (2): 387/798 kB | 262/385 kB Progress (2): 403/798 kB | 262/385 kB Progress (2): 420/798 kB | 262/385 kB Progress (2): 436/798 kB | 262/385 kB Progress (2): 452/798 kB | 262/385 kB Progress (2): 469/798 kB | 262/385 kB Progress (2): 485/798 kB | 262/385 kB Progress (3): 485/798 kB | 262/385 kB | 16/75 kB Progress (4): 485/798 kB | 262/385 kB | 16/75 kB | 16/780 kB Progress (4): 485/798 kB | 262/385 kB | 33/75 kB | 16/780 kB Progress (4): 485/798 kB | 262/385 kB | 33/75 kB | 33/780 kB Progress (4): 485/798 kB | 262/385 kB | 49/75 kB | 33/780 kB Progress (4): 485/798 kB | 262/385 kB | 49/75 kB | 49/780 kB Progress (4): 485/798 kB | 262/385 kB | 66/75 kB | 49/780 kB Progress (4): 485/798 kB | 262/385 kB | 66/75 kB | 64/780 kB Progress (4): 485/798 kB | 262/385 kB | 75 kB | 64/780 kB Progress (4): 485/798 kB | 262/385 kB | 75 kB | 80/780 kB Progress (4): 485/798 kB | 262/385 kB | 75 kB | 97/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 611 kB/s) 2024-09-14T11:25:52.533 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:25:52.536 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 485/798 kB | 262/385 kB | 113/780 kB Progress (3): 485/798 kB | 279/385 kB | 113/780 kB Progress (3): 485/798 kB | 279/385 kB | 129/780 kB Progress (3): 485/798 kB | 295/385 kB | 129/780 kB Progress (3): 485/798 kB | 295/385 kB | 146/780 kB Progress (3): 485/798 kB | 311/385 kB | 146/780 kB Progress (3): 485/798 kB | 311/385 kB | 162/780 kB Progress (3): 485/798 kB | 311/385 kB | 178/780 kB Progress (3): 485/798 kB | 328/385 kB | 178/780 kB Progress (3): 485/798 kB | 344/385 kB | 178/780 kB Progress (3): 485/798 kB | 344/385 kB | 195/780 kB Progress (3): 485/798 kB | 360/385 kB | 195/780 kB Progress (3): 485/798 kB | 360/385 kB | 211/780 kB Progress (3): 502/798 kB | 360/385 kB | 211/780 kB Progress (3): 502/798 kB | 377/385 kB | 211/780 kB Progress (3): 502/798 kB | 377/385 kB | 228/780 kB Progress (3): 502/798 kB | 385 kB | 228/780 kB Progress (3): 518/798 kB | 385 kB | 228/780 kB Progress (3): 518/798 kB | 385 kB | 244/780 kB Progress (3): 534/798 kB | 385 kB | 244/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-14T11:25:52.536 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:25:52.541 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 551/798 kB | 244/780 kB Progress (2): 567/798 kB | 244/780 kB Progress (3): 567/798 kB | 244/780 kB | 16/329 kB Progress (3): 583/798 kB | 244/780 kB | 16/329 kB Progress (3): 600/798 kB | 244/780 kB | 16/329 kB Progress (3): 616/798 kB | 244/780 kB | 16/329 kB Progress (3): 616/798 kB | 244/780 kB | 33/329 kB Progress (3): 633/798 kB | 244/780 kB | 33/329 kB Progress (3): 649/798 kB | 244/780 kB | 33/329 kB Progress (3): 665/798 kB | 244/780 kB | 33/329 kB Progress (3): 665/798 kB | 244/780 kB | 49/329 kB Progress (3): 682/798 kB | 244/780 kB | 49/329 kB Progress (3): 698/798 kB | 244/780 kB | 49/329 kB Progress (3): 715/798 kB | 244/780 kB | 49/329 kB Progress (3): 731/798 kB | 244/780 kB | 49/329 kB Progress (3): 747/798 kB | 244/780 kB | 49/329 kB Progress (3): 764/798 kB | 244/780 kB | 49/329 kB Progress (3): 780/798 kB | 244/780 kB | 49/329 kB Progress (3): 796/798 kB | 244/780 kB | 49/329 kB Progress (3): 798 kB | 244/780 kB | 49/329 kB Progress (3): 798 kB | 244/780 kB | 66/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.1 MB/s) 2024-09-14T11:25:52.541 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:25:52.556 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 260/780 kB | 66/329 kB Progress (2): 277/780 kB | 66/329 kB Progress (2): 293/780 kB | 66/329 kB Progress (2): 310/780 kB | 66/329 kB Progress (2): 326/780 kB | 66/329 kB Progress (2): 342/780 kB | 66/329 kB Progress (2): 359/780 kB | 66/329 kB Progress (2): 375/780 kB | 66/329 kB Progress (2): 391/780 kB | 66/329 kB Progress (2): 408/780 kB | 66/329 kB Progress (2): 424/780 kB | 66/329 kB Progress (2): 441/780 kB | 66/329 kB Progress (2): 457/780 kB | 66/329 kB Progress (2): 473/780 kB | 66/329 kB Progress (2): 490/780 kB | 66/329 kB Progress (3): 490/780 kB | 66/329 kB | 16/501 kB Progress (3): 506/780 kB | 66/329 kB | 16/501 kB Progress (3): 506/780 kB | 66/329 kB | 33/501 kB Progress (3): 522/780 kB | 66/329 kB | 33/501 kB Progress (3): 522/780 kB | 82/329 kB | 33/501 kB Progress (3): 522/780 kB | 82/329 kB | 49/501 kB Progress (3): 539/780 kB | 82/329 kB | 49/501 kB Progress (3): 539/780 kB | 82/329 kB | 66/501 kB Progress (3): 539/780 kB | 98/329 kB | 66/501 kB Progress (3): 555/780 kB | 98/329 kB | 66/501 kB Progress (3): 572/780 kB | 98/329 kB | 66/501 kB Progress (3): 572/780 kB | 98/329 kB | 82/501 kB Progress (3): 588/780 kB | 98/329 kB | 82/501 kB Progress (3): 588/780 kB | 98/329 kB | 98/501 kB Progress (3): 604/780 kB | 98/329 kB | 98/501 kB Progress (3): 604/780 kB | 114/329 kB | 98/501 kB Progress (3): 604/780 kB | 114/329 kB | 115/501 kB Progress (3): 604/780 kB | 114/329 kB | 131/501 kB Progress (3): 621/780 kB | 114/329 kB | 131/501 kB Progress (3): 621/780 kB | 130/329 kB | 131/501 kB Progress (3): 621/780 kB | 130/329 kB | 147/501 kB Progress (3): 637/780 kB | 130/329 kB | 147/501 kB Progress (3): 637/780 kB | 130/329 kB | 164/501 kB Progress (3): 637/780 kB | 130/329 kB | 180/501 kB Progress (4): 637/780 kB | 130/329 kB | 180/501 kB | 16/354 kB Progress (4): 654/780 kB | 130/329 kB | 180/501 kB | 16/354 kB Progress (4): 654/780 kB | 130/329 kB | 197/501 kB | 16/354 kB Progress (4): 654/780 kB | 146/329 kB | 197/501 kB | 16/354 kB Progress (4): 654/780 kB | 146/329 kB | 197/501 kB | 32/354 kB Progress (4): 670/780 kB | 146/329 kB | 197/501 kB | 32/354 kB Progress (4): 670/780 kB | 146/329 kB | 213/501 kB | 32/354 kB Progress (4): 670/780 kB | 146/329 kB | 213/501 kB | 49/354 kB Progress (4): 686/780 kB | 146/329 kB | 213/501 kB | 49/354 kB Progress (4): 686/780 kB | 146/329 kB | 229/501 kB | 49/354 kB Progress (4): 686/780 kB | 146/329 kB | 229/501 kB | 65/354 kB Progress (4): 703/780 kB | 146/329 kB | 229/501 kB | 65/354 kB Progress (4): 703/780 kB | 146/329 kB | 246/501 kB | 65/354 kB Progress (4): 703/780 kB | 146/329 kB | 246/501 kB | 81/354 kB Progress (4): 703/780 kB | 146/329 kB | 256/501 kB | 81/354 kB Progress (4): 703/780 kB | 163/329 kB | 256/501 kB | 81/354 kB Progress (4): 719/780 kB | 163/329 kB | 256/501 kB | 81/354 kB Progress (4): 719/780 kB | 163/329 kB | 256/501 kB | 98/354 kB Progress (4): 719/780 kB | 163/329 kB | 272/501 kB | 98/354 kB Progress (4): 735/780 kB | 163/329 kB | 272/501 kB | 98/354 kB Progress (4): 735/780 kB | 163/329 kB | 272/501 kB | 114/354 kB Progress (4): 735/780 kB | 163/329 kB | 289/501 kB | 114/354 kB Progress (4): 735/780 kB | 163/329 kB | 289/501 kB | 130/354 kB Progress (4): 735/780 kB | 163/329 kB | 305/501 kB | 130/354 kB Progress (4): 735/780 kB | 163/329 kB | 305/501 kB | 147/354 kB Progress (4): 735/780 kB | 163/329 kB | 321/501 kB | 147/354 kB Progress (4): 735/780 kB | 179/329 kB | 321/501 kB | 147/354 kB Progress (4): 735/780 kB | 179/329 kB | 321/501 kB | 163/354 kB Progress (4): 735/780 kB | 179/329 kB | 338/501 kB | 163/354 kB Progress (4): 735/780 kB | 195/329 kB | 338/501 kB | 163/354 kB Progress (4): 735/780 kB | 195/329 kB | 338/501 kB | 180/354 kB Progress (4): 735/780 kB | 195/329 kB | 354/501 kB | 180/354 kB Progress (4): 752/780 kB | 195/329 kB | 354/501 kB | 180/354 kB Progress (4): 752/780 kB | 195/329 kB | 354/501 kB | 196/354 kB Progress (4): 752/780 kB | 195/329 kB | 370/501 kB | 196/354 kB Progress (4): 768/780 kB | 195/329 kB | 370/501 kB | 196/354 kB Progress (4): 768/780 kB | 195/329 kB | 370/501 kB | 212/354 kB Progress (4): 768/780 kB | 195/329 kB | 387/501 kB | 212/354 kB Progress (4): 780 kB | 195/329 kB | 387/501 kB | 212/354 kB Progress (4): 780 kB | 195/329 kB | 387/501 kB | 229/354 kB Progress (4): 780 kB | 195/329 kB | 403/501 kB | 229/354 kB Progress (4): 780 kB | 195/329 kB | 403/501 kB | 245/354 kB Progress (4): 780 kB | 195/329 kB | 420/501 kB | 245/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.4 MB/s) 2024-09-14T11:25:52.556 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:25:52.557 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 195/329 kB | 420/501 kB | 262/354 kB Progress (3): 195/329 kB | 436/501 kB | 262/354 kB Progress (4): 195/329 kB | 436/501 kB | 262/354 kB | 16/41 kB Progress (4): 195/329 kB | 452/501 kB | 262/354 kB | 16/41 kB Progress (4): 195/329 kB | 452/501 kB | 278/354 kB | 16/41 kB Progress (4): 195/329 kB | 469/501 kB | 278/354 kB | 16/41 kB Progress (4): 195/329 kB | 469/501 kB | 278/354 kB | 33/41 kB Progress (4): 195/329 kB | 469/501 kB | 294/354 kB | 33/41 kB Progress (4): 195/329 kB | 485/501 kB | 294/354 kB | 33/41 kB Progress (4): 195/329 kB | 485/501 kB | 294/354 kB | 41 kB Progress (4): 195/329 kB | 501 kB | 294/354 kB | 41 kB Progress (4): 195/329 kB | 501 kB | 311/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 284 kB/s) 2024-09-14T11:25:52.557 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.5 MB/s) 2024-09-14T11:25:52.557 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 195/329 kB | 327/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:25:52.557 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:25:52.558 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 195/329 kB | 343/354 kB Progress (2): 195/329 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.4 MB/s) 2024-09-14T11:25:52.558 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:25:52.563 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 212/329 kB Progress (1): 228/329 kB Progress (1): 245/329 kB Progress (1): 261/329 kB Progress (1): 277/329 kB Progress (1): 294/329 kB Progress (1): 310/329 kB Progress (1): 326/329 kB Progress (1): 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-14T11:25:52.563 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:25:52.569 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 40 kB/s) 2024-09-14T11:25:52.569 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:25:52.572 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 66/211 kB Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (2): 98/211 kB | 16/586 kB Progress (3): 98/211 kB | 16/586 kB | 14 kB Progress (3): 115/211 kB | 16/586 kB | 14 kB Progress (3): 115/211 kB | 32/586 kB | 14 kB Progress (3): 131/211 kB | 32/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 89 kB/s) 2024-09-14T11:25:52.572 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 131/211 kB | 49/586 kB Progress (2): 147/211 kB | 49/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:25:52.586 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 147/211 kB | 65/586 kB Progress (2): 164/211 kB | 65/586 kB Progress (2): 164/211 kB | 81/586 kB Progress (2): 180/211 kB | 81/586 kB Progress (2): 197/211 kB | 81/586 kB Progress (3): 197/211 kB | 81/586 kB | 6.8 kB Progress (3): 197/211 kB | 98/586 kB | 6.8 kB Progress (4): 197/211 kB | 98/586 kB | 6.8 kB | 16/106 kB Progress (4): 211 kB | 98/586 kB | 6.8 kB | 16/106 kB Progress (4): 211 kB | 114/586 kB | 6.8 kB | 16/106 kB Progress (4): 211 kB | 114/586 kB | 6.8 kB | 32/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-14T11:25:52.587 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:25:52.587 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:25:52.587 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:25:52.588 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 114/586 kB | 49/106 kB Progress (2): 130/586 kB | 49/106 kB Progress (2): 130/586 kB | 65/106 kB Progress (2): 147/586 kB | 65/106 kB Progress (2): 147/586 kB | 81/106 kB Progress (2): 163/586 kB | 81/106 kB Progress (2): 163/586 kB | 98/106 kB Progress (2): 163/586 kB | 106 kB Progress (2): 180/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 600 kB/s) 2024-09-14T11:25:52.588 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 196/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:25:52.597 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 212/586 kB Progress (1): 229/586 kB Progress (1): 245/586 kB Progress (1): 262/586 kB Progress (1): 278/586 kB Progress (1): 294/586 kB Progress (1): 311/586 kB Progress (1): 327/586 kB Progress (1): 343/586 kB Progress (1): 360/586 kB Progress (1): 376/586 kB Progress (1): 393/586 kB Progress (1): 402/586 kB Progress (1): 418/586 kB Progress (1): 435/586 kB Progress (1): 451/586 kB Progress (1): 468/586 kB Progress (1): 484/586 kB Progress (1): 500/586 kB Progress (1): 517/586 kB Progress (1): 533/586 kB Progress (1): 549/586 kB Progress (1): 566/586 kB Progress (1): 582/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:25:52.597 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:25:52.601 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (2): 82/245 kB | 15 kB Progress (3): 82/245 kB | 15 kB | 16/205 kB Progress (3): 98/245 kB | 15 kB | 16/205 kB Progress (3): 98/245 kB | 15 kB | 33/205 kB Progress (3): 115/245 kB | 15 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 80 kB/s) 2024-09-14T11:25:52.601 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:25:52.603 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 115/245 kB | 49/205 kB Progress (2): 131/245 kB | 49/205 kB Progress (2): 131/245 kB | 66/205 kB Progress (2): 147/245 kB | 66/205 kB Progress (2): 147/245 kB | 82/205 kB Progress (3): 147/245 kB | 82/205 kB | 16/16 kB Progress (3): 147/245 kB | 82/205 kB | 16 kB Progress (3): 164/245 kB | 82/205 kB | 16 kB Progress (3): 164/245 kB | 98/205 kB | 16 kB Progress (3): 180/245 kB | 98/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 86 kB/s) 2024-09-14T11:25:52.603 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 180/245 kB | 115/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:25:52.605 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 197/245 kB | 115/205 kB Progress (2): 197/245 kB | 131/205 kB Progress (2): 213/245 kB | 131/205 kB Progress (2): 213/245 kB | 147/205 kB Progress (2): 229/245 kB | 147/205 kB Progress (2): 229/245 kB | 164/205 kB Progress (2): 245 kB | 164/205 kB Progress (2): 245 kB | 180/205 kB Progress (2): 245 kB | 197/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T11:25:52.605 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:25:52.605 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:25:52.605 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:25:52.612 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-14T11:25:52.616 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 111 kB/s) 2024-09-14T11:25:52.617 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 117 kB/s) 2024-09-14T11:25:52.620 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (2): 33/184 kB | 16/17 kB Progress (2): 33/184 kB | 17 kB Progress (2): 49/184 kB | 17 kB Progress (2): 66/184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 83 kB/s) 2024-09-14T11:25:52.622 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 875 kB/s) 2024-09-14T11:25:52.640 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:52.640 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:25:52.646 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:25:52.661 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-14T11:25:52.663 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:25:52.680 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 283 kB/s) 2024-09-14T11:25:52.682 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:25:52.698 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:25:52.703 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:25:52.717 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:52.723 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:25:52.740 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:25:52.740 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:25:52.758 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-14T11:25:52.803 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:52.803 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:52.807 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:25:52.822 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-14T11:25:52.824 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:25:52.839 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:25:52.842 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:25:52.857 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:25:52.860 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:25:52.874 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:25:52.877 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:25:52.892 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:25:52.894 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:25:52.908 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:25:52.912 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:25:52.925 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 47 kB/s) 2024-09-14T11:25:52.928 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:25:52.941 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:25:52.943 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:25:52.956 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:52.958 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:25:52.973 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:25:52.974 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:25:52.988 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-14T11:25:52.990 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:25:53.004 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-14T11:25:53.007 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:25:53.022 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-14T11:25:53.026 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:25:53.040 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.5 MB/s) 2024-09-14T11:25:53.045 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:25:53.059 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-14T11:25:53.062 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:25:53.076 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:25:53.082 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:25:53.095 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-14T11:25:53.100 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:25:53.115 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-14T11:25:53.116 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:25:53.116 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:25:53.116 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:25:53.116 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:25:53.117 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:25:53.442 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/55 kB Progress (4): 2.5 kB | 8.5 kB | 16/55 kB | 16/269 kB Progress (5): 2.5 kB | 8.5 kB | 16/55 kB | 16/269 kB | 16/41 kB Progress (5): 2.5 kB | 8.5 kB | 33/55 kB | 16/269 kB | 16/41 kB Progress (5): 2.5 kB | 8.5 kB | 33/55 kB | 33/269 kB | 16/41 kB Progress (5): 2.5 kB | 8.5 kB | 33/55 kB | 33/269 kB | 33/41 kB Progress (5): 2.5 kB | 8.5 kB | 49/55 kB | 33/269 kB | 33/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 26 kB/s) 2024-09-14T11:25:53.442 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (4): 2.5 kB | 49/55 kB | 33/269 kB | 41 kB Progress (4): 2.5 kB | 55 kB | 33/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 7.7 kB/s) 2024-09-14T11:25:53.442 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 55 kB | 49/269 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:25:53.442 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:25:53.442 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 55 kB | 66/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 169 kB/s) 2024-09-14T11:25:53.443 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 127 kB/s) 2024-09-14T11:25:53.444 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 819 kB/s) 2024-09-14T11:25:53.462 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 66/327 kB | 16/587 kB Progress (2): 66/327 kB | 33/587 kB Progress (2): 82/327 kB | 33/587 kB Progress (2): 82/327 kB | 49/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 98/327 kB | 66/587 kB Progress (2): 115/327 kB | 66/587 kB Progress (2): 115/327 kB | 82/587 kB Progress (2): 131/327 kB | 82/587 kB Progress (2): 131/327 kB | 98/587 kB Progress (2): 147/327 kB | 98/587 kB Progress (2): 147/327 kB | 115/587 kB Progress (2): 164/327 kB | 115/587 kB Progress (2): 164/327 kB | 131/587 kB Progress (2): 180/327 kB | 131/587 kB Progress (2): 180/327 kB | 147/587 kB Progress (2): 197/327 kB | 147/587 kB Progress (2): 197/327 kB | 164/587 kB Progress (2): 213/327 kB | 164/587 kB Progress (2): 213/327 kB | 180/587 kB Progress (2): 229/327 kB | 180/587 kB Progress (2): 229/327 kB | 197/587 kB Progress (2): 246/327 kB | 197/587 kB Progress (2): 246/327 kB | 213/587 kB Progress (2): 262/327 kB | 213/587 kB Progress (2): 262/327 kB | 229/587 kB Progress (2): 279/327 kB | 229/587 kB Progress (2): 295/327 kB | 229/587 kB Progress (2): 295/327 kB | 246/587 kB Progress (2): 295/327 kB | 256/587 kB Progress (2): 311/327 kB | 256/587 kB Progress (2): 311/327 kB | 272/587 kB Progress (2): 327 kB | 272/587 kB Progress (2): 327 kB | 289/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 948 kB/s) 2024-09-14T11:25:53.466 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 305/587 kB Progress (1): 321/587 kB Progress (1): 338/587 kB Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 1.7 MB/s) 2024-09-14T11:25:53.495 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:53.496 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:53.496 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:53.500 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:25:53.514 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:25:53.517 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:25:53.532 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-09-14T11:25:53.534 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:25:53.547 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:25:53.550 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:25:53.564 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:25:53.567 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:25:53.581 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 63 kB/s) 2024-09-14T11:25:53.582 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:25:53.596 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:25:53.598 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:25:53.612 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.3 MB/s) 2024-09-14T11:25:53.615 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:25:53.628 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:25:53.630 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:25:53.644 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T11:25:53.647 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:25:53.662 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-14T11:25:53.664 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:25:53.678 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 868 kB/s) 2024-09-14T11:25:53.680 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:25:53.694 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:53.696 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:25:53.710 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:25:53.713 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:25:53.728 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:25:53.730 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:25:53.744 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-14T11:25:53.746 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:25:53.760 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-14T11:25:53.763 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:25:53.777 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T11:25:53.781 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:25:53.795 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:25:53.799 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:25:53.813 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-14T11:25:53.814 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:25:53.828 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 464 kB/s) 2024-09-14T11:25:53.829 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:25:53.843 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:25:53.846 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:25:53.860 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:25:53.862 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:25:53.876 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-14T11:25:53.883 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:25:53.899 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-14T11:25:53.899 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:25:53.899 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:25:53.900 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:25:53.900 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:25:53.900 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 16/334 kB Progress (3): 16/55 kB | 16/334 kB | 16/27 kB Progress (3): 33/55 kB | 16/334 kB | 16/27 kB Progress (3): 33/55 kB | 16/334 kB | 27 kB Progress (3): 33/55 kB | 33/334 kB | 27 kB Progress (3): 49/55 kB | 33/334 kB | 27 kB Progress (3): 55 kB | 33/334 kB | 27 kB Progress (3): 55 kB | 49/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:25:53.916 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T11:25:53.917 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 65/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:25:53.918 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 82/334 kB Progress (2): 82/334 kB | 16/122 kB Progress (2): 98/334 kB | 16/122 kB Progress (2): 98/334 kB | 33/122 kB Progress (2): 114/334 kB | 33/122 kB Progress (2): 114/334 kB | 49/122 kB Progress (2): 131/334 kB | 49/122 kB Progress (2): 131/334 kB | 66/122 kB Progress (2): 147/334 kB | 66/122 kB Progress (2): 147/334 kB | 82/122 kB Progress (2): 164/334 kB | 82/122 kB Progress (2): 164/334 kB | 98/122 kB Progress (2): 180/334 kB | 98/122 kB Progress (2): 180/334 kB | 115/122 kB Progress (2): 196/334 kB | 115/122 kB Progress (2): 196/334 kB | 122 kB Progress (2): 213/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-14T11:25:53.918 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-14T11:25:53.928 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (2): 98/267 kB | 4.7 kB Progress (2): 114/267 kB | 4.7 kB Progress (2): 130/267 kB | 4.7 kB Progress (3): 130/267 kB | 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-14T11:25:53.928 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 130/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Progress (2): 163/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-14T11:25:53.929 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 179/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 261/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.9 MB/s) 2024-09-14T11:25:53.985 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:25:53.987 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:25:54.555 INFO:tasks.workunit.client.0.smithi130.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:54.556 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:54.556 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:54.558 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:54.558 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:54.558 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:54.562 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:25:54.562 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:25:54.717 INFO:tasks.workunit.client.0.smithi130.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:25:54.717 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:54.717 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:54.720 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:25:54.735 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:25:54.738 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:25:54.753 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:25:54.756 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:25:54.771 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:25:54.774 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:25:54.789 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:25:54.792 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:25:54.806 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:25:54.810 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:25:54.824 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:25:54.827 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:25:54.842 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:25:54.845 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:25:54.859 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-14T11:25:54.861 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:25:54.875 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:25:54.878 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:25:54.892 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-14T11:25:54.895 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:25:54.909 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-14T11:25:54.912 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:25:54.928 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-14T11:25:54.930 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:25:54.944 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-14T11:25:54.946 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:25:54.961 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-14T11:25:54.963 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:25:54.977 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:54.981 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:25:54.995 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:25:54.997 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:25:55.012 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.8 MB/s) 2024-09-14T11:25:55.014 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:25:55.028 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:25:55.031 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:25:55.046 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-14T11:25:55.049 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:25:55.063 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:25:55.066 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:25:55.080 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 118 kB/s) 2024-09-14T11:25:55.081 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:25:55.095 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:25:55.097 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:25:55.111 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:25:55.112 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:25:55.127 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:25:55.128 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:25:55.142 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-14T11:25:55.144 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:25:55.158 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-14T11:25:55.159 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:25:55.173 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-14T11:25:55.174 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:25:55.188 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:25:55.190 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:25:55.204 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 159 kB/s) 2024-09-14T11:25:55.206 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:25:55.221 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:25:55.224 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:25:55.238 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T11:25:55.241 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:25:55.255 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T11:25:55.257 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:25:55.271 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:55.273 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:25:55.288 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:25:55.289 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:25:55.304 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-14T11:25:55.306 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:25:55.320 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:25:55.321 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:25:55.336 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-14T11:25:55.339 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:25:55.353 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:25:55.354 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:25:55.368 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:25:55.371 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:25:55.385 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:25:55.386 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:25:55.400 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:25:55.402 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:25:55.416 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:25:55.418 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:25:55.432 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:25:55.434 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:25:55.448 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:25:55.451 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:25:55.465 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-14T11:25:55.467 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:25:55.481 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 267 kB/s) 2024-09-14T11:25:55.483 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:25:55.498 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:25:55.499 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:25:55.513 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:25:55.515 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:25:55.540 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 721 kB/s) 2024-09-14T11:25:55.542 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:25:55.556 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 28 kB/s) 2024-09-14T11:25:55.557 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:25:55.572 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-14T11:25:55.573 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:25:55.587 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-14T11:25:55.588 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:25:55.601 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-14T11:25:55.604 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:25:55.617 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T11:25:55.620 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:25:55.634 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-14T11:25:55.635 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:25:55.650 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T11:25:55.653 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:25:55.668 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:25:55.670 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:25:55.685 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T11:25:55.687 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:25:55.701 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T11:25:55.702 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:25:55.716 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 246 kB/s) 2024-09-14T11:25:55.717 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:25:55.732 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-14T11:25:55.735 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:25:55.749 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T11:25:55.753 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:25:55.771 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:25:55.772 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:25:55.772 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:25:55.772 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:25:55.773 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:25:55.773 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:25:55.786 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/26 kB Progress (3): 14 kB | 16/26 kB | 16/171 kB Progress (3): 14 kB | 26 kB | 16/171 kB Progress (4): 14 kB | 26 kB | 16/171 kB | 16/118 kB Progress (5): 14 kB | 26 kB | 16/171 kB | 16/118 kB | 8.2 kB Progress (5): 14 kB | 26 kB | 33/171 kB | 16/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-14T11:25:55.789 INFO:tasks.workunit.client.0.smithi130.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.8 MB/s) 2024-09-14T11:25:55.789 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:25:55.789 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 33/171 kB | 33/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:25:55.789 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 49/171 kB | 33/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 584 kB/s) 2024-09-14T11:25:55.789 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:25:55.790 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 49/171 kB | 49/118 kB Progress (2): 66/171 kB | 49/118 kB Progress (2): 66/171 kB | 66/118 kB Progress (2): 82/171 kB | 66/118 kB Progress (2): 82/171 kB | 82/118 kB Progress (2): 98/171 kB | 82/118 kB Progress (2): 98/171 kB | 98/118 kB Progress (2): 115/171 kB | 98/118 kB Progress (2): 115/171 kB | 115/118 kB Progress (2): 115/171 kB | 118 kB Progress (2): 131/171 kB | 118 kB Progress (2): 147/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T11:25:55.790 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 164/171 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:25:55.790 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T11:25:55.790 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:25:55.804 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (3): 33/136 kB | 16/61 kB | 16/146 kB Progress (3): 49/136 kB | 16/61 kB | 16/146 kB Progress (3): 49/136 kB | 33/61 kB | 16/146 kB Progress (3): 66/136 kB | 33/61 kB | 16/146 kB Progress (3): 66/136 kB | 33/61 kB | 33/146 kB Progress (3): 66/136 kB | 49/61 kB | 33/146 kB Progress (3): 82/136 kB | 49/61 kB | 33/146 kB Progress (3): 82/136 kB | 61 kB | 33/146 kB Progress (3): 82/136 kB | 61 kB | 49/146 kB Progress (3): 98/136 kB | 61 kB | 49/146 kB Progress (3): 115/136 kB | 61 kB | 49/146 kB Progress (3): 115/136 kB | 61 kB | 66/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.1 MB/s) 2024-09-14T11:25:55.804 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 131/136 kB | 66/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:25:55.804 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 136 kB | 66/146 kB Progress (2): 136 kB | 82/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.5 MB/s) 2024-09-14T11:25:55.804 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:25:55.804 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 98/146 kB Progress (1): 115/146 kB Progress (1): 131/146 kB Progress (2): 131/146 kB | 16/501 kB Progress (2): 146 kB | 16/501 kB Progress (2): 146 kB | 32/501 kB Progress (3): 146 kB | 32/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-14T11:25:55.805 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 49/501 kB | 16/58 kB Progress (2): 49/501 kB | 33/58 kB Progress (2): 65/501 kB | 33/58 kB Progress (2): 65/501 kB | 49/58 kB Progress (2): 77/501 kB | 49/58 kB Progress (2): 77/501 kB | 58 kB Progress (2): 93/501 kB | 58 kB Progress (2): 110/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.8 MB/s) 2024-09-14T11:25:55.809 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 126/501 kB Progress (1): 143/501 kB Progress (1): 159/501 kB Progress (1): 175/501 kB Progress (1): 192/501 kB Progress (1): 208/501 kB Progress (1): 224/501 kB Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 290/501 kB Progress (1): 306/501 kB Progress (1): 323/501 kB Progress (1): 339/501 kB Progress (1): 356/501 kB Progress (1): 372/501 kB Progress (1): 388/501 kB Progress (1): 405/501 kB Progress (1): 421/501 kB Progress (1): 437/501 kB Progress (1): 454/501 kB Progress (1): 470/501 kB Progress (1): 487/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 14 MB/s) 2024-09-14T11:25:55.817 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-14T11:25:55.873 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 24 MB/s) 2024-09-14T11:25:55.938 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:55.938 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:25:55.941 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:25:55.955 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-14T11:25:55.957 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:25:55.971 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-14T11:25:55.972 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:25:55.987 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-14T11:25:55.989 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:25:56.004 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T11:25:56.007 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:25:56.021 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T11:25:56.024 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:25:56.038 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-14T11:25:56.041 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:25:56.055 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:25:56.058 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:25:56.072 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:25:56.074 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:25:56.089 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:25:56.093 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:25:56.107 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:25:56.109 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:25:56.123 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:25:56.125 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:25:56.139 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 632 kB/s) 2024-09-14T11:25:56.141 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:25:56.155 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-14T11:25:56.161 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:25:56.175 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:25:56.176 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:25:56.176 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:25:56.176 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:25:56.176 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:25:56.177 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:25:56.194 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (3): 16/79 kB | 16/26 kB | 16/211 kB Progress (3): 32/79 kB | 16/26 kB | 16/211 kB Progress (3): 32/79 kB | 26 kB | 16/211 kB Progress (3): 32/79 kB | 26 kB | 33/211 kB Progress (3): 49/79 kB | 26 kB | 33/211 kB Progress (3): 65/79 kB | 26 kB | 33/211 kB Progress (3): 65/79 kB | 26 kB | 49/211 kB Progress (4): 65/79 kB | 26 kB | 49/211 kB | 0/1.0 MB Progress (4): 79 kB | 26 kB | 49/211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-14T11:25:56.194 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:25:56.194 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 79 kB | 62/211 kB | 0/1.0 MB Progress (4): 79 kB | 62/211 kB | 0/1.0 MB | 16/58 kB Progress (4): 79 kB | 62/211 kB | 0/1.0 MB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-14T11:25:56.194 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:25:56.195 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (3): 78/211 kB | 0/1.0 MB | 16/58 kB Progress (3): 78/211 kB | 0/1.0 MB | 33/58 kB Progress (3): 78/211 kB | 0/1.0 MB | 33/58 kB Progress (3): 95/211 kB | 0/1.0 MB | 33/58 kB Progress (3): 95/211 kB | 0/1.0 MB | 49/58 kB Progress (3): 95/211 kB | 0.1/1.0 MB | 49/58 kB Progress (3): 111/211 kB | 0.1/1.0 MB | 49/58 kB Progress (3): 111/211 kB | 0.1/1.0 MB | 58 kB Progress (3): 127/211 kB | 0.1/1.0 MB | 58 kB Progress (3): 127/211 kB | 0.1/1.0 MB | 58 kB Progress (3): 144/211 kB | 0.1/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-14T11:25:56.195 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 144/211 kB | 0.1/1.0 MB Progress (2): 160/211 kB | 0.1/1.0 MB Progress (2): 176/211 kB | 0.1/1.0 MB Progress (2): 176/211 kB | 0.1/1.0 MB Progress (2): 193/211 kB | 0.1/1.0 MB Progress (2): 209/211 kB | 0.1/1.0 MB Progress (2): 209/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-14T11:25:56.208 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (3): 0.7/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 16/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 33/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 33/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 49/116 kB | 49/267 kB Progress (3): 0.7/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 49/267 kB Progress (3): 0.8/1.0 MB | 66/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 82/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 66/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 82/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 82/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 82/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 82/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 98/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 98/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 115/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-14T11:25:56.210 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 131/267 kB Progress (2): 0.8/1.0 MB | 147/267 kB Progress (2): 0.8/1.0 MB | 147/267 kB Progress (2): 0.8/1.0 MB | 164/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 180/267 kB Progress (2): 0.8/1.0 MB | 197/267 kB Progress (2): 0.9/1.0 MB | 197/267 kB Progress (2): 0.9/1.0 MB | 213/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 229/267 kB Progress (2): 0.9/1.0 MB | 246/267 kB Progress (2): 0.9/1.0 MB | 246/267 kB Progress (2): 0.9/1.0 MB | 256/267 kB Progress (2): 0.9/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-14T11:25:56.213 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 28 MB/s) 2024-09-14T11:25:56.354 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:25:56.378 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:56.378 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:25:56.378 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:56.379 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Total time: 6.051 s 2024-09-14T11:25:56.379 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Finished at: 2024-09-14T11:25:56Z 2024-09-14T11:25:56.379 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:25:56.402 INFO:tasks.workunit.client.0.smithi130.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:25:56.411 INFO:tasks.workunit.client.0.smithi130.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:25:57.401 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Scanning for projects... 2024-09-14T11:25:57.482 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.482 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:25:57.482 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:25:57.482 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] from pom.xml 2024-09-14T11:25:57.482 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:25:57.796 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.796 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:25:57.879 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:25:57.880 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.880 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:25:57.964 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:57.964 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.964 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:25:57.966 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:25:57.966 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.966 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:25:57.970 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:25:57.970 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:57.970 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:25:58.146 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:25:58.337 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:25:58.526 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:25:58.537 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:25:58.551 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T11:25:58.557 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:25:58.573 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:25:58.577 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:25:58.593 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:25:58.596 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:25:58.612 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:25:58.616 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:25:58.631 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:25:58.634 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:25:58.650 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:25:58.657 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:25:58.680 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-14T11:25:58.682 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:25:58.682 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:25:58.683 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:25:58.683 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:25:58.684 INFO:tasks.workunit.client.0.smithi130.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:25:58.722 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 16/189 kB Progress (1): 33/189 kB Progress (1): 49/189 kB Progress (1): 66/189 kB Progress (1): 82/189 kB Progress (1): 98/189 kB Progress (1): 115/189 kB Progress (1): 131/189 kB Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.7 MB/s) 2024-09-14T11:25:58.730 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 1.4/18 kB Progress (2): 4.1/7.7 kB | 2.8/18 kB Progress (2): 5.5/7.7 kB | 2.8/18 kB Progress (2): 5.5/7.7 kB | 4.1/18 kB Progress (2): 6.9/7.7 kB | 4.1/18 kB Progress (2): 6.9/7.7 kB | 5.5/18 kB Progress (2): 7.7 kB | 5.5/18 kB Progress (2): 7.7 kB | 6.9/18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 159 kB/s) 2024-09-14T11:25:58.733 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 8.3/18 kB Progress (1): 9.7/18 kB Progress (2): 9.7/18 kB | 16/103 kB Progress (2): 11/18 kB | 16/103 kB Progress (2): 12/18 kB | 16/103 kB Progress (3): 12/18 kB | 16/103 kB | 16/169 kB Progress (3): 14/18 kB | 16/103 kB | 16/169 kB Progress (3): 15/18 kB | 16/103 kB | 16/169 kB Progress (3): 17/18 kB | 16/103 kB | 16/169 kB Progress (3): 18 kB | 16/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 331 kB/s) 2024-09-14T11:25:58.756 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (2): 33/103 kB | 16/169 kB Progress (2): 33/103 kB | 33/169 kB Progress (2): 49/103 kB | 33/169 kB Progress (2): 49/103 kB | 49/169 kB Progress (2): 66/103 kB | 49/169 kB Progress (2): 66/103 kB | 66/169 kB Progress (2): 66/103 kB | 82/169 kB Progress (2): 82/103 kB | 82/169 kB Progress (2): 82/103 kB | 98/169 kB Progress (2): 98/103 kB | 98/169 kB Progress (2): 103 kB | 98/169 kB Progress (2): 103 kB | 115/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-09-14T11:25:58.765 INFO:tasks.workunit.client.0.smithi130.stdout:Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-14T11:25:58.778 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:25:58.778 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:25:58.778 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] T E S T S 2024-09-14T11:25:58.779 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:25:59.267 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:25:59.357 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjects.java: starting test run: 2024-09-14T11:25:59.357 INFO:tasks.workunit.client.0.smithi130.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:25:59.357 INFO:tasks.workunit.client.0.smithi130.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:25:59.357 INFO:tasks.workunit.client.0.smithi130.stdout: EndpointUrl=https://smithi130.front.sepia.ceph.com:443 2024-09-14T11:25:59.357 INFO:tasks.workunit.client.0.smithi130.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:25:59.454 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Environment Variables Read 2024-09-14T11:25:59.755 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:25:59.756 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.756 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.756 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.756 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.756 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.856 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.856 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generating File 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: File Generated 2024-09-14T11:25:59.857 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Generated Big Files 2024-09-14T11:26:00.055 INFO:tasks.workunit.client.0.smithi130.stdout:HeadBucketResponse() 2024-09-14T11:26:00.056 INFO:tasks.workunit.client.0.smithi130.stdout:sheik is ready 2024-09-14T11:26:00.056 INFO:tasks.workunit.client.0.smithi130.stdout:DEBUG: Test Bucket Created 2024-09-14T11:26:00.155 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:26:00.247 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:26:00.255 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:26:00.337 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:26:00.355 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:26:00.456 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:26:00.514 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:26:00.556 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:26:00.656 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:26:00.756 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:26:02.459 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:26:02.759 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:26:04.610 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-0b 2024-09-14T11:26:04.611 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-8b 2024-09-14T11:26:04.612 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-200b 2024-09-14T11:26:04.613 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-21983b 2024-09-14T11:26:04.614 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-5519b 2024-09-14T11:26:04.615 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-204329b 2024-09-14T11:26:04.616 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-256k 2024-09-14T11:26:04.617 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-1m 2024-09-14T11:26:04.618 INFO:tasks.workunit.client.0.smithi130.stdout:arg: file-1038757b 2024-09-14T11:26:04.651 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:26:04.651 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.662 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:26:04.662 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.761 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:26:04.762 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.818 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:26:04.818 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.862 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:26:04.862 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.937 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:26:04.937 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.969 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:26:04.969 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:04.969 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:26:05.006 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:05.063 INFO:tasks.workunit.client.0.smithi130.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:26:05.063 INFO:tasks.workunit.client.0.smithi130.stdout:PutObjectResponse 2024-09-14T11:26:05.162 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:26:05.463 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:26:05.964 INFO:tasks.workunit.client.0.smithi130.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:26:09.942 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.67 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:26:09.953 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:26:09.953 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Results: 2024-09-14T11:26:09.953 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:26:09.953 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:26:09.953 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] 2024-09-14T11:26:09.955 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:09.955 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:26:09.955 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:09.957 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Total time: 12.576 s 2024-09-14T11:26:09.957 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] Finished at: 2024-09-14T11:26:09Z 2024-09-14T11:26:09.957 INFO:tasks.workunit.client.0.smithi130.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:26:09.972 INFO:tasks.workunit.client.0.smithi130.stderr:+ exit 2024-09-14T11:26:09.972 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:26:09.972 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:26:10.051 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:26:10.051 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:26:10.420 DEBUG:teuthology.parallel:result is None 2024-09-14T11:26:10.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:10.458 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:10.458 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:10.527 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:26:10.527 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:26:10.540 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:10.540 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:26:10.540 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:10.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:26:10.596 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:26:10.596 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:10.665 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:26:10.666 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:26:10.734 INFO:tasks.workunit:timeout=3h 2024-09-14T11:26:10.734 INFO:tasks.workunit:cleanup=True 2024-09-14T11:26:10.734 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:26:10.803 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.379 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:27:07.380 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:27:07.382 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:27:07.450 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:27:07.452 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:07.452 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:27:07.499 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:27:07.548 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:27:07.587 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:27:07.589 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:07.589 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:27:07.627 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:27:07.631 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:27:07.631 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:27:07.701 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:27:07.702 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:27:07.702 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:27:07.777 INFO:tasks.workunit.client.0.smithi130.stdout:INFO: fully qualified domain name: smithi130.front.sepia.ceph.com 2024-09-14T11:27:07.777 INFO:tasks.workunit.client.0.smithi130.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:27:07.777 INFO:tasks.workunit.client.0.smithi130.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:27:10.271 INFO:tasks.workunit.client.0.smithi130.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:27:10.455 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting pip 2024-09-14T11:27:10.460 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:27:10.504 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: pip 2024-09-14T11:27:10.504 INFO:tasks.workunit.client.0.smithi130.stdout: Attempting uninstall: pip 2024-09-14T11:27:10.505 INFO:tasks.workunit.client.0.smithi130.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:27:10.655 INFO:tasks.workunit.client.0.smithi130.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:27:10.660 INFO:tasks.workunit.client.0.smithi130.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:27:11.397 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed pip-24.2 2024-09-14T11:27:12.213 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting boto3 2024-09-14T11:27:12.214 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:27:12.809 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:27:12.810 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:27:12.866 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:27:12.867 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:27:12.920 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:27:12.922 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:27:12.972 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:12.973 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:27:13.049 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:13.050 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:27:13.294 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:27:13.295 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:27:13.300 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:27:13.301 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:27:13.310 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:27:13.312 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:27:13.313 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:27:13.315 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:27:13.316 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:27:13.388 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:27:14.383 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:27:14.822 INFO:tasks.workunit.client.0.smithi130.stdout:INFO: creating user 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout:{ 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "user_id": "testid", 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "display_name": "M. Tester", 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "email": "tester@ceph.com", 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "suspended": 0, 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "subusers": [], 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "keys": [ 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: { 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "user": "testid", 2024-09-14T11:27:15.136 INFO:tasks.workunit.client.0.smithi130.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "active": true, 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:27:15.132169Z" 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: } 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: ], 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "swift_keys": [], 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "caps": [], 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "default_placement": "", 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "placement_tags": [], 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "bucket_quota": { 2024-09-14T11:27:15.137 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "user_quota": { 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "enabled": false, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: }, 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:27:15.138 INFO:tasks.workunit.client.0.smithi130.stdout: "type": "rgw", 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "account_id": "", 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "path": "/", 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "create_date": "2024-09-14T11:27:15.132159Z", 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "tags": [], 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: "group_ids": [] 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout:} 2024-09-14T11:27:15.139 INFO:tasks.workunit.client.0.smithi130.stdout: 2024-09-14T11:27:22.160 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.160 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.177 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.177 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.205 INFO:tasks.workunit.client.0.smithi130.stderr:5+0 records in 2024-09-14T11:27:22.205 INFO:tasks.workunit.client.0.smithi130.stderr:5+0 records out 2024-09-14T11:27:22.206 INFO:tasks.workunit.client.0.smithi130.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0148108 s, 354 MB/s 2024-09-14T11:27:22.206 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.206 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.259 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.259 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.318 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.318 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.382 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.382 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.441 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.441 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.501 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.501 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.562 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.562 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.620 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.620 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.677 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.677 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.732 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.732 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.792 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.792 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.850 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.850 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.909 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.910 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:22.966 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:22.966 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:23.017 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:27:23.018 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:bucket nams is reupload-bkt-101514 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:endpoint is https://smithi130.front.sepia.ceph.com:443 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:start UploadId=2~-JmTf6F-fBFm2RD-3BeDvM61EltAtyT 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:phase 1 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:phase 1 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 2} 2024-09-14T11:27:23.027 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:phase 2 uploaded part {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1} 2024-09-14T11:27:23.028 INFO:tasks.workunit.client.0.smithi130.stdout:aborting multipart upload, parts=[{'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 1}, {'ETag': '"eb71c4f9f6f9a1b4d126300112fc3325"', 'PartNumber': 2}] 2024-09-14T11:27:24.018 INFO:tasks.workunit.client.0.smithi130.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:27:24.077 INFO:tasks.workunit.client.0.smithi130.stdout:rados ls: 2024-09-14T11:27:24.081 INFO:tasks.workunit.client.0.smithi130.stdout:== PASSED == 2024-09-14T11:27:24.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:27:24.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:27:24.160 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:27:24.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:27:24.533 DEBUG:teuthology.parallel:result is None 2024-09-14T11:27:24.533 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:24.571 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:24.572 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:24.640 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:24.640 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:27:24.654 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:27:24.654 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:27:24.655 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:27:24.655 DEBUG:teuthology.orchestra.run.smithi130:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:24.709 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:27:24.736 INFO:teuthology.orchestra.run.smithi130.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:27:24.737 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:27:24.738 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:27:24.738 DEBUG:teuthology.orchestra.run.smithi130:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:24.807 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:27:24.972 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:27:24.973 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:27:24.973 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key NXPILALFIQAUNVQQNWME --secret kOxqeqD/e3Ptwc/Pi5rIX91LuGSk2Fm4O9yfbQq3A1UemMFuQXej5A== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:27:25.080 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:25.080 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:25.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.115+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.116+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.116+0000 7f5242740800 20 realm 2024-09-14T11:27:25.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.116+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.117+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.117+0000 7f5242740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.117+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.117+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.117+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.118+0000 7f5242740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:25.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.118+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.119+0000 7f5242740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:25.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.119+0000 7f5242740800 20 searching for the correct realm 2024-09-14T11:27:25.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.121+0000 7f5237fff640 0 -- 172.21.15.130:0/3059895222 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f523002c070 msgr2=0x7f5230077020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:25.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.125+0000 7f523e4c0640 0 -- 172.21.15.130:0/3059895222 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f5238017070 msgr2=0x7f523806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.332 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:25.332 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.332+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 zone default found 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 4 Realm: () 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 zonegroup default 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.333+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.334+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.334+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.334+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.334+0000 7f5242740800 20 started sync module instance, tier type = 2024-09-14T11:27:25.334 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.334+0000 7f5242740800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:27:25.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=0 2024-09-14T11:27:25.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=1 2024-09-14T11:27:25.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=2 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=3 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=4 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=5 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.344+0000 7f5242740800 20 add_watcher() i=6 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.345+0000 7f5242740800 20 add_watcher() i=7 2024-09-14T11:27:25.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.345+0000 7f5242740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.346+0000 7f50f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.346+0000 7f5242740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.346+0000 7f5242740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 5 note: GC not initialized 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f506f7fe640 20 reqs_thread_entry: start 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 20 init_complete bucket index max shards: 11 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 20 Filter name: none 2024-09-14T11:27:25.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f506d7fa640 20 reqs_thread_entry: start 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:27:25.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.347+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 cache get: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME : miss 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME info.flags=0x0 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 adding default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME to cache LRU end 2024-09-14T11:27:25.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 cache get: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME : hit (negative entry) 2024-09-14T11:27:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.348+0000 7f5242740800 10 cache get: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME : hit (negative entry) 2024-09-14T11:27:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:27:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5242740800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:25.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5242740800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5121ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758614 cookie 93834893933728 notifier 5949 bl.length()=675 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5121ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.350+0000 7f5121ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5242740800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:25.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5242740800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5121ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 93834893924784 notifier 5949 bl.length()=202 2024-09-14T11:27:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5121ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:25.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.352+0000 7f5121ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:27:25.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5242740800 10 cache put: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME info.flags=0x7 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5242740800 10 moving default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME to cache LRU end 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5242740800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:NXPILALFIQAUNVQQNWME, ofs0, ns] 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5121ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758644 cookie 93834893923216 notifier 5949 bl.length()=190 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5121ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME info.flags=0x7 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.354+0000 7f5121ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NXPILALFIQAUNVQQNWME to cache LRU end 2024-09-14T11:27:25.353 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "ragweed.client.0", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "NXPILALFIQAUNVQQNWME", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "kOxqeqD/e3Ptwc/Pi5rIX91LuGSk2Fm4O9yfbQq3A1UemMFuQXej5A==", 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:27:25.354 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:27:25.349728Z" 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:25.355 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:27:25.356 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:27:25.349718Z", 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.356+0000 7f50f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:25.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.358+0000 7f5242740800 20 remove_watcher() i=0 2024-09-14T11:27:25.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.358+0000 7f5242740800 2 removed watcher, disabling cache 2024-09-14T11:27:25.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.359+0000 7f5242740800 20 remove_watcher() i=1 2024-09-14T11:27:25.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.361+0000 7f5242740800 20 remove_watcher() i=2 2024-09-14T11:27:25.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.362+0000 7f5242740800 20 remove_watcher() i=3 2024-09-14T11:27:25.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.363+0000 7f5242740800 20 remove_watcher() i=4 2024-09-14T11:27:25.362 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.364+0000 7f5242740800 20 remove_watcher() i=5 2024-09-14T11:27:25.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.365+0000 7f5242740800 20 remove_watcher() i=6 2024-09-14T11:27:25.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.366+0000 7f5242740800 20 remove_watcher() i=7 2024-09-14T11:27:25.375 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:27:25.376 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ESSRCHIMVODQIUEAJTGK --secret H9MJb28uM+0GbIswNX6WrsHfZNGLhxyJiCOZl0shAQDhca+UCo8FDA== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:27:25.442 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:25.442 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:25.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.477+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.478+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.478+0000 7fd55a52e800 20 realm 2024-09-14T11:27:25.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.478+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.479+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.479+0000 7fd55a52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.479+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.479+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.479+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.480+0000 7fd55a52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:25.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.480+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:25.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.481+0000 7fd55a52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:25.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.481+0000 7fd55a52e800 20 searching for the correct realm 2024-09-14T11:27:25.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:25.683+0000 7fd555963640 0 -- 172.21.15.130:0/982950476 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd54805e890 msgr2=0x7fd548061c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:26.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.089+0000 7fd556164640 0 -- 172.21.15.130:0/982950476 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd55007c8f0 msgr2=0x7fd55006e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:26.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:26.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:26.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:27:26.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:26.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:26.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:27:26.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.296+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:26.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:26.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 zone default found 2024-09-14T11:27:26.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 4 Realm: () 2024-09-14T11:27:26.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:27:26.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:27:26.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:26.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 zonegroup default 2024-09-14T11:27:26.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.297+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.298+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.298+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.298+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.298+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.299+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.299+0000 7fd55a52e800 20 started sync module instance, tier type = 2024-09-14T11:27:26.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.299+0000 7fd55a52e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:27:26.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=0 2024-09-14T11:27:26.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=1 2024-09-14T11:27:26.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=2 2024-09-14T11:27:26.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=3 2024-09-14T11:27:26.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=4 2024-09-14T11:27:26.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=5 2024-09-14T11:27:26.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.310+0000 7fd55a52e800 20 add_watcher() i=6 2024-09-14T11:27:26.311 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.311+0000 7fd55a52e800 20 add_watcher() i=7 2024-09-14T11:27:26.311 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.311+0000 7fd55a52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:26.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd40cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:26.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd55a52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:26.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd55a52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd55a52e800 5 note: GC not initialized 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd3877fe640 20 reqs_thread_entry: start 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.313+0000 7fd55a52e800 20 init_complete bucket index max shards: 11 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 20 Filter name: none 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd3857fa640 20 reqs_thread_entry: start 2024-09-14T11:27:26.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:27:26.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.314+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 cache get: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK : miss 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 20 rados->read ofs=0 len=0 2024-09-14T11:27:26.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:26.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK info.flags=0x0 2024-09-14T11:27:26.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 adding default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK to cache LRU end 2024-09-14T11:27:26.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 cache get: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK : hit (negative entry) 2024-09-14T11:27:26.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.315+0000 7fd55a52e800 10 cache get: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK : hit (negative entry) 2024-09-14T11:27:26.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.316+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:27:26.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.317+0000 7fd55a52e800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:26.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.317+0000 7fd55a52e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:27:26.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.317+0000 7fd4397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758603 cookie 94348384639104 notifier 5645 bl.length()=675 2024-09-14T11:27:26.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.317+0000 7fd4397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:27:26.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.317+0000 7fd4397fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:26.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:26.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd55a52e800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:26.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd55a52e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:26.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd4397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758615 cookie 94348384636256 notifier 5645 bl.length()=202 2024-09-14T11:27:26.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd4397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:27:26.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.319+0000 7fd4397fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:27:26.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.321+0000 7fd55a52e800 10 cache put: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK info.flags=0x7 2024-09-14T11:27:26.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.321+0000 7fd55a52e800 10 moving default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK to cache LRU end 2024-09-14T11:27:26.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.321+0000 7fd55a52e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ESSRCHIMVODQIUEAJTGK, ofs0, ns] 2024-09-14T11:27:26.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.322+0000 7fd439ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758609 cookie 94348384649552 notifier 5645 bl.length()=190 2024-09-14T11:27:26.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.322+0000 7fd439ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK info.flags=0x7 2024-09-14T11:27:26.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.322+0000 7fd439ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ESSRCHIMVODQIUEAJTGK to cache LRU end 2024-09-14T11:27:26.325 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:27:26.326 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "sysuser.client.0", 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "ESSRCHIMVODQIUEAJTGK", 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "H9MJb28uM+0GbIswNX6WrsHfZNGLhxyJiCOZl0shAQDhca+UCo8FDA==", 2024-09-14T11:27:26.327 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:27:26.316458Z" 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:27:26.328 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "system": true, 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:27:26.329 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:27:26.330 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:27:26.331 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:27:26.331 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:27:26.331 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:27:26.331 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:27:26.331 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:27:26.332 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:27:26.333 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:27:26.316439Z", 2024-09-14T11:27:26.333 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:27:26.333 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:27:26.333 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:27:26.333 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:27:26.335 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.323+0000 7fd40cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:26.335 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.326+0000 7fd55a52e800 20 remove_watcher() i=0 2024-09-14T11:27:26.335 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.326+0000 7fd55a52e800 2 removed watcher, disabling cache 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.327+0000 7fd55a52e800 20 remove_watcher() i=1 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.328+0000 7fd55a52e800 20 remove_watcher() i=2 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.330+0000 7fd55a52e800 20 remove_watcher() i=3 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.331+0000 7fd55a52e800 20 remove_watcher() i=4 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.332+0000 7fd55a52e800 20 remove_watcher() i=5 2024-09-14T11:27:26.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.333+0000 7fd55a52e800 20 remove_watcher() i=6 2024-09-14T11:27:26.337 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:26.334+0000 7fd55a52e800 20 remove_watcher() i=7 2024-09-14T11:27:26.346 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:27:26.346 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:27:26.347 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:27:26.379 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:27:26.379 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:27:26.379 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:27:26.450 DEBUG:teuthology.orchestra.run.smithi130:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:27:26.715 INFO:teuthology.orchestra.run.smithi130.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:27:26.892 INFO:teuthology.orchestra.run.smithi130.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:27:27.447 INFO:teuthology.orchestra.run.smithi130.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:27:33.525 INFO:teuthology.orchestra.run.smithi130.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:27:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d37f48918e1481924dd9d1073ae93d9198e64aeecf77f544498b33b3d99c497d,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:27:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:py run-test-pre: PYTHONHASHSEED='4241628020' 2024-09-14T11:27:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:27:37.122 INFO:teuthology.orchestra.run.smithi130.stdout:============================= test session starts ============================== 2024-09-14T11:27:37.123 INFO:teuthology.orchestra.run.smithi130.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:27:37.123 INFO:teuthology.orchestra.run.smithi130.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:27:37.123 INFO:teuthology.orchestra.run.smithi130.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:37.123 INFO:teuthology.orchestra.run.smithi130.stdout:configfile: pytest.ini 2024-09-14T11:27:37.224 INFO:teuthology.orchestra.run.smithi130.stdout:collecting ... collected 9 items 2024-09-14T11:27:37.224 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:27:39.087 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:27:39.910 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:27:40.683 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:27:41.471 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:27:42.274 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:27:48.578 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:27:50.149 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:27:52.129 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:27:55.414 INFO:teuthology.orchestra.run.smithi130.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout:=============================== warnings summary =============================== 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout: import imp 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:27:55.415 INFO:teuthology.orchestra.run.smithi130.stdout:======================== 9 passed, 1 warning in 18.29s ========================= 2024-09-14T11:27:55.447 INFO:teuthology.orchestra.run.smithi130.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:27:55.447 INFO:teuthology.orchestra.run.smithi130.stdout: py: commands succeeded 2024-09-14T11:27:55.447 INFO:teuthology.orchestra.run.smithi130.stdout: congratulations :) 2024-09-14T11:27:55.465 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:27:55.465 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:27:55.494 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:27:55.590 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:55.590 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:55.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.624+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 realm 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:55.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.626+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.627+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:55.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.627+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.628+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:55.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.628+0000 7f8f54f2c800 20 searching for the correct realm 2024-09-14T11:27:55.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.630+0000 7f8f51362640 0 -- 172.21.15.130:0/2306999752 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8f38089bc0 msgr2=0x7f8f38056670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:27:55.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.835+0000 7f8f51362640 0 -- 172.21.15.130:0/2306999752 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8f38089bc0 msgr2=0x7f8f38056670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:27:55.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.839+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 zone default found 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 4 Realm: () 2024-09-14T11:27:55.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 zonegroup default 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.840+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.841+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.841+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.841+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.841+0000 7f8f54f2c800 20 started sync module instance, tier type = 2024-09-14T11:27:55.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.841+0000 7f8f54f2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:27:55.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=0 2024-09-14T11:27:55.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=1 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=2 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=3 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=4 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=5 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.850+0000 7f8f54f2c800 20 add_watcher() i=6 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.851+0000 7f8f54f2c800 20 add_watcher() i=7 2024-09-14T11:27:55.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.851+0000 7f8f54f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:55.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.852+0000 7f8e06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:55.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.852+0000 7f8f54f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:55.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.852+0000 7f8f54f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:55.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.887+0000 7f8e05fe3640 20 reqs_thread_entry: start 2024-09-14T11:27:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:27:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 20 Filter name: none 2024-09-14T11:27:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8d777fe640 20 reqs_thread_entry: start 2024-09-14T11:27:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:27:55.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.888+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5 : miss 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:27:55.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5 info.flags=0x17 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5 to cache LRU end 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.889+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.890+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:27:55.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.891+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:27:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.891+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:27:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.891+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:27:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.891+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:27:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.891+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:27:55.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.892+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:27:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.893+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:27:55.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.893+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:27:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b3d401f628 s->prefetch_data=0 2024-09-14T11:27:55.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 10 manifest: total_size = 15980 2024-09-14T11:27:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.14740153464023769913 2024-09-14T11:27:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55b3d401f628 s->prefetch_data=0 2024-09-14T11:27:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401f628 2024-09-14T11:27:55.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.894+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.1 2024-09-14T11:27:55.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b3d401f5b8 s->prefetch_data=0 2024-09-14T11:27:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 10 manifest: total_size = 4889 2024-09-14T11:27:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.17904705557582428621 2024-09-14T11:27:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55b3d401f5b8 s->prefetch_data=0 2024-09-14T11:27:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401f5b8 2024-09-14T11:27:55.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.897+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.2 2024-09-14T11:27:55.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.898+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:27:55.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa9570 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b3d401f458 s->prefetch_data=0 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 10 manifest: total_size = 5043 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.6584032713915829704 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa9570 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55b3d401f458 s->prefetch_data=0 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401f458 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.900+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.2 2024-09-14T11:27:55.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.901+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:27:55.901 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.902+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b3d401f3c8 s->prefetch_data=0 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8f54f2c800 10 manifest: total_size = 5007 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.16478762757012560547 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806f610 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55b3d401f3c8 s->prefetch_data=0 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401f3c8 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.3 2024-09-14T11:27:55.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.903+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:27:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.905+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b3d401f3c8 s->prefetch_data=0 2024-09-14T11:27:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.906+0000 7f8f54f2c800 10 manifest: total_size = 5202 2024-09-14T11:27:55.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.906+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.9894582514110627455 2024-09-14T11:27:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.906+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55b3d401f3c8 s->prefetch_data=0 2024-09-14T11:27:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.906+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401f3c8 2024-09-14T11:27:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.906+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.4 2024-09-14T11:27:55.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.907+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:27:55.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.908+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fab8c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b3d3fa6fd8 s->prefetch_data=0 2024-09-14T11:27:55.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.909+0000 7f8f54f2c800 10 manifest: total_size = 4983 2024-09-14T11:27:55.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.909+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.1237872334511224114 2024-09-14T11:27:55.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.909+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fab8c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55b3d3fa6fd8 s->prefetch_data=0 2024-09-14T11:27:55.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.909+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa6fd8 2024-09-14T11:27:55.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.909+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.4 2024-09-14T11:27:55.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.910+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:27:55.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.911+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8f54f2c800 10 manifest: total_size = 4906 2024-09-14T11:27:55.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.1928404734491423580 2024-09-14T11:27:55.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5fc8 2024-09-14T11:27:55.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.5 2024-09-14T11:27:55.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.912+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:27:55.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.916+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.917+0000 7f8f54f2c800 10 manifest: total_size = 14228 2024-09-14T11:27:55.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.917+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.3830391957798647036 2024-09-14T11:27:55.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.917+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.917+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5fc8 2024-09-14T11:27:55.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.917+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.7 2024-09-14T11:27:55.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.918+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:27:55.917 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.919+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.919+0000 7f8f54f2c800 10 manifest: total_size = 5393 2024-09-14T11:27:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.919+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.15963583735580152488 2024-09-14T11:27:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.919+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55b3d3fa5fc8 s->prefetch_data=0 2024-09-14T11:27:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.920+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5fc8 2024-09-14T11:27:55.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.920+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.5.8 2024-09-14T11:27:55.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.920+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:27:55.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.922+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:55.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.922+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:55.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.923+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[a588039c-1457-497f-adbd-8890a12279b7.4508.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:55.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.925+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:27:55.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.925+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.925+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:27:55.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.925+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:27:55.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.925+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:27:55.925 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.926+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:27:55.925 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.926+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:27:55.925 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.927+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94230843623200 notifier 6006 bl.length()=162 2024-09-14T11:27:55.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.928+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5 from cache 2024-09-14T11:27:55.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.928+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:a588039c-1457-497f-adbd-8890a12279b7.4508.5, ofs0, ns] 2024-09-14T11:27:55.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.928+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94230843642736 notifier 6006 bl.length()=219 2024-09-14T11:27:55.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.931+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a588039c-1457-497f-adbd-8890a12279b7.4508.5 : miss 2024-09-14T11:27:55.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.931+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.931+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.931+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/a588039c-1457-497f-adbd-8890a12279b7.4508.5 info.flags=0x0 2024-09-14T11:27:55.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.931+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/a588039c-1457-497f-adbd-8890a12279b7.4508.5 to cache LRU end 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.933+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12 : miss 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.933+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12 info.flags=0x17 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12 to cache LRU end 2024-09-14T11:27:55.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:55.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.934+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12 2024-09-14T11:27:55.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.938+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:55.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.938+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b3d401ed98 s->prefetch_data=0 2024-09-14T11:27:55.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.939+0000 7f8f54f2c800 10 manifest: total_size = 18874368 2024-09-14T11:27:55.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.939+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.6721268573605664635 2024-09-14T11:27:55.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.939+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa47a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55b3d401ed98 s->prefetch_data=0 2024-09-14T11:27:55.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.939+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d401ed98 2024-09-14T11:27:55.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.939+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.12.10 2024-09-14T11:27:55.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:55.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:55.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.6721268573605664635 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.1 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.1_1 2024-09-14T11:27:55.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 590 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.2 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 836 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.2_1 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1080 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.3 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1326 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.3_1 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1570 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.4 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1816 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:55.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.941+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.6721268573605664635 2024-09-14T11:27:55.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.942+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.943+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[a588039c-1457-497f-adbd-8890a12279b7.4508.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.945+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.945+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.945+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.945+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:27:55.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.945+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:27:55.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.946+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:27:55.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.946+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:27:55.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.947+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 94230843627600 notifier 6006 bl.length()=191 2024-09-14T11:27:55.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.948+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12 from cache 2024-09-14T11:27:55.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.948+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.12, ofs0, ns] 2024-09-14T11:27:55.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.948+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 94230843633728 notifier 6006 bl.length()=249 2024-09-14T11:27:55.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.951+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.12 : miss 2024-09-14T11:27:55.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.951+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.951+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.951+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.12 info.flags=0x0 2024-09-14T11:27:55.950 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.951+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.12 to cache LRU end 2024-09-14T11:27:55.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13 : miss 2024-09-14T11:27:55.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13 info.flags=0x17 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13 to cache LRU end 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:55.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.953+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13 2024-09-14T11:27:55.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:55.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4809e4e0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b3d3ef4198 s->prefetch_data=0 2024-09-14T11:27:55.956 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 10 manifest: total_size = 26083 2024-09-14T11:27:55.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.18298258356801202082 2024-09-14T11:27:55.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4809e4e0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55b3d3ef4198 s->prefetch_data=0 2024-09-14T11:27:55.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.957+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef4198 2024-09-14T11:27:55.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.958+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.13.10 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7672 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4197880 part_ofs=7672 rule->part_size=7673 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=7671 2024-09-14T11:27:55.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4205553 part_ofs=15345 rule->part_size=7671 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4213224 part_ofs=23016 rule->part_size=3067 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.18298258356801202082 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.1 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.2 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:27:55.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.3 2024-09-14T11:27:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:27:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.4 2024-09-14T11:27:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:27:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:55.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.960+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.18298258356801202082 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.961+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.962+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.962+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.963+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.963+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.963+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.963+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:55.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.963+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[a588039c-1457-497f-adbd-8890a12279b7.4508.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:55.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.964+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:27:55.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.964+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.965+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:27:55.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.965+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:27:55.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.965+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:27:55.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.966+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:27:55.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.966+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:27:55.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.966+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 94230843629744 notifier 6006 bl.length()=198 2024-09-14T11:27:55.966 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.968+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13 from cache 2024-09-14T11:27:55.966 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.968+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:a588039c-1457-497f-adbd-8890a12279b7.4508.13, ofs0, ns] 2024-09-14T11:27:55.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.968+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562431 cookie 94230843627600 notifier 6006 bl.length()=256 2024-09-14T11:27:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.971+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.13 : miss 2024-09-14T11:27:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.971+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.971+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.971+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.13 info.flags=0x0 2024-09-14T11:27:55.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.971+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/a588039c-1457-497f-adbd-8890a12279b7.4508.13 to cache LRU end 2024-09-14T11:27:55.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11 : miss 2024-09-14T11:27:55.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11 info.flags=0x17 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11 to cache LRU end 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:55.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.973+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11 2024-09-14T11:27:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo[EtAwmaP.d7dJu6lehuky1.-Gl4S8eD5] 2024-09-14T11:27:55.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55b3d3fa36b8 s->prefetch_data=0 2024-09-14T11:27:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to ksa80jyloywupwr2ts7kha8d64nsk1v5 2024-09-14T11:27:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 20 get_obj_state_impl: setting s->olh_tag to x2ddhtysjkfpd3xmvx4efw9ofgx2wkro 2024-09-14T11:27:55.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.977+0000 7f8f54f2c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x2ddhtysjkfpd3xmvx4efw9ofgx2wkro 2024-09-14T11:27:55.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.979+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 olh_log_entry: epoch=3 op=3 key=foo[EtAwmaP.d7dJu6lehuky1.-Gl4S8eD5] 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-multipart-index-versioning.1:_:EtAwmaP.d7dJu6lehuky1.-Gl4S8eD5_foo state=0x55b3d3ef3fa8 s->prefetch_data=0 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 10 manifest: total_size = 26081 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.2040968818327926524 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-multipart-index-versioning.1:_:EtAwmaP.d7dJu6lehuky1.-Gl4S8eD5_foo state=0x55b3d3ef3fa8 s->prefetch_data=0 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3fa8 2024-09-14T11:27:55.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.980+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7672 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7671 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4197880 part_ofs=7672 rule->part_size=7671 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=7671 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4213222 part_ofs=23014 rule->part_size=3067 2024-09-14T11:27:55.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.2040968818327926524 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.1 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.2 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.3 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.4 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:55.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.983+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.2040968818327926524 2024-09-14T11:27:55.984 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.984+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo[EtAwmaP.d7dJu6lehuky1.-Gl4S8eD5] 2024-09-14T11:27:55.984 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.986+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55b3d3fa36b8 s->prefetch_data=0 2024-09-14T11:27:55.985 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.987+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.988+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.11.10 2024-09-14T11:27:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.988+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:55.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.988+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.989+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.989+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.989+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.989+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:55.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.989+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[a588039c-1457-497f-adbd-8890a12279b7.4508.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:55.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.992+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:27:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.992+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.992+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:27:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.992+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:27:55.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.992+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:27:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.993+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:27:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.993+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:27:55.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.994+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 94230843629744 notifier 6006 bl.length()=193 2024-09-14T11:27:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.995+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11 from cache 2024-09-14T11:27:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.995+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:a588039c-1457-497f-adbd-8890a12279b7.4508.11, ofs0, ns] 2024-09-14T11:27:55.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.995+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562425 cookie 94230843645936 notifier 6006 bl.length()=251 2024-09-14T11:27:55.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.997+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a588039c-1457-497f-adbd-8890a12279b7.4508.11 : miss 2024-09-14T11:27:55.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.997+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.998+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:55.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.998+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a588039c-1457-497f-adbd-8890a12279b7.4508.11 info.flags=0x0 2024-09-14T11:27:55.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:55.998+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/a588039c-1457-497f-adbd-8890a12279b7.4508.11 to cache LRU end 2024-09-14T11:27:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10 : miss 2024-09-14T11:27:55.998 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10 info.flags=0x17 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10 to cache LRU end 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:55.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.000+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10 2024-09-14T11:27:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.004+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:27:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.004+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbea70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.005+0000 7f8f54f2c800 10 manifest: total_size = 26079 2024-09-14T11:27:56.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.005+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.17803982733261994910 2024-09-14T11:27:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.005+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbea70 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.005+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.005+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.10.10 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7670 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4197878 part_ofs=7670 rule->part_size=7672 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7670 2024-09-14T11:27:56.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4205550 part_ofs=15342 rule->part_size=7670 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4213220 part_ofs=23012 rule->part_size=3067 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.17803982733261994910 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.1 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.2 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:27:56.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.3 2024-09-14T11:27:56.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:27:56.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.4 2024-09-14T11:27:56.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:27:56.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.007+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.17803982733261994910 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.008+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.009+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[a588039c-1457-497f-adbd-8890a12279b7.4508.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.011+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:27:56.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.011+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.012+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:27:56.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.012+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:27:56.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.012+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:27:56.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.012+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:27:56.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.012+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:27:56.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.013+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94230843633728 notifier 6006 bl.length()=183 2024-09-14T11:27:56.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.014+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10 from cache 2024-09-14T11:27:56.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.014+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:a588039c-1457-497f-adbd-8890a12279b7.4508.10, ofs0, ns] 2024-09-14T11:27:56.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.015+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94230843637792 notifier 6006 bl.length()=241 2024-09-14T11:27:56.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.018+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a588039c-1457-497f-adbd-8890a12279b7.4508.10 : miss 2024-09-14T11:27:56.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.018+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.018+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.018+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a588039c-1457-497f-adbd-8890a12279b7.4508.10 info.flags=0x0 2024-09-14T11:27:56.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.018+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/a588039c-1457-497f-adbd-8890a12279b7.4508.10 to cache LRU end 2024-09-14T11:27:56.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16 : miss 2024-09-14T11:27:56.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:27:56.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16 info.flags=0x17 2024-09-14T11:27:56.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16 to cache LRU end 2024-09-14T11:27:56.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.020+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16 2024-09-14T11:27:56.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.021+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:27:56.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.021+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:27:56.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.022+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:56.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.023+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:27:56.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.023+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:27:56.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.023+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:56.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.024+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:27:56.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.024+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:56.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.024+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:27:56.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.024+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:56.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.024+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:27:56.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:27:56.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d40218a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 10 manifest: total_size = 22651 2024-09-14T11:27:56.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _2tU3Hsa3aP06K8D6EzSfq00pZJKBVzN 2024-09-14T11:27:56.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d40218a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.025+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.0 2024-09-14T11:27:56.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _2tU3Hsa3aP06K8D6EzSfq00pZJKBVzN 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.kOQJvnqLncBu7vf-huOdS749C2jnUgs_0 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.028+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _2tU3Hsa3aP06K8D6EzSfq00pZJKBVzN 2024-09-14T11:27:56.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.029+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:27:56.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4802bea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _U-OL4qzDI4V0J6ZJHZX9oRcmCxZ0vwd 2024-09-14T11:27:56.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4802bea0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.030+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.2 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _U-OL4qzDI4V0J6ZJHZX9oRcmCxZ0vwd 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.bxVQ05_UMjQZoKx6BtxUB9FANi6VBwF_1 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.032+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _U-OL4qzDI4V0J6ZJHZX9oRcmCxZ0vwd 2024-09-14T11:27:56.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.7003922205286755087 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.034+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.3 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7003922205286755087 2024-09-14T11:27:56.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_0 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_1 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.036+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7003922205286755087 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40007ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _hFh7yolTfPCTJu_LnBkIxyRUzcqbDGh 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40007ec0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.038+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.5 2024-09-14T11:27:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _hFh7yolTfPCTJu_LnBkIxyRUzcqbDGh 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.hQ8VvKVmnZQO4uIOd0ifHuo9_PsYpmE_0 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.hQ8VvKVmnZQO4uIOd0ifHuo9_PsYpmE_1 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.041+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _hFh7yolTfPCTJu_LnBkIxyRUzcqbDGh 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _DeizgXvJ6v8zwR78-aNJoq6qcLLjlCO 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.042+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.5 2024-09-14T11:27:56.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _DeizgXvJ6v8zwR78-aNJoq6qcLLjlCO 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.o313R4e9yRfTpIxZICQeq5z6AnLce-u_0 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.o313R4e9yRfTpIxZICQeq5z6AnLce-u_1 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.045+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _DeizgXvJ6v8zwR78-aNJoq6qcLLjlCO 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d40202d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8f54f2c800 10 manifest: total_size = 22651 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.6814976220473359427 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d40202d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.046+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.047+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.5 2024-09-14T11:27:56.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _E2zE6IqbQHV0XU4EWxN60AT5Wg5dB-d 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40023470 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.049+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.7 2024-09-14T11:27:56.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.050+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:56.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _E2zE6IqbQHV0XU4EWxN60AT5Wg5dB-d 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.l87GYvTiBRHlYEGONvTTiJmQ3rMgaCZ_1 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.052+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _E2zE6IqbQHV0XU4EWxN60AT5Wg5dB-d 2024-09-14T11:27:56.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.053+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:27:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.053+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.054+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.054+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.15392047456026118229 2024-09-14T11:27:56.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.054+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.054+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.054+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.7 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.15392047456026118229 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_0 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_1 2024-09-14T11:27:56.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:27:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.056+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.15392047456026118229 2024-09-14T11:27:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.057+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.057+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.058+0000 7f8f54f2c800 10 manifest: total_size = 22651 2024-09-14T11:27:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.058+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _WG5XbbxZizkkhqycy4eeZdFQjNlcwbf 2024-09-14T11:27:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.058+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.058+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.058+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.7 2024-09-14T11:27:56.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.9832184751681929952 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.060+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.8 2024-09-14T11:27:56.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.061+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.9832184751681929952 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_0 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_1 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:27:56.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.063+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.9832184751681929952 2024-09-14T11:27:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.064+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.064+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbfe00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.065+0000 7f8f54f2c800 10 manifest: total_size = 22651 2024-09-14T11:27:56.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.065+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _Az7Uvghjmo5gkJKejfqfMbWfjAiOam_ 2024-09-14T11:27:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.065+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbfe00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.065+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.065+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.8 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _Az7Uvghjmo5gkJKejfqfMbWfjAiOam_ 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.duGToRX4mBzLV-0YDjn-E0bXVkCPbH1_0 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.067+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _Az7Uvghjmo5gkJKejfqfMbWfjAiOam_ 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.068+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.068+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbfe00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.069+0000 7f8f54f2c800 10 manifest: total_size = 5242880 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.069+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.3130798413733992043 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.069+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbfe00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55b3d3ef3e78 s->prefetch_data=0 2024-09-14T11:27:56.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.069+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3ef3e78 2024-09-14T11:27:56.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.069+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.16.9 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.3130798413733992043 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_0 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_1 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.071+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.3130798413733992043 2024-09-14T11:27:56.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.072+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:27:56.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.072+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.072+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.073+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.073+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.073+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.073+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.073+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[a588039c-1457-497f-adbd-8890a12279b7.4508.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.074+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:27:56.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.074+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.075+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:27:56.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.075+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:27:56.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.075+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:27:56.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.076+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:27:56.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.076+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:27:56.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.076+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 94230843629744 notifier 6006 bl.length()=189 2024-09-14T11:27:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.078+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16 from cache 2024-09-14T11:27:56.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.078+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.16, ofs0, ns] 2024-09-14T11:27:56.077 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.078+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562426 cookie 94230843645936 notifier 6006 bl.length()=247 2024-09-14T11:27:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.080+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.16 : miss 2024-09-14T11:27:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.080+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.080+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.081+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.16 info.flags=0x0 2024-09-14T11:27:56.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.081+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.16 to cache LRU end 2024-09-14T11:27:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.082+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17 : miss 2024-09-14T11:27:56.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.082+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17 info.flags=0x17 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17 to cache LRU end 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17 2024-09-14T11:27:56.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.083+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:27:56.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.084+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:27:56.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.084+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.085+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.085+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.085+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.086+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.086+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:56.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.086+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:27:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.086+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.086+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:27:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:27:56.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa1020 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b3d3fb9208 s->prefetch_data=0 2024-09-14T11:27:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _XHU1GNLPtsnJ3gU6DICZZjhjMXHmb3O 2024-09-14T11:27:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa1020 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55b3d3fb9208 s->prefetch_data=0 2024-09-14T11:27:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb9208 2024-09-14T11:27:56.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.087+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.0 2024-09-14T11:27:56.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _XHU1GNLPtsnJ3gU6DICZZjhjMXHmb3O 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_0 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_1 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_2 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:27:56.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.090+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _XHU1GNLPtsnJ3gU6DICZZjhjMXHmb3O 2024-09-14T11:27:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:27:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b3d3fb9208 s->prefetch_data=0 2024-09-14T11:27:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _Vs3vDZKu6PRySTTrujQnEJMungUVKQ1 2024-09-14T11:27:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55b3d3fb9208 s->prefetch_data=0 2024-09-14T11:27:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb9208 2024-09-14T11:27:56.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.091+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.2 2024-09-14T11:27:56.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _Vs3vDZKu6PRySTTrujQnEJMungUVKQ1 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.au6EzfvimOVqheZaFmeNd9TL164Y9_z_1 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.au6EzfvimOVqheZaFmeNd9TL164Y9_z_2 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.094+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _Vs3vDZKu6PRySTTrujQnEJMungUVKQ1 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.095+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.095+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b3d3fb91b8 s->prefetch_data=0 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.096+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.096+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.14067117076655289081 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.096+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55b3d3fb91b8 s->prefetch_data=0 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.096+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb91b8 2024-09-14T11:27:56.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.096+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.3 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.14067117076655289081 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:27:56.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1_1 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2_1 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.3 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.098+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.14067117076655289081 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.099+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.099+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fc0600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.100+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.100+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _6mqFDuL8MQ3pOqfled51hTmQxJ-H8mH 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.100+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fc0600 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.100+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.100+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.5 2024-09-14T11:27:56.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _6mqFDuL8MQ3pOqfled51hTmQxJ-H8mH 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_0 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_1 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_2 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.102+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _6mqFDuL8MQ3pOqfled51hTmQxJ-H8mH 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.103+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.103+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.104+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.104+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _GSLv2I0Uob_mfWPfb4nZwcujpWTOeFr 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.104+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.104+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.104+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.5 2024-09-14T11:27:56.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _GSLv2I0Uob_mfWPfb4nZwcujpWTOeFr 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_0 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_1 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_2 2024-09-14T11:27:56.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:27:56.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.106+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _GSLv2I0Uob_mfWPfb4nZwcujpWTOeFr 2024-09-14T11:27:56.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.107+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:27:56.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.107+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.108+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.108+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.6609037090344355037 2024-09-14T11:27:56.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.108+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.108+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.108+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.5 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.6609037090344355037 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1_1 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-14T11:27:56.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2_1 2024-09-14T11:27:56.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-14T11:27:56.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.3 2024-09-14T11:27:56.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-14T11:27:56.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.110+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.6609037090344355037 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.111+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806ff50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _6LrTxOkGgOHXMjAIqN2W3SY3skEe8PK 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806ff50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.7 2024-09-14T11:27:56.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.112+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:56.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _6LrTxOkGgOHXMjAIqN2W3SY3skEe8PK 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.-PkFJ4mNyVeJu-gkpGc4EB-G1kCSIxb_1 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.-PkFJ4mNyVeJu-gkpGc4EB-G1kCSIxb_2 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.114+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _6LrTxOkGgOHXMjAIqN2W3SY3skEe8PK 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806ff50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.10186100763519683980 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f3806ff50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.116+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.7 2024-09-14T11:27:56.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.118+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10186100763519683980 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1_1 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2_1 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.3 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.119+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10186100763519683980 2024-09-14T11:27:56.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:56.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fca9b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.10267730985951509029 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fca9b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.120+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.7 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10267730985951509029 2024-09-14T11:27:56.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1_1 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2_1 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.3 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.122+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10267730985951509029 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f380048c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.8323340511491998542 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f380048c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.124+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.8 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8323340511491998542 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1_1 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2_1 2024-09-14T11:27:56.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:27:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.3 2024-09-14T11:27:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:27:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.127+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8323340511491998542 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.128+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.128+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa6990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.129+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.129+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to _NFdVpq9vZaYnWef5sD4yA4fYDbrJvJ0 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.129+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fa6990 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.129+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.129+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.8 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: _NFdVpq9vZaYnWef5sD4yA4fYDbrJvJ0 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_0 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:27:56.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_1 2024-09-14T11:27:56.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:27:56.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_2 2024-09-14T11:27:56.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:27:56.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.131+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _NFdVpq9vZaYnWef5sD4yA4fYDbrJvJ0 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f480a0af0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.8459172432023098428 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f480a0af0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55b3d3fa5ef8 s->prefetch_data=0 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa5ef8 2024-09-14T11:27:56.132 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.132+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.17.9 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8459172432023098428 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1_1 2024-09-14T11:27:56.135 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2_1 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.3 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.136 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.135+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8459172432023098428 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.136+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.136+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.137 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.137+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[a588039c-1457-497f-adbd-8890a12279b7.4508.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.139+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:27:56.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.139+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.140+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:27:56.138 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.140+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:27:56.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.140+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:27:56.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.141+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:27:56.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.141+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:27:56.140 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.141+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562379 cookie 94230843632016 notifier 6006 bl.length()=199 2024-09-14T11:27:56.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.142+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17 from cache 2024-09-14T11:27:56.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.142+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:a588039c-1457-497f-adbd-8890a12279b7.4508.17, ofs0, ns] 2024-09-14T11:27:56.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.143+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 94230843629744 notifier 6006 bl.length()=257 2024-09-14T11:27:56.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.145+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.17 : miss 2024-09-14T11:27:56.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.145+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.146+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.146+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.17 info.flags=0x0 2024-09-14T11:27:56.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.146+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/a588039c-1457-497f-adbd-8890a12279b7.4508.17 to cache LRU end 2024-09-14T11:27:56.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15 : miss 2024-09-14T11:27:56.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15 info.flags=0x17 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15 to cache LRU end 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.148+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15 2024-09-14T11:27:56.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.150+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.150+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:56.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.151+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:56.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbe8b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.3512108729484560922 2024-09-14T11:27:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fbe8b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fbeda8 2024-09-14T11:27:56.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.152+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.15.3 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.154 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.3512108729484560922 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.1 2024-09-14T11:27:56.155 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.1_1 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.2 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.2_1 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.3 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.156 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.155+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.3512108729484560922 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.156+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.156+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.157+0000 7f8f54f2c800 10 manifest: total_size = 45360 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.157+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.7561130587305046999 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.157+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400079f0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.157+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fbeda8 2024-09-14T11:27:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.157+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.15.5 2024-09-14T11:27:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-14T11:27:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:56.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7561130587305046999 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.1 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.2 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.3 2024-09-14T11:27:56.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:27:56.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.159+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7561130587305046999 2024-09-14T11:27:56.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.160+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:56.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.160+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fca9b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.161+0000 7f8f54f2c800 10 manifest: total_size = 11534336 2024-09-14T11:27:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.161+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.10107936100009112501 2024-09-14T11:27:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.161+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fca9b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55b3d3fbeda8 s->prefetch_data=0 2024-09-14T11:27:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.161+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fbeda8 2024-09-14T11:27:56.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.161+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.15.7 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10107936100009112501 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.1 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:27:56.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.1_1 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.2 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.2_1 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.3 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.163+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.10107936100009112501 2024-09-14T11:27:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.165+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.165+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.165+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.166+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.166+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.166+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.166+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.166+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[a588039c-1457-497f-adbd-8890a12279b7.4508.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.167+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:27:56.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.167+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.168+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:27:56.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.168+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:27:56.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.168+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:27:56.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.169+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:27:56.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.169+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:27:56.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.169+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94230843637792 notifier 6006 bl.length()=194 2024-09-14T11:27:56.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.170+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15 from cache 2024-09-14T11:27:56.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.170+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:a588039c-1457-497f-adbd-8890a12279b7.4508.15, ofs0, ns] 2024-09-14T11:27:56.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.171+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 94230843629744 notifier 6006 bl.length()=252 2024-09-14T11:27:56.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.173+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a588039c-1457-497f-adbd-8890a12279b7.4508.15 : miss 2024-09-14T11:27:56.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.173+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.174+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.174+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a588039c-1457-497f-adbd-8890a12279b7.4508.15 info.flags=0x0 2024-09-14T11:27:56.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.174+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/a588039c-1457-497f-adbd-8890a12279b7.4508.15 to cache LRU end 2024-09-14T11:27:56.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14 : miss 2024-09-14T11:27:56.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14 info.flags=0x17 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14 to cache LRU end 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.176+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14 2024-09-14T11:27:56.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.177+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:27:56.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.178+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:27:56.177 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.179+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:27:56.178 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3ef49c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 10 manifest: total_size = 10485760 2024-09-14T11:27:56.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.14012103814512270143 2024-09-14T11:27:56.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3ef49c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.179 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.180+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.14.3 2024-09-14T11:27:56.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.14012103814512270143 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_0 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_1 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_2 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.182 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.183+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.14012103814512270143 2024-09-14T11:27:56.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:27:56.183 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fc58b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 10 manifest: total_size = 10485760 2024-09-14T11:27:56.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.8216771819420567536 2024-09-14T11:27:56.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fc58b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.184 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.184+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.14.5 2024-09-14T11:27:56.185 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8216771819420567536 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.XA7hoBeioC2Xe7HJNW5EZpcezEToPAu_1 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.XA7hoBeioC2Xe7HJNW5EZpcezEToPAu_2 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.186 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.187+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.8216771819420567536 2024-09-14T11:27:56.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.188+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:27:56.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.188+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.187 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.189+0000 7f8f54f2c800 10 manifest: total_size = 10485760 2024-09-14T11:27:56.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.189+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.7623194926665877657 2024-09-14T11:27:56.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.189+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f400486f0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.189+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.188 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.189+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.14.7 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7623194926665877657 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_0 2024-09-14T11:27:56.190 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_1 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_2 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:27:56.191 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.191+0000 7f8f54f2c800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: a588039c-1457-497f-adbd-8890a12279b7.4508.7623194926665877657 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.192+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.192 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.193+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[a588039c-1457-497f-adbd-8890a12279b7.4508.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.193 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.195+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:27:56.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.195+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.196+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:27:56.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.196+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:27:56.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.196+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:27:56.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.197+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:27:56.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.197+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:27:56.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.197+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94230843629744 notifier 6006 bl.length()=184 2024-09-14T11:27:56.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.198+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14 from cache 2024-09-14T11:27:56.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.198+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:a588039c-1457-497f-adbd-8890a12279b7.4508.14, ofs0, ns] 2024-09-14T11:27:56.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.199+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562432 cookie 94230843627600 notifier 6006 bl.length()=242 2024-09-14T11:27:56.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.201+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a588039c-1457-497f-adbd-8890a12279b7.4508.14 : miss 2024-09-14T11:27:56.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.201+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.202+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.202+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a588039c-1457-497f-adbd-8890a12279b7.4508.14 info.flags=0x0 2024-09-14T11:27:56.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.202+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/a588039c-1457-497f-adbd-8890a12279b7.4508.14 to cache LRU end 2024-09-14T11:27:56.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7 : miss 2024-09-14T11:27:56.202 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7 info.flags=0x17 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7 to cache LRU end 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.204+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7 2024-09-14T11:27:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.205+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:56.204 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.206+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:56.205 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.207+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.207+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:56.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 10 manifest: total_size = 0 2024-09-14T11:27:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.15222392283098175837 2024-09-14T11:27:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5c1f8 2024-09-14T11:27:56.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.208+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.7.2 2024-09-14T11:27:56.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 10 manifest: total_size = 0 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.11394595147949522695 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3fadee0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5c1f8 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.211+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.7.3 2024-09-14T11:27:56.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.212+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:56.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3f5e580 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 10 manifest: total_size = 0 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.4425506469467787563 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3f5e580 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5c1f8 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.214+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.7.6 2024-09-14T11:27:56.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.215+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:56.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.216+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.217+0000 7f8f54f2c800 10 manifest: total_size = 0 2024-09-14T11:27:56.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.217+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.14840464481509819085 2024-09-14T11:27:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.217+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f38056fc0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55b3d3f5c1f8 s->prefetch_data=0 2024-09-14T11:27:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.217+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5c1f8 2024-09-14T11:27:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.217+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.7.8 2024-09-14T11:27:56.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.218+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:56.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.219+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.218 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.219+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.219 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.220+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:56.219 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.221+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.219 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.221+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.219 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.221+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.221+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.221+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[a588039c-1457-497f-adbd-8890a12279b7.4508.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.222+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:27:56.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.222+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.223+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:56.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.223+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:27:56.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.223+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:27:56.223 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.224+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:27:56.223 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.224+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:27:56.223 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.224+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94230843627600 notifier 6006 bl.length()=181 2024-09-14T11:27:56.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.226+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7 from cache 2024-09-14T11:27:56.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.226+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:a588039c-1457-497f-adbd-8890a12279b7.4508.7, ofs0, ns] 2024-09-14T11:27:56.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.226+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562434 cookie 94230843627600 notifier 6006 bl.length()=238 2024-09-14T11:27:56.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.229+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a588039c-1457-497f-adbd-8890a12279b7.4508.7 : miss 2024-09-14T11:27:56.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.229+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.229+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.229+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a588039c-1457-497f-adbd-8890a12279b7.4508.7 info.flags=0x0 2024-09-14T11:27:56.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.229+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/a588039c-1457-497f-adbd-8890a12279b7.4508.7 to cache LRU end 2024-09-14T11:27:56.230 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.231+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8 : miss 2024-09-14T11:27:56.230 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.231+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.230 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8 info.flags=0x17 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8 to cache LRU end 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.232+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8 2024-09-14T11:27:56.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.233+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:56.232 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.233+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:56.233 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.234+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:56.233 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.235+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:56.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.235+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.236+0000 7f8f54f2c800 10 manifest: total_size = 527 2024-09-14T11:27:56.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.236+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.2770145677942270500 2024-09-14T11:27:56.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.236+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.236+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.236+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.8.2 2024-09-14T11:27:56.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.238+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.239+0000 7f8f54f2c800 10 manifest: total_size = 527 2024-09-14T11:27:56.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.239+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.4855302054008954913 2024-09-14T11:27:56.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.239+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4806a2e0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.239+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.239+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.8.3 2024-09-14T11:27:56.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.240+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:56.240 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.241+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40007ec0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.240 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8f54f2c800 10 manifest: total_size = 38 2024-09-14T11:27:56.240 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.12773401056608306875 2024-09-14T11:27:56.240 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40007ec0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.8.6 2024-09-14T11:27:56.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.242+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:56.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4005ffc0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 10 manifest: total_size = 527 2024-09-14T11:27:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.12035170189053529497 2024-09-14T11:27:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f4005ffc0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55b3d3fb6b68 s->prefetch_data=0 2024-09-14T11:27:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fb6b68 2024-09-14T11:27:56.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.244+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.8.8 2024-09-14T11:27:56.244 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.246+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:56.246 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.247+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.246 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.247+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.248+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:56.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.249+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.249+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.249+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.249+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.249+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[a588039c-1457-497f-adbd-8890a12279b7.4508.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.250+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:27:56.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.250+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.251+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:56.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.251+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:27:56.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.251+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:27:56.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.252+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:27:56.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.252+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:27:56.251 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.252+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562435 cookie 94230843627600 notifier 6006 bl.length()=181 2024-09-14T11:27:56.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.254+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8 from cache 2024-09-14T11:27:56.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.254+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:a588039c-1457-497f-adbd-8890a12279b7.4508.8, ofs0, ns] 2024-09-14T11:27:56.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.254+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94230843627600 notifier 6006 bl.length()=238 2024-09-14T11:27:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.257+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a588039c-1457-497f-adbd-8890a12279b7.4508.8 : miss 2024-09-14T11:27:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.257+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.257+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.257+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a588039c-1457-497f-adbd-8890a12279b7.4508.8 info.flags=0x0 2024-09-14T11:27:56.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.257+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/a588039c-1457-497f-adbd-8890a12279b7.4508.8 to cache LRU end 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9 : miss 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9 info.flags=0x17 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9 to cache LRU end 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:27:56.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.259+0000 7f8f54f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9 2024-09-14T11:27:56.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.260+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:27:56.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.261+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:27:56.260 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.262+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:27:56.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.262+0000 7f8f54f2c800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:27:56.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b3d3fa57b8 s->prefetch_data=0 2024-09-14T11:27:56.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 10 manifest: total_size = 4134 2024-09-14T11:27:56.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.4325806609135708079 2024-09-14T11:27:56.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55b3d3fa57b8 s->prefetch_data=0 2024-09-14T11:27:56.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3fa57b8 2024-09-14T11:27:56.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.263+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.9.2 2024-09-14T11:27:56.264 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3faab60 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 10 manifest: total_size = 1035 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.10355924568920715003 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 20 get_obj_state: octx=0x55b3d3faab60 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5d5d8 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.266+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.9.3 2024-09-14T11:27:56.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.267+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:27:56.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 10 manifest: total_size = 55 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.1103401471849813769 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f40077150 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5d5d8 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.269+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.9.6 2024-09-14T11:27:56.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.270+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:27:56.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.272+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f380048c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.273+0000 7f8f54f2c800 10 manifest: total_size = 4134 2024-09-14T11:27:56.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.273+0000 7f8f54f2c800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.347269800732879557 2024-09-14T11:27:56.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.273+0000 7f8f54f2c800 20 get_obj_state: octx=0x7f8f380048c0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55b3d3f5d5d8 s->prefetch_data=0 2024-09-14T11:27:56.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.273+0000 7f8f54f2c800 20 prepare_atomic_modification: state is not atomic. state=0x55b3d3f5d5d8 2024-09-14T11:27:56.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.273+0000 7f8f54f2c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.9.8 2024-09-14T11:27:56.273 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.275+0000 7f8e277fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:27:56.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.276+0000 7f8f54f2c800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:27:56.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.276+0000 7f8f54f2c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:27:56.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8e27fff640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:27:56.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:27:56.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8f54f2c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:27:56.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8f54f2c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:27:56.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8f54f2c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:27:56.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.278+0000 7f8f54f2c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[a588039c-1457-497f-adbd-8890a12279b7.4508.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:27:56.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.279+0000 7f8f54f2c800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:27:56.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.279+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.280+0000 7f8f54f2c800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:27:56.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.280+0000 7f8f54f2c800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:27:56.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.280+0000 7f8f54f2c800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:27:56.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.281+0000 7f8f54f2c800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:27:56.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.281+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:27:56.280 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.281+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94230843627600 notifier 6006 bl.length()=181 2024-09-14T11:27:56.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.283+0000 7f8f54f2c800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9 from cache 2024-09-14T11:27:56.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.283+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:a588039c-1457-497f-adbd-8890a12279b7.4508.9, ofs0, ns] 2024-09-14T11:27:56.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.283+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94230843627600 notifier 6006 bl.length()=238 2024-09-14T11:27:56.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.286+0000 7f8f54f2c800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a588039c-1457-497f-adbd-8890a12279b7.4508.9 : miss 2024-09-14T11:27:56.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.286+0000 7f8f54f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.286+0000 7f8f54f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.286+0000 7f8f54f2c800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a588039c-1457-497f-adbd-8890a12279b7.4508.9 info.flags=0x0 2024-09-14T11:27:56.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.286+0000 7f8f54f2c800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/a588039c-1457-497f-adbd-8890a12279b7.4508.9 to cache LRU end 2024-09-14T11:27:56.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.289+0000 7f8f54f2c800 10 removing key index: NXPILALFIQAUNVQQNWME 2024-09-14T11:27:56.288 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.290+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:NXPILALFIQAUNVQQNWME, ofs0, ns] 2024-09-14T11:27:56.288 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.290+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94230843627600 notifier 6006 bl.length()=170 2024-09-14T11:27:56.289 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.290+0000 7f8f54f2c800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:27:56.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.291+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:56.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.292+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94230843629744 notifier 6006 bl.length()=182 2024-09-14T11:27:56.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.292+0000 7f8f54f2c800 10 removing user buckets index 2024-09-14T11:27:56.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.293+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:27:56.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.293+0000 7f8e277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94230843637792 notifier 6006 bl.length()=173 2024-09-14T11:27:56.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.294+0000 7f8f54f2c800 10 removing user index: ragweed.client.0 2024-09-14T11:27:56.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.295+0000 7f8f54f2c800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:27:56.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.295+0000 7f8f54f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:27:56.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.295+0000 7f8e27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94230843633728 notifier 6006 bl.length()=165 2024-09-14T11:27:56.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.296+0000 7f8e06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:56.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.298+0000 7f8f54f2c800 20 remove_watcher() i=0 2024-09-14T11:27:56.297 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.298+0000 7f8f54f2c800 2 removed watcher, disabling cache 2024-09-14T11:27:56.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.299+0000 7f8f54f2c800 20 remove_watcher() i=1 2024-09-14T11:27:56.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.300+0000 7f8f54f2c800 20 remove_watcher() i=2 2024-09-14T11:27:56.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.301+0000 7f8f54f2c800 20 remove_watcher() i=3 2024-09-14T11:27:56.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.302+0000 7f8f54f2c800 20 remove_watcher() i=4 2024-09-14T11:27:56.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.303+0000 7f8f54f2c800 20 remove_watcher() i=5 2024-09-14T11:27:56.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.304+0000 7f8f54f2c800 20 remove_watcher() i=6 2024-09-14T11:27:56.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.305+0000 7f8f54f2c800 20 remove_watcher() i=7 2024-09-14T11:27:56.314 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:27:56.370 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:27:56.370 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:27:56.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.405+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 realm 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.407+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.408+0000 7f5e4d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.408+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.409+0000 7f5e4d098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:27:56.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.409+0000 7f5e4d098800 20 searching for the correct realm 2024-09-14T11:27:56.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.411+0000 7f5e4b383640 0 -- 172.21.15.130:0/3327388459 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f5e40018070 msgr2=0x7f5e40060530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:27:56.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.617+0000 7f5e4b383640 0 -- 172.21.15.130:0/3327388459 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f5e40018070 msgr2=0x7f5e40060530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:27:56.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.621+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 zone default found 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 4 Realm: () 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:27:56.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 zonegroup default 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 started sync module instance, tier type = 2024-09-14T11:27:56.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.622+0000 7f5e4d098800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:27:56.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=0 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=1 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=2 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=3 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=4 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=5 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.636+0000 7f5e4d098800 20 add_watcher() i=6 2024-09-14T11:27:56.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.637+0000 7f5e4d098800 20 add_watcher() i=7 2024-09-14T11:27:56.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.637+0000 7f5e4d098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:27:56.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.639+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:56.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.639+0000 7f5e4d098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:27:56.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.639+0000 7f5e4d098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5c7bfff640 20 reqs_thread_entry: start 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5e4d098800 20 init_complete bucket index max shards: 11 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5e4d098800 20 Filter name: none 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5c79ffb640 20 reqs_thread_entry: start 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5e4d098800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:27:56.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.674+0000 7f5e4d098800 20 rados->read ofs=0 len=0 2024-09-14T11:27:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.675+0000 7f5e4d098800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:27:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.675+0000 7f5e4d098800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:27:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.675+0000 7f5e4d098800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:27:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.675+0000 7f5e4d098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:27:56.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.675+0000 7f5e4d098800 10 removing key index: ESSRCHIMVODQIUEAJTGK 2024-09-14T11:27:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.676+0000 7f5e4d098800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:ESSRCHIMVODQIUEAJTGK, ofs0, ns] 2024-09-14T11:27:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.676+0000 7f5d2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94007169355600 notifier 5687 bl.length()=170 2024-09-14T11:27:56.675 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.677+0000 7f5e4d098800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:27:56.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.677+0000 7f5e4d098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:27:56.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.678+0000 7f5d2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94007169349552 notifier 5687 bl.length()=182 2024-09-14T11:27:56.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.678+0000 7f5e4d098800 10 removing user buckets index 2024-09-14T11:27:56.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.679+0000 7f5e4d098800 10 removing user index: sysuser.client.0 2024-09-14T11:27:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.680+0000 7f5e4d098800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:27:56.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.680+0000 7f5e4d098800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:27:56.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.681+0000 7f5d2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94007169343616 notifier 5687 bl.length()=165 2024-09-14T11:27:56.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.683+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:27:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.685+0000 7f5e4d098800 20 remove_watcher() i=0 2024-09-14T11:27:56.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.685+0000 7f5e4d098800 2 removed watcher, disabling cache 2024-09-14T11:27:56.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.686+0000 7f5e4d098800 20 remove_watcher() i=1 2024-09-14T11:27:56.685 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.687+0000 7f5e4d098800 20 remove_watcher() i=2 2024-09-14T11:27:56.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.688+0000 7f5e4d098800 20 remove_watcher() i=3 2024-09-14T11:27:56.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.689+0000 7f5e4d098800 20 remove_watcher() i=4 2024-09-14T11:27:56.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.689+0000 7f5e4d098800 20 remove_watcher() i=5 2024-09-14T11:27:56.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.690+0000 7f5e4d098800 20 remove_watcher() i=6 2024-09-14T11:27:56.689 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:27:56.691+0000 7f5e4d098800 20 remove_watcher() i=7 2024-09-14T11:27:56.700 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:27:56.700 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:27:56.773 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:27:56.786 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:56.786 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:27:56.786 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:56.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:27:56.815 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:27:56.815 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:56.884 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:56.884 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:27:56.953 INFO:tasks.workunit:timeout=3h 2024-09-14T11:27:56.953 INFO:tasks.workunit:cleanup=True 2024-09-14T11:27:56.953 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:57.023 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:28:53.578 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:28:53.579 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:28:53.580 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:28:53.649 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:28:53.652 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:53.652 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:28:53.699 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:28:53.746 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:28:53.785 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:53.787 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:53.787 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:28:53.824 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:53.828 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:28:53.828 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:28:53.897 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:28:53.898 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:28:53.899 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:28:53.971 INFO:tasks.workunit.client.0.smithi130.stderr:+ ulimit -c 0 2024-09-14T11:28:53.971 INFO:tasks.workunit.client.0.smithi130.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:28:53.971 INFO:tasks.workunit.client.0.smithi130.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:53.971 INFO:tasks.workunit.client.0.smithi130.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:56.310 INFO:tasks.workunit.client.0.smithi130.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:28:56.310 INFO:tasks.workunit.client.0.smithi130.stderr:++ deactivate nondestructive 2024-09-14T11:28:56.310 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:28:56.311 INFO:tasks.workunit.client.0.smithi130.stderr:++ export VIRTUAL_ENV 2024-09-14T11:28:56.312 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:28:56.312 INFO:tasks.workunit.client.0.smithi130.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:28:56.312 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PATH 2024-09-14T11:28:56.312 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -z '' ']' 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ PS1='(rgw) ' 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PS1 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:28:56.313 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install pip --upgrade 2024-09-14T11:28:56.536 INFO:tasks.workunit.client.0.smithi130.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:28:56.727 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting pip 2024-09-14T11:28:56.733 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:28:56.778 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: pip 2024-09-14T11:28:56.778 INFO:tasks.workunit.client.0.smithi130.stdout: Attempting uninstall: pip 2024-09-14T11:28:56.778 INFO:tasks.workunit.client.0.smithi130.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:28:56.928 INFO:tasks.workunit.client.0.smithi130.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:28:56.933 INFO:tasks.workunit.client.0.smithi130.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:28:57.671 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed pip-24.2 2024-09-14T11:28:57.719 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install boto3 2024-09-14T11:28:58.483 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting boto3 2024-09-14T11:28:58.485 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:28:59.076 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:28:59.077 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:28:59.132 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:28:59.133 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:28:59.187 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:28:59.189 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:28:59.238 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:59.239 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:28:59.306 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:59.308 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:28:59.560 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:59.561 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:28:59.566 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:28:59.567 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:28:59.576 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:28:59.577 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:28:59.579 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:28:59.580 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:28:59.582 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:28:59.655 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:29:00.683 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:29:00.803 INFO:tasks.workunit.client.0.smithi130.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:29:00.926 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:29:00.960 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:00.960 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:00.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.000+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 20 realm 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.001+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.002+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.002+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.003+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:01.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.003+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.003+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:01.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.003+0000 7f43c1125800 20 searching for the correct realm 2024-09-14T11:29:01.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.006+0000 7f43bd534640 0 -- 172.21.15.130:0/4104560111 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f43a400b040 msgr2=0x7f43a4032460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:01.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.010+0000 7f43b4532640 0 -- 172.21.15.130:0/4104560111 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x5603c851dfc0 msgr2=0x5603c85203d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:01.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:01.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.014+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 zone default found 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 4 Realm: () 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:01.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 zonegroup default 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.015+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.016+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.016+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.016+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.016+0000 7f43c1125800 20 started sync module instance, tier type = 2024-09-14T11:29:01.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.016+0000 7f43c1125800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=0 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=1 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=2 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=3 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=4 2024-09-14T11:29:01.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=5 2024-09-14T11:29:01.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.025+0000 7f43c1125800 20 add_watcher() i=6 2024-09-14T11:29:01.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.026+0000 7f43c1125800 20 add_watcher() i=7 2024-09-14T11:29:01.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.026+0000 7f43c1125800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:01.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f42737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:01.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f43c1125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:01.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f43c1125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f43c1125800 5 note: GC not initialized 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f42727e4640 20 reqs_thread_entry: start 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f43c1125800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f43c1125800 20 Filter name: none 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.028+0000 7f426bfff640 20 reqs_thread_entry: start 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:29:01.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:29:01.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:29:01.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.029+0000 7f43c1125800 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.030+0000 7f43c1125800 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:29:01.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.031+0000 7f42737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:01.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.033+0000 7f43c1125800 20 remove_watcher() i=0 2024-09-14T11:29:01.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.033+0000 7f43c1125800 2 removed watcher, disabling cache 2024-09-14T11:29:01.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.034+0000 7f43c1125800 20 remove_watcher() i=1 2024-09-14T11:29:01.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.035+0000 7f43c1125800 20 remove_watcher() i=2 2024-09-14T11:29:01.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.036+0000 7f43c1125800 20 remove_watcher() i=3 2024-09-14T11:29:01.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.037+0000 7f43c1125800 20 remove_watcher() i=4 2024-09-14T11:29:01.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.038+0000 7f43c1125800 20 remove_watcher() i=5 2024-09-14T11:29:01.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.039+0000 7f43c1125800 20 remove_watcher() i=6 2024-09-14T11:29:01.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:01.040+0000 7f43c1125800 20 remove_watcher() i=7 2024-09-14T11:29:14.508 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.508 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.555 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.555 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.568 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.568 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.581 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.581 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.587 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.587 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.630 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:14.630 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:14.672 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard add 2024-09-14T11:29:14.672 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:14.673 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:14.704 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:14.704 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:14.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.745+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 realm 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.747+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.748+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:14.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.748+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.749+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:14.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.749+0000 7fb1eb342800 20 searching for the correct realm 2024-09-14T11:29:14.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.749+0000 7fb1e70ed640 0 -- 172.21.15.130:0/3116963504 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7fb1e0035070 msgr2=0x7fb1e0066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:14.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.954+0000 7fb1de8ec640 0 -- 172.21.15.130:0/3116963504 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fb1d801a070 msgr2=0x7fb1d8068d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:14.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:14.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.960+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:14.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 zone default found 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 4 Realm: () 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 zonegroup default 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.961+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:14.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 started sync module instance, tier type = 2024-09-14T11:29:14.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.962+0000 7fb1eb342800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:14.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=0 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=1 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=2 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=3 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=4 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=5 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=6 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 20 add_watcher() i=7 2024-09-14T11:29:14.971 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.972+0000 7fb1eb342800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.974+0000 7fb09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 5 note: GC not initialized 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb09cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 20 Filter name: none 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb0167fc640 20 reqs_thread_entry: start 2024-09-14T11:29:14.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.975+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.976+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:14.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.976+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.976+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:14.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.976+0000 7fb1eb342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:14.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.976+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.977+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:14.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.977+0000 7fb1eb342800 20 rados->read ofs=0 len=0 2024-09-14T11:29:14.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.978+0000 7fb1eb342800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:14.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.978+0000 7fb1eb342800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:14.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.979+0000 7fb09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:14.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.981+0000 7fb1eb342800 20 remove_watcher() i=0 2024-09-14T11:29:14.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.981+0000 7fb1eb342800 2 removed watcher, disabling cache 2024-09-14T11:29:14.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.982+0000 7fb1eb342800 20 remove_watcher() i=1 2024-09-14T11:29:14.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.983+0000 7fb1eb342800 20 remove_watcher() i=2 2024-09-14T11:29:14.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.984+0000 7fb1eb342800 20 remove_watcher() i=3 2024-09-14T11:29:14.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.985+0000 7fb1eb342800 20 remove_watcher() i=4 2024-09-14T11:29:14.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.986+0000 7fb1eb342800 20 remove_watcher() i=5 2024-09-14T11:29:14.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.987+0000 7fb1eb342800 20 remove_watcher() i=6 2024-09-14T11:29:14.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:14.988+0000 7fb1eb342800 20 remove_watcher() i=7 2024-09-14T11:29:14.998 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:14.998 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:14.998 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:29:14.998 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:14.999 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:29:15.030 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:15.030 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:15.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.068+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 20 realm 2024-09-14T11:29:15.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.070+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.071+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.071+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.072+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.072+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.072+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:15.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.072+0000 7f278ff40800 20 searching for the correct realm 2024-09-14T11:29:15.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.075+0000 7f278c4c1640 0 -- 172.21.15.130:0/1491693043 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f277c001c20 msgr2=0x7f277c069cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:15.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.281+0000 7f278c4c1640 0 -- 172.21.15.130:0/1491693043 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f277c001c20 msgr2=0x7f277c069cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:15.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:15.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:15.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:15.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.285+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 zone default found 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 4 Realm: () 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:15.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 zonegroup default 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.286+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.287+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.287+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.287+0000 7f278ff40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.287+0000 7f278ff40800 20 started sync module instance, tier type = 2024-09-14T11:29:15.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.287+0000 7f278ff40800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=0 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=1 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=2 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=3 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=4 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=5 2024-09-14T11:29:15.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.296+0000 7f278ff40800 20 add_watcher() i=6 2024-09-14T11:29:15.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.297+0000 7f278ff40800 20 add_watcher() i=7 2024-09-14T11:29:15.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.297+0000 7f278ff40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:15.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f2641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f278ff40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f278ff40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f278ff40800 5 note: GC not initialized 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f2640fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f278ff40800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.299+0000 7f278ff40800 20 Filter name: none 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f25ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:29:15.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.300+0000 7f278ff40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.301+0000 7f278ff40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:15.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.303+0000 7f2641fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:15.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.305+0000 7f278ff40800 20 remove_watcher() i=0 2024-09-14T11:29:15.304 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.305+0000 7f278ff40800 2 removed watcher, disabling cache 2024-09-14T11:29:15.305 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.306+0000 7f278ff40800 20 remove_watcher() i=1 2024-09-14T11:29:15.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.307+0000 7f278ff40800 20 remove_watcher() i=2 2024-09-14T11:29:15.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.308+0000 7f278ff40800 20 remove_watcher() i=3 2024-09-14T11:29:15.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.309+0000 7f278ff40800 20 remove_watcher() i=4 2024-09-14T11:29:15.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.310+0000 7f278ff40800 20 remove_watcher() i=5 2024-09-14T11:29:15.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.311+0000 7f278ff40800 20 remove_watcher() i=6 2024-09-14T11:29:15.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.312+0000 7f278ff40800 20 remove_watcher() i=7 2024-09-14T11:29:15.323 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard list 2024-09-14T11:29:15.350 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:15.350 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:15.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.388+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 realm 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.390+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.391+0000 7f2058c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.391+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.392+0000 7f2058c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:15.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.392+0000 7f2058c40800 20 searching for the correct realm 2024-09-14T11:29:15.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.394+0000 7f2056f2b640 0 -- 172.21.15.130:0/1065616038 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2040063070 msgr2=0x7f2040065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:15.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.601+0000 7f2056f2b640 0 -- 172.21.15.130:0/1065616038 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2040063070 msgr2=0x7f2040065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.606+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 zone default found 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 4 Realm: () 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 zonegroup default 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.607+0000 7f2058c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.608+0000 7f2058c40800 20 started sync module instance, tier type = 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.608+0000 7f2058c40800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=0 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=1 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=2 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=3 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=4 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=5 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=6 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 20 add_watcher() i=7 2024-09-14T11:29:15.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.619+0000 7f2058c40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.621+0000 7f1f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f2058c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f2058c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f2058c40800 5 note: GC not initialized 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f1e877fe640 20 reqs_thread_entry: start 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f2058c40800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f2058c40800 20 Filter name: none 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.622+0000 7f1e857fa640 20 reqs_thread_entry: start 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.629+0000 7f1f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.631+0000 7f2058c40800 20 remove_watcher() i=0 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.631+0000 7f2058c40800 2 removed watcher, disabling cache 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.632+0000 7f2058c40800 20 remove_watcher() i=1 2024-09-14T11:29:15.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.633+0000 7f2058c40800 20 remove_watcher() i=2 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.634+0000 7f2058c40800 20 remove_watcher() i=3 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.635+0000 7f2058c40800 20 remove_watcher() i=4 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.636+0000 7f2058c40800 20 remove_watcher() i=5 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.637+0000 7f2058c40800 20 remove_watcher() i=6 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.638+0000 7f2058c40800 20 remove_watcher() i=7 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:bucket name a-bucket 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard process 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:15.654 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard process 2024-09-14T11:29:15.676 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:15.676 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:15.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.715+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 realm 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.716+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.717+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.717+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.718+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:15.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.718+0000 7f49e6f26800 20 searching for the correct realm 2024-09-14T11:29:15.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.720+0000 7f49e33da640 0 -- 172.21.15.130:0/501733478 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f49d8036040 msgr2=0x7f49d8035410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:15.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.926+0000 7f49e33da640 0 -- 172.21.15.130:0/501733478 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f49d8036040 msgr2=0x7f49d8035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:15.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.930+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 zone default found 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 4 Realm: () 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:15.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:15.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 zonegroup default 2024-09-14T11:29:15.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.931+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.932+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.932+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.932+0000 7f49e6f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:15.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.932+0000 7f49e6f26800 20 started sync module instance, tier type = 2024-09-14T11:29:15.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.932+0000 7f49e6f26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:15.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=0 2024-09-14T11:29:15.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=1 2024-09-14T11:29:15.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=2 2024-09-14T11:29:15.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=3 2024-09-14T11:29:15.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=4 2024-09-14T11:29:15.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=5 2024-09-14T11:29:15.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.941+0000 7f49e6f26800 20 add_watcher() i=6 2024-09-14T11:29:15.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.942+0000 7f49e6f26800 20 add_watcher() i=7 2024-09-14T11:29:15.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.942+0000 7f49e6f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:15.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.944+0000 7f48997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 5 note: GC not initialized 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f4813fff640 20 reqs_thread_entry: start 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 20 Filter name: none 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f4811ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:15.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.945+0000 7f49e6f26800 20 processing logshard = reshard.0000000000 2024-09-14T11:29:15.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.948+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:29:15.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.948+0000 7f49e6f26800 20 processing logshard = reshard.0000000001 2024-09-14T11:29:15.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.950+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:29:15.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.950+0000 7f49e6f26800 20 processing logshard = reshard.0000000002 2024-09-14T11:29:15.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.953+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:29:15.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.953+0000 7f49e6f26800 20 processing logshard = reshard.0000000003 2024-09-14T11:29:15.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.956+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:29:15.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.956+0000 7f49e6f26800 20 processing logshard = reshard.0000000004 2024-09-14T11:29:15.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.958+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:29:15.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.958+0000 7f49e6f26800 20 processing logshard = reshard.0000000005 2024-09-14T11:29:15.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.961+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:29:15.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.961+0000 7f49e6f26800 20 processing logshard = reshard.0000000006 2024-09-14T11:29:15.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.962+0000 7f49e6f26800 20 process_entry resharding a-bucket 2024-09-14T11:29:15.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.962+0000 7f49e6f26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:15.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.962+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 20 rados->read ofs=0 len=0 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:15.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.963+0000 7f49e6f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:15.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.973+0000 7f49e6f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.973+0000 7f49e6f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.973+0000 7f49e6f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.973+0000 7f49e6f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:15.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f48c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93969844046880 notifier 6120 bl.length()=911 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f48c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f48c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f48c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:15.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.974+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:15.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:15.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:15.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:15.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:15.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:15.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:15.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.0 2024-09-14T11:29:15.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.979+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1 2024-09-14T11:29:15.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.980+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.980+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.980+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.4 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.981+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.5 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.981+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.6 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.982+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.7 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.982+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.8 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.983+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.9 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.983+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.10 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.984+0000 7f49e6f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.984+0000 7f49e6f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:15.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f49e6f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f49e6f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f49e6f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f49e6f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f48c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93969844046880 notifier 6120 bl.length()=911 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f48c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f48c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.985+0000 7f48c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.986+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.986+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.986+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:15.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.986+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:15.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.988+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.0 2024-09-14T11:29:15.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.989+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1 2024-09-14T11:29:15.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.989+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2 2024-09-14T11:29:15.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.989+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3 2024-09-14T11:29:15.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.990+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.4 2024-09-14T11:29:15.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.990+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.5 2024-09-14T11:29:15.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.990+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.6 2024-09-14T11:29:15.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.990+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.7 2024-09-14T11:29:15.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.991+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.8 2024-09-14T11:29:15.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.991+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.9 2024-09-14T11:29:15.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.991+0000 7f49e6f26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.10 2024-09-14T11:29:15.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.992+0000 7f49e6f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:15.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.992+0000 7f49e6f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:15.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f49e6f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f49e6f26800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f49e6f26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f49e6f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f48c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 93969844046880 notifier 6120 bl.length()=879 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f48c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f48c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.993+0000 7f48c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.994+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.994+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.994+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:15.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.994+0000 7f49e6f26800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:15.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.996+0000 7f49e6f26800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:15.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.997+0000 7f49e6f26800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:29:15.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.999+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:29:15.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:15.999+0000 7f49e6f26800 20 processing logshard = reshard.0000000007 2024-09-14T11:29:16.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.001+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:29:16.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.001+0000 7f49e6f26800 20 processing logshard = reshard.0000000008 2024-09-14T11:29:16.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.004+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:29:16.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.004+0000 7f49e6f26800 20 processing logshard = reshard.0000000009 2024-09-14T11:29:16.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.006+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:29:16.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.006+0000 7f49e6f26800 20 processing logshard = reshard.0000000010 2024-09-14T11:29:16.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.008+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:29:16.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.008+0000 7f49e6f26800 20 processing logshard = reshard.0000000011 2024-09-14T11:29:16.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.011+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:29:16.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.011+0000 7f49e6f26800 20 processing logshard = reshard.0000000012 2024-09-14T11:29:16.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.013+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:29:16.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.013+0000 7f49e6f26800 20 processing logshard = reshard.0000000013 2024-09-14T11:29:16.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.016+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:29:16.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.016+0000 7f49e6f26800 20 processing logshard = reshard.0000000014 2024-09-14T11:29:16.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.018+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:29:16.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.018+0000 7f49e6f26800 20 processing logshard = reshard.0000000015 2024-09-14T11:29:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.021+0000 7f49e6f26800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:29:16.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.022+0000 7f48997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:16.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.024+0000 7f49e6f26800 20 remove_watcher() i=0 2024-09-14T11:29:16.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.024+0000 7f49e6f26800 2 removed watcher, disabling cache 2024-09-14T11:29:16.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.025+0000 7f49e6f26800 20 remove_watcher() i=1 2024-09-14T11:29:16.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.026+0000 7f49e6f26800 20 remove_watcher() i=2 2024-09-14T11:29:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.027+0000 7f49e6f26800 20 remove_watcher() i=3 2024-09-14T11:29:16.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.028+0000 7f49e6f26800 20 remove_watcher() i=4 2024-09-14T11:29:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.029+0000 7f49e6f26800 20 remove_watcher() i=5 2024-09-14T11:29:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.030+0000 7f49e6f26800 20 remove_watcher() i=6 2024-09-14T11:29:16.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:16.030+0000 7f49e6f26800 20 remove_watcher() i=7 2024-09-14T11:29:21.047 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:21.084 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:21.085 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:21.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.328+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 20 realm 2024-09-14T11:29:21.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.330+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.331+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.331+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.332+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:21.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.332+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.333+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:21.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.333+0000 7ff226b21800 20 searching for the correct realm 2024-09-14T11:29:21.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.335+0000 7ff223045640 0 -- 172.21.15.130:0/246973771 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff218075040 msgr2=0x7ff218081900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:21.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.542+0000 7ff223045640 0 -- 172.21.15.130:0/246973771 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff218075040 msgr2=0x7ff218081900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:21.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:21.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:21.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:21.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:21.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:21.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:21.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.547+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:21.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:21.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 zone default found 2024-09-14T11:29:21.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 4 Realm: () 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 zonegroup default 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.548+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 started sync module instance, tier type = 2024-09-14T11:29:21.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.549+0000 7ff226b21800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=0 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=1 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=2 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=3 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=4 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=5 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.560+0000 7ff226b21800 20 add_watcher() i=6 2024-09-14T11:29:21.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.561+0000 7ff226b21800 20 add_watcher() i=7 2024-09-14T11:29:21.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.561+0000 7ff226b21800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.563+0000 7ff0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.563+0000 7ff226b21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.563+0000 7ff226b21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff226b21800 5 note: GC not initialized 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff053fff640 20 reqs_thread_entry: start 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff226b21800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff226b21800 20 Filter name: none 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff051ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:21.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.564+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.565+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:21.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.565+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.565+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.565+0000 7ff226b21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.565+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.566+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.566+0000 7ff226b21800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.566+0000 7ff226b21800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:21.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.566+0000 7ff226b21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:21.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.568+0000 7ff0d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:21.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.571+0000 7ff226b21800 20 remove_watcher() i=0 2024-09-14T11:29:21.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.571+0000 7ff226b21800 2 removed watcher, disabling cache 2024-09-14T11:29:21.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.572+0000 7ff226b21800 20 remove_watcher() i=1 2024-09-14T11:29:21.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.573+0000 7ff226b21800 20 remove_watcher() i=2 2024-09-14T11:29:21.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.574+0000 7ff226b21800 20 remove_watcher() i=3 2024-09-14T11:29:21.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.576+0000 7ff226b21800 20 remove_watcher() i=4 2024-09-14T11:29:21.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.577+0000 7ff226b21800 20 remove_watcher() i=5 2024-09-14T11:29:21.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.578+0000 7ff226b21800 20 remove_watcher() i=6 2024-09-14T11:29:21.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.579+0000 7ff226b21800 20 remove_watcher() i=7 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard add non empty bucket 2024-09-14T11:29:21.590 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:21.594 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.594 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.603 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.603 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.610 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.610 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.617 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.617 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.625 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.626 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.633 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.633 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.640 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.641 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.647 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:21.647 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:21.653 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:21.683 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:21.683 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:21.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.721+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.722+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.722+0000 7f912fd3e800 20 realm 2024-09-14T11:29:21.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.722+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.723+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.723+0000 7f912fd3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.723+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.723+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.723+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.724+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:21.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.724+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.724+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:21.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.724+0000 7f912fd3e800 20 searching for the correct realm 2024-09-14T11:29:21.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.726+0000 7f912c287640 0 -- 172.21.15.130:0/944568445 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f912006cb10 msgr2=0x7f9120093a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:21.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.932+0000 7f912c287640 0 -- 172.21.15.130:0/944568445 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f912006cb10 msgr2=0x7f9120093a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:21.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:21.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:21.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:21.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:21.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:21.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:21.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.936+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 zone default found 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 4 Realm: () 2024-09-14T11:29:21.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 zonegroup default 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.937+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 started sync module instance, tier type = 2024-09-14T11:29:21.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.938+0000 7f912fd3e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:21.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=0 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=1 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=2 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=3 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=4 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=5 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.948+0000 7f912fd3e800 20 add_watcher() i=6 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.949+0000 7f912fd3e800 20 add_watcher() i=7 2024-09-14T11:29:21.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.949+0000 7f912fd3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:21.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f8fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f912fd3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f912fd3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f912fd3e800 5 note: GC not initialized 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f8fe0fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f912fd3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:21.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f912fd3e800 20 Filter name: none 2024-09-14T11:29:21.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.951+0000 7f8f5a7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:21.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.952+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.952+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:21.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.952+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.953+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.953+0000 7f912fd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.953+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.953+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.953+0000 7f912fd3e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:21.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.954+0000 7f912fd3e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:21.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.954+0000 7f912fd3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:21.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.955+0000 7f8fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:21.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.958+0000 7f912fd3e800 20 remove_watcher() i=0 2024-09-14T11:29:21.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.958+0000 7f912fd3e800 2 removed watcher, disabling cache 2024-09-14T11:29:21.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.959+0000 7f912fd3e800 20 remove_watcher() i=1 2024-09-14T11:29:21.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.960+0000 7f912fd3e800 20 remove_watcher() i=2 2024-09-14T11:29:21.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.961+0000 7f912fd3e800 20 remove_watcher() i=3 2024-09-14T11:29:21.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.962+0000 7f912fd3e800 20 remove_watcher() i=4 2024-09-14T11:29:21.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.963+0000 7f912fd3e800 20 remove_watcher() i=5 2024-09-14T11:29:21.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.964+0000 7f912fd3e800 20 remove_watcher() i=6 2024-09-14T11:29:21.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:21.965+0000 7f912fd3e800 20 remove_watcher() i=7 2024-09-14T11:29:21.974 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:21.974 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:21.975 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:29:21.975 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:21.976 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:29:22.007 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:22.007 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:22.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.048+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 20 realm 2024-09-14T11:29:22.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:22.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.049+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.050+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.050+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.050+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:22.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.050+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.051+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:22.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.051+0000 7f9f9f723800 20 searching for the correct realm 2024-09-14T11:29:22.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.054+0000 7f9f9bc0d640 0 -- 172.21.15.130:0/56109751 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9f90005530 msgr2=0x7f9f90005950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:22.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.259+0000 7f9f9b40c640 0 -- 172.21.15.130:0/56109751 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f9f9408c920 msgr2=0x7f9f9407d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:22.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.466+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 zone default found 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 4 Realm: () 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 zonegroup default 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.467+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.468+0000 7f9f9f723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.468+0000 7f9f9f723800 20 started sync module instance, tier type = 2024-09-14T11:29:22.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.468+0000 7f9f9f723800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:22.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=0 2024-09-14T11:29:22.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=1 2024-09-14T11:29:22.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=2 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=3 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=4 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=5 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.477+0000 7f9f9f723800 20 add_watcher() i=6 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.478+0000 7f9f9f723800 20 add_watcher() i=7 2024-09-14T11:29:22.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.478+0000 7f9f9f723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:22.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.481+0000 7f9e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.481+0000 7f9f9f723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.481+0000 7f9f9f723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.481+0000 7f9f9f723800 5 note: GC not initialized 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9e50fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 20 Filter name: none 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9dca7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:22.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.482+0000 7f9f9f723800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:22.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:22.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:22.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:22.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:22.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.483+0000 7f9f9f723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:22.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.485+0000 7f9e51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:22.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.487+0000 7f9f9f723800 20 remove_watcher() i=0 2024-09-14T11:29:22.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.487+0000 7f9f9f723800 2 removed watcher, disabling cache 2024-09-14T11:29:22.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.488+0000 7f9f9f723800 20 remove_watcher() i=1 2024-09-14T11:29:22.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.489+0000 7f9f9f723800 20 remove_watcher() i=2 2024-09-14T11:29:22.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.490+0000 7f9f9f723800 20 remove_watcher() i=3 2024-09-14T11:29:22.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.492+0000 7f9f9f723800 20 remove_watcher() i=4 2024-09-14T11:29:22.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.493+0000 7f9f9f723800 20 remove_watcher() i=5 2024-09-14T11:29:22.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.493+0000 7f9f9f723800 20 remove_watcher() i=6 2024-09-14T11:29:22.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.494+0000 7f9f9f723800 20 remove_watcher() i=7 2024-09-14T11:29:22.505 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard list 2024-09-14T11:29:22.532 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:22.533 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:22.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.571+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 realm 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.574+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.575+0000 7f9476814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:22.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.575+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.576+0000 7f9476814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:22.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.576+0000 7f9476814800 20 searching for the correct realm 2024-09-14T11:29:22.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.579+0000 7f9471fe0640 0 -- 172.21.15.130:0/4087569838 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f946c02b3f0 msgr2=0x7f946c02b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:22.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.583+0000 7f9471fe0640 0 -- 172.21.15.130:0/4087569838 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f933c0878d0 msgr2=0x7f933c089d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:22.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.586+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 zone default found 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 4 Realm: () 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 zonegroup default 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.587+0000 7f9476814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.588+0000 7f9476814800 20 started sync module instance, tier type = 2024-09-14T11:29:22.588 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.588+0000 7f9476814800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:22.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=0 2024-09-14T11:29:22.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=1 2024-09-14T11:29:22.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=2 2024-09-14T11:29:22.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=3 2024-09-14T11:29:22.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=4 2024-09-14T11:29:22.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=5 2024-09-14T11:29:22.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=6 2024-09-14T11:29:22.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 20 add_watcher() i=7 2024-09-14T11:29:22.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.597+0000 7f9476814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:22.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.599+0000 7f93237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.599+0000 7f9476814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f9476814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f9476814800 5 note: GC not initialized 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f93227fc640 20 reqs_thread_entry: start 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f9476814800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f9476814800 20 Filter name: none 2024-09-14T11:29:22.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.600+0000 7f9293fff640 20 reqs_thread_entry: start 2024-09-14T11:29:22.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.607+0000 7f93237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.609+0000 7f9476814800 20 remove_watcher() i=0 2024-09-14T11:29:22.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.609+0000 7f9476814800 2 removed watcher, disabling cache 2024-09-14T11:29:22.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.610+0000 7f9476814800 20 remove_watcher() i=1 2024-09-14T11:29:22.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.611+0000 7f9476814800 20 remove_watcher() i=2 2024-09-14T11:29:22.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.612+0000 7f9476814800 20 remove_watcher() i=3 2024-09-14T11:29:22.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.613+0000 7f9476814800 20 remove_watcher() i=4 2024-09-14T11:29:22.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.614+0000 7f9476814800 20 remove_watcher() i=5 2024-09-14T11:29:22.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.615+0000 7f9476814800 20 remove_watcher() i=6 2024-09-14T11:29:22.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.616+0000 7f9476814800 20 remove_watcher() i=7 2024-09-14T11:29:22.626 INFO:tasks.workunit.client.0.smithi130.stderr:bucket name a-bucket 2024-09-14T11:29:22.626 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard process non empty bucket 2024-09-14T11:29:22.626 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:22.627 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshard process 2024-09-14T11:29:22.654 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:22.654 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:22.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.697+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 realm 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:22.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.699+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.700+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:22.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.700+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:22.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.701+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:22.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.701+0000 7f08b3546800 20 searching for the correct realm 2024-09-14T11:29:22.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.703+0000 7f08b0836640 0 -- 172.21.15.130:0/3122014641 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f07800878d0 msgr2=0x7f0780089d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:22.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:22.908+0000 7f08b1037640 0 -- 172.21.15.130:0/3122014641 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f08ac0bdb30 msgr2=0x7f08ac0a6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:23.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.115+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 zone default found 2024-09-14T11:29:23.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 4 Realm: () 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 zonegroup default 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 started sync module instance, tier type = 2024-09-14T11:29:23.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.116+0000 7f08b3546800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=0 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=1 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=2 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=3 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=4 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=5 2024-09-14T11:29:23.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.126+0000 7f08b3546800 20 add_watcher() i=6 2024-09-14T11:29:23.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.127+0000 7f08b3546800 20 add_watcher() i=7 2024-09-14T11:29:23.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.127+0000 7f08b3546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.128+0000 7f07667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 5 note: GC not initialized 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f07657e2640 20 reqs_thread_entry: start 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 20 Filter name: none 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f06d6ffd640 20 reqs_thread_entry: start 2024-09-14T11:29:23.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.129+0000 7f08b3546800 20 processing logshard = reshard.0000000000 2024-09-14T11:29:23.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.132+0000 7f08b3546800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:29:23.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.132+0000 7f08b3546800 20 processing logshard = reshard.0000000001 2024-09-14T11:29:23.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.135+0000 7f08b3546800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:29:23.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.135+0000 7f08b3546800 20 processing logshard = reshard.0000000002 2024-09-14T11:29:23.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.137+0000 7f08b3546800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:29:23.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.137+0000 7f08b3546800 20 processing logshard = reshard.0000000003 2024-09-14T11:29:23.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.140+0000 7f08b3546800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:29:23.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.140+0000 7f08b3546800 20 processing logshard = reshard.0000000004 2024-09-14T11:29:23.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.143+0000 7f08b3546800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:29:23.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.143+0000 7f08b3546800 20 processing logshard = reshard.0000000005 2024-09-14T11:29:23.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.145+0000 7f08b3546800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:29:23.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.145+0000 7f08b3546800 20 processing logshard = reshard.0000000006 2024-09-14T11:29:23.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 20 process_entry resharding a-bucket 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:29:23.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.147+0000 7f08b3546800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.148+0000 7f08b3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f08b3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f08b3546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f08b3546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f08b3546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f078f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94182255169584 notifier 5846 bl.length()=911 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f078f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f078f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.154+0000 7f078f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.155+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:23.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.155+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:23.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.155+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:23.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.155+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:23.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:29:23.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:29:23.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:29:23.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:29:23.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:29:23.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:29:23.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:23.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.159+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:23.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.160+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:23.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.160+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:23.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.160+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:23.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.160+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:23.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:23.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:23.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.161+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.162+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.162+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.162+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.162+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.163+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.163+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.163+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.163+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.164+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:23.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.164+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:23.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.164+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:23.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.164+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:23.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.167+0000 7f08b3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:23.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.167+0000 7f08b3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f08b3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f08b3546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f08b3546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f08b3546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f078effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94182255169584 notifier 5846 bl.length()=911 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f078effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f078effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.168+0000 7f078effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.169+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:23.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.169+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:23.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.169+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:23.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.169+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:23.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.171+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:23.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.171+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.0 2024-09-14T11:29:23.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.171+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:23.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.171+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.1 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.2 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.3 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.4 2024-09-14T11:29:23.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:23.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.172+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.5 2024-09-14T11:29:23.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.6 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.7 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.173+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.8 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.9 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:23.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.10 2024-09-14T11:29:23.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:23.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.174+0000 7f08b3546800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.1.11 2024-09-14T11:29:23.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.175+0000 7f08b3546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:23.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.175+0000 7f08b3546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f08b3546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f08b3546800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f08b3546800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f08b3546800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f078effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94182255169584 notifier 5846 bl.length()=879 2024-09-14T11:29:23.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f078effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f078effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.176+0000 7f078effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.177+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.177+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.177+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:29:23.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.177+0000 7f08b3546800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:29:23.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.179+0000 7f08b3546800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:29:23.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.180+0000 7f08b3546800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:29:23.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.182+0000 7f08b3546800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:29:23.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.182+0000 7f08b3546800 20 processing logshard = reshard.0000000007 2024-09-14T11:29:23.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.184+0000 7f08b3546800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:29:23.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.184+0000 7f08b3546800 20 processing logshard = reshard.0000000008 2024-09-14T11:29:23.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.187+0000 7f08b3546800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:29:23.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.187+0000 7f08b3546800 20 processing logshard = reshard.0000000009 2024-09-14T11:29:23.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.189+0000 7f08b3546800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:29:23.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.189+0000 7f08b3546800 20 processing logshard = reshard.0000000010 2024-09-14T11:29:23.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.191+0000 7f08b3546800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:29:23.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.191+0000 7f08b3546800 20 processing logshard = reshard.0000000011 2024-09-14T11:29:23.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.194+0000 7f08b3546800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:29:23.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.194+0000 7f08b3546800 20 processing logshard = reshard.0000000012 2024-09-14T11:29:23.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.197+0000 7f08b3546800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:29:23.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.197+0000 7f08b3546800 20 processing logshard = reshard.0000000013 2024-09-14T11:29:23.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.199+0000 7f08b3546800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:29:23.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.199+0000 7f08b3546800 20 processing logshard = reshard.0000000014 2024-09-14T11:29:23.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.202+0000 7f08b3546800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:29:23.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.202+0000 7f08b3546800 20 processing logshard = reshard.0000000015 2024-09-14T11:29:23.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.205+0000 7f08b3546800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:29:23.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.205+0000 7f07667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:23.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.207+0000 7f08b3546800 20 remove_watcher() i=0 2024-09-14T11:29:23.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.207+0000 7f08b3546800 2 removed watcher, disabling cache 2024-09-14T11:29:23.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.209+0000 7f08b3546800 20 remove_watcher() i=1 2024-09-14T11:29:23.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.209+0000 7f08b3546800 20 remove_watcher() i=2 2024-09-14T11:29:23.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.210+0000 7f08b3546800 20 remove_watcher() i=3 2024-09-14T11:29:23.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.212+0000 7f08b3546800 20 remove_watcher() i=4 2024-09-14T11:29:23.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.213+0000 7f08b3546800 20 remove_watcher() i=5 2024-09-14T11:29:23.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.213+0000 7f08b3546800 20 remove_watcher() i=6 2024-09-14T11:29:23.213 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.214+0000 7f08b3546800 20 remove_watcher() i=7 2024-09-14T11:29:23.225 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:29:23.254 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:23.254 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:23.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.293+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 20 realm 2024-09-14T11:29:23.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:23.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.294+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.295+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.295+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.295+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:23.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.295+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.296+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:23.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.296+0000 7f90ae926800 20 searching for the correct realm 2024-09-14T11:29:23.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.297+0000 7f90aa5d9640 0 -- 172.21.15.130:0/2586571011 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f90a4061070 msgr2=0x7f90a40ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:23.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.503+0000 7f90a1dd8640 0 -- 172.21.15.130:0/2586571011 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f909c089930 msgr2=0x7f909c06c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:23.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:23.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:23.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:23.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:23.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.509+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:23.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 zone default found 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 4 Realm: () 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 zonegroup default 2024-09-14T11:29:23.510 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.510+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.511+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.511+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.511+0000 7f90ae926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.511+0000 7f90ae926800 20 started sync module instance, tier type = 2024-09-14T11:29:23.511 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.511+0000 7f90ae926800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=0 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=1 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=2 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=3 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=4 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=5 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.520+0000 7f90ae926800 20 add_watcher() i=6 2024-09-14T11:29:23.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.521+0000 7f90ae926800 20 add_watcher() i=7 2024-09-14T11:29:23.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.521+0000 7f90ae926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:23.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.523+0000 7f8f60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:23.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.523+0000 7f90ae926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.523+0000 7f90ae926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.523+0000 7f90ae926800 5 note: GC not initialized 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f8edb7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f90ae926800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f90ae926800 20 Filter name: none 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f8ed97fa640 20 reqs_thread_entry: start 2024-09-14T11:29:23.523 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.524+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.525+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.525+0000 7f90ae926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.525+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.525+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:29:23.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.525+0000 7f90ae926800 20 rados->read ofs=0 len=0 2024-09-14T11:29:23.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.526+0000 7f90ae926800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:29:23.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.526+0000 7f90ae926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:23.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.527+0000 7f8f60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:23.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.530+0000 7f90ae926800 20 remove_watcher() i=0 2024-09-14T11:29:23.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.530+0000 7f90ae926800 2 removed watcher, disabling cache 2024-09-14T11:29:23.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.531+0000 7f90ae926800 20 remove_watcher() i=1 2024-09-14T11:29:23.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.532+0000 7f90ae926800 20 remove_watcher() i=2 2024-09-14T11:29:23.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.533+0000 7f90ae926800 20 remove_watcher() i=3 2024-09-14T11:29:23.533 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.534+0000 7f90ae926800 20 remove_watcher() i=4 2024-09-14T11:29:23.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.535+0000 7f90ae926800 20 remove_watcher() i=5 2024-09-14T11:29:23.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.536+0000 7f90ae926800 20 remove_watcher() i=6 2024-09-14T11:29:23.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:23.537+0000 7f90ae926800 20 remove_watcher() i=7 2024-09-14T11:29:23.546 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:23.546 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:23.546 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:29:23.546 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:23.546 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:29:23.547 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:23.548 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.548 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.560 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.560 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.603 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.603 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.610 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.610 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.616 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.617 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.623 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.623 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.629 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.630 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.636 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.636 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.642 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.643 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.649 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.649 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.655 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.655 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.662 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.662 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.669 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.669 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.676 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.676 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.683 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.683 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.689 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.696 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.696 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.703 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.709 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.709 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.716 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.716 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.722 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.728 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:23.729 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:23.735 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:23.763 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:23.763 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:24.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.002+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 realm 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.004+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.005+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:24.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.005+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.006+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:24.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.006+0000 7f4aeb726800 20 searching for the correct realm 2024-09-14T11:29:24.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.007+0000 7f4ae6bd8640 0 -- 172.21.15.130:0/3189689112 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f4ad80e30b0 msgr2=0x7f4ad8071940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:24.211 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.213+0000 7f4ae73d9640 0 -- 172.21.15.130:0/3189689112 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f4ae0025410 msgr2=0x7f4ae0025870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.418+0000 7f4aeb726800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:24.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:24.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 zone default found 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 4 Realm: () 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 zonegroup default 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.419+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 started sync module instance, tier type = 2024-09-14T11:29:24.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.420+0000 7f4aeb726800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=0 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=1 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=2 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=3 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=4 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=5 2024-09-14T11:29:24.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.430+0000 7f4aeb726800 20 add_watcher() i=6 2024-09-14T11:29:24.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.431+0000 7f4aeb726800 20 add_watcher() i=7 2024-09-14T11:29:24.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.431+0000 7f4aeb726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:24.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.433+0000 7f499dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:24.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.433+0000 7f4aeb726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:24.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.433+0000 7f4aeb726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:24.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.433+0000 7f4aeb726800 5 note: GC not initialized 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.433+0000 7f499cfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.434+0000 7f4aeb726800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.434+0000 7f4aeb726800 20 Filter name: none 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.434+0000 7f49167fc640 20 reqs_thread_entry: start 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.434+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.435+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:24.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.435+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.435+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:24.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.435+0000 7f4aeb726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:24.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.435+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.436+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:24.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.436+0000 7f4aeb726800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.436+0000 7f4aeb726800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:24.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.436+0000 7f4aeb726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:24.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.438+0000 7f499dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:24.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.441+0000 7f4aeb726800 20 remove_watcher() i=0 2024-09-14T11:29:24.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.441+0000 7f4aeb726800 2 removed watcher, disabling cache 2024-09-14T11:29:24.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.442+0000 7f4aeb726800 20 remove_watcher() i=1 2024-09-14T11:29:24.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.443+0000 7f4aeb726800 20 remove_watcher() i=2 2024-09-14T11:29:24.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.444+0000 7f4aeb726800 20 remove_watcher() i=3 2024-09-14T11:29:24.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.445+0000 7f4aeb726800 20 remove_watcher() i=4 2024-09-14T11:29:24.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.446+0000 7f4aeb726800 20 remove_watcher() i=5 2024-09-14T11:29:24.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.447+0000 7f4aeb726800 20 remove_watcher() i=6 2024-09-14T11:29:24.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.448+0000 7f4aeb726800 20 remove_watcher() i=7 2024-09-14T11:29:24.457 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:24.458 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:24.458 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-init-index id: a588039c-1457-497f-adbd-8890a12279b7.4508.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:24.458 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:24.459 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:29:24.494 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:24.494 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:24.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.533+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 realm 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.535+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.536+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:24.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.536+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.537+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:24.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.537+0000 7f6105b0c800 20 searching for the correct realm 2024-09-14T11:29:24.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.538+0000 7f61035fd640 0 -- 172.21.15.130:0/2799870218 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x56481ea882a0 msgr2=0x7f60fc072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:24.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.744+0000 7f6102dfc640 0 -- 172.21.15.130:0/2799870218 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f60f401c040 msgr2=0x7f60f404a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:24.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.749+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:24.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 zone default found 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 4 Realm: () 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 zonegroup default 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.750+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 started sync module instance, tier type = 2024-09-14T11:29:24.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.751+0000 7f6105b0c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=0 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=1 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=2 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=3 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=4 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=5 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.760+0000 7f6105b0c800 20 add_watcher() i=6 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.761+0000 7f6105b0c800 20 add_watcher() i=7 2024-09-14T11:29:24.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.761+0000 7f6105b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:24.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.763+0000 7f5fb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:24.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.763+0000 7f6105b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:24.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.763+0000 7f6105b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:24.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.763+0000 7f6105b0c800 5 note: GC not initialized 2024-09-14T11:29:24.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f5fb8fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:24.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 20 Filter name: none 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f5f327fc640 20 reqs_thread_entry: start 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 : miss 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.764+0000 7f6105b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:24.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:24.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:24.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.765+0000 7f6105b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 2024-09-14T11:29:24.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.766+0000 7f6105b0c800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:29:24.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.766+0000 7f6105b0c800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:29:24.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.768+0000 7f5fb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:24.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.770+0000 7f6105b0c800 20 remove_watcher() i=0 2024-09-14T11:29:24.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.770+0000 7f6105b0c800 2 removed watcher, disabling cache 2024-09-14T11:29:24.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.771+0000 7f6105b0c800 20 remove_watcher() i=1 2024-09-14T11:29:24.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.772+0000 7f6105b0c800 20 remove_watcher() i=2 2024-09-14T11:29:24.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.773+0000 7f6105b0c800 20 remove_watcher() i=3 2024-09-14T11:29:24.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.774+0000 7f6105b0c800 20 remove_watcher() i=4 2024-09-14T11:29:24.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.775+0000 7f6105b0c800 20 remove_watcher() i=5 2024-09-14T11:29:24.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.776+0000 7f6105b0c800 20 remove_watcher() i=6 2024-09-14T11:29:24.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.777+0000 7f6105b0c800 20 remove_watcher() i=7 2024-09-14T11:29:24.788 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:24.816 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:24.816 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:24.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.854+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 realm 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.856+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.857+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:24.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.857+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:24.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.858+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:24.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.858+0000 7fd84373e800 20 searching for the correct realm 2024-09-14T11:29:24.858 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:24.860+0000 7fd83fcc1640 0 -- 172.21.15.130:0/369806091 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd83402b420 msgr2=0x7fd83402b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:25.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.065+0000 7fd83fcc1640 0 -- 172.21.15.130:0/369806091 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fd83402b420 msgr2=0x7fd83402b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:25.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.069+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 zone default found 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 4 Realm: () 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 zonegroup default 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.070+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.071+0000 7fd84373e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.071+0000 7fd84373e800 20 started sync module instance, tier type = 2024-09-14T11:29:25.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.071+0000 7fd84373e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:25.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=0 2024-09-14T11:29:25.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=1 2024-09-14T11:29:25.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=2 2024-09-14T11:29:25.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=3 2024-09-14T11:29:25.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=4 2024-09-14T11:29:25.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=5 2024-09-14T11:29:25.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.079+0000 7fd84373e800 20 add_watcher() i=6 2024-09-14T11:29:25.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.080+0000 7fd84373e800 20 add_watcher() i=7 2024-09-14T11:29:25.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.080+0000 7fd84373e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd6f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd84373e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd84373e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd84373e800 5 note: GC not initialized 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd6f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd84373e800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:25.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.082+0000 7fd84373e800 20 Filter name: none 2024-09-14T11:29:25.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd66e7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:25.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.083+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.084+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.084+0000 7fd84373e800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.084+0000 7fd84373e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:25.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.084+0000 7fd84373e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:25.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.086+0000 7fd6f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.088+0000 7fd84373e800 20 remove_watcher() i=0 2024-09-14T11:29:25.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.088+0000 7fd84373e800 2 removed watcher, disabling cache 2024-09-14T11:29:25.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.090+0000 7fd84373e800 20 remove_watcher() i=1 2024-09-14T11:29:25.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.091+0000 7fd84373e800 20 remove_watcher() i=2 2024-09-14T11:29:25.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.092+0000 7fd84373e800 20 remove_watcher() i=3 2024-09-14T11:29:25.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.093+0000 7fd84373e800 20 remove_watcher() i=4 2024-09-14T11:29:25.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.094+0000 7fd84373e800 20 remove_watcher() i=5 2024-09-14T11:29:25.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.095+0000 7fd84373e800 20 remove_watcher() i=6 2024-09-14T11:29:25.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.096+0000 7fd84373e800 20 remove_watcher() i=7 2024-09-14T11:29:25.105 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:25.106 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:25.106 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-init-index id: a588039c-1457-497f-adbd-8890a12279b7.4508.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:25.106 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:25.108 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.108 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.114 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.114 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:25.187 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:25.188 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:25.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.226+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 realm 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.227+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.228+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:25.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.228+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.229+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:25.227 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.229+0000 7fcd2f014800 20 searching for the correct realm 2024-09-14T11:29:25.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.231+0000 7fcd2afe1640 0 -- 172.21.15.130:0/713875356 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fcd2000b040 msgr2=0x7fcd20018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:25.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.437+0000 7fcd2afe1640 0 -- 172.21.15.130:0/713875356 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fcd2000b040 msgr2=0x7fcd20018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:25.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.441+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 zone default found 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 4 Realm: () 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 zonegroup default 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.442+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.443+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.443+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.443+0000 7fcd2f014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.443+0000 7fcd2f014800 20 started sync module instance, tier type = 2024-09-14T11:29:25.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.443+0000 7fcd2f014800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=0 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=1 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=2 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=3 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=4 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=5 2024-09-14T11:29:25.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.453+0000 7fcd2f014800 20 add_watcher() i=6 2024-09-14T11:29:25.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.454+0000 7fcd2f014800 20 add_watcher() i=7 2024-09-14T11:29:25.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.454+0000 7fcd2f014800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:25.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.455+0000 7fcbe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 5 note: GC not initialized 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcb5b7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:25.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 20 Filter name: none 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcb597fa640 20 reqs_thread_entry: start 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.456+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 : miss 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.457+0000 7fcd2f014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcd2f014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcd2f014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcd2f014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcd2f014800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20, ofs0, ns] 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcc0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 93949100504064 notifier 5930 bl.length()=995 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcc0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcc0dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.462+0000 7fcc0dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.463+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_sources= new_sources= 2024-09-14T11:29:25.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.463+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential sources added=[] removed=[] 2024-09-14T11:29:25.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.463+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_dests= new_dests= 2024-09-14T11:29:25.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.463+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential dests added=[] removed=[] 2024-09-14T11:29:25.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.0 2024-09-14T11:29:25.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.0 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.1 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.1 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.2 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.2 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.3 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.3 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.4 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.4 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.5 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.5 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.6 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.6 2024-09-14T11:29:25.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.7 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.7 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.8 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.8 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.9 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.9 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.10 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.10 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.11 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1.11 2024-09-14T11:29:25.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.0 2024-09-14T11:29:25.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.469+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1 2024-09-14T11:29:25.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.470+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.2 2024-09-14T11:29:25.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.470+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.3 2024-09-14T11:29:25.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.471+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.4 2024-09-14T11:29:25.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.471+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.5 2024-09-14T11:29:25.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.472+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.6 2024-09-14T11:29:25.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.472+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.7 2024-09-14T11:29:25.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.473+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.8 2024-09-14T11:29:25.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.473+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.9 2024-09-14T11:29:25.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.474+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.10 2024-09-14T11:29:25.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.477+0000 7fcd2f014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:25.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.477+0000 7fcd2f014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 2024-09-14T11:29:25.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.478+0000 7fcd2f014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.478+0000 7fcd2f014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.478+0000 7fcd2f014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.478+0000 7fcd2f014800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20, ofs0, ns] 2024-09-14T11:29:25.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcc0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 93949100504064 notifier 5930 bl.length()=995 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcc0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcc0dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcc0dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_sources= new_sources= 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential sources added=[] removed=[] 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_dests= new_dests= 2024-09-14T11:29:25.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.479+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential dests added=[] removed=[] 2024-09-14T11:29:25.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.481+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.0 2024-09-14T11:29:25.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.481+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.1 2024-09-14T11:29:25.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.482+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.2 2024-09-14T11:29:25.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.482+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.3 2024-09-14T11:29:25.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.482+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.4 2024-09-14T11:29:25.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.483+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.5 2024-09-14T11:29:25.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.483+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.6 2024-09-14T11:29:25.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.483+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.7 2024-09-14T11:29:25.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.484+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.8 2024-09-14T11:29:25.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.484+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.9 2024-09-14T11:29:25.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.484+0000 7fcd2f014800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.20.10 2024-09-14T11:29:25.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.485+0000 7fcd2f014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:25.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.485+0000 7fcd2f014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20, ofs0, ns] 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcc0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 93949100504064 notifier 5930 bl.length()=963 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcc0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 info.flags=0x17 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcc0dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.20 to cache LRU end 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcc0dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:25.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_sources= new_sources= 2024-09-14T11:29:25.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential sources added=[] removed=[] 2024-09-14T11:29:25.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): orig_dests= new_dests= 2024-09-14T11:29:25.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.486+0000 7fcd2f014800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.20]): potential dests added=[] removed=[] 2024-09-14T11:29:25.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.488+0000 7fcd2f014800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:25.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.490+0000 7fcbe0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.492+0000 7fcd2f014800 20 remove_watcher() i=0 2024-09-14T11:29:25.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.492+0000 7fcd2f014800 2 removed watcher, disabling cache 2024-09-14T11:29:25.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.493+0000 7fcd2f014800 20 remove_watcher() i=1 2024-09-14T11:29:25.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.494+0000 7fcd2f014800 20 remove_watcher() i=2 2024-09-14T11:29:25.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.495+0000 7fcd2f014800 20 remove_watcher() i=3 2024-09-14T11:29:25.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.496+0000 7fcd2f014800 20 remove_watcher() i=4 2024-09-14T11:29:25.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.497+0000 7fcd2f014800 20 remove_watcher() i=5 2024-09-14T11:29:25.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.498+0000 7fcd2f014800 20 remove_watcher() i=6 2024-09-14T11:29:25.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.499+0000 7fcd2f014800 20 remove_watcher() i=7 2024-09-14T11:29:25.510 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:25.538 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:25.538 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:25.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.576+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 realm 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.577 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.578+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.579+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.579+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.580+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.580+0000 7f0c30320800 20 searching for the correct realm 2024-09-14T11:29:25.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.582+0000 7f0c2c703640 0 -- 172.21.15.130:0/3059158682 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0c140b2be0 msgr2=0x7f0c140abc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:25.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.787+0000 7f0c2c703640 0 -- 172.21.15.130:0/3059158682 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0c140b2be0 msgr2=0x7f0c140abc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.791+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 zone default found 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 4 Realm: () 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 zonegroup default 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.792+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.793+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.793+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.793+0000 7f0c30320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.793+0000 7f0c30320800 20 started sync module instance, tier type = 2024-09-14T11:29:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.793+0000 7f0c30320800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:25.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=0 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=1 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=2 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=3 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=4 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=5 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.803+0000 7f0c30320800 20 add_watcher() i=6 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.804+0000 7f0c30320800 20 add_watcher() i=7 2024-09-14T11:29:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.804+0000 7f0c30320800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0ae1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 5 note: GC not initialized 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0ae0fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 20 Filter name: none 2024-09-14T11:29:25.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0a5a7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:25.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.806+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.807+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.807+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.807+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.807+0000 7f0c30320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.807+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.808+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.808+0000 7f0c30320800 20 rados->read ofs=0 len=0 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.808+0000 7f0c30320800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.808+0000 7f0c30320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:25.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.810+0000 7f0ae1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:25.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.812+0000 7f0c30320800 20 remove_watcher() i=0 2024-09-14T11:29:25.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.812+0000 7f0c30320800 2 removed watcher, disabling cache 2024-09-14T11:29:25.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.813+0000 7f0c30320800 20 remove_watcher() i=1 2024-09-14T11:29:25.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.815+0000 7f0c30320800 20 remove_watcher() i=2 2024-09-14T11:29:25.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.816+0000 7f0c30320800 20 remove_watcher() i=3 2024-09-14T11:29:25.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.817+0000 7f0c30320800 20 remove_watcher() i=4 2024-09-14T11:29:25.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.819+0000 7f0c30320800 20 remove_watcher() i=5 2024-09-14T11:29:25.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.820+0000 7f0c30320800 20 remove_watcher() i=6 2024-09-14T11:29:25.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:25.820+0000 7f0c30320800 20 remove_watcher() i=7 2024-09-14T11:29:25.829 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:25.903 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:25.903 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-init-index id: a588039c-1457-497f-adbd-8890a12279b7.4508.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:29:25.903 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.904 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.906 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:29:25.907 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:25.907 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.907 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.918 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.918 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.960 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.960 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.967 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.967 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.973 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.973 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.979 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.986 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.986 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.992 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.992 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:25.998 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:25.998 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.004 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.004 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.010 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.010 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.017 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.017 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.023 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.023 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.029 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.029 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.035 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.035 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.041 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.041 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.047 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.047 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.053 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.053 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.059 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.059 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.065 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.065 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.071 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.071 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.077 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:26.077 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:26.085 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:26.112 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:26.113 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:26.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.150+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 realm 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.152+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.153+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:26.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.153+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.154+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:26.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.154+0000 7f779ef31800 20 searching for the correct realm 2024-09-14T11:29:26.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.156+0000 7f779b39a640 0 -- 172.21.15.130:0/3987348619 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f778407d060 msgr2=0x7f77840aa610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:26.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.361+0000 7f779b39a640 0 -- 172.21.15.130:0/3987348619 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f778407d060 msgr2=0x7f77840aa610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:26.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 zone default found 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 4 Realm: () 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 zonegroup default 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.365+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 started sync module instance, tier type = 2024-09-14T11:29:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.366+0000 7f779ef31800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=0 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=1 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=2 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=3 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=4 2024-09-14T11:29:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=5 2024-09-14T11:29:26.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=6 2024-09-14T11:29:26.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 20 add_watcher() i=7 2024-09-14T11:29:26.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.378+0000 7f779ef31800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:26.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.380+0000 7f76517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 5 note: GC not initialized 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f75cbfff640 20 reqs_thread_entry: start 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 20 Filter name: none 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f75c9ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:26.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.381+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.382+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:26.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.382+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.382+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:26.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:26.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:26.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:26.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.383+0000 7f779ef31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:26.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.385+0000 7f76517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:26.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.387+0000 7f779ef31800 20 remove_watcher() i=0 2024-09-14T11:29:26.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.387+0000 7f779ef31800 2 removed watcher, disabling cache 2024-09-14T11:29:26.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.388+0000 7f779ef31800 20 remove_watcher() i=1 2024-09-14T11:29:26.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.389+0000 7f779ef31800 20 remove_watcher() i=2 2024-09-14T11:29:26.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.391+0000 7f779ef31800 20 remove_watcher() i=3 2024-09-14T11:29:26.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.391+0000 7f779ef31800 20 remove_watcher() i=4 2024-09-14T11:29:26.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.392+0000 7f779ef31800 20 remove_watcher() i=5 2024-09-14T11:29:26.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.393+0000 7f779ef31800 20 remove_watcher() i=6 2024-09-14T11:29:26.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.394+0000 7f779ef31800 20 remove_watcher() i=7 2024-09-14T11:29:26.403 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:26.403 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:26.403 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-init-index id: a588039c-1457-497f-adbd-8890a12279b7.4508.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:26.403 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:26.404 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:29:26.441 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:26.441 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:26.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.479+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 realm 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.480+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.481+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:26.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.481+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.482+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.482+0000 7f1f31f46800 20 searching for the correct realm 2024-09-14T11:29:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.484+0000 7f1f30231640 0 -- 172.21.15.130:0/2340094799 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f1f24082060 msgr2=0x7f1f24047400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:26.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.691+0000 7f1f30231640 0 -- 172.21.15.130:0/2340094799 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f1f24082060 msgr2=0x7f1f24047400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:26.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:26.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:26.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 zone default found 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 4 Realm: () 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 zonegroup default 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.695+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 started sync module instance, tier type = 2024-09-14T11:29:26.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.696+0000 7f1f31f46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:26.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=0 2024-09-14T11:29:26.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=1 2024-09-14T11:29:26.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=2 2024-09-14T11:29:26.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=3 2024-09-14T11:29:26.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=4 2024-09-14T11:29:26.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=5 2024-09-14T11:29:26.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.705+0000 7f1f31f46800 20 add_watcher() i=6 2024-09-14T11:29:26.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.706+0000 7f1f31f46800 20 add_watcher() i=7 2024-09-14T11:29:26.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.706+0000 7f1f31f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:26.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:26.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1f31f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:26.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1f31f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:26.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1f31f46800 5 note: GC not initialized 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1de4fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1f31f46800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.708+0000 7f1f31f46800 20 Filter name: none 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1d5e7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:29:26.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 : miss 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.709+0000 7f1f31f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 info.flags=0x17 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 to cache LRU end 2024-09-14T11:29:26.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:26.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:26.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.710+0000 7f1f31f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 2024-09-14T11:29:26.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.711+0000 7f1f31f46800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:29:26.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.711+0000 7f1f31f46800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:29:26.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 info.flags=0x17 2024-09-14T11:29:26.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 to cache LRU end 2024-09-14T11:29:26.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21, ofs0, ns] 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1e0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94278620013168 notifier 5978 bl.length()=995 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1e0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 info.flags=0x17 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1e0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 to cache LRU end 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1e0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): orig_sources= new_sources= 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): potential sources added=[] removed=[] 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): orig_dests= new_dests= 2024-09-14T11:29:26.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.715+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): potential dests added=[] removed=[] 2024-09-14T11:29:26.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.0 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.0 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.1 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.1 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.2 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.2 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.3 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.3 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.4 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.4 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.5 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.5 2024-09-14T11:29:26.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.6 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.6 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.7 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.7 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.8 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.8 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.9 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.9 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.10 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.10 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.11 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1.11 2024-09-14T11:29:26.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.0 2024-09-14T11:29:26.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.718+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.1 2024-09-14T11:29:26.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.719+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.2 2024-09-14T11:29:26.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.719+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.3 2024-09-14T11:29:26.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.720+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.4 2024-09-14T11:29:26.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.720+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.5 2024-09-14T11:29:26.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.721+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.6 2024-09-14T11:29:26.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.722+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.7 2024-09-14T11:29:26.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.722+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.8 2024-09-14T11:29:26.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.723+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.9 2024-09-14T11:29:26.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.723+0000 7f1f31f46800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.21.10 2024-09-14T11:29:26.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.727+0000 7f1f31f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:26.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.727+0000 7f1f31f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 2024-09-14T11:29:26.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 info.flags=0x17 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 to cache LRU end 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21, ofs0, ns] 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1e0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94278620013168 notifier 5978 bl.length()=963 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1e0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 info.flags=0x17 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1e0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:a588039c-1457-497f-adbd-8890a12279b7.4508.21 to cache LRU end 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1e0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): orig_sources= new_sources= 2024-09-14T11:29:26.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): potential sources added=[] removed=[] 2024-09-14T11:29:26.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): orig_dests= new_dests= 2024-09-14T11:29:26.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.728+0000 7f1f31f46800 20 handle_bi_update(): bucket=:error-at-init-index[a588039c-1457-497f-adbd-8890a12279b7.4508.21]): potential dests added=[] removed=[] 2024-09-14T11:29:26.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.730+0000 7f1f31f46800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:26.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.732+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:26.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.734+0000 7f1f31f46800 20 remove_watcher() i=0 2024-09-14T11:29:26.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.734+0000 7f1f31f46800 2 removed watcher, disabling cache 2024-09-14T11:29:26.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.735+0000 7f1f31f46800 20 remove_watcher() i=1 2024-09-14T11:29:26.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.736+0000 7f1f31f46800 20 remove_watcher() i=2 2024-09-14T11:29:26.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.737+0000 7f1f31f46800 20 remove_watcher() i=3 2024-09-14T11:29:26.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.738+0000 7f1f31f46800 20 remove_watcher() i=4 2024-09-14T11:29:26.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.739+0000 7f1f31f46800 20 remove_watcher() i=5 2024-09-14T11:29:26.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.740+0000 7f1f31f46800 20 remove_watcher() i=6 2024-09-14T11:29:26.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.741+0000 7f1f31f46800 20 remove_watcher() i=7 2024-09-14T11:29:26.751 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:29:26.780 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:26.780 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:26.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.817+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 realm 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:26.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.819+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.820+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:26.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.820+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:26.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.821+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:26.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.821+0000 7f41e131f800 20 searching for the correct realm 2024-09-14T11:29:26.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.823+0000 7f41d48a1640 0 -- 172.21.15.130:0/684568089 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f41d0011c50 msgr2=0x7f41d003f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:26.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:26.826+0000 7f41dd0a2640 0 -- 172.21.15.130:0/684568089 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f41d8055490 msgr2=0x7f41d806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:27.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:27.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 20 zone default found 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 4 Realm: () 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.033+0000 7f41e131f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 zonegroup default 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 started sync module instance, tier type = 2024-09-14T11:29:27.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.034+0000 7f41e131f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=0 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=1 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=2 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=3 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=4 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=5 2024-09-14T11:29:27.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.042+0000 7f41e131f800 20 add_watcher() i=6 2024-09-14T11:29:27.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.043+0000 7f41e131f800 20 add_watcher() i=7 2024-09-14T11:29:27.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.043+0000 7f41e131f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:27.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.045+0000 7f4093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:27.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.045+0000 7f41e131f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.045+0000 7f41e131f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.045+0000 7f41e131f800 5 note: GC not initialized 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f4092fe5640 20 reqs_thread_entry: start 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f41e131f800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f41e131f800 20 Filter name: none 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f4090fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:27.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.046+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.047+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.047+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.047+0000 7f41e131f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.047+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.048+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:29:27.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.048+0000 7f41e131f800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.048+0000 7f41e131f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:29:27.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.048+0000 7f41e131f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:27.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.050+0000 7f4093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:27.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.052+0000 7f41e131f800 20 remove_watcher() i=0 2024-09-14T11:29:27.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.052+0000 7f41e131f800 2 removed watcher, disabling cache 2024-09-14T11:29:27.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.053+0000 7f41e131f800 20 remove_watcher() i=1 2024-09-14T11:29:27.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.054+0000 7f41e131f800 20 remove_watcher() i=2 2024-09-14T11:29:27.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.055+0000 7f41e131f800 20 remove_watcher() i=3 2024-09-14T11:29:27.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.056+0000 7f41e131f800 20 remove_watcher() i=4 2024-09-14T11:29:27.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.057+0000 7f41e131f800 20 remove_watcher() i=5 2024-09-14T11:29:27.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.058+0000 7f41e131f800 20 remove_watcher() i=6 2024-09-14T11:29:27.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.058+0000 7f41e131f800 20 remove_watcher() i=7 2024-09-14T11:29:27.067 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.068 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:27.068 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-init-index id: a588039c-1457-497f-adbd-8890a12279b7.4508.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:29:27.068 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.069 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.070 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.072 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.072 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.115 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.115 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.141 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:29:27.141 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.142 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.143 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.153 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.153 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.195 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.196 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.204 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.204 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.210 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.210 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.216 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.216 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.222 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.222 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.229 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.229 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.235 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.235 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.241 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.241 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.248 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.248 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.254 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.255 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.261 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.261 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.267 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.267 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.274 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.274 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.282 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.282 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.288 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.288 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.295 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.295 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.301 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.301 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.308 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.308 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.314 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.315 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.321 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:27.321 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:27.328 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:27.356 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:27.356 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:27.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.393+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 realm 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.395+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.396+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:27.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.396+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.397+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:27.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.397+0000 7f9208528800 20 searching for the correct realm 2024-09-14T11:29:27.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.399+0000 7f9204a70640 0 -- 172.21.15.130:0/627554879 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f91f802c040 msgr2=0x7f91f802d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:27.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.605+0000 7f9204a70640 0 -- 172.21.15.130:0/627554879 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f91f802c040 msgr2=0x7f91f802d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:27.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:27.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:27.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:27.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.608+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 zone default found 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 4 Realm: () 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:27.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 zonegroup default 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.609+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.610+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.610+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.610+0000 7f9208528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.610+0000 7f9208528800 20 started sync module instance, tier type = 2024-09-14T11:29:27.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.610+0000 7f9208528800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=0 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=1 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=2 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=3 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=4 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=5 2024-09-14T11:29:27.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.618+0000 7f9208528800 20 add_watcher() i=6 2024-09-14T11:29:27.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.619+0000 7f9208528800 20 add_watcher() i=7 2024-09-14T11:29:27.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.619+0000 7f9208528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:27.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.621+0000 7f90bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:27.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.621+0000 7f9208528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:27.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.621+0000 7f9208528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:27.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.621+0000 7f9208528800 5 note: GC not initialized 2024-09-14T11:29:27.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f90b9fdb640 20 reqs_thread_entry: start 2024-09-14T11:29:27.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f9208528800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:27.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f9208528800 20 Filter name: none 2024-09-14T11:29:27.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f902b7fe640 20 reqs_thread_entry: start 2024-09-14T11:29:27.621 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.622+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.623+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.623+0000 7f9208528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.623+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.623+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.623+0000 7f9208528800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.624+0000 7f9208528800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:27.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.624+0000 7f9208528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:27.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.625+0000 7f90bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:27.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.627+0000 7f9208528800 20 remove_watcher() i=0 2024-09-14T11:29:27.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.627+0000 7f9208528800 2 removed watcher, disabling cache 2024-09-14T11:29:27.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.628+0000 7f9208528800 20 remove_watcher() i=1 2024-09-14T11:29:27.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.629+0000 7f9208528800 20 remove_watcher() i=2 2024-09-14T11:29:27.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.630+0000 7f9208528800 20 remove_watcher() i=3 2024-09-14T11:29:27.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.631+0000 7f9208528800 20 remove_watcher() i=4 2024-09-14T11:29:27.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.632+0000 7f9208528800 20 remove_watcher() i=5 2024-09-14T11:29:27.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.633+0000 7f9208528800 20 remove_watcher() i=6 2024-09-14T11:29:27.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.634+0000 7f9208528800 20 remove_watcher() i=7 2024-09-14T11:29:27.643 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.643 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:27.643 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-init-indext id: a588039c-1457-497f-adbd-8890a12279b7.4508.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:27.643 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.645 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:29:27.677 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:27.678 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:27.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.715+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 realm 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.719+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.719+0000 7fe157d46800 20 searching for the correct realm 2024-09-14T11:29:27.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.721+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:27.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.927+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:27.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:27.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 zone default found 2024-09-14T11:29:27.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 4 Realm: () 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 zonegroup default 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.933+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.933+0000 7fe157d46800 20 started sync module instance, tier type = 2024-09-14T11:29:27.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.933+0000 7fe157d46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=0 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=1 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=2 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=3 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=4 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=5 2024-09-14T11:29:27.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=6 2024-09-14T11:29:27.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.942+0000 7fe157d46800 20 add_watcher() i=7 2024-09-14T11:29:27.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.942+0000 7fe157d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:27.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe00bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:27.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe157d46800 5 note: GC not initialized 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe00afe5640 20 reqs_thread_entry: start 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe157d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.944+0000 7fe157d46800 20 Filter name: none 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe008fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : miss 2024-09-14T11:29:27.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:27.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:27.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:27.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.945+0000 7fe157d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe157d46800 time 2024-09-14T11:29:27.948184+0000 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:27.946 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe15b38c76a] 2024-09-14T11:29:27.947 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:27.947 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:27.947 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:27.947 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:27.948 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:29:27.948 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:27.948 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:29:27.948 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:29:27.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.947+0000 7fe157d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe157d46800 time 2024-09-14T11:29:27.948184+0000 2024-09-14T11:29:27.949 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:27.949 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.949 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:27.949 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe15b38c76a] 2024-09-14T11:29:27.949 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:29:27.950 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fe157d46800 thread_name:radosgw-admin 2024-09-14T11:29:27.964 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:27.964 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe15a03e6f0] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe15a08b99c] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe15b38c7c4] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:29:27.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:27.948+0000 7fe157d46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fe157d46800 thread_name:radosgw-admin 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe15a03e6f0] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe15a08b99c] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe15b38c7c4] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:29:27.966 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6017 payload 274 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:29:27.698+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:29:27.698+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d13520 auth_method 0 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:27.967 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: dump: 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: _finish_auth 0 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: _check_auth_tickets 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:27.968 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: dump: 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 monclient: authenticate success, global_id 6017 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: get_monmap_and_config success 2024-09-14T11:29:27.969 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:29:27.699+0000 7fe157d46800 4 set_mon_vals no callback set 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: shutdown 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 asok(0x560728aec270) unregister_commands rotate-key 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:29:27.699+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:27.970 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.971 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: starting msgr at 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: starting objecter 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests hook 0x560728d3b0f0 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: setting wanted keys 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: calling monclient init 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:27.972 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:27.973 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key hook 0x560728d0c358 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728b95ce0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728c55b60 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728d13520 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.974 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.184833s 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728b95ce0 auth_method 0 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728c55b60 auth_method 0 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.975 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient: _finish_hunting 0 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:29:27.701+0000 7fe155837640 1 monclient: found mon.noname-c 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:29:27.701+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d13520 auth_method 0 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: dump: 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: _finish_auth 0 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: _check_auth_tickets 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:29:27.701+0000 7fe157d46800 5 monclient: authenticate success, global_id 6020 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: dump: 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.977 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:29:27.701+0000 7fe043e07640 4 set_mon_vals no callback set 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:29:27.701+0000 7fe157d46800 1 librados: init done 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:27.978 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:29:27.703+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe03c077230 auth_method 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:29:27.703+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d41140 auth_method 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:29:27.704+0000 7fe155837640 10 monclient: get_auth_request con 0x560728d58090 auth_method 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:29:27.705+0000 7fe155036640 10 monclient: get_auth_request con 0x560728d5c3f0 auth_method 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:29:27.706+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:29:27.706+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:29:27.706+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:27.979 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.980 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:29:27.706+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests cmddesc objecter_requests hook 0x560728d646b0 EEXIST 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:27.981 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:29:27.707+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.982 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:29:27.707+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x560728d5f9c0 EEXIST 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728d889d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728d88db0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728d876e0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.191668s 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728d88db0 auth_method 0 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.983 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728d876e0 auth_method 0 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728d889d0 auth_method 0 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.984 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:29:27.708+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: dump: 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.985 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:27.986 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: dump: 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:29:27.708+0000 7fe157d46800 5 monclient: authenticate success, global_id 6023 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:27.987 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:29:27.708+0000 7fe156839640 4 set_mon_vals no callback set 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: get_monmap_and_config 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:29:27.710+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:29:27.710+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe030077140 auth_method 0 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.989 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:29:27.710+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:27.990 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:27.991 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:29:27.711+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:29:27.711+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x7fff7d0c98e8 EEXIST 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728ddca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728dd6c70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728dd83c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:27.992 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.195535s 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728dd6c70 auth_method 0 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728ddca10 auth_method 0 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728dd83c0 auth_method 0 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:27.993 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6026 payload 274 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:29:27.711+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.994 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: dump: 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:27.995 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: dump: 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.996 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 monclient: authenticate success, global_id 6026 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: get_monmap_and_config success 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:29:27.712+0000 7fe157d46800 4 set_mon_vals no callback set 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: shutdown 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:29:27.712+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.998 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:29:27.712+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: starting msgr at 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: starting objecter 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests cmddesc objecter_requests hook 0x560728d86f50 EEXIST 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: setting wanted keys 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: calling monclient init 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:27.999 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:29:27.713+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.000 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:29:27.713+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x560728d9d3d8 EEXIST 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728dd6c70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728dd83c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728ddca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.197722s 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728dd6c70 auth_method 0 2024-09-14T11:29:28.001 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728ddca10 auth_method 0 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728dd83c0 auth_method 0 2024-09-14T11:29:28.002 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:29:27.714+0000 7fe155837640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: dump: 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: dump: 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:29:27.714+0000 7fe157d46800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:29:27.714+0000 7fe0397fa640 4 set_mon_vals no callback set 2024-09-14T11:29:28.005 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:29:27.714+0000 7fe157d46800 1 librados: init done 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:29:27.714+0000 7fe157d46800 5 asok(0x560728aec270) register_command cr dump hook 0x560728ddcec8 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:29:27.715+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:29:27.716+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe020077260 auth_method 0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:29:27.716+0000 7fe156038640 10 monclient: get_auth_request con 0x560728df69d0 auth_method 0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 realm 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.006 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:29:27.717+0000 7fe157d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:29:27.718+0000 7fe155837640 10 monclient: get_auth_request con 0x560728dfae30 auth_method 0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:29:27.718+0000 7fe155036640 10 monclient: get_auth_request con 0x560728dfe590 auth_method 0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:29:27.719+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:29:27.719+0000 7fe157d46800 20 searching for the correct realm 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:29:27.719+0000 7fe156038640 10 monclient: get_auth_request con 0x560728e03350 auth_method 0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:29:27.720+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe15000f3d0 auth_method 0 2024-09-14T11:29:28.007 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:29:27.720+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe148077020 auth_method 0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:29:27.721+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe14c0ac0e0 auth_method 0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:29:27.721+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:29:27.923+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe14c0ac0e0 auth_method 0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:29:27.926+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe150034450 auth_method 0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:29:27.927+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:29:27.927+0000 7fe0277fe640 1 client.6029.objecter ms_handle_reset 0x7fe14c0ac0e0 session 0x7fe14c07e050 osd.4 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:29:27.927+0000 7fe0277fe640 10 monclient: _renew_subs 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:29:27.927+0000 7fe0277fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:29:27.927+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe020087900 auth_method 0 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:28.008 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 zone default found 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 Realm: () 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:28.009 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:29:27.932+0000 7fe157d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 zonegroup default 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 started sync module instance, tier type = 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=0 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=1 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=2 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=3 2024-09-14T11:29:28.010 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=4 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=5 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=6 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:29:27.942+0000 7fe157d46800 20 add_watcher() i=7 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:29:27.942+0000 7fe157d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.011 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:29:27.944+0000 7fe00bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:29:27.944+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache list hook 0x560728ddc300 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache inspect hook 0x560728ddc300 2024-09-14T11:29:28.012 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache erase hook 0x560728ddc300 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache zap hook 0x560728ddc300 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 note: GC not initialized 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:29:27.944+0000 7fe00afe5640 20 reqs_thread_entry: start 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace show hook 0x7fe14c07b030 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace history hook 0x7fe14c07b030 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace active hook 0x7fe14c07b030 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace active_short hook 0x7fe14c07b030 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 Filter name: none 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:29:27.945+0000 7fe008fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.013 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : miss 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:29:27.947+0000 7fe157d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe157d46800 time 2024-09-14T11:29:27.948184+0000 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:28.014 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe15b38c76a] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:29:27.948+0000 7fe157d46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:28.015 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fe157d46800 thread_name:radosgw-admin 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe15a03e6f0] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe15a08b99c] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe15b38c7c4] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:28.016 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:29:28.017 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:29:28.018 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:29:28.019 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:29:28.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:29:28.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:28.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:29:28.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe008fe1640 / http_manager 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe00afe5640 / http_manager 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe00bfe7640 / rgw_dt_lg_renew 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe0277fe640 / ms_dispatch 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe0397fa640 / io_context_pool 2024-09-14T11:29:28.024 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe03b7fe640 / ms_dispatch 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe042604640 / ms_dispatch 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe043e07640 / io_context_pool 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe155036640 / msgr-worker-2 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe155837640 / msgr-worker-1 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe156038640 / msgr-worker-0 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe156839640 / io_context_pool 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe157d46800 / radosgw-admin 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.90972.log 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:29:28.025 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6017 payload 274 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:29:27.698+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:29:27.698+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:29:27.698+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d13520 auth_method 0 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:29:27.698+0000 7fe043e07640 10 monclient: dump: 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.026 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:29:27.699+0000 7fe043e07640 10 monclient: dump: 2024-09-14T11:29:28.027 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 monclient: authenticate success, global_id 6017 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: get_monmap_and_config success 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:29:27.699+0000 7fe157d46800 4 set_mon_vals no callback set 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: shutdown 2024-09-14T11:29:28.028 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 asok(0x560728aec270) unregister_commands rotate-key 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:29:27.699+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:29:27.699+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:28.029 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding auth protocol: cephx 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: crc 2024-09-14T11:29:28.030 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:29:27.699+0000 7fe157d46800 5 AuthRegistry(0x560728d11ee0) adding con mode: secure 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: starting msgr at 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: starting objecter 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests hook 0x560728d3b0f0 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: setting wanted keys 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:29:27.700+0000 7fe157d46800 1 librados: calling monclient init 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding auth protocol: cephx 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.031 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: crc 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 AuthRegistry(0x560728d0c210) adding con mode: secure 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:29:27.700+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:29:27.700+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key hook 0x560728d0c358 2024-09-14T11:29:28.032 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728b95ce0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728c55b60 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728d13520 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:29:27.700+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.184833s 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728b95ce0 auth_method 0 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.033 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728c55b60 auth_method 0 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:29:27.700+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:29:27.700+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:29:27.701+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient(hunting): handle_auth_done global_id 6020 payload 824 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:29:27.701+0000 7fe155837640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:29:27.701+0000 7fe155837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.034 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:29:27.701+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d13520 auth_method 0 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: dump: 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.035 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:29:27.701+0000 7fe157d46800 5 monclient: authenticate success, global_id 6020 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:29:27.701+0000 7fe042604640 10 monclient: dump: 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:29:27.701+0000 7fe043e07640 4 set_mon_vals no callback set 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:29:27.701+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:29:27.701+0000 7fe157d46800 1 librados: init done 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:29:27.703+0000 7fe042604640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.037 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:29:27.703+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe03c077230 auth_method 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:29:27.703+0000 7fe156038640 10 monclient: get_auth_request con 0x560728d41140 auth_method 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:29:27.704+0000 7fe155837640 10 monclient: get_auth_request con 0x560728d58090 auth_method 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:29:27.705+0000 7fe155036640 10 monclient: get_auth_request con 0x560728d5c3f0 auth_method 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:29:27.706+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:29:27.706+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:29:27.706+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding auth protocol: cephx 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.039 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: crc 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:29:27.706+0000 7fe157d46800 5 AuthRegistry(0x560728d611a0) adding con mode: secure 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:29:27.706+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests cmddesc objecter_requests hook 0x560728d646b0 EEXIST 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:28.040 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding auth protocol: cephx 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.041 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: crc 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 AuthRegistry(0x560728d5f878) adding con mode: secure 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:29:27.707+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:29:27.707+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:29:27.707+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x560728d5f9c0 EEXIST 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728d889d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728d88db0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728d876e0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:28.042 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:29:27.707+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.191668s 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728d88db0 auth_method 0 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728d876e0 auth_method 0 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:29:27.707+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.043 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:29:27.707+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728d889d0 auth_method 0 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:29:27.707+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:29:27.708+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:29:27.708+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:29:27.708+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.044 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: dump: 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.045 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:29:27.708+0000 7fe03b7fe640 10 monclient: dump: 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:29:27.708+0000 7fe157d46800 5 monclient: authenticate success, global_id 6023 2024-09-14T11:29:28.046 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:29:27.708+0000 7fe156839640 4 set_mon_vals no callback set 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:29:27.708+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:29:27.710+0000 7fe03b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: get_monmap_and_config 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:29:27.710+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:29:27.710+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:28.047 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:29:27.710+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe030077140 auth_method 0 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding auth protocol: cephx 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.048 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: crc 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:29:27.710+0000 7fe157d46800 5 AuthRegistry(0x560728da8430) adding con mode: secure 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:29:27.710+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding auth protocol: cephx 2024-09-14T11:29:28.049 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: crc 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c97a0) adding con mode: secure 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:29:27.711+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:29:27.711+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:29:27.711+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x7fff7d0c98e8 EEXIST 2024-09-14T11:29:28.050 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728ddca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728dd6c70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728dd83c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:29:27.711+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.195535s 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728dd6c70 auth_method 0 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.051 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728ddca10 auth_method 0 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728dd83c0 auth_method 0 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.052 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:29:27.711+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:29:27.711+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient(hunting): handle_auth_done global_id 6026 payload 274 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:29:27.711+0000 7fe155036640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:29:27.711+0000 7fe155036640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: dump: 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.053 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:29:27.712+0000 7fe0397fa640 10 monclient: dump: 2024-09-14T11:29:28.054 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 monclient: authenticate success, global_id 6026 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: get_monmap_and_config success 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:29:27.712+0000 7fe157d46800 4 set_mon_vals no callback set 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: shutdown 2024-09-14T11:29:28.055 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: build_initial_monmap 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:29:27.712+0000 7fe157d46800 1 build_initial for_mkfs: 0 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:29:27.712+0000 7fe157d46800 10 monclient: monmap: 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:29:28.056 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding auth protocol: cephx 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.057 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: crc 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:29:27.712+0000 7fe157d46800 5 AuthRegistry(0x560728dad5c0) adding con mode: secure 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:29:27.712+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: starting msgr at 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: starting objecter 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 asok(0x560728aec270) register_command objecter_requests cmddesc objecter_requests hook 0x560728d86f50 EEXIST 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: setting wanted keys 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:29:27.713+0000 7fe157d46800 1 librados: calling monclient init 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: init 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding auth protocol: cephx 2024-09-14T11:29:28.058 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: crc 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 AuthRegistry(0x560728d9d290) adding con mode: secure 2024-09-14T11:29:28.059 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:29:27.713+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:29:27.713+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:29:27.713+0000 7fe157d46800 5 asok(0x560728aec270) register_command rotate-key cmddesc rotate-key hook 0x560728d9d3d8 EEXIST 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: _reopen_session rank -1 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-c con 0x560728dd6c70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-b con 0x560728dd83c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): picked mon.noname-a con 0x560728ddca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): _renew_subs 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:29:27.713+0000 7fe157d46800 10 monclient(hunting): authenticate will time out at 1884.197722s 2024-09-14T11:29:28.060 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): get_auth_request con 0x560728dd6c70 auth_method 0 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): get_auth_request con 0x560728ddca10 auth_method 0 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:29:27.713+0000 7fe155837640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:29:27.713+0000 7fe156038640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:29:28.061 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): get_auth_request con 0x560728dd83c0 auth_method 0 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:29:27.713+0000 7fe155036640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient: _finish_hunting 0 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:29:27.714+0000 7fe155837640 1 monclient: found mon.noname-c 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:29:27.714+0000 7fe155837640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: dump: 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.062 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: _finish_auth 0 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: _check_auth_tickets 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:29:27.714+0000 7fe0277fe640 10 monclient: dump: 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.063 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:29:27.714+0000 7fe157d46800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:29:27.714+0000 7fe0397fa640 4 set_mon_vals no callback set 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _renew_subs 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:29:27.714+0000 7fe157d46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:29:27.714+0000 7fe157d46800 1 librados: init done 2024-09-14T11:29:28.064 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:29:27.714+0000 7fe157d46800 5 asok(0x560728aec270) register_command cr dump hook 0x560728ddcec8 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:29:27.715+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:29:27.716+0000 7fe0277fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:29:27.716+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe020077260 auth_method 0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:29:27.716+0000 7fe156038640 10 monclient: get_auth_request con 0x560728df69d0 auth_method 0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 realm 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:29:27.717+0000 7fe157d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:29:27.717+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.065 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:29:27.718+0000 7fe155837640 10 monclient: get_auth_request con 0x560728dfae30 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:29:27.718+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:29:27.718+0000 7fe155036640 10 monclient: get_auth_request con 0x560728dfe590 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:29:27.719+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:29:27.719+0000 7fe157d46800 20 searching for the correct realm 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:29:27.719+0000 7fe156038640 10 monclient: get_auth_request con 0x560728e03350 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:29:27.720+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe15000f3d0 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:29:27.720+0000 7fe155036640 10 monclient: get_auth_request con 0x7fe148077020 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:29:27.721+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe14c0ac0e0 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:29:27.721+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:29:27.923+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe14c0ac0e0 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:29:27.926+0000 7fe155837640 10 monclient: get_auth_request con 0x7fe150034450 auth_method 0 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:29:27.927+0000 7fe156038640 0 -- 172.21.15.130:0/996500940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe14c0ac0e0 msgr2=0x7fe14c0e38c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.066 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:29:27.927+0000 7fe0277fe640 1 client.6029.objecter ms_handle_reset 0x7fe14c0ac0e0 session 0x7fe14c07e050 osd.4 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:29:27.927+0000 7fe0277fe640 10 monclient: _renew_subs 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:29:27.927+0000 7fe0277fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:29:27.927+0000 7fe156038640 10 monclient: get_auth_request con 0x7fe020087900 auth_method 0 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:29:27.931+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.067 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 zone default found 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 Realm: () 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:29:27.932+0000 7fe157d46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:29:27.932+0000 7fe157d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 zonegroup default 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:29:27.932+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 started sync module instance, tier type = 2024-09-14T11:29:28.068 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:29:27.933+0000 7fe157d46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=0 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=1 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=2 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=3 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=4 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=5 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:29:27.941+0000 7fe157d46800 20 add_watcher() i=6 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:29:27.942+0000 7fe157d46800 20 add_watcher() i=7 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:29:27.942+0000 7fe157d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding auth protocol: cephx 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.069 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: crc 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 AuthRegistry(0x7fff7d0c9c80) adding con mode: secure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:29:27.944+0000 7fe00bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:29:27.944+0000 7fe157d46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:28.070 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache list hook 0x560728ddc300 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache inspect hook 0x560728ddc300 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache erase hook 0x560728ddc300 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command cache zap hook 0x560728ddc300 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 note: GC not initialized 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:29:27.944+0000 7fe00afe5640 20 reqs_thread_entry: start 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace show hook 0x7fe14c07b030 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace history hook 0x7fe14c07b030 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace active hook 0x7fe14c07b030 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:29:27.944+0000 7fe157d46800 5 asok(0x560728aec270) register_command sync trace active_short hook 0x7fe14c07b030 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:29:27.944+0000 7fe157d46800 20 Filter name: none 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:29:27.945+0000 7fe008fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:28.071 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : miss 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:29:27.945+0000 7fe157d46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:29:27.945+0000 7fe157d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:29:27.947+0000 7fe157d46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe157d46800 time 2024-09-14T11:29:27.948184+0000 2024-09-14T11:29:28.072 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe15b38c76a] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:29:28.073 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:29:27.948+0000 7fe157d46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fe157d46800 thread_name:radosgw-admin 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe15a03e6f0] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe15a08b99c] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe15b38c7c4] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe15b38c928] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607277310b1] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd882d4) [0x560727c442d4] 2024-09-14T11:29:28.074 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560727740efd] 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe15a029590] 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:29:28.075 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:29:28.076 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:29:28.077 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:29:28.078 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:29:28.079 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:29:28.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:29:28.081 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe008fe1640 / http_manager 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe00afe5640 / http_manager 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe00bfe7640 / rgw_dt_lg_renew 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe0277fe640 / ms_dispatch 2024-09-14T11:29:28.082 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe0397fa640 / io_context_pool 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe03b7fe640 / ms_dispatch 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe042604640 / ms_dispatch 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe043e07640 / io_context_pool 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe155036640 / msgr-worker-2 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe155837640 / msgr-worker-1 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe156038640 / msgr-worker-0 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe156839640 / io_context_pool 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: 7fe157d46800 / radosgw-admin 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:29:27.949851Z_106cecf5-4104-4e99-9f0c-9ce893060788/log 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:29:28.083 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.025+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 20 realm 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:28.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.026+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.027+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.027+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.028+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.028+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.028+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.028+0000 7f7a03f46800 20 searching for the correct realm 2024-09-14T11:29:28.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.031+0000 7f7a02238640 0 -- 172.21.15.130:0/2352803625 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f79f8084060 msgr2=0x7f79f80b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.236+0000 7f7a02238640 0 -- 172.21.15.130:0/2352803625 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f79f8084060 msgr2=0x7f79f80b5230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:28.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.241+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 zone default found 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 4 Realm: () 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 zonegroup default 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 started sync module instance, tier type = 2024-09-14T11:29:28.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.242+0000 7f7a03f46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=0 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=1 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=2 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=3 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=4 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=5 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.252+0000 7f7a03f46800 20 add_watcher() i=6 2024-09-14T11:29:28.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.253+0000 7f7a03f46800 20 add_watcher() i=7 2024-09-14T11:29:28.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.253+0000 7f7a03f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:28.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f78937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f7a03f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:28.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f7a03f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f7a03f46800 5 note: GC not initialized 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f78927fc640 20 reqs_thread_entry: start 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f7a03f46800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.255+0000 7f7a03f46800 20 Filter name: none 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7823fff640 20 reqs_thread_entry: start 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.256+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.257+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:28.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.257+0000 7f7a03f46800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.257+0000 7f7a03f46800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:28.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.257+0000 7f7a03f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:28.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.259+0000 7f78937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.261+0000 7f7a03f46800 20 remove_watcher() i=0 2024-09-14T11:29:28.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.261+0000 7f7a03f46800 2 removed watcher, disabling cache 2024-09-14T11:29:28.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.262+0000 7f7a03f46800 20 remove_watcher() i=1 2024-09-14T11:29:28.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.263+0000 7f7a03f46800 20 remove_watcher() i=2 2024-09-14T11:29:28.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.264+0000 7f7a03f46800 20 remove_watcher() i=3 2024-09-14T11:29:28.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.265+0000 7f7a03f46800 20 remove_watcher() i=4 2024-09-14T11:29:28.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.266+0000 7f7a03f46800 20 remove_watcher() i=5 2024-09-14T11:29:28.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.266+0000 7f7a03f46800 20 remove_watcher() i=6 2024-09-14T11:29:28.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.267+0000 7f7a03f46800 20 remove_watcher() i=7 2024-09-14T11:29:28.277 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.277 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:28.277 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-init-indext id: a588039c-1457-497f-adbd-8890a12279b7.4508.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:29:28.277 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:28.279 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:28.279 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:28.286 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:28.286 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:28.330 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.400+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.401+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.401+0000 7fd40d52c800 20 realm 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.401+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.402+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.402+0000 7fd40d52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.402+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.402+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.402+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.603+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.604+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.605+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:28.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.605+0000 7fd40d52c800 20 searching for the correct realm 2024-09-14T11:29:28.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.607+0000 7fd408a4e640 0 -- 172.21.15.130:0/2973837140 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd3fc039060 msgr2=0x7fd3fc01c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.611+0000 7fd40924f640 0 -- 172.21.15.130:0/2973837140 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd4040a76a0 msgr2=0x7fd4040a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:28.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.817+0000 7fd40d52c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.818 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 zone default found 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 4 Realm: () 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.818+0000 7fd40d52c800 20 zonegroup default 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:28.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 started sync module instance, tier type = 2024-09-14T11:29:28.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.819+0000 7fd40d52c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=0 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=1 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=2 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=3 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=4 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=5 2024-09-14T11:29:28.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.829+0000 7fd40d52c800 20 add_watcher() i=6 2024-09-14T11:29:28.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.830+0000 7fd40d52c800 20 add_watcher() i=7 2024-09-14T11:29:28.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.830+0000 7fd40d52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:28.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.832+0000 7fd2bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.832+0000 7fd40d52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:28.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.832+0000 7fd40d52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:28.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.832+0000 7fd40d52c800 5 note: GC not initialized 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.832+0000 7fd2befe5640 20 reqs_thread_entry: start 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 20 Filter name: none 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd2bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:28.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : miss 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.833+0000 7fd40d52c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:28.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:28.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.834+0000 7fd40d52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:28.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.835+0000 7fd40d52c800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to be held by another RGW process; skipping for now 2024-09-14T11:29:28.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.836+0000 7fd2bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:28.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.839+0000 7fd40d52c800 20 remove_watcher() i=0 2024-09-14T11:29:28.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.839+0000 7fd40d52c800 2 removed watcher, disabling cache 2024-09-14T11:29:28.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.840+0000 7fd40d52c800 20 remove_watcher() i=1 2024-09-14T11:29:28.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.841+0000 7fd40d52c800 20 remove_watcher() i=2 2024-09-14T11:29:28.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.842+0000 7fd40d52c800 20 remove_watcher() i=3 2024-09-14T11:29:28.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.843+0000 7fd40d52c800 20 remove_watcher() i=4 2024-09-14T11:29:28.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.844+0000 7fd40d52c800 20 remove_watcher() i=5 2024-09-14T11:29:28.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.845+0000 7fd40d52c800 20 remove_watcher() i=6 2024-09-14T11:29:28.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:28.846+0000 7fd40d52c800 20 remove_watcher() i=7 2024-09-14T11:29:28.857 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:29:58.884 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:29:58.919 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:58.919 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:58.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.962+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 realm 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:58.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:58.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:58.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.964+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:58.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.965+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:58.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.966+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:58.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.966+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:58.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.966+0000 7fcb17132800 20 searching for the correct realm 2024-09-14T11:29:58.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:58.968+0000 7fcb125bb640 0 -- 172.21.15.130:0/3731765532 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fcb040bb010 msgr2=0x7fcb040c7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:59.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.174+0000 7fcb12dbc640 0 -- 172.21.15.130:0/3731765532 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fcb0c06ba90 msgr2=0x7fcb0c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:59.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:59.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.381+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 zone default found 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 4 Realm: () 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 zonegroup default 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.382+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.383+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.383+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.383+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.383+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.384+0000 7fcb17132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.384+0000 7fcb17132800 20 started sync module instance, tier type = 2024-09-14T11:29:59.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.384+0000 7fcb17132800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:59.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=0 2024-09-14T11:29:59.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=1 2024-09-14T11:29:59.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=2 2024-09-14T11:29:59.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=3 2024-09-14T11:29:59.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=4 2024-09-14T11:29:59.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=5 2024-09-14T11:29:59.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.394+0000 7fcb17132800 20 add_watcher() i=6 2024-09-14T11:29:59.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.395+0000 7fcb17132800 20 add_watcher() i=7 2024-09-14T11:29:59.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.395+0000 7fcb17132800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:59.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fc9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:59.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fcb17132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:59.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fcb17132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fcb17132800 5 note: GC not initialized 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fc943fff640 20 reqs_thread_entry: start 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.398+0000 7fcb17132800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 20 Filter name: none 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fc941ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:29:59.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : miss 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.399+0000 7fcb17132800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:29:59.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.400+0000 7fcb17132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:59.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fcb17132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fcb17132800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fcb17132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fcb17132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22, ofs0, ns] 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fc9f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 93891266692784 notifier 6077 bl.length()=997 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fc9f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fc9f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.406+0000 7fc9f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.407+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_sources= new_sources= 2024-09-14T11:29:59.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.407+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential sources added=[] removed=[] 2024-09-14T11:29:59.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.407+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_dests= new_dests= 2024-09-14T11:29:59.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.407+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential dests added=[] removed=[] 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.0 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.0 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.1 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.1 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.2 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.2 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.3 2024-09-14T11:29:59.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.3 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.4 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.4 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.5 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.5 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.6 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.6 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.7 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.7 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.8 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.8 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.9 2024-09-14T11:29:59.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.9 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.10 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.10 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.11 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1.11 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.0 2024-09-14T11:29:59.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.412+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.413+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.2 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.413+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.3 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.414+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.4 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.415+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.5 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.415+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.6 2024-09-14T11:29:59.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.416+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.7 2024-09-14T11:29:59.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.416+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.8 2024-09-14T11:29:59.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.417+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.9 2024-09-14T11:29:59.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.418+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.10 2024-09-14T11:29:59.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.420+0000 7fcb17132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:59.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.420+0000 7fcb17132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22, ofs0, ns] 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fc9f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 93891266692784 notifier 6077 bl.length()=997 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fc9f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fc9f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fc9f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_sources= new_sources= 2024-09-14T11:29:59.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential sources added=[] removed=[] 2024-09-14T11:29:59.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_dests= new_dests= 2024-09-14T11:29:59.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.422+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential dests added=[] removed=[] 2024-09-14T11:29:59.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.425+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.0 2024-09-14T11:29:59.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.425+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.1 2024-09-14T11:29:59.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.426+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.2 2024-09-14T11:29:59.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.426+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.3 2024-09-14T11:29:59.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.426+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.4 2024-09-14T11:29:59.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.427+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.5 2024-09-14T11:29:59.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.427+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.6 2024-09-14T11:29:59.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.428+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.7 2024-09-14T11:29:59.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.428+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.8 2024-09-14T11:29:59.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.428+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.9 2024-09-14T11:29:59.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.429+0000 7fcb17132800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.22.10 2024-09-14T11:29:59.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.429+0000 7fcb17132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:29:59.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.429+0000 7fcb17132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.430+0000 7fcb17132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.430+0000 7fcb17132800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.430+0000 7fcb17132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.430+0000 7fcb17132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22, ofs0, ns] 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fc9f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 93891266692784 notifier 6077 bl.length()=965 2024-09-14T11:29:59.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fc9f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 info.flags=0x17 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fc9f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:a588039c-1457-497f-adbd-8890a12279b7.4508.22 to cache LRU end 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fc9f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_sources= new_sources= 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential sources added=[] removed=[] 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): orig_dests= new_dests= 2024-09-14T11:29:59.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.431+0000 7fcb17132800 20 handle_bi_update(): bucket=:abort-at-init-indext[a588039c-1457-497f-adbd-8890a12279b7.4508.22]): potential dests added=[] removed=[] 2024-09-14T11:29:59.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.433+0000 7fcb17132800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:29:59.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.435+0000 7fc9c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:59.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.438+0000 7fcb17132800 20 remove_watcher() i=0 2024-09-14T11:29:59.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.438+0000 7fcb17132800 2 removed watcher, disabling cache 2024-09-14T11:29:59.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.439+0000 7fcb17132800 20 remove_watcher() i=1 2024-09-14T11:29:59.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.440+0000 7fcb17132800 20 remove_watcher() i=2 2024-09-14T11:29:59.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.441+0000 7fcb17132800 20 remove_watcher() i=3 2024-09-14T11:29:59.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.442+0000 7fcb17132800 20 remove_watcher() i=4 2024-09-14T11:29:59.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.443+0000 7fcb17132800 20 remove_watcher() i=5 2024-09-14T11:29:59.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.444+0000 7fcb17132800 20 remove_watcher() i=6 2024-09-14T11:29:59.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.445+0000 7fcb17132800 20 remove_watcher() i=7 2024-09-14T11:29:59.457 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:29:59.487 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:59.487 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:59.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.526+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.527+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 realm 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.528+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.529+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:59.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.529+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.530+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:59.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.530+0000 7ffbd6612800 20 searching for the correct realm 2024-09-14T11:29:59.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.734+0000 7ffbd24cc640 0 -- 172.21.15.130:0/524816877 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffbc8009040 msgr2=0x7ffbc80616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:59.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.941+0000 7ffbd24cc640 0 -- 172.21.15.130:0/524816877 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffbc8009040 msgr2=0x7ffbc80616c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:59.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.945+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 zone default found 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 4 Realm: () 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 zonegroup default 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.946+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.947+0000 7ffbd6612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.947+0000 7ffbd6612800 20 started sync module instance, tier type = 2024-09-14T11:29:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.947+0000 7ffbd6612800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:29:59.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=0 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=1 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=2 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=3 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=4 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=5 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.956+0000 7ffbd6612800 20 add_watcher() i=6 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.957+0000 7ffbd6612800 20 add_watcher() i=7 2024-09-14T11:29:59.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.957+0000 7ffbd6612800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.958+0000 7ffa83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 5 note: GC not initialized 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffa82ffd640 20 reqs_thread_entry: start 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 Filter name: none 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffa80ff9640 20 reqs_thread_entry: start 2024-09-14T11:29:59.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:59.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.959+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.960+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.960+0000 7ffbd6612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.960+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.960+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.960+0000 7ffbd6612800 20 rados->read ofs=0 len=0 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.961+0000 7ffbd6612800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:29:59.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.961+0000 7ffbd6612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:29:59.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.963+0000 7ffa83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:59.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.965+0000 7ffbd6612800 20 remove_watcher() i=0 2024-09-14T11:29:59.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.965+0000 7ffbd6612800 2 removed watcher, disabling cache 2024-09-14T11:29:59.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.966+0000 7ffbd6612800 20 remove_watcher() i=1 2024-09-14T11:29:59.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.967+0000 7ffbd6612800 20 remove_watcher() i=2 2024-09-14T11:29:59.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.968+0000 7ffbd6612800 20 remove_watcher() i=3 2024-09-14T11:29:59.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.969+0000 7ffbd6612800 20 remove_watcher() i=4 2024-09-14T11:29:59.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.970+0000 7ffbd6612800 20 remove_watcher() i=5 2024-09-14T11:29:59.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.971+0000 7ffbd6612800 20 remove_watcher() i=6 2024-09-14T11:29:59.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:29:59.972+0000 7ffbd6612800 20 remove_watcher() i=7 2024-09-14T11:29:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:29:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-init-indext id: a588039c-1457-497f-adbd-8890a12279b7.4508.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:29:59.981 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:29:59.982 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:29:59.986 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:29:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.029 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.056 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:30:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.058 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.071 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.113 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.113 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.121 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.121 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.128 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.128 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.134 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.134 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.141 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.141 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.148 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.149 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.155 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.155 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.161 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.161 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.168 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.168 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.174 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.174 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.180 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.181 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.187 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.187 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.193 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.194 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.200 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.200 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.207 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.207 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.213 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.213 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.219 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.219 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.225 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.225 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.231 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.231 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.237 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:00.237 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:00.245 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:00.273 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:00.273 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:00.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.311+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 realm 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.313+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.314+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:00.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.314+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.314+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:00.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.314+0000 7f9379b46800 20 searching for the correct realm 2024-09-14T11:30:00.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.316+0000 7f9377e38640 0 -- 172.21.15.130:0/2954809077 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9360087020 msgr2=0x7f93600ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:00.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.521+0000 7f9377637640 0 -- 172.21.15.130:0/2954809077 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f937001a040 msgr2=0x7f937007a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:00.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.727+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 zone default found 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 4 Realm: () 2024-09-14T11:30:00.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 zonegroup default 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.728+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.729+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.729+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.729+0000 7f9379b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.729+0000 7f9379b46800 20 started sync module instance, tier type = 2024-09-14T11:30:00.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.729+0000 7f9379b46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=0 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=1 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=2 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=3 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=4 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=5 2024-09-14T11:30:00.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.738+0000 7f9379b46800 20 add_watcher() i=6 2024-09-14T11:30:00.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.739+0000 7f9379b46800 20 add_watcher() i=7 2024-09-14T11:30:00.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.739+0000 7f9379b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.740+0000 7f922dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 5 note: GC not initialized 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f922cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 20 Filter name: none 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f91a67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:00.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.741+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.742+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.742+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.742+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.742+0000 7f9379b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.742+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.743+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.743+0000 7f9379b46800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.743+0000 7f9379b46800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:00.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.743+0000 7f9379b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:00.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.745+0000 7f922dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:00.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.747+0000 7f9379b46800 20 remove_watcher() i=0 2024-09-14T11:30:00.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.747+0000 7f9379b46800 2 removed watcher, disabling cache 2024-09-14T11:30:00.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.748+0000 7f9379b46800 20 remove_watcher() i=1 2024-09-14T11:30:00.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.749+0000 7f9379b46800 20 remove_watcher() i=2 2024-09-14T11:30:00.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.750+0000 7f9379b46800 20 remove_watcher() i=3 2024-09-14T11:30:00.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.751+0000 7f9379b46800 20 remove_watcher() i=4 2024-09-14T11:30:00.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.752+0000 7f9379b46800 20 remove_watcher() i=5 2024-09-14T11:30:00.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.753+0000 7f9379b46800 20 remove_watcher() i=6 2024-09-14T11:30:00.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.754+0000 7f9379b46800 20 remove_watcher() i=7 2024-09-14T11:30:00.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:00.762 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:00.762 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:00.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:00.764 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:30:00.798 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:00.798 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:00.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.836+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 realm 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.838+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.839+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:00.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.839+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:00.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.840+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:00.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.840+0000 7f74be420800 20 searching for the correct realm 2024-09-14T11:30:00.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.842+0000 7f74b3709640 0 -- 172.21.15.130:0/1435965702 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f74ac067eb0 msgr2=0x7f74ac00eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:00.844 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:00.845+0000 7f74bbf0a640 0 -- 172.21.15.130:0/1435965702 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f74b4061040 msgr2=0x7f74b40ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:01.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.051+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:01.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 zone default found 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 4 Realm: () 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 zonegroup default 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.052+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.053+0000 7f74be420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.053+0000 7f74be420800 20 started sync module instance, tier type = 2024-09-14T11:30:01.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.053+0000 7f74be420800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=0 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=1 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=2 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=3 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=4 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=5 2024-09-14T11:30:01.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.061+0000 7f74be420800 20 add_watcher() i=6 2024-09-14T11:30:01.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.062+0000 7f74be420800 20 add_watcher() i=7 2024-09-14T11:30:01.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.062+0000 7f74be420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f7371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f74be420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f74be420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f74be420800 5 note: GC not initialized 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f7370fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f74be420800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:01.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.064+0000 7f74be420800 20 Filter name: none 2024-09-14T11:30:01.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f72ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:01.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:01.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 : miss 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:01.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.065+0000 7f74be420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 2024-09-14T11:30:01.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.069+0000 7f74be420800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:30:01.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.069+0000 7f74be420800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:30:01.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.073+0000 7f7371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:01.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.075+0000 7f74be420800 20 remove_watcher() i=0 2024-09-14T11:30:01.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.075+0000 7f74be420800 2 removed watcher, disabling cache 2024-09-14T11:30:01.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.076+0000 7f74be420800 20 remove_watcher() i=1 2024-09-14T11:30:01.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.077+0000 7f74be420800 20 remove_watcher() i=2 2024-09-14T11:30:01.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.078+0000 7f74be420800 20 remove_watcher() i=3 2024-09-14T11:30:01.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.079+0000 7f74be420800 20 remove_watcher() i=4 2024-09-14T11:30:01.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.079+0000 7f74be420800 20 remove_watcher() i=5 2024-09-14T11:30:01.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.080+0000 7f74be420800 20 remove_watcher() i=6 2024-09-14T11:30:01.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.081+0000 7f74be420800 20 remove_watcher() i=7 2024-09-14T11:30:01.091 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:01.119 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:01.120 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:01.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.157+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 realm 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.159+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.160+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.160+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.161+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:01.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.161+0000 7fcde27ad800 20 searching for the correct realm 2024-09-14T11:30:01.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.162+0000 7fcddfa96640 0 -- 172.21.15.130:0/1237206630 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fcdd80d2020 msgr2=0x7fcdd804fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:01.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.166+0000 7fcde0297640 0 -- 172.21.15.130:0/1237206630 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fcdd006ab90 msgr2=0x7fcdd00683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:01.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:01.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:01.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.775+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:01.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 zone default found 2024-09-14T11:30:01.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 4 Realm: () 2024-09-14T11:30:01.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:01.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 zonegroup default 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.776+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.777+0000 7fcde27ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.777+0000 7fcde27ad800 20 started sync module instance, tier type = 2024-09-14T11:30:01.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.777+0000 7fcde27ad800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:01.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=0 2024-09-14T11:30:01.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=1 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=2 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=3 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=4 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=5 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.787+0000 7fcde27ad800 20 add_watcher() i=6 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.788+0000 7fcde27ad800 20 add_watcher() i=7 2024-09-14T11:30:01.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.788+0000 7fcde27ad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:01.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcc96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:01.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcde27ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:01.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcde27ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:01.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcde27ad800 5 note: GC not initialized 2024-09-14T11:30:01.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcc95fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:01.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcde27ad800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:01.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.790+0000 7fcde27ad800 20 Filter name: none 2024-09-14T11:30:01.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.791+0000 7fcc077fe640 20 reqs_thread_entry: start 2024-09-14T11:30:01.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.791+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.791+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.791+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:01.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:01.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.792+0000 7fcde27ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:01.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.794+0000 7fcc96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:01.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.796+0000 7fcde27ad800 20 remove_watcher() i=0 2024-09-14T11:30:01.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.796+0000 7fcde27ad800 2 removed watcher, disabling cache 2024-09-14T11:30:01.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.797+0000 7fcde27ad800 20 remove_watcher() i=1 2024-09-14T11:30:01.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.798+0000 7fcde27ad800 20 remove_watcher() i=2 2024-09-14T11:30:01.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.799+0000 7fcde27ad800 20 remove_watcher() i=3 2024-09-14T11:30:01.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.800+0000 7fcde27ad800 20 remove_watcher() i=4 2024-09-14T11:30:01.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.802+0000 7fcde27ad800 20 remove_watcher() i=5 2024-09-14T11:30:01.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.803+0000 7fcde27ad800 20 remove_watcher() i=6 2024-09-14T11:30:01.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.804+0000 7fcde27ad800 20 remove_watcher() i=7 2024-09-14T11:30:01.813 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:01.813 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:01.814 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:01.814 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:01.815 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:01.816 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:01.823 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:01.823 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:01.866 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:01.902 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:01.902 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:01.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.941+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 realm 2024-09-14T11:30:01.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:01.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:01.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.942+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.943+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:01.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.943+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:01.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.944+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:01.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.944+0000 7f7c3bf32800 20 searching for the correct realm 2024-09-14T11:30:01.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:01.946+0000 7f7c383bd640 0 -- 172.21.15.130:0/2533081280 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f7c20037040 msgr2=0x7f7c20037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:02.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.151+0000 7f7c383bd640 0 -- 172.21.15.130:0/2533081280 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f7c20037040 msgr2=0x7f7c20037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:02.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:02.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:02.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:02.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:02.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:02.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.154+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:02.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 zone default found 2024-09-14T11:30:02.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 4 Realm: () 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 zonegroup default 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.155+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.156+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.156+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.156+0000 7f7c3bf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.156+0000 7f7c3bf32800 20 started sync module instance, tier type = 2024-09-14T11:30:02.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.156+0000 7f7c3bf32800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:02.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=0 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=1 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=2 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=3 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=4 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=5 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.165+0000 7f7c3bf32800 20 add_watcher() i=6 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.166+0000 7f7c3bf32800 20 add_watcher() i=7 2024-09-14T11:30:02.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.166+0000 7f7c3bf32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:02.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.167+0000 7f7aedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:02.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:02.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 5 note: GC not initialized 2024-09-14T11:30:02.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7aecfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:02.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 20 Filter name: none 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7a667fc640 20 reqs_thread_entry: start 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.168+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 : miss 2024-09-14T11:30:02.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.169+0000 7f7c3bf32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 2024-09-14T11:30:02.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23, ofs0, ns] 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7b16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94195505719568 notifier 6161 bl.length()=1009 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7b16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7b16ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7b16ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_sources= new_sources= 2024-09-14T11:30:02.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential sources added=[] removed=[] 2024-09-14T11:30:02.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_dests= new_dests= 2024-09-14T11:30:02.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.174+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential dests added=[] removed=[] 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.0 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.0 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.1 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.1 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.2 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.2 2024-09-14T11:30:02.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.3 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.3 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.4 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.4 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.5 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.5 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.6 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.6 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.7 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.7 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.8 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.8 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.9 2024-09-14T11:30:02.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.9 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.10 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.10 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.11 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1.11 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.179+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.0 2024-09-14T11:30:02.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.180+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.180+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.2 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.181+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.3 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.181+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.4 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.181+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.5 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.182+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.6 2024-09-14T11:30:02.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.182+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.7 2024-09-14T11:30:02.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.183+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.8 2024-09-14T11:30:02.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.183+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.9 2024-09-14T11:30:02.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.184+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.10 2024-09-14T11:30:02.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.186+0000 7f7c3bf32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:02.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.186+0000 7f7c3bf32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23, ofs0, ns] 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7b16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94195505719568 notifier 6161 bl.length()=1009 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7b16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7b16ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7b16ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_sources= new_sources= 2024-09-14T11:30:02.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential sources added=[] removed=[] 2024-09-14T11:30:02.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_dests= new_dests= 2024-09-14T11:30:02.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.188+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential dests added=[] removed=[] 2024-09-14T11:30:02.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.191+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.0 2024-09-14T11:30:02.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.191+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.1 2024-09-14T11:30:02.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.191+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.2 2024-09-14T11:30:02.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.191+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.3 2024-09-14T11:30:02.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.192+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.4 2024-09-14T11:30:02.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.192+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.5 2024-09-14T11:30:02.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.192+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.6 2024-09-14T11:30:02.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.193+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.7 2024-09-14T11:30:02.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.193+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.8 2024-09-14T11:30:02.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.193+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.9 2024-09-14T11:30:02.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.194+0000 7f7c3bf32800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.23.10 2024-09-14T11:30:02.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.194+0000 7f7c3bf32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:02.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.194+0000 7f7c3bf32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7c3bf32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7c3bf32800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7c3bf32800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7c3bf32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23, ofs0, ns] 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7b16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94195505719568 notifier 6161 bl.length()=977 2024-09-14T11:30:02.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7b16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 info.flags=0x17 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7b16ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.23 to cache LRU end 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.195+0000 7f7b16ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.196+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_sources= new_sources= 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.196+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential sources added=[] removed=[] 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.196+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): orig_dests= new_dests= 2024-09-14T11:30:02.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.196+0000 7f7c3bf32800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.23]): potential dests added=[] removed=[] 2024-09-14T11:30:02.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.198+0000 7f7c3bf32800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:02.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.200+0000 7f7aedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.202+0000 7f7c3bf32800 20 remove_watcher() i=0 2024-09-14T11:30:02.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.202+0000 7f7c3bf32800 2 removed watcher, disabling cache 2024-09-14T11:30:02.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.203+0000 7f7c3bf32800 20 remove_watcher() i=1 2024-09-14T11:30:02.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.204+0000 7f7c3bf32800 20 remove_watcher() i=2 2024-09-14T11:30:02.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.204+0000 7f7c3bf32800 20 remove_watcher() i=3 2024-09-14T11:30:02.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.206+0000 7f7c3bf32800 20 remove_watcher() i=4 2024-09-14T11:30:02.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.207+0000 7f7c3bf32800 20 remove_watcher() i=5 2024-09-14T11:30:02.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.208+0000 7f7c3bf32800 20 remove_watcher() i=6 2024-09-14T11:30:02.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.208+0000 7f7c3bf32800 20 remove_watcher() i=7 2024-09-14T11:30:02.219 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:02.247 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:02.247 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:02.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.285+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 20 realm 2024-09-14T11:30:02.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.286+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.287+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.287+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.287+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.286 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.287+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.288+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:02.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.288+0000 7fe542f2c800 20 searching for the correct realm 2024-09-14T11:30:02.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.291+0000 7fe53f450640 0 -- 172.21.15.130:0/1479750779 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x5575608ac1f0 msgr2=0x5575608ae6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.295+0000 7fe53ec4f640 0 -- 172.21.15.130:0/1479750779 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7fe538071930 msgr2=0x7fe538055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:02.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.298+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 zone default found 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 4 Realm: () 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 zonegroup default 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 started sync module instance, tier type = 2024-09-14T11:30:02.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.299+0000 7fe542f2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:02.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=0 2024-09-14T11:30:02.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=1 2024-09-14T11:30:02.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=2 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=3 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=4 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=5 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.308+0000 7fe542f2c800 20 add_watcher() i=6 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.309+0000 7fe542f2c800 20 add_watcher() i=7 2024-09-14T11:30:02.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.309+0000 7fe542f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:02.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.310+0000 7fe3f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.310+0000 7fe542f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.310+0000 7fe542f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.310+0000 7fe542f2c800 5 note: GC not initialized 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe36ffff640 20 reqs_thread_entry: start 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe542f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe542f2c800 20 Filter name: none 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe36dffb640 20 reqs_thread_entry: start 2024-09-14T11:30:02.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.311+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.312+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.312+0000 7fe542f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.312+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.313+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:02.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.313+0000 7fe542f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.313+0000 7fe542f2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:02.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.313+0000 7fe542f2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:02.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.315+0000 7fe3f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.316+0000 7fe542f2c800 20 remove_watcher() i=0 2024-09-14T11:30:02.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.316+0000 7fe542f2c800 2 removed watcher, disabling cache 2024-09-14T11:30:02.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.317+0000 7fe542f2c800 20 remove_watcher() i=1 2024-09-14T11:30:02.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.318+0000 7fe542f2c800 20 remove_watcher() i=2 2024-09-14T11:30:02.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.319+0000 7fe542f2c800 20 remove_watcher() i=3 2024-09-14T11:30:02.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.320+0000 7fe542f2c800 20 remove_watcher() i=4 2024-09-14T11:30:02.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.321+0000 7fe542f2c800 20 remove_watcher() i=5 2024-09-14T11:30:02.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.322+0000 7fe542f2c800 20 remove_watcher() i=6 2024-09-14T11:30:02.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.323+0000 7fe542f2c800 20 remove_watcher() i=7 2024-09-14T11:30:02.332 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:02.332 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:02.332 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:02.332 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:02.334 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.334 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.338 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.338 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.381 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.381 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.407 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:30:02.407 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:02.408 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.408 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.418 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.418 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.460 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.461 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.467 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.467 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.473 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.473 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.479 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.479 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.486 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.486 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.492 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.492 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.498 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.498 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.504 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.504 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.510 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.510 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.516 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.516 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.522 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.522 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.528 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.528 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.535 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.535 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.541 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.541 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.547 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.547 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.553 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.553 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.559 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.559 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.566 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.566 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.572 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.572 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.577 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:02.578 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:02.585 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:02.614 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:02.614 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:02.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.651+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 realm 2024-09-14T11:30:02.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:02.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.653+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.654+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.654+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.655+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:02.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.655+0000 7fa707840800 20 searching for the correct realm 2024-09-14T11:30:02.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.657+0000 7fa705b2b640 0 -- 172.21.15.130:0/2543879626 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fa6f00671f0 msgr2=0x7fa6f0066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:02.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.863+0000 7fa705b2b640 0 -- 172.21.15.130:0/2543879626 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fa6f00671f0 msgr2=0x7fa6f0066c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:02.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:02.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:02.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.866+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 zone default found 2024-09-14T11:30:02.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 4 Realm: () 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 zonegroup default 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.867+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.868+0000 7fa707840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.868+0000 7fa707840800 20 started sync module instance, tier type = 2024-09-14T11:30:02.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.868+0000 7fa707840800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=0 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=1 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=2 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=3 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=4 2024-09-14T11:30:02.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=5 2024-09-14T11:30:02.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.876+0000 7fa707840800 20 add_watcher() i=6 2024-09-14T11:30:02.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.877+0000 7fa707840800 20 add_watcher() i=7 2024-09-14T11:30:02.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.877+0000 7fa707840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.878+0000 7fa5bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 5 note: GC not initialized 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa5ba7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:02.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:02.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 20 Filter name: none 2024-09-14T11:30:02.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa52bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:02.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.879+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.880+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.880+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.880+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.880+0000 7fa707840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.880+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.881+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:02.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.881+0000 7fa707840800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.881+0000 7fa707840800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:02.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.881+0000 7fa707840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:02.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.883+0000 7fa5bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:02.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.885+0000 7fa707840800 20 remove_watcher() i=0 2024-09-14T11:30:02.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.885+0000 7fa707840800 2 removed watcher, disabling cache 2024-09-14T11:30:02.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.886+0000 7fa707840800 20 remove_watcher() i=1 2024-09-14T11:30:02.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.887+0000 7fa707840800 20 remove_watcher() i=2 2024-09-14T11:30:02.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.888+0000 7fa707840800 20 remove_watcher() i=3 2024-09-14T11:30:02.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.889+0000 7fa707840800 20 remove_watcher() i=4 2024-09-14T11:30:02.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.890+0000 7fa707840800 20 remove_watcher() i=5 2024-09-14T11:30:02.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.890+0000 7fa707840800 20 remove_watcher() i=6 2024-09-14T11:30:02.890 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.891+0000 7fa707840800 20 remove_watcher() i=7 2024-09-14T11:30:02.900 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:02.900 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:02.901 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:02.901 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:02.902 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:30:02.938 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:02.938 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:02.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.976+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.977+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.977+0000 7f279e51f800 20 realm 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.977+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.978+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.978+0000 7f279e51f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.978+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.978+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.978+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.979+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.979+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.979+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:02.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.979+0000 7f279e51f800 20 searching for the correct realm 2024-09-14T11:30:02.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.981+0000 7f2791aa1640 0 -- 172.21.15.130:0/4024510383 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f278c018070 msgr2=0x7f278c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.984+0000 7f279a2a2640 0 -- 172.21.15.130:0/4024510383 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f27940059e0 msgr2=0x7f2794026460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.989+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 zone default found 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 4 Realm: () 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 zonegroup default 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.990+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:02.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.991+0000 7f279e51f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:02.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.991+0000 7f279e51f800 20 started sync module instance, tier type = 2024-09-14T11:30:02.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.991+0000 7f279e51f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=0 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=1 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=2 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=3 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=4 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=5 2024-09-14T11:30:02.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:02.999+0000 7f279e51f800 20 add_watcher() i=6 2024-09-14T11:30:02.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.000+0000 7f279e51f800 20 add_watcher() i=7 2024-09-14T11:30:02.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.000+0000 7f279e51f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:03.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.001+0000 7f2650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:03.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:03.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 5 note: GC not initialized 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f25cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 20 Filter name: none 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f25c97fa640 20 reqs_thread_entry: start 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.002+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 : miss 2024-09-14T11:30:03.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.003+0000 7f279e51f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 2024-09-14T11:30:03.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.006+0000 7f279e51f800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:30:03.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24, ofs0, ns] 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f267dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94518061093360 notifier 6612 bl.length()=1009 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f267dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f267dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f267dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_sources= new_sources= 2024-09-14T11:30:03.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential sources added=[] removed=[] 2024-09-14T11:30:03.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_dests= new_dests= 2024-09-14T11:30:03.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.008+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential dests added=[] removed=[] 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.0 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.0 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.1 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.1 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.2 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.2 2024-09-14T11:30:03.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.3 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.3 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.4 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.4 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.5 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.5 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.6 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.6 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.7 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.7 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.8 2024-09-14T11:30:03.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.8 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.9 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.9 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.10 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.10 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.11 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1.11 2024-09-14T11:30:03.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.012+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.0 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.013+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.013+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.2 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.014+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.3 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.014+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.4 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.015+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.5 2024-09-14T11:30:03.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.015+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.6 2024-09-14T11:30:03.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.016+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.7 2024-09-14T11:30:03.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.016+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.8 2024-09-14T11:30:03.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.017+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.9 2024-09-14T11:30:03.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.017+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.10 2024-09-14T11:30:03.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.020+0000 7f279e51f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:03.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.020+0000 7f279e51f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 2024-09-14T11:30:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.021+0000 7f279e51f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.021+0000 7f279e51f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.021+0000 7f279e51f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.021+0000 7f279e51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24, ofs0, ns] 2024-09-14T11:30:03.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.021+0000 7f267d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94518061093360 notifier 6612 bl.length()=1009 2024-09-14T11:30:03.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f267d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f267d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f267d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_sources= new_sources= 2024-09-14T11:30:03.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential sources added=[] removed=[] 2024-09-14T11:30:03.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_dests= new_dests= 2024-09-14T11:30:03.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.022+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential dests added=[] removed=[] 2024-09-14T11:30:03.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.024+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.0 2024-09-14T11:30:03.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.025+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.1 2024-09-14T11:30:03.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.025+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.2 2024-09-14T11:30:03.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.025+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.3 2024-09-14T11:30:03.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.025+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.4 2024-09-14T11:30:03.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.026+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.5 2024-09-14T11:30:03.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.026+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.6 2024-09-14T11:30:03.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.026+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.7 2024-09-14T11:30:03.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.027+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.8 2024-09-14T11:30:03.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.027+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.9 2024-09-14T11:30:03.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.028+0000 7f279e51f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.24.10 2024-09-14T11:30:03.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.028+0000 7f279e51f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:03.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.028+0000 7f279e51f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f279e51f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f279e51f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f279e51f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f279e51f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24, ofs0, ns] 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f267d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94518061093360 notifier 6612 bl.length()=977 2024-09-14T11:30:03.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f267d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 info.flags=0x17 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f267d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.24 to cache LRU end 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.029+0000 7f267d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.030+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_sources= new_sources= 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.030+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential sources added=[] removed=[] 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.030+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): orig_dests= new_dests= 2024-09-14T11:30:03.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.030+0000 7f279e51f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.24]): potential dests added=[] removed=[] 2024-09-14T11:30:03.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.032+0000 7f279e51f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:03.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.034+0000 7f2650fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.036+0000 7f279e51f800 20 remove_watcher() i=0 2024-09-14T11:30:03.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.036+0000 7f279e51f800 2 removed watcher, disabling cache 2024-09-14T11:30:03.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.037+0000 7f279e51f800 20 remove_watcher() i=1 2024-09-14T11:30:03.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.038+0000 7f279e51f800 20 remove_watcher() i=2 2024-09-14T11:30:03.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.039+0000 7f279e51f800 20 remove_watcher() i=3 2024-09-14T11:30:03.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.039+0000 7f279e51f800 20 remove_watcher() i=4 2024-09-14T11:30:03.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.040+0000 7f279e51f800 20 remove_watcher() i=5 2024-09-14T11:30:03.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.041+0000 7f279e51f800 20 remove_watcher() i=6 2024-09-14T11:30:03.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.042+0000 7f279e51f800 20 remove_watcher() i=7 2024-09-14T11:30:03.052 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:30:03.081 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:03.081 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:03.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.118+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 realm 2024-09-14T11:30:03.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:03.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.120+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.121+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:03.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.121+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.122+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:03.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.122+0000 7ff7d2532800 20 searching for the correct realm 2024-09-14T11:30:03.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.124+0000 7ff7ce9bd640 0 -- 172.21.15.130:0/2284002565 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff7b8025040 msgr2=0x7ff7b8076bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:03.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.330+0000 7ff7ce9bd640 0 -- 172.21.15.130:0/2284002565 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff7b8025040 msgr2=0x7ff7b8076bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:03.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:03.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:03.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:03.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:03.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.333+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 zone default found 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 4 Realm: () 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:03.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:03.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 zonegroup default 2024-09-14T11:30:03.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.334+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.335+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.335+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.335+0000 7ff7d2532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.335+0000 7ff7d2532800 20 started sync module instance, tier type = 2024-09-14T11:30:03.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.335+0000 7ff7d2532800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=0 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=1 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=2 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=3 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=4 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=5 2024-09-14T11:30:03.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.344+0000 7ff7d2532800 20 add_watcher() i=6 2024-09-14T11:30:03.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.345+0000 7ff7d2532800 20 add_watcher() i=7 2024-09-14T11:30:03.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.345+0000 7ff7d2532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:03.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff684fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:03.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 5 note: GC not initialized 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff5ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 20 Filter name: none 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff5fd7fa640 20 reqs_thread_entry: start 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.347+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.348+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:03.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.348+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.348+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:03.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.348+0000 7ff7d2532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:03.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.348+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.349+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:03.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.349+0000 7ff7d2532800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.349+0000 7ff7d2532800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:03.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.349+0000 7ff7d2532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:03.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.351+0000 7ff684fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.353+0000 7ff7d2532800 20 remove_watcher() i=0 2024-09-14T11:30:03.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.353+0000 7ff7d2532800 2 removed watcher, disabling cache 2024-09-14T11:30:03.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.354+0000 7ff7d2532800 20 remove_watcher() i=1 2024-09-14T11:30:03.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.355+0000 7ff7d2532800 20 remove_watcher() i=2 2024-09-14T11:30:03.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.356+0000 7ff7d2532800 20 remove_watcher() i=3 2024-09-14T11:30:03.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.357+0000 7ff7d2532800 20 remove_watcher() i=4 2024-09-14T11:30:03.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.358+0000 7ff7d2532800 20 remove_watcher() i=5 2024-09-14T11:30:03.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.359+0000 7ff7d2532800 20 remove_watcher() i=6 2024-09-14T11:30:03.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.359+0000 7ff7d2532800 20 remove_watcher() i=7 2024-09-14T11:30:03.368 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:03.369 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:03.369 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:30:03.369 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:03.371 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.371 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.373 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.373 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.417 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.417 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.444 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:30:03.444 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:03.445 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.445 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.456 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.456 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.499 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.499 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.506 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.507 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.513 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.513 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.519 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.519 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.525 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.526 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.533 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.533 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.540 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.540 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.546 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.546 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.552 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.553 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.559 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.559 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.566 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.566 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.572 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.572 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.578 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.579 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.585 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.585 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.592 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.592 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.599 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.599 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.605 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.605 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.611 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.612 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.618 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.618 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.624 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:03.624 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:03.632 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:03.660 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:03.660 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:03.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.697+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.698+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.698+0000 7f8a1090c800 20 realm 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.698+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.699+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.699+0000 7f8a1090c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.699+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.699+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.699+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.700+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:03.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.700+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.700+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:03.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.700+0000 7f8a1090c800 20 searching for the correct realm 2024-09-14T11:30:03.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.702+0000 7f8a0ebfe640 0 -- 172.21.15.130:0/828547730 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f89f8065040 msgr2=0x7f89f8074950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:03.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.908+0000 7f8a0ebfe640 0 -- 172.21.15.130:0/828547730 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f89f8065040 msgr2=0x7f89f8074950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:03.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:03.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:03.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:03.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:03.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:03.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:03.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.912+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:03.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:03.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 zone default found 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 4 Realm: () 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 zonegroup default 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.913+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.914+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.914+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.914+0000 7f8a1090c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.914+0000 7f8a1090c800 20 started sync module instance, tier type = 2024-09-14T11:30:03.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.914+0000 7f8a1090c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:03.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=0 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=1 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=2 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=3 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=4 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=5 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.923+0000 7f8a1090c800 20 add_watcher() i=6 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.924+0000 7f8a1090c800 20 add_watcher() i=7 2024-09-14T11:30:03.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.924+0000 7f8a1090c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:03.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.925+0000 7f88c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.925+0000 7f8a1090c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.925+0000 7f8a1090c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.925+0000 7f8a1090c800 5 note: GC not initialized 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.926+0000 7f883f7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.926+0000 7f8a1090c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.926+0000 7f8a1090c800 20 Filter name: none 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.926+0000 7f883d7fa640 20 reqs_thread_entry: start 2024-09-14T11:30:03.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.926+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.927+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.927+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.927+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.927+0000 7f8a1090c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.927+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.928+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.928+0000 7f8a1090c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.928+0000 7f8a1090c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:03.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.928+0000 7f8a1090c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:03.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.929+0000 7f88c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:03.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.931+0000 7f8a1090c800 20 remove_watcher() i=0 2024-09-14T11:30:03.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.931+0000 7f8a1090c800 2 removed watcher, disabling cache 2024-09-14T11:30:03.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.932+0000 7f8a1090c800 20 remove_watcher() i=1 2024-09-14T11:30:03.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.933+0000 7f8a1090c800 20 remove_watcher() i=2 2024-09-14T11:30:03.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.934+0000 7f8a1090c800 20 remove_watcher() i=3 2024-09-14T11:30:03.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.936+0000 7f8a1090c800 20 remove_watcher() i=4 2024-09-14T11:30:03.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.937+0000 7f8a1090c800 20 remove_watcher() i=5 2024-09-14T11:30:03.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.937+0000 7f8a1090c800 20 remove_watcher() i=6 2024-09-14T11:30:03.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:03.938+0000 7f8a1090c800 20 remove_watcher() i=7 2024-09-14T11:30:03.947 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:03.947 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:03.947 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:03.947 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:03.949 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:30:03.983 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:03.983 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:04.214 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.216+0000 7f9c232a2640 0 --2- 172.21.15.130:0/2385511096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abbac62280 0x55abbac68500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:30:04.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.224+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 realm 2024-09-14T11:30:04.224 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.225 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:04.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.227+0000 7f9c2751f800 20 searching for the correct realm 2024-09-14T11:30:04.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.228+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:04.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.432+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:04.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:04.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:04.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:04.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zone default found 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Realm: () 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zonegroup default 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started sync module instance, tier type = 2024-09-14T11:30:04.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=0 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=1 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=2 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=3 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=4 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=5 2024-09-14T11:30:04.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=6 2024-09-14T11:30:04.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.452+0000 7f9c2751f800 20 add_watcher() i=7 2024-09-14T11:30:04.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.452+0000 7f9c2751f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:04.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:04.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:04.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:04.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9c2751f800 5 note: GC not initialized 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9ad8fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9c2751f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.454+0000 7f9c2751f800 20 Filter name: none 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9a527fc640 20 reqs_thread_entry: start 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:04.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : miss 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:04.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:04.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.455+0000 7f9c2751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:04.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c2751f800 time 2024-09-14T11:30:04.460697+0000 2024-09-14T11:30:04.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9c28d8c76a] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:04.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.460+0000 7f9c2751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c2751f800 time 2024-09-14T11:30:04.460697+0000 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9c28d8c76a] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:04.460 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.461 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:30:04.461 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f9c2751f800 thread_name:radosgw-admin 2024-09-14T11:30:04.479 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.479 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9c27a3e6f0] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9c27a8b99c] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9c28d8c7c4] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:04.480 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.461+0000 7f9c2751f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f9c2751f800 thread_name:radosgw-admin 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9c27a3e6f0] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9c27a8b99c] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9c28d8c7c4] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.481 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: crc 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: secure 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: crc 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: secure 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:30:04.006+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: starting msgr at 2024-09-14T11:30:04.482 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: starting objecter 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests hook 0x55abbac10310 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: setting wanted keys 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: calling monclient init 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:30:04.006+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.483 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:30:04.006+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:30:04.007+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:30:04.007+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key hook 0x55abbabe5268 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbabe8810 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbac14a80 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x7f9c10003ab0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.484 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.491159s 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbabe8810 auth_method 0 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac14a80 auth_method 0 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.485 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x7f9c10003ab0 auth_method 0 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6663 payload 824 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:30:04.007+0000 7f9c232a2640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.486 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: dump: 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.487 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: dump: 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.488 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:30:04.007+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6663 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:30:04.007+0000 7f9b1160a640 4 set_mon_vals no callback set 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:30:04.007+0000 7f9c2751f800 1 librados: init done 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:30:04.010+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9b08077230 auth_method 0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:30:04.010+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbac052e0 auth_method 0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:30:04.011+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac316b0 auth_method 0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:30:04.011+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x55abbac35a60 auth_method 0 2024-09-14T11:30:04.489 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:30:04.013+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.490 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.491 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:30:04.013+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests cmddesc objecter_requests hook 0x55abbac3df60 EEXIST 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.492 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:30:04.013+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:30:04.014+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:30:04.014+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x55abbac39140 EEXIST 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbac62280 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac62660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.493 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbac61030 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.498173s 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbac61030 auth_method 0 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.494 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac62660 auth_method 0 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6666 payload 824 2024-09-14T11:30:04.495 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:30:04.014+0000 7f9c232a2640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:30:04.216+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:30:04.216+0000 7f9c232a2640 0 --2- 172.21.15.130:0/2385511096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abbac62280 0x55abbac68500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: ms_handle_reset current mon [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-b con 0x55abbac62660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-a con 0x7f9afc004820 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-c con 0x55abbac61030 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.496 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x7f9afc004820 auth_method 0 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbac61030 auth_method 0 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.497 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_done global_id 6666 payload 293 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: dump: 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.498 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: dump: 2024-09-14T11:30:04.499 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:30:04.216+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6666 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.500 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:30:04.216+0000 7f9c242a4640 4 set_mon_vals no callback set 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:30:04.219+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: get_monmap_and_config 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:30:04.219+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.501 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.502 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:30:04.219+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.503 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.504 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:30:04.219+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:30:04.220+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:30:04.220+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x7ffdecff9c78 EEXIST 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbacaf820 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac80770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbacab0c0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.505 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.704147s 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbacaf820 auth_method 0 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbacab0c0 auth_method 0 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.506 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac80770 auth_method 0 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6254 payload 274 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:30:04.220+0000 7f9c232a2640 1 monclient: found mon.noname-c 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: dump: 2024-09-14T11:30:04.507 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:30:04.220+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6254 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.508 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:30:04.220+0000 7f9c2751f800 4 set_mon_vals no callback set 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: dump: 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.509 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: shutdown 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.510 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.511 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:30:04.221+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: starting msgr at 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: starting objecter 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests cmddesc objecter_requests hook 0x55abbac7db30 EEXIST 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: setting wanted keys 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: calling monclient init 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.512 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:30:04.222+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:30:04.222+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.513 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:30:04.222+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x55abbac7a1a8 EEXIST 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac80770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbacab0c0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbacaf820 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.706423s 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbacab0c0 auth_method 0 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.514 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbacaf820 auth_method 0 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbac80770 auth_method 0 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.515 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_done global_id 6257 payload 824 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 1 monclient: found mon.noname-c 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: dump: 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.516 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: dump: 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.517 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:30:04.223+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6257 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:30:04.223+0000 7f9b06ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:30:04.223+0000 7f9c2751f800 1 librados: init done 2024-09-14T11:30:04.518 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:30:04.223+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cr dump hook 0x55abbac9d7c8 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:30:04.224+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:30:04.225+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9aec077230 auth_method 0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:30:04.225+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacc9fe0 auth_method 0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 realm 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:30:04.226+0000 7f9c2751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.519 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:30:04.226+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbacce220 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:30:04.227+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x55abbacd1a80 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 searching for the correct realm 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:30:04.228+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacd67f0 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:30:04.228+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:30:04.429+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacd67f0 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:30:04.429+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9c1c072040 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:30:04.430+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9c14080070 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:30:04.431+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x7f9c0c09e040 auth_method 0 2024-09-14T11:30:04.520 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:30:04.432+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:30:04.432+0000 7f9b057fa640 1 client.6257.objecter ms_handle_reset 0x55abbacd67f0 session 0x55abbacd6170 osd.3 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:30:04.432+0000 7f9b057fa640 10 monclient: _renew_subs 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:30:04.432+0000 7f9b057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:30:04.432+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x7f9aec087850 auth_method 0 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:30:04.435+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9c1c093040 auth_method 0 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:04.521 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zone default found 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Realm: () 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:30:04.441+0000 7f9c2751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zonegroup default 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.522 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started sync module instance, tier type = 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=0 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=1 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=2 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=3 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=4 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=5 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=6 2024-09-14T11:30:04.523 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:30:04.452+0000 7f9c2751f800 20 add_watcher() i=7 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:30:04.452+0000 7f9c2751f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.524 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:30:04.454+0000 7f9ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:30:04.454+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache list hook 0x55abbaca2a20 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache inspect hook 0x55abbaca2a20 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache erase hook 0x55abbaca2a20 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache zap hook 0x55abbaca2a20 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 note: GC not initialized 2024-09-14T11:30:04.525 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:30:04.454+0000 7f9ad8fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace show hook 0x7f9c0c0104e0 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace history hook 0x7f9c0c0104e0 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace active hook 0x7f9c0c0104e0 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace active_short hook 0x7f9c0c0104e0 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 Filter name: none 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:30:04.455+0000 7f9a527fc640 20 reqs_thread_entry: start 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:04.526 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : miss 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:30:04.460+0000 7f9c2751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c2751f800 time 2024-09-14T11:30:04.460697+0000 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9c28d8c76a] 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.527 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:30:04.461+0000 7f9c2751f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f9c2751f800 thread_name:radosgw-admin 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9c27a3e6f0] 2024-09-14T11:30:04.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9c27a8b99c] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9c28d8c7c4] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:04.529 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:04.530 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:30:04.531 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:30:04.532 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:30:04.533 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:30:04.534 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:04.535 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:04.536 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9a527fc640 / http_manager 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9ad8fe1640 / http_manager 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9ad9fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b057fa640 / ms_dispatch 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b06ffd640 / io_context_pool 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b0d602640 / ms_dispatch 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b0fe07640 / ms_dispatch 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b1160a640 / io_context_pool 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c1bfff640 / msgr-worker-2 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c232a2640 / msgr-worker-1 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c23aa3640 / msgr-worker-0 2024-09-14T11:30:04.537 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c242a4640 / io_context_pool 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c2751f800 / radosgw-admin 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.99218.log 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: crc 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: secure 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: crc 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabeadc0) adding con mode: secure 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:30:04.006+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.538 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: starting msgr at 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: starting objecter 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests hook 0x55abbac10310 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: setting wanted keys 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:30:04.006+0000 7f9c2751f800 1 librados: calling monclient init 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:30:04.006+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding auth protocol: cephx 2024-09-14T11:30:04.539 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: crc 2024-09-14T11:30:04.540 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:30:04.006+0000 7f9c2751f800 5 AuthRegistry(0x55abbabe5120) adding con mode: secure 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:30:04.006+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:30:04.007+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:30:04.007+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key hook 0x55abbabe5268 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbabe8810 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbac14a80 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x7f9c10003ab0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.541 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.491159s 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbabe8810 auth_method 0 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac14a80 auth_method 0 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.542 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:30:04.007+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x7f9c10003ab0 auth_method 0 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:30:04.007+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6663 payload 824 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:30:04.007+0000 7f9c232a2640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:30:04.007+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: dump: 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.543 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.544 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:30:04.007+0000 7f9b0fe07640 10 monclient: dump: 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:30:04.007+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6663 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.545 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:30:04.007+0000 7f9b1160a640 4 set_mon_vals no callback set 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:30:04.007+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:30:04.007+0000 7f9c2751f800 1 librados: init done 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:30:04.009+0000 7f9b0fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:30:04.010+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9b08077230 auth_method 0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:30:04.010+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbac052e0 auth_method 0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:30:04.011+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac316b0 auth_method 0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:30:04.011+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x55abbac35a60 auth_method 0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:30:04.013+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.546 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding auth protocol: cephx 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.547 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: crc 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac3aa30) adding con mode: secure 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:30:04.013+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests cmddesc objecter_requests hook 0x55abbac3df60 EEXIST 2024-09-14T11:30:04.548 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:30:04.013+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding auth protocol: cephx 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.549 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: crc 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:30:04.013+0000 7f9c2751f800 5 AuthRegistry(0x55abbac38ff8) adding con mode: secure 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:30:04.013+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:30:04.014+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:30:04.014+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x55abbac39140 EEXIST 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbac62280 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac62660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbac61030 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.550 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:30:04.014+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.498173s 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbac61030 auth_method 0 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.551 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac62660 auth_method 0 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:30:04.014+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.552 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:30:04.014+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6666 payload 824 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:30:04.014+0000 7f9c232a2640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:30:04.014+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:30:04.216+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:30:04.216+0000 7f9c232a2640 0 --2- 172.21.15.130:0/2385511096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55abbac62280 0x55abbac68500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: ms_handle_reset current mon [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-b con 0x55abbac62660 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.553 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-a con 0x7f9afc004820 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): picked mon.noname-c con 0x55abbac61030 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x7f9afc004820 auth_method 0 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbac61030 auth_method 0 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:30:04.554 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:30:04.216+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_done global_id 6666 payload 293 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 1 monclient: found mon.noname-a 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:30:04.216+0000 7f9c1bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: dump: 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.555 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:04.556 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:30:04.216+0000 7f9b0d602640 10 monclient: dump: 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:30:04.216+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6666 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.557 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:30:04.216+0000 7f9c242a4640 4 set_mon_vals no callback set 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:30:04.216+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:30:04.218+0000 7f9b0d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:30:04.219+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbac62280 auth_method 0 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: get_monmap_and_config 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:30:04.219+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.558 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding auth protocol: cephx 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.559 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: crc 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7b3b0) adding con mode: secure 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:30:04.219+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:30:04.219+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.560 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding auth protocol: cephx 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: crc 2024-09-14T11:30:04.561 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:30:04.219+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecff9b30) adding con mode: secure 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:30:04.219+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:30:04.220+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:30:04.220+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x7ffdecff9c78 EEXIST 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbacaf820 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac80770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbacab0c0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.562 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.704147s 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbacaf820 auth_method 0 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbacab0c0 auth_method 0 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:30:04.220+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.563 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbac80770 auth_method 0 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:30:04.220+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient(hunting): handle_auth_done global_id 6254 payload 274 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:30:04.220+0000 7f9c232a2640 1 monclient: found mon.noname-c 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:30:04.220+0000 7f9c232a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: dump: 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.564 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:30:04.220+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6254 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:30:04.220+0000 7f9c2751f800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:30:04.220+0000 7f9c2751f800 4 set_mon_vals no callback set 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.565 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:30:04.220+0000 7f9b06ffd640 10 monclient: dump: 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: shutdown 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: build_initial_monmap 2024-09-14T11:30:04.566 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 build_initial for_mkfs: 0 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: monmap: 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.567 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding auth protocol: cephx 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: crc 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbaca1a50) adding con mode: secure 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:30:04.221+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.568 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: starting msgr at 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: starting objecter 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command objecter_requests cmddesc objecter_requests hook 0x55abbac7db30 EEXIST 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: setting wanted keys 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:30:04.221+0000 7f9c2751f800 1 librados: calling monclient init 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:30:04.221+0000 7f9c2751f800 10 monclient: init 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding auth protocol: cephx 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.569 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: crc 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:30:04.221+0000 7f9c2751f800 5 AuthRegistry(0x55abbac7a060) adding con mode: secure 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:30:04.222+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:30:04.222+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:30:04.222+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command rotate-key cmddesc rotate-key hook 0x55abbac7a1a8 EEXIST 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-b con 0x55abbac80770 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-c con 0x55abbacab0c0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): picked mon.noname-a con 0x55abbacaf820 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:04.570 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:30:04.222+0000 7f9c2751f800 10 monclient(hunting): authenticate will time out at 1920.706423s 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x55abbacab0c0 auth_method 0 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request con 0x55abbacaf820 auth_method 0 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.571 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): get_auth_request con 0x55abbac80770 auth_method 0 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:30:04.222+0000 7f9c23aa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:30:04.222+0000 7f9c232a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:04.572 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_done global_id 6257 payload 824 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 1 monclient: found mon.noname-c 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:30:04.222+0000 7f9c1bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:30:04.222+0000 7f9b057fa640 10 monclient: dump: 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.573 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:30:04.223+0000 7f9b057fa640 10 monclient: dump: 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:04.574 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:30:04.223+0000 7f9c2751f800 5 monclient: authenticate success, global_id 6257 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:30:04.223+0000 7f9b06ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _renew_subs 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:30:04.223+0000 7f9c2751f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:30:04.223+0000 7f9c2751f800 1 librados: init done 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:30:04.223+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cr dump hook 0x55abbac9d7c8 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:30:04.224+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:04.575 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:30:04.225+0000 7f9b057fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:30:04.225+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9aec077230 auth_method 0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:30:04.225+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacc9fe0 auth_method 0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 realm 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:30:04.226+0000 7f9c2751f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:30:04.226+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:30:04.226+0000 7f9c232a2640 10 monclient: get_auth_request con 0x55abbacce220 auth_method 0 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.576 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:30:04.227+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x55abbacd1a80 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:30:04.227+0000 7f9c2751f800 20 searching for the correct realm 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:30:04.228+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacd67f0 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:30:04.228+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:30:04.429+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x55abbacd67f0 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:30:04.429+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9c1c072040 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:30:04.430+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9c14080070 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:30:04.431+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x7f9c0c09e040 auth_method 0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:30:04.432+0000 7f9c23aa3640 0 -- 172.21.15.130:0/2669399281 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x55abbacd67f0 msgr2=0x55abbacd8cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:30:04.432+0000 7f9b057fa640 1 client.6257.objecter ms_handle_reset 0x55abbacd67f0 session 0x55abbacd6170 osd.3 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:30:04.432+0000 7f9b057fa640 10 monclient: _renew_subs 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:30:04.432+0000 7f9b057fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:04.577 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:30:04.432+0000 7f9c23aa3640 10 monclient: get_auth_request con 0x7f9aec087850 auth_method 0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:30:04.435+0000 7f9c232a2640 10 monclient: get_auth_request con 0x7f9c1c093040 auth_method 0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:30:04.440+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.578 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zone default found 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Realm: () 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:30:04.441+0000 7f9c2751f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:30:04.441+0000 7f9c2751f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 zonegroup default 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:30:04.441+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.579 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started sync module instance, tier type = 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:30:04.442+0000 7f9c2751f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=0 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=1 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=2 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=3 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=4 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=5 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:30:04.451+0000 7f9c2751f800 20 add_watcher() i=6 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:30:04.452+0000 7f9c2751f800 20 add_watcher() i=7 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:30:04.452+0000 7f9c2751f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding auth protocol: cephx 2024-09-14T11:30:04.580 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: crc 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 AuthRegistry(0x7ffdecffa010) adding con mode: secure 2024-09-14T11:30:04.581 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:30:04.454+0000 7f9ad9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:30:04.454+0000 7f9c2751f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache list hook 0x55abbaca2a20 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache inspect hook 0x55abbaca2a20 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache erase hook 0x55abbaca2a20 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command cache zap hook 0x55abbaca2a20 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 note: GC not initialized 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:30:04.454+0000 7f9ad8fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace show hook 0x7f9c0c0104e0 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace history hook 0x7f9c0c0104e0 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace active hook 0x7f9c0c0104e0 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:30:04.454+0000 7f9c2751f800 5 asok(0x55abba9c5270) register_command sync trace active_short hook 0x7f9c0c0104e0 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:04.582 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:30:04.454+0000 7f9c2751f800 20 Filter name: none 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:30:04.455+0000 7f9a527fc640 20 reqs_thread_entry: start 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : miss 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:30:04.455+0000 7f9c2751f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:30:04.455+0000 7f9c2751f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:04.583 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:30:04.460+0000 7f9c2751f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9c2751f800 time 2024-09-14T11:30:04.460697+0000 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9c28d8c76a] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:04.584 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:30:04.461+0000 7f9c2751f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f9c2751f800 thread_name:radosgw-admin 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9c27a3e6f0] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9c27a8b99c] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9c28d8c7c4] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f9c28d8c928] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55abb83fd0b1] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd88418) [0x55abb8910418] 2024-09-14T11:30:04.585 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55abb840cefd] 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9c27a29590] 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:04.586 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:04.587 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:30:04.588 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:30:04.589 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:30:04.590 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:04.591 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:04.592 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9a527fc640 / http_manager 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9ad8fe1640 / http_manager 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9ad9fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b057fa640 / ms_dispatch 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b06ffd640 / io_context_pool 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b0d602640 / ms_dispatch 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b0fe07640 / ms_dispatch 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9b1160a640 / io_context_pool 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c1bfff640 / msgr-worker-2 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c232a2640 / msgr-worker-1 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c23aa3640 / msgr-worker-0 2024-09-14T11:30:04.593 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c242a4640 / io_context_pool 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr: 7f9c2751f800 / radosgw-admin 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:30:04.462394Z_7a8a0063-6124-424c-861e-aede479a1bcc/log 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:30:04.594 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:04.595 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:04.595 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:04.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.536+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.538+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.538+0000 7f66a931f800 20 realm 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.538+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.539+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.539+0000 7f66a931f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.539+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.539+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.539+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.540+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.540+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.540+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.540+0000 7f66a931f800 20 searching for the correct realm 2024-09-14T11:30:04.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.543+0000 7f66a58a3640 0 -- 172.21.15.130:0/1707746526 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f66900a13b0 msgr2=0x7f6690067720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:04.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.749+0000 7f66a58a3640 0 -- 172.21.15.130:0/1707746526 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f66900a13b0 msgr2=0x7f6690067720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:04.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:04.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 zone default found 2024-09-14T11:30:04.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 4 Realm: () 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 zonegroup default 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.753+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 started sync module instance, tier type = 2024-09-14T11:30:04.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.754+0000 7f66a931f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=0 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=1 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=2 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=3 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=4 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=5 2024-09-14T11:30:04.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.763+0000 7f66a931f800 20 add_watcher() i=6 2024-09-14T11:30:04.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.764+0000 7f66a931f800 20 add_watcher() i=7 2024-09-14T11:30:04.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.764+0000 7f66a931f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:04.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f655bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:04.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f66a931f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:04.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f66a931f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:04.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f66a931f800 5 note: GC not initialized 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f655afe5640 20 reqs_thread_entry: start 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f66a931f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f66a931f800 20 Filter name: none 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.766+0000 7f6558fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:04.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.767+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.768+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:04.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.768+0000 7f66a931f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.768+0000 7f66a931f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:04.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.768+0000 7f66a931f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:04.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.770+0000 7f655bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:04.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.772+0000 7f66a931f800 20 remove_watcher() i=0 2024-09-14T11:30:04.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.772+0000 7f66a931f800 2 removed watcher, disabling cache 2024-09-14T11:30:04.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.773+0000 7f66a931f800 20 remove_watcher() i=1 2024-09-14T11:30:04.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.774+0000 7f66a931f800 20 remove_watcher() i=2 2024-09-14T11:30:04.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.775+0000 7f66a931f800 20 remove_watcher() i=3 2024-09-14T11:30:04.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.776+0000 7f66a931f800 20 remove_watcher() i=4 2024-09-14T11:30:04.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.777+0000 7f66a931f800 20 remove_watcher() i=5 2024-09-14T11:30:04.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.778+0000 7f66a931f800 20 remove_watcher() i=6 2024-09-14T11:30:04.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.779+0000 7f66a931f800 20 remove_watcher() i=7 2024-09-14T11:30:04.787 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.788 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:04.788 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:04.788 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:04.789 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:04.789 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:04.796 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:04.796 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:04.839 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:04.872 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:04.872 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:04.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.910+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.911+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.911+0000 7fa27ab2a800 20 realm 2024-09-14T11:30:04.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.911+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.912+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.912+0000 7fa27ab2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.912+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.912+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.912+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.913+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:04.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.913+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:04.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.913+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:04.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.913+0000 7fa27ab2a800 20 searching for the correct realm 2024-09-14T11:30:04.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:04.916+0000 7fa277018640 0 -- 172.21.15.130:0/3986350255 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fa26001e060 msgr2=0x7fa26004fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.121+0000 7fa276817640 0 -- 172.21.15.130:0/3986350255 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fa270049040 msgr2=0x7fa27001e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:05.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.328+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 zone default found 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 4 Realm: () 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 zonegroup default 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:05.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 started sync module instance, tier type = 2024-09-14T11:30:05.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.329+0000 7fa27ab2a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:05.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=0 2024-09-14T11:30:05.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=1 2024-09-14T11:30:05.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=2 2024-09-14T11:30:05.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=3 2024-09-14T11:30:05.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=4 2024-09-14T11:30:05.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=5 2024-09-14T11:30:05.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.338+0000 7fa27ab2a800 20 add_watcher() i=6 2024-09-14T11:30:05.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.339+0000 7fa27ab2a800 20 add_watcher() i=7 2024-09-14T11:30:05.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.339+0000 7fa27ab2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:05.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.341+0000 7fa12dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.341+0000 7fa27ab2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:05.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.341+0000 7fa27ab2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:05.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.341+0000 7fa27ab2a800 5 note: GC not initialized 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa12cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa27ab2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa27ab2a800 20 Filter name: none 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa125ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa27ab2a800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.342+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : miss 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:05.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.343+0000 7fa27ab2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:05.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.344+0000 7fa27ab2a800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to be held by another RGW process; skipping for now 2024-09-14T11:30:05.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.345+0000 7fa12dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:05.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.347+0000 7fa27ab2a800 20 remove_watcher() i=0 2024-09-14T11:30:05.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.347+0000 7fa27ab2a800 2 removed watcher, disabling cache 2024-09-14T11:30:05.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.348+0000 7fa27ab2a800 20 remove_watcher() i=1 2024-09-14T11:30:05.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.349+0000 7fa27ab2a800 20 remove_watcher() i=2 2024-09-14T11:30:05.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.350+0000 7fa27ab2a800 20 remove_watcher() i=3 2024-09-14T11:30:05.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.351+0000 7fa27ab2a800 20 remove_watcher() i=4 2024-09-14T11:30:05.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.352+0000 7fa27ab2a800 20 remove_watcher() i=5 2024-09-14T11:30:05.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.353+0000 7fa27ab2a800 20 remove_watcher() i=6 2024-09-14T11:30:05.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:05.354+0000 7fa27ab2a800 20 remove_watcher() i=7 2024-09-14T11:30:05.363 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:30:35.395 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:35.430 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:35.430 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:35.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.474+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 20 realm 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.475+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.476+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.476+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.477+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:35.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.477+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.477+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:35.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.477+0000 7fdd0b52c800 20 searching for the correct realm 2024-09-14T11:30:35.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.480+0000 7fdd07a50640 0 -- 172.21.15.130:0/1074427940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdcfc08f730 msgr2=0x7fdcfc086410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:35.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.687+0000 7fdd07a50640 0 -- 172.21.15.130:0/1074427940 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdcfc08f730 msgr2=0x7fdcfc086410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:35.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:35.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:35.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.692+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:35.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:35.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 zone default found 2024-09-14T11:30:35.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 4 Realm: () 2024-09-14T11:30:35.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 zonegroup default 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.693+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.694+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.694+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.694+0000 7fdd0b52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.694+0000 7fdd0b52c800 20 started sync module instance, tier type = 2024-09-14T11:30:35.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.694+0000 7fdd0b52c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=0 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=1 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=2 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=3 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=4 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=5 2024-09-14T11:30:35.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.704+0000 7fdd0b52c800 20 add_watcher() i=6 2024-09-14T11:30:35.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.705+0000 7fdd0b52c800 20 add_watcher() i=7 2024-09-14T11:30:35.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.705+0000 7fdd0b52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:35.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.707+0000 7fdbbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 5 note: GC not initialized 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdbbd7e2640 20 reqs_thread_entry: start 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 20 Filter name: none 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdbb67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:30:35.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.708+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:35.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:30:35.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:30:35.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : miss 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.709+0000 7fdd0b52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdd0b52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdd0b52c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdd0b52c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdd0b52c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25, ofs0, ns] 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdbeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94596476705952 notifier 6305 bl.length()=1009 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdbeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdbeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.715+0000 7fdbeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.716+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_sources= new_sources= 2024-09-14T11:30:35.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.716+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential sources added=[] removed=[] 2024-09-14T11:30:35.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.716+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_dests= new_dests= 2024-09-14T11:30:35.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.716+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential dests added=[] removed=[] 2024-09-14T11:30:35.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.0 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.0 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.1 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.1 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.2 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.2 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.3 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.3 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.4 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.4 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.5 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.5 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.6 2024-09-14T11:30:35.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.6 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.7 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.7 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.8 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.8 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.9 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.9 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.10 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.10 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.11 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1.11 2024-09-14T11:30:35.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.0 2024-09-14T11:30:35.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.721+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1 2024-09-14T11:30:35.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.722+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.2 2024-09-14T11:30:35.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.722+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.3 2024-09-14T11:30:35.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.723+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.4 2024-09-14T11:30:35.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.723+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.5 2024-09-14T11:30:35.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.724+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.6 2024-09-14T11:30:35.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.725+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.7 2024-09-14T11:30:35.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.725+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.8 2024-09-14T11:30:35.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.726+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.9 2024-09-14T11:30:35.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.727+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.10 2024-09-14T11:30:35.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.730+0000 7fdd0b52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:35.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.730+0000 7fdd0b52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.731+0000 7fdd0b52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.731+0000 7fdd0b52c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.731+0000 7fdd0b52c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.731+0000 7fdd0b52c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25, ofs0, ns] 2024-09-14T11:30:35.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdbeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94596476705952 notifier 6305 bl.length()=1009 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdbeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdbeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdbeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_sources= new_sources= 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential sources added=[] removed=[] 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_dests= new_dests= 2024-09-14T11:30:35.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.732+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential dests added=[] removed=[] 2024-09-14T11:30:35.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.734+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.0 2024-09-14T11:30:35.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.735+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.1 2024-09-14T11:30:35.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.735+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.2 2024-09-14T11:30:35.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.735+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.3 2024-09-14T11:30:35.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.736+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.4 2024-09-14T11:30:35.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.736+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.5 2024-09-14T11:30:35.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.736+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.6 2024-09-14T11:30:35.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.737+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.7 2024-09-14T11:30:35.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.737+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.8 2024-09-14T11:30:35.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.738+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.9 2024-09-14T11:30:35.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.738+0000 7fdd0b52c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.25.10 2024-09-14T11:30:35.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.738+0000 7fdd0b52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:35.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.738+0000 7fdd0b52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 2024-09-14T11:30:35.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdd0b52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdd0b52c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdd0b52c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdd0b52c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25, ofs0, ns] 2024-09-14T11:30:35.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdbea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94596476705952 notifier 6305 bl.length()=977 2024-09-14T11:30:35.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdbea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 info.flags=0x17 2024-09-14T11:30:35.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdbea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.25 to cache LRU end 2024-09-14T11:30:35.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.740+0000 7fdbea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:35.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.741+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_sources= new_sources= 2024-09-14T11:30:35.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.741+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential sources added=[] removed=[] 2024-09-14T11:30:35.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.741+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): orig_dests= new_dests= 2024-09-14T11:30:35.740 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.741+0000 7fdd0b52c800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.25]): potential dests added=[] removed=[] 2024-09-14T11:30:35.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.743+0000 7fdd0b52c800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:35.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.745+0000 7fdbbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:35.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.747+0000 7fdd0b52c800 20 remove_watcher() i=0 2024-09-14T11:30:35.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.747+0000 7fdd0b52c800 2 removed watcher, disabling cache 2024-09-14T11:30:35.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.749+0000 7fdd0b52c800 20 remove_watcher() i=1 2024-09-14T11:30:35.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.750+0000 7fdd0b52c800 20 remove_watcher() i=2 2024-09-14T11:30:35.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.751+0000 7fdd0b52c800 20 remove_watcher() i=3 2024-09-14T11:30:35.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.752+0000 7fdd0b52c800 20 remove_watcher() i=4 2024-09-14T11:30:35.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.753+0000 7fdd0b52c800 20 remove_watcher() i=5 2024-09-14T11:30:35.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.754+0000 7fdd0b52c800 20 remove_watcher() i=6 2024-09-14T11:30:35.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.755+0000 7fdd0b52c800 20 remove_watcher() i=7 2024-09-14T11:30:35.766 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:30:35.795 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:35.795 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:35.832 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.833+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 realm 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:35.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.835+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.836+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:35.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.836+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:35.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.837+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:35.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.837+0000 7ffa87575800 20 searching for the correct realm 2024-09-14T11:30:35.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:35.839+0000 7ffa85860640 0 -- 172.21.15.130:0/3475506325 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffa7c086090 msgr2=0x7ffa7c09e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.046+0000 7ffa85860640 0 -- 172.21.15.130:0/3475506325 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffa7c086090 msgr2=0x7ffa7c09e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:36.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.050+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 zone default found 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 4 Realm: () 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 zonegroup default 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 started sync module instance, tier type = 2024-09-14T11:30:36.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.051+0000 7ffa87575800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:36.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=0 2024-09-14T11:30:36.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=1 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=2 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=3 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=4 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=5 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=6 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 20 add_watcher() i=7 2024-09-14T11:30:36.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.061+0000 7ffa87575800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:36.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.063+0000 7ff93bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:36.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.063+0000 7ffa87575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.063+0000 7ffa87575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.063+0000 7ffa87575800 5 note: GC not initialized 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.064+0000 7ff93afe5640 20 reqs_thread_entry: start 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.064+0000 7ffa87575800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.064+0000 7ffa87575800 20 Filter name: none 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.064+0000 7ff938fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:36.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.064+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.065+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:36.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.065+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.065+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:36.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.065+0000 7ffa87575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:36.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.065+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.066+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:30:36.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.066+0000 7ffa87575800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.066+0000 7ffa87575800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:30:36.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.066+0000 7ffa87575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:36.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.068+0000 7ff93bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:36.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.070+0000 7ffa87575800 20 remove_watcher() i=0 2024-09-14T11:30:36.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.070+0000 7ffa87575800 2 removed watcher, disabling cache 2024-09-14T11:30:36.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.071+0000 7ffa87575800 20 remove_watcher() i=1 2024-09-14T11:30:36.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.072+0000 7ffa87575800 20 remove_watcher() i=2 2024-09-14T11:30:36.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.073+0000 7ffa87575800 20 remove_watcher() i=3 2024-09-14T11:30:36.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.074+0000 7ffa87575800 20 remove_watcher() i=4 2024-09-14T11:30:36.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.075+0000 7ffa87575800 20 remove_watcher() i=5 2024-09-14T11:30:36.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.076+0000 7ffa87575800 20 remove_watcher() i=6 2024-09-14T11:30:36.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.077+0000 7ffa87575800 20 remove_watcher() i=7 2024-09-14T11:30:36.085 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:36.085 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:36.086 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-set-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:36.086 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:36.087 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.088 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.091 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.091 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.134 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.134 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.159 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:30:36.160 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:36.161 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.161 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.174 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.174 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.217 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.217 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.224 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.224 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.231 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.231 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.238 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.238 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.245 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.245 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.251 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.251 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.258 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.264 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.264 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.271 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.271 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.278 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.278 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.285 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.285 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.291 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.292 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.298 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.298 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.305 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.305 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.312 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.312 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.354 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.354 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.361 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.361 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.368 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.374 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.374 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.380 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:36.381 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:36.415 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:36.416 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:36.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.452+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.454+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.454+0000 7f89d01af800 20 realm 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.454+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.455+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.455+0000 7f89d01af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.455+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.455+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.455+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.456+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:36.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.456+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.456+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:36.455 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.456+0000 7f89d01af800 20 searching for the correct realm 2024-09-14T11:30:36.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.458+0000 7f89ce49a640 0 -- 172.21.15.130:0/4253756202 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f89c4090040 msgr2=0x7f89c40cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.664+0000 7f89ce49a640 0 -- 172.21.15.130:0/4253756202 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f89c4090040 msgr2=0x7f89c40cc050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:36.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:36.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.668+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:36.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 zone default found 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 4 Realm: () 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 zonegroup default 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.669+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.670+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.670+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.670+0000 7f89d01af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.670+0000 7f89d01af800 20 started sync module instance, tier type = 2024-09-14T11:30:36.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.670+0000 7f89d01af800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:36.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=0 2024-09-14T11:30:36.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=1 2024-09-14T11:30:36.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=2 2024-09-14T11:30:36.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=3 2024-09-14T11:30:36.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=4 2024-09-14T11:30:36.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=5 2024-09-14T11:30:36.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=6 2024-09-14T11:30:36.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 20 add_watcher() i=7 2024-09-14T11:30:36.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.679+0000 7f89d01af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:36.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.681+0000 7f887f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.681+0000 7f89d01af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.681+0000 7f89d01af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.681+0000 7f89d01af800 5 note: GC not initialized 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.682+0000 7f887e7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.682+0000 7f89d01af800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.682+0000 7f89d01af800 20 Filter name: none 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.682+0000 7f87effff640 20 reqs_thread_entry: start 2024-09-14T11:30:36.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.682+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:36.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:36.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:36.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:36.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.683+0000 7f89d01af800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.684+0000 7f89d01af800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:36.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.684+0000 7f89d01af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:36.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.685+0000 7f887f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:36.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.688+0000 7f89d01af800 20 remove_watcher() i=0 2024-09-14T11:30:36.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.688+0000 7f89d01af800 2 removed watcher, disabling cache 2024-09-14T11:30:36.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.689+0000 7f89d01af800 20 remove_watcher() i=1 2024-09-14T11:30:36.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.690+0000 7f89d01af800 20 remove_watcher() i=2 2024-09-14T11:30:36.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.691+0000 7f89d01af800 20 remove_watcher() i=3 2024-09-14T11:30:36.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.691+0000 7f89d01af800 20 remove_watcher() i=4 2024-09-14T11:30:36.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.692+0000 7f89d01af800 20 remove_watcher() i=5 2024-09-14T11:30:36.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.693+0000 7f89d01af800 20 remove_watcher() i=6 2024-09-14T11:30:36.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.694+0000 7f89d01af800 20 remove_watcher() i=7 2024-09-14T11:30:36.703 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:36.703 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:36.703 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:36.703 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:36.704 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:30:36.738 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:36.738 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:36.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.777+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.778+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.778+0000 7f0eb9119800 20 realm 2024-09-14T11:30:36.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.778+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.779+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.779+0000 7f0eb9119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.779+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.779+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.779+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.780+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:36.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.780+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.780+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:36.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.780+0000 7f0eb9119800 20 searching for the correct realm 2024-09-14T11:30:36.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.782+0000 7f0eb6409640 0 -- 172.21.15.130:0/1090481198 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f0ea808c030 msgr2=0x7f0ea807f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.786+0000 7f0eb6c0a640 0 -- 172.21.15.130:0/1090481198 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f0eb0066c20 msgr2=0x7f0eb006f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:36.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:36.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:36.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:36.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:36.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.992+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 zone default found 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 4 Realm: () 2024-09-14T11:30:36.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 zonegroup default 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.993+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.994+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.994+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:36.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.994+0000 7f0eb9119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:36.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.994+0000 7f0eb9119800 20 started sync module instance, tier type = 2024-09-14T11:30:36.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:36.994+0000 7f0eb9119800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:37.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=0 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=1 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=2 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=3 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=4 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=5 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.003+0000 7f0eb9119800 20 add_watcher() i=6 2024-09-14T11:30:37.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.004+0000 7f0eb9119800 20 add_watcher() i=7 2024-09-14T11:30:37.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.004+0000 7f0eb9119800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.005+0000 7f0d6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.005+0000 7f0eb9119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.005+0000 7f0eb9119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0eb9119800 5 note: GC not initialized 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0ce7fff640 20 reqs_thread_entry: start 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0eb9119800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0eb9119800 20 Filter name: none 2024-09-14T11:30:37.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0ce5ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:37.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0eb9119800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:37.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.006+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 : miss 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:37.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.007+0000 7f0eb9119800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26, ofs0, ns] 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0d9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94191304444288 notifier 6359 bl.length()=1023 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0d9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0d9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0d9a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_sources= new_sources= 2024-09-14T11:30:37.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential sources added=[] removed=[] 2024-09-14T11:30:37.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_dests= new_dests= 2024-09-14T11:30:37.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential dests added=[] removed=[] 2024-09-14T11:30:37.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:30:37.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.012+0000 7f0eb9119800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:30:37.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.014+0000 7f0d6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.016+0000 7f0eb9119800 20 remove_watcher() i=0 2024-09-14T11:30:37.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.016+0000 7f0eb9119800 2 removed watcher, disabling cache 2024-09-14T11:30:37.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.017+0000 7f0eb9119800 20 remove_watcher() i=1 2024-09-14T11:30:37.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.018+0000 7f0eb9119800 20 remove_watcher() i=2 2024-09-14T11:30:37.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.019+0000 7f0eb9119800 20 remove_watcher() i=3 2024-09-14T11:30:37.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.020+0000 7f0eb9119800 20 remove_watcher() i=4 2024-09-14T11:30:37.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.021+0000 7f0eb9119800 20 remove_watcher() i=5 2024-09-14T11:30:37.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.022+0000 7f0eb9119800 20 remove_watcher() i=6 2024-09-14T11:30:37.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.023+0000 7f0eb9119800 20 remove_watcher() i=7 2024-09-14T11:30:37.033 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:37.062 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:37.062 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:37.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.100+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.101+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.101+0000 7ffb7bb2a800 20 realm 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.101+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:37.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.102+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.103+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:37.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.103+0000 7ffb7bb2a800 20 searching for the correct realm 2024-09-14T11:30:37.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.105+0000 7ffb780db640 0 -- 172.21.15.130:0/383493116 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffb6007bbe0 msgr2=0x7ffb600893f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:37.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.312+0000 7ffb780db640 0 -- 172.21.15.130:0/383493116 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffb6007bbe0 msgr2=0x7ffb600893f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:37.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:37.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:37.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:37.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.315+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 zone default found 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 4 Realm: () 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:37.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 zonegroup default 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.316+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.317+0000 7ffb7bb2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.317+0000 7ffb7bb2a800 20 started sync module instance, tier type = 2024-09-14T11:30:37.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.317+0000 7ffb7bb2a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=0 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=1 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=2 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=3 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=4 2024-09-14T11:30:37.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=5 2024-09-14T11:30:37.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.325+0000 7ffb7bb2a800 20 add_watcher() i=6 2024-09-14T11:30:37.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.326+0000 7ffb7bb2a800 20 add_watcher() i=7 2024-09-14T11:30:37.325 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.326+0000 7ffb7bb2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 5 note: GC not initialized 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffa2cfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:37.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 20 Filter name: none 2024-09-14T11:30:37.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ff9a67fc640 20 reqs_thread_entry: start 2024-09-14T11:30:37.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.328+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.329+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.329+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.329+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.329+0000 7ffb7bb2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:37.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.329+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.330+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:37.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.330+0000 7ffb7bb2a800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.330+0000 7ffb7bb2a800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:37.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.330+0000 7ffb7bb2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:37.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.332+0000 7ffa2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.334+0000 7ffb7bb2a800 20 remove_watcher() i=0 2024-09-14T11:30:37.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.334+0000 7ffb7bb2a800 2 removed watcher, disabling cache 2024-09-14T11:30:37.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.334+0000 7ffb7bb2a800 20 remove_watcher() i=1 2024-09-14T11:30:37.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.336+0000 7ffb7bb2a800 20 remove_watcher() i=2 2024-09-14T11:30:37.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.337+0000 7ffb7bb2a800 20 remove_watcher() i=3 2024-09-14T11:30:37.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.338+0000 7ffb7bb2a800 20 remove_watcher() i=4 2024-09-14T11:30:37.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.339+0000 7ffb7bb2a800 20 remove_watcher() i=5 2024-09-14T11:30:37.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.339+0000 7ffb7bb2a800 20 remove_watcher() i=6 2024-09-14T11:30:37.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.340+0000 7ffb7bb2a800 20 remove_watcher() i=7 2024-09-14T11:30:37.349 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:37.350 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:37.350 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:37.350 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:37.351 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:37.351 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:37.358 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:37.358 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:37.401 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:37.435 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:37.435 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:37.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.473+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.474+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.474+0000 7ff549013800 20 realm 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.474+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.475+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.475+0000 7ff549013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.475+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.475+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.475+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.476+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:37.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.476+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.476+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:37.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.476+0000 7ff549013800 20 searching for the correct realm 2024-09-14T11:30:37.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.479+0000 7ff544f49640 0 -- 172.21.15.130:0/2865132334 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff52c020060 msgr2=0x7ff52c060600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:37.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.685+0000 7ff544f49640 0 -- 172.21.15.130:0/2865132334 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff52c020060 msgr2=0x7ff52c060600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:37.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:37.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:37.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.689+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:37.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 zone default found 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 4 Realm: () 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 zonegroup default 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 started sync module instance, tier type = 2024-09-14T11:30:37.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.690+0000 7ff549013800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:37.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=0 2024-09-14T11:30:37.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=1 2024-09-14T11:30:37.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=2 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=3 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=4 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=5 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=6 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 20 add_watcher() i=7 2024-09-14T11:30:37.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.700+0000 7ff549013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.702+0000 7ff3fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.702+0000 7ff549013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.702+0000 7ff549013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff549013800 5 note: GC not initialized 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff3f9fdb640 20 reqs_thread_entry: start 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff549013800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff549013800 20 Filter name: none 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff36b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:37.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff549013800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:37.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.703+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 : miss 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:37.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.704+0000 7ff549013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 2024-09-14T11:30:37.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.705+0000 7ff549013800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:30:37.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.711+0000 7ff549013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.711+0000 7ff549013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.711+0000 7ff549013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.711+0000 7ff549013800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26, ofs0, ns] 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff41affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94257721880320 notifier 6389 bl.length()=1023 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff41affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff41affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff41affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_sources= new_sources= 2024-09-14T11:30:37.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential sources added=[] removed=[] 2024-09-14T11:30:37.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_dests= new_dests= 2024-09-14T11:30:37.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.712+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential dests added=[] removed=[] 2024-09-14T11:30:37.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.0 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.0 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.1 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.1 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.2 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.2 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.3 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.3 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.4 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.4 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.5 2024-09-14T11:30:37.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.5 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.6 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.6 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.7 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.7 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.8 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.8 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.9 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.9 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.10 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.10 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.11 2024-09-14T11:30:37.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2.11 2024-09-14T11:30:37.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.716+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.0 2024-09-14T11:30:37.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.717+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.1 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.717+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.718+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.3 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.718+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.4 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.719+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.5 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.719+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.6 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.720+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.7 2024-09-14T11:30:37.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.720+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.8 2024-09-14T11:30:37.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.720+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.9 2024-09-14T11:30:37.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.721+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.10 2024-09-14T11:30:37.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.726+0000 7ff549013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:37.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.726+0000 7ff549013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26, ofs0, ns] 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff41affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94257721880320 notifier 6389 bl.length()=1023 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff41affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff41affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff41affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_sources= new_sources= 2024-09-14T11:30:37.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential sources added=[] removed=[] 2024-09-14T11:30:37.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_dests= new_dests= 2024-09-14T11:30:37.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.727+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential dests added=[] removed=[] 2024-09-14T11:30:37.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.729+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.0 2024-09-14T11:30:37.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.730+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.1 2024-09-14T11:30:37.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.730+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.2 2024-09-14T11:30:37.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.730+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.3 2024-09-14T11:30:37.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.731+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.4 2024-09-14T11:30:37.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.731+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.5 2024-09-14T11:30:37.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.731+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.6 2024-09-14T11:30:37.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.732+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.7 2024-09-14T11:30:37.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.732+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.8 2024-09-14T11:30:37.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.732+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.9 2024-09-14T11:30:37.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.733+0000 7ff549013800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.26.10 2024-09-14T11:30:37.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.733+0000 7ff549013800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:37.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.733+0000 7ff549013800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 2024-09-14T11:30:37.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff549013800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff549013800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff549013800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff549013800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26, ofs0, ns] 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff41affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94257721880320 notifier 6389 bl.length()=991 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff41affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 info.flags=0x17 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff41affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.26 to cache LRU end 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.734+0000 7ff41affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.735+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_sources= new_sources= 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.735+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential sources added=[] removed=[] 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.735+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): orig_dests= new_dests= 2024-09-14T11:30:37.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.735+0000 7ff549013800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.26]): potential dests added=[] removed=[] 2024-09-14T11:30:37.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.737+0000 7ff549013800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:37.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.739+0000 7ff3fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:37.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.741+0000 7ff549013800 20 remove_watcher() i=0 2024-09-14T11:30:37.739 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.741+0000 7ff549013800 2 removed watcher, disabling cache 2024-09-14T11:30:37.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.743+0000 7ff549013800 20 remove_watcher() i=1 2024-09-14T11:30:37.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.743+0000 7ff549013800 20 remove_watcher() i=2 2024-09-14T11:30:37.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.745+0000 7ff549013800 20 remove_watcher() i=3 2024-09-14T11:30:37.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.746+0000 7ff549013800 20 remove_watcher() i=4 2024-09-14T11:30:37.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.747+0000 7ff549013800 20 remove_watcher() i=5 2024-09-14T11:30:37.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.747+0000 7ff549013800 20 remove_watcher() i=6 2024-09-14T11:30:37.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.748+0000 7ff549013800 20 remove_watcher() i=7 2024-09-14T11:30:37.759 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:37.788 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:37.788 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:37.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.825+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 20 realm 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:37.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.827+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.828+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:37.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.828+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.828+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:37.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.828+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:37.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.829+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:37.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.829+0000 7fc3a212f800 20 searching for the correct realm 2024-09-14T11:30:37.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:37.831+0000 7fc395675640 0 -- 172.21.15.130:0/3556824597 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fc390044be0 msgr2=0x7fc390051910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:38.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.037+0000 7fc39de76640 0 -- 172.21.15.130:0/3556824597 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x55619e65ca80 msgr2=0x7fc3980dca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:38.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:38.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 zone default found 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 4 Realm: () 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 zonegroup default 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.244+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 started sync module instance, tier type = 2024-09-14T11:30:38.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.245+0000 7fc3a212f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:38.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=0 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=1 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=2 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=3 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=4 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=5 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.254+0000 7fc3a212f800 20 add_watcher() i=6 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.255+0000 7fc3a212f800 20 add_watcher() i=7 2024-09-14T11:30:38.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.255+0000 7fc3a212f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.256+0000 7fc24f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 5 note: GC not initialized 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc24e7fc640 20 reqs_thread_entry: start 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 20 Filter name: none 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc1c3fff640 20 reqs_thread_entry: start 2024-09-14T11:30:38.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.257+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.258+0000 7fc3a212f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.259+0000 7fc3a212f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:38.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.259+0000 7fc3a212f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:38.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.260+0000 7fc24f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:38.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.263+0000 7fc3a212f800 20 remove_watcher() i=0 2024-09-14T11:30:38.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.263+0000 7fc3a212f800 2 removed watcher, disabling cache 2024-09-14T11:30:38.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.264+0000 7fc3a212f800 20 remove_watcher() i=1 2024-09-14T11:30:38.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.265+0000 7fc3a212f800 20 remove_watcher() i=2 2024-09-14T11:30:38.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.266+0000 7fc3a212f800 20 remove_watcher() i=3 2024-09-14T11:30:38.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.267+0000 7fc3a212f800 20 remove_watcher() i=4 2024-09-14T11:30:38.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.268+0000 7fc3a212f800 20 remove_watcher() i=5 2024-09-14T11:30:38.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.269+0000 7fc3a212f800 20 remove_watcher() i=6 2024-09-14T11:30:38.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.269+0000 7fc3a212f800 20 remove_watcher() i=7 2024-09-14T11:30:38.278 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:38.279 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:38.279 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:30:38.279 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:38.281 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.281 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.284 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.284 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.327 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.327 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.352 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:30:38.353 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:38.353 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.353 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.364 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.364 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.406 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.407 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.413 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.413 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.420 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.420 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.426 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.426 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.433 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.433 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.439 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.439 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.445 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.445 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.450 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.451 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.458 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.464 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.464 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.470 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.470 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.476 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.477 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.483 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.483 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.489 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.489 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.495 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.495 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.501 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.501 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.508 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.508 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.514 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.515 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.521 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.521 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.527 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:38.528 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:38.534 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:38.563 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:38.563 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:38.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.600+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 realm 2024-09-14T11:30:38.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.601 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:38.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:38.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.602+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.603+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:38.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.603+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:38.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.604+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:38.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.604+0000 7fb22bb2e800 20 searching for the correct realm 2024-09-14T11:30:38.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.606+0000 7fb21f0dc640 0 -- 172.21.15.130:0/2777169190 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fb218046030 msgr2=0x7fb218047930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:38.810 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:38.812+0000 7fb2278dd640 0 -- 172.21.15.130:0/2777169190 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fb220029040 msgr2=0x7fb2200373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.019+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:39.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 zone default found 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 4 Realm: () 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 zonegroup default 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.020+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.021+0000 7fb22bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.021+0000 7fb22bb2e800 20 started sync module instance, tier type = 2024-09-14T11:30:39.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.021+0000 7fb22bb2e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:39.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=0 2024-09-14T11:30:39.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=1 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=2 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=3 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=4 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=5 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.030+0000 7fb22bb2e800 20 add_watcher() i=6 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.031+0000 7fb22bb2e800 20 add_watcher() i=7 2024-09-14T11:30:39.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.031+0000 7fb22bb2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:39.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb22bb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:39.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb22bb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:39.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb22bb2e800 5 note: GC not initialized 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb0dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb22bb2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.033+0000 7fb22bb2e800 20 Filter name: none 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.034+0000 7fb0567fc640 20 reqs_thread_entry: start 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.034+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.034+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:39.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.034+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.035+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.035+0000 7fb22bb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.035+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.036+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.036+0000 7fb22bb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.036+0000 7fb22bb2e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:39.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.036+0000 7fb22bb2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:39.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.038+0000 7fb0ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.040+0000 7fb22bb2e800 20 remove_watcher() i=0 2024-09-14T11:30:39.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.040+0000 7fb22bb2e800 2 removed watcher, disabling cache 2024-09-14T11:30:39.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.041+0000 7fb22bb2e800 20 remove_watcher() i=1 2024-09-14T11:30:39.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.042+0000 7fb22bb2e800 20 remove_watcher() i=2 2024-09-14T11:30:39.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.043+0000 7fb22bb2e800 20 remove_watcher() i=3 2024-09-14T11:30:39.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.044+0000 7fb22bb2e800 20 remove_watcher() i=4 2024-09-14T11:30:39.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.045+0000 7fb22bb2e800 20 remove_watcher() i=5 2024-09-14T11:30:39.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.046+0000 7fb22bb2e800 20 remove_watcher() i=6 2024-09-14T11:30:39.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.047+0000 7fb22bb2e800 20 remove_watcher() i=7 2024-09-14T11:30:39.056 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:39.056 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:39.056 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:39.056 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:39.058 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:30:39.094 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:39.094 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.132+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 realm 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.134+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.135+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:39.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.135+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.136+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:39.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.136+0000 7f5c4502f800 20 searching for the correct realm 2024-09-14T11:30:39.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.138+0000 7f5c43321640 0 -- 172.21.15.130:0/3324396794 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f5c38049b80 msgr2=0x7f5c38062490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:39.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.344+0000 7f5c43321640 0 -- 172.21.15.130:0/3324396794 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f5c38049b80 msgr2=0x7f5c38062490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:39.348 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 zone default found 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 4 Realm: () 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.348+0000 7f5c4502f800 20 zonegroup default 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 started sync module instance, tier type = 2024-09-14T11:30:39.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.349+0000 7f5c4502f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=0 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=1 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=2 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=3 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=4 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=5 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.358+0000 7f5c4502f800 20 add_watcher() i=6 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.359+0000 7f5c4502f800 20 add_watcher() i=7 2024-09-14T11:30:39.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.359+0000 7f5c4502f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:39.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.360+0000 7f5af97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 5 note: GC not initialized 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5a73fff640 20 reqs_thread_entry: start 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 20 Filter name: none 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5a71ffb640 20 reqs_thread_entry: start 2024-09-14T11:30:39.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:30:39.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.361+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 : miss 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 info.flags=0x17 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 to cache LRU end 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:39.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.362+0000 7f5c4502f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5c4502f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 info.flags=0x17 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5c4502f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 to cache LRU end 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5c4502f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5c4502f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27, ofs0, ns] 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5b267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94369716465216 notifier 6876 bl.length()=1023 2024-09-14T11:30:39.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5b267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 info.flags=0x17 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5b267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 to cache LRU end 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.368+0000 7f5b267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): orig_sources= new_sources= 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): potential sources added=[] removed=[] 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): orig_dests= new_dests= 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): potential dests added=[] removed=[] 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:30:39.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.369+0000 7f5c4502f800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:30:39.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.0 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.0 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.1 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.1 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.2 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.2 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.3 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.3 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.4 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.4 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.5 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.5 2024-09-14T11:30:39.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.6 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.6 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.7 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.7 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.8 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.8 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.9 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.9 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.10 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.10 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.11 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1.11 2024-09-14T11:30:39.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.0 2024-09-14T11:30:39.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.373+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.1 2024-09-14T11:30:39.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.374+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.2 2024-09-14T11:30:39.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.374+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.3 2024-09-14T11:30:39.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.375+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.4 2024-09-14T11:30:39.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.375+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.5 2024-09-14T11:30:39.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.376+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.6 2024-09-14T11:30:39.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.376+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.7 2024-09-14T11:30:39.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.377+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.8 2024-09-14T11:30:39.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.378+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.9 2024-09-14T11:30:39.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.378+0000 7f5c4502f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.27.10 2024-09-14T11:30:39.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.381+0000 7f5c4502f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:30:39.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.381+0000 7f5c4502f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5c4502f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 info.flags=0x17 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5c4502f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 to cache LRU end 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5c4502f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5c4502f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27, ofs0, ns] 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5b25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94369716465216 notifier 6876 bl.length()=991 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5b25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 info.flags=0x17 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5b25ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.27 to cache LRU end 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.383+0000 7f5b25ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:39.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.384+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): orig_sources= new_sources= 2024-09-14T11:30:39.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.384+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): potential sources added=[] removed=[] 2024-09-14T11:30:39.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.384+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): orig_dests= new_dests= 2024-09-14T11:30:39.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.384+0000 7f5c4502f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.27]): potential dests added=[] removed=[] 2024-09-14T11:30:39.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.385+0000 7f5c4502f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:30:39.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.387+0000 7f5af97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.389+0000 7f5c4502f800 20 remove_watcher() i=0 2024-09-14T11:30:39.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.389+0000 7f5c4502f800 2 removed watcher, disabling cache 2024-09-14T11:30:39.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.390+0000 7f5c4502f800 20 remove_watcher() i=1 2024-09-14T11:30:39.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.391+0000 7f5c4502f800 20 remove_watcher() i=2 2024-09-14T11:30:39.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.392+0000 7f5c4502f800 20 remove_watcher() i=3 2024-09-14T11:30:39.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.393+0000 7f5c4502f800 20 remove_watcher() i=4 2024-09-14T11:30:39.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.394+0000 7f5c4502f800 20 remove_watcher() i=5 2024-09-14T11:30:39.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.395+0000 7f5c4502f800 20 remove_watcher() i=6 2024-09-14T11:30:39.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.396+0000 7f5c4502f800 20 remove_watcher() i=7 2024-09-14T11:30:39.406 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:30:39.436 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:39.436 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:39.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.473+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 realm 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.475+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.476+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.476+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.477+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.477+0000 7f29b792e800 20 searching for the correct realm 2024-09-14T11:30:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.479+0000 7f29b3d65640 0 -- 172.21.15.130:0/1791879832 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f299c040060 msgr2=0x7f299c069030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:39.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.686+0000 7f29b3d65640 0 -- 172.21.15.130:0/1791879832 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f299c040060 msgr2=0x7f299c069030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.690+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 zone default found 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 4 Realm: () 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 zonegroup default 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.691+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.692+0000 7f29b792e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:39.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.692+0000 7f29b792e800 20 started sync module instance, tier type = 2024-09-14T11:30:39.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.692+0000 7f29b792e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=0 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=1 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=2 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=3 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=4 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=5 2024-09-14T11:30:39.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.700+0000 7f29b792e800 20 add_watcher() i=6 2024-09-14T11:30:39.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.701+0000 7f29b792e800 20 add_watcher() i=7 2024-09-14T11:30:39.700 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.701+0000 7f29b792e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:39.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.703+0000 7f2869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.703+0000 7f29b792e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:39.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.703+0000 7f29b792e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.703+0000 7f29b792e800 5 note: GC not initialized 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.703+0000 7f2868fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f29b792e800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f29b792e800 20 Filter name: none 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f27e27fc640 20 reqs_thread_entry: start 2024-09-14T11:30:39.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:39.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.704+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.705+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:39.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.705+0000 7f29b792e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:39.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.705+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.705+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:39.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.705+0000 7f29b792e800 20 rados->read ofs=0 len=0 2024-09-14T11:30:39.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.706+0000 7f29b792e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:39.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.706+0000 7f29b792e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:39.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.707+0000 7f2869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:39.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.709+0000 7f29b792e800 20 remove_watcher() i=0 2024-09-14T11:30:39.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.709+0000 7f29b792e800 2 removed watcher, disabling cache 2024-09-14T11:30:39.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.710+0000 7f29b792e800 20 remove_watcher() i=1 2024-09-14T11:30:39.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.711+0000 7f29b792e800 20 remove_watcher() i=2 2024-09-14T11:30:39.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.712+0000 7f29b792e800 20 remove_watcher() i=3 2024-09-14T11:30:39.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.713+0000 7f29b792e800 20 remove_watcher() i=4 2024-09-14T11:30:39.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.714+0000 7f29b792e800 20 remove_watcher() i=5 2024-09-14T11:30:39.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.715+0000 7f29b792e800 20 remove_watcher() i=6 2024-09-14T11:30:39.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:39.716+0000 7f29b792e800 20 remove_watcher() i=7 2024-09-14T11:30:39.725 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:39.725 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:39.725 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:30:39.725 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:39.727 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.727 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.730 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.730 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.773 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.773 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.802 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:30:39.802 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:39.803 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.804 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.815 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.815 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.858 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.858 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.867 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.867 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.874 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.874 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.880 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.880 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.887 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.887 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.893 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.894 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.900 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.901 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.907 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.907 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.914 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.914 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.920 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.920 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.927 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.927 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.933 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.933 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.940 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.940 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.946 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.946 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.953 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.953 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.960 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.960 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.967 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.967 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.974 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.975 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.981 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.982 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.988 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:39.988 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:39.995 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:30:40.023 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:40.023 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:40.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.060+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 realm 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.062+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.063+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.063+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.064+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:40.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.064+0000 7f4959b22800 20 searching for the correct realm 2024-09-14T11:30:40.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.066+0000 7f4955fd3640 0 -- 172.21.15.130:0/2002428848 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4940018070 msgr2=0x7f4940060590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:40.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.271+0000 7f4955fd3640 0 -- 172.21.15.130:0/2002428848 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4940018070 msgr2=0x7f4940060590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:40.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.275+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 zone default found 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 4 Realm: () 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 zonegroup default 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.276 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.276+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.277+0000 7f4959b22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.277+0000 7f4959b22800 20 started sync module instance, tier type = 2024-09-14T11:30:40.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.277+0000 7f4959b22800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=0 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=1 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=2 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=3 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=4 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=5 2024-09-14T11:30:40.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.285+0000 7f4959b22800 20 add_watcher() i=6 2024-09-14T11:30:40.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.286+0000 7f4959b22800 20 add_watcher() i=7 2024-09-14T11:30:40.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.286+0000 7f4959b22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f480b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f4959b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f4959b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f4959b22800 5 note: GC not initialized 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f480a7e4640 20 reqs_thread_entry: start 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f4959b22800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.288+0000 7f4959b22800 20 Filter name: none 2024-09-14T11:30:40.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.289+0000 7f477bfff640 20 reqs_thread_entry: start 2024-09-14T11:30:40.288 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.289+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.289+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.289+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.290+0000 7f4959b22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:40.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.292+0000 7f480b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:40.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.294+0000 7f4959b22800 20 remove_watcher() i=0 2024-09-14T11:30:40.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.294+0000 7f4959b22800 2 removed watcher, disabling cache 2024-09-14T11:30:40.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.295+0000 7f4959b22800 20 remove_watcher() i=1 2024-09-14T11:30:40.294 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.296+0000 7f4959b22800 20 remove_watcher() i=2 2024-09-14T11:30:40.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.297+0000 7f4959b22800 20 remove_watcher() i=3 2024-09-14T11:30:40.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.298+0000 7f4959b22800 20 remove_watcher() i=4 2024-09-14T11:30:40.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.299+0000 7f4959b22800 20 remove_watcher() i=5 2024-09-14T11:30:40.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.300+0000 7f4959b22800 20 remove_watcher() i=6 2024-09-14T11:30:40.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.301+0000 7f4959b22800 20 remove_watcher() i=7 2024-09-14T11:30:40.309 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.310 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:40.310 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:40.310 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.311 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:30:40.346 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:40.346 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:40.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.383+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 realm 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:40.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 searching for the correct realm 2024-09-14T11:30:40.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.388+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:40.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.594+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:40.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:40.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 zone default found 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Realm: () 2024-09-14T11:30:40.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 zonegroup default 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started sync module instance, tier type = 2024-09-14T11:30:40.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=0 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=1 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=2 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=3 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=4 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=5 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=6 2024-09-14T11:30:40.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.610+0000 7f26e7f2c800 20 add_watcher() i=7 2024-09-14T11:30:40.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.610+0000 7f26e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:40.610 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.612+0000 7f2599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:40.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:40.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:40.611 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 note: GC not initialized 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.612+0000 7f2598fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 Filter name: none 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f25127fc640 20 reqs_thread_entry: start 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:40.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : miss 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:30:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 93982322550608 notifier 6491 bl.length()=1023 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26e7f2c800 time 2024-09-14T11:30:40.620743+0000 2024-09-14T11:30:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26e978c76a] 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.619 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.620+0000 7f26e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26e7f2c800 time 2024-09-14T11:30:40.620743+0000 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26e978c76a] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.620 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:30:40.621 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f26e7f2c800 thread_name:radosgw-admin 2024-09-14T11:30:40.640 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26e843e6f0] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26e848b99c] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26e978c7c4] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.641 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.621+0000 7f26e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f26e7f2c800 thread_name:radosgw-admin 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26e843e6f0] 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26e848b99c] 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26e978c7c4] 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.642 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 4 set_mon_vals no callback set 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.643 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: dump: 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: shutdown 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) unregister_commands rotate-key 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.644 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.645 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.646 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: starting msgr at 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: starting objecter 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests hook 0x5579f6e64be0 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: setting wanted keys 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: calling monclient init 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.647 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key hook 0x5579f6e3a768 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6ce7b20 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.648 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6ceef50 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6e645f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.852822s 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6ceef50 auth_method 0 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6ce7b20 auth_method 0 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.649 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6e645f0 auth_method 0 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6918 payload 824 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.650 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 1 monclient: found mon.noname-a 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: dump: 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.651 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6918 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: dump: 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.652 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:30:40.369+0000 7f25d1e0b640 4 set_mon_vals no callback set 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 1 librados: init done 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:30:40.371+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25cc077260 auth_method 0 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:30:40.371+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6e83610 auth_method 0 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:30:40.372+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x5579f6e867f0 auth_method 0 2024-09-14T11:30:40.653 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:30:40.373+0000 7f26db44e640 10 monclient: get_auth_request con 0x5579f6e8a9e0 auth_method 0 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.654 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.655 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests cmddesc objecter_requests hook 0x5579f6e92cc0 EEXIST 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x5579f6e8df80 EEXIST 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6eb6fe0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6eb73c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6eb5cf0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.859329s 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6eb6fe0 auth_method 0 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6eb5cf0 auth_method 0 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6eb73c0 auth_method 0 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6921 payload 824 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 1 monclient: found mon.noname-a 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: dump: 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.659 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:40.660 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: dump: 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6921 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.661 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:30:40.375+0000 7f26e4c51640 4 set_mon_vals no callback set 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: get_monmap_and_config 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.662 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.663 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:30:40.378+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25bc077170 auth_method 0 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.664 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.665 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x7ffda8850cf8 EEXIST 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6f0b0f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6ed7a90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6f06990 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.863211s 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6f0b0f0 auth_method 0 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.666 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6f06990 auth_method 0 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6ed7a90 auth_method 0 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.667 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 1 monclient: found mon.noname-c 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: dump: 2024-09-14T11:30:40.668 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.669 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6488 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 4 set_mon_vals no callback set 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: dump: 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.670 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: shutdown 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.671 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.672 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: starting msgr at 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: starting objecter 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests cmddesc objecter_requests hook 0x5579f6f067c0 EEXIST 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: setting wanted keys 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: calling monclient init 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.673 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.674 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x5579f6ecb9e8 EEXIST 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6ed7a90 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6f06990 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6f0b0f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.865341s 2024-09-14T11:30:40.675 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6ed7a90 auth_method 0 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6f0b0f0 auth_method 0 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6f06990 auth_method 0 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6491 payload 824 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 1 monclient: found mon.noname-c 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: dump: 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: dump: 2024-09-14T11:30:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6491 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:30:40.381+0000 7f25c2ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 1 librados: init done 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cr dump hook 0x5579f6f085e8 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:30:40.383+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:30:40.384+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25ac077260 auth_method 0 2024-09-14T11:30:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:30:40.384+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6f24a60 auth_method 0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 realm 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:30:40.385+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x5579f6f28e70 auth_method 0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:30:40.386+0000 7f26db44e640 10 monclient: get_auth_request con 0x5579f6f2c5f0 auth_method 0 2024-09-14T11:30:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 searching for the correct realm 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:30:40.386+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6f313b0 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:30:40.387+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x7f26dc02c3f0 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:30:40.388+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f26d40b2c40 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:30:40.388+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f26cc028040 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:30:40.388+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:30:40.589+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f26cc028040 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:30:40.593+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x7f26dc00f430 auth_method 0 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:30:40.594+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:30:40.594+0000 7f25c17fa640 1 client.6491.objecter ms_handle_reset 0x7f26cc028040 session 0x7f26cc028710 osd.4 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:30:40.594+0000 7f25c17fa640 10 monclient: _renew_subs 2024-09-14T11:30:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:30:40.594+0000 7f25c17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:30:40.594+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f25ac087880 auth_method 0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 zone default found 2024-09-14T11:30:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Realm: () 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 zonegroup default 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started sync module instance, tier type = 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=0 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=1 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=2 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=3 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=4 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=5 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=6 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:30:40.610+0000 7f26e7f2c800 20 add_watcher() i=7 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:30:40.610+0000 7f26e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:30:40.612+0000 7f2599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache list hook 0x5579f6ef4940 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache inspect hook 0x5579f6ef4940 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache erase hook 0x5579f6ef4940 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache zap hook 0x5579f6ef4940 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 note: GC not initialized 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:30:40.612+0000 7f2598fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace show hook 0x7f26dc004720 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace history hook 0x7f26dc004720 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace active hook 0x7f26dc004720 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace active_short hook 0x7f26dc004720 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 Filter name: none 2024-09-14T11:30:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:30:40.613+0000 7f25127fc640 20 reqs_thread_entry: start 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : miss 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 93982322550608 notifier 6491 bl.length()=1023 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:30:40.620+0000 7f26e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26e7f2c800 time 2024-09-14T11:30:40.620743+0000 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26e978c76a] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:30:40.621+0000 7f26e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f26e7f2c800 thread_name:radosgw-admin 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26e843e6f0] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26e848b99c] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26e978c7c4] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:30:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:30:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:30:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:30:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:40.701 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25127fc640 / http_manager 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f2598fe1640 / http_manager 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f2599fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c17fa640 / ms_dispatch 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c27fc640 / io_context_pool 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c2ffd640 / io_context_pool 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c97fa640 / ms_dispatch 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25cbfff640 / ms_dispatch 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25d1e0b640 / io_context_pool 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26db44e640 / msgr-worker-2 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e3c4f640 / msgr-worker-1 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e4450640 / msgr-worker-0 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e4c51640 / io_context_pool 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e7f2c800 / radosgw-admin 2024-09-14T11:30:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.107466.log 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 4 set_mon_vals no callback set 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:30:40.367+0000 7f25d1e0b640 10 monclient: dump: 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: shutdown 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) unregister_commands rotate-key 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding auth protocol: cephx 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: crc 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:30:40.367+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e40260) adding con mode: secure 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: starting msgr at 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: starting objecter 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests hook 0x5579f6e64be0 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: setting wanted keys 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 1 librados: calling monclient init 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding auth protocol: cephx 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: crc 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e3a620) adding con mode: secure 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key hook 0x5579f6e3a768 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6ce7b20 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6ceef50 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6e645f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:30:40.368+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.852822s 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6ceef50 auth_method 0 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6ce7b20 auth_method 0 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:30:40.368+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:30:40.368+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6e645f0 auth_method 0 2024-09-14T11:30:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:30:40.369+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6918 payload 824 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 1 monclient: found mon.noname-a 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:30:40.369+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: dump: 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6918 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:30:40.369+0000 7f25cbfff640 10 monclient: dump: 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:30:40.369+0000 7f25d1e0b640 4 set_mon_vals no callback set 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:30:40.369+0000 7f26e7f2c800 1 librados: init done 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:30:40.371+0000 7f25cbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:30:40.371+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25cc077260 auth_method 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:30:40.371+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6e83610 auth_method 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:30:40.372+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x5579f6e867f0 auth_method 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:30:40.373+0000 7f26db44e640 10 monclient: get_auth_request con 0x5579f6e8a9e0 auth_method 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.713 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding auth protocol: cephx 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: crc 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8f820) adding con mode: secure 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests cmddesc objecter_requests hook 0x5579f6e92cc0 EEXIST 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding auth protocol: cephx 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: crc 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:30:40.374+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6e8de38) adding con mode: secure 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x5579f6e8df80 EEXIST 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6eb6fe0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6eb73c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6eb5cf0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.859329s 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6eb6fe0 auth_method 0 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6eb5cf0 auth_method 0 2024-09-14T11:30:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:30:40.375+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6eb73c0 auth_method 0 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:30:40.375+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6921 payload 824 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 1 monclient: found mon.noname-a 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:30:40.375+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: dump: 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:30:40.375+0000 7f25c97fa640 10 monclient: dump: 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6921 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:30:40.375+0000 7f26e4c51640 4 set_mon_vals no callback set 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:30:40.375+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:30:40.377+0000 7f25c97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: get_monmap_and_config 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.721 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding auth protocol: cephx 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: crc 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ed6ab0) adding con mode: secure 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:30:40.378+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25bc077170 auth_method 0 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding auth protocol: cephx 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: crc 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8850bb0) adding con mode: secure 2024-09-14T11:30:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:30:40.378+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x7ffda8850cf8 EEXIST 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6f0b0f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6ed7a90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6f06990 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.863211s 2024-09-14T11:30:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6f0b0f0 auth_method 0 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6f06990 auth_method 0 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6ed7a90 auth_method 0 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:30:40.379+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:30:40.379+0000 7f26db44e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 1 monclient: found mon.noname-c 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:30:40.379+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: dump: 2024-09-14T11:30:40.727 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6488 2024-09-14T11:30:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 10 monclient: get_monmap_and_config success 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:30:40.379+0000 7f26e7f2c800 4 set_mon_vals no callback set 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:30:40.379+0000 7f25c2ffd640 10 monclient: dump: 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: shutdown 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: build_initial_monmap 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 build_initial for_mkfs: 0 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: monmap: 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding auth protocol: cephx 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: crc 2024-09-14T11:30:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6edaad0) adding con mode: secure 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: starting msgr at 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: starting objecter 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command objecter_requests cmddesc objecter_requests hook 0x5579f6f067c0 EEXIST 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: setting wanted keys 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 1 librados: calling monclient init 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 10 monclient: init 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding auth protocol: cephx 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: crc 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:30:40.380+0000 7f26e7f2c800 5 AuthRegistry(0x5579f6ecb8a0) adding con mode: secure 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command rotate-key cmddesc rotate-key hook 0x5579f6ecb9e8 EEXIST 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _reopen_session rank -1 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-c con 0x5579f6ed7a90 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:30:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-b con 0x5579f6f06990 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): picked mon.noname-a con 0x5579f6f0b0f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): _renew_subs 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient(hunting): authenticate will time out at 1956.865341s 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request con 0x5579f6ed7a90 auth_method 0 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): get_auth_request con 0x5579f6f0b0f0 auth_method 0 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:30:40.381+0000 7f26e4450640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): get_auth_request con 0x5579f6f06990 auth_method 0 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:30:40.381+0000 7f26db44e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient(hunting): handle_auth_done global_id 6491 payload 824 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient: _finish_hunting 0 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 1 monclient: found mon.noname-c 2024-09-14T11:30:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:30:40.381+0000 7f26e3c4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: dump: 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: _finish_auth 0 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:30:40.381+0000 7f25c17fa640 10 monclient: dump: 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:30:40.737 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 monclient: authenticate success, global_id 6491 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:30:40.381+0000 7f25c2ffd640 4 set_mon_vals no callback set 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _renew_subs 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 1 librados: init done 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:30:40.381+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cr dump hook 0x5579f6f085e8 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:30:40.383+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:30:40.383+0000 7f25c17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:30:40.384+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f25ac077260 auth_method 0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:30:40.384+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6f24a60 auth_method 0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 realm 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:30:40.384+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:30:40.385+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x5579f6f28e70 auth_method 0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:30:40.385+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:30:40.386+0000 7f26db44e640 10 monclient: get_auth_request con 0x5579f6f2c5f0 auth_method 0 2024-09-14T11:30:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:30:40.386+0000 7f26e7f2c800 20 searching for the correct realm 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:30:40.386+0000 7f26e4450640 10 monclient: get_auth_request con 0x5579f6f313b0 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:30:40.387+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x7f26dc02c3f0 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:30:40.388+0000 7f26db44e640 10 monclient: get_auth_request con 0x7f26d40b2c40 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:30:40.388+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f26cc028040 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:30:40.388+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:30:40.589+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f26cc028040 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:30:40.593+0000 7f26e3c4f640 10 monclient: get_auth_request con 0x7f26dc00f430 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:30:40.594+0000 7f26e4450640 0 -- 172.21.15.130:0/3679434374 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f26cc028040 msgr2=0x7f26cc043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:30:40.594+0000 7f25c17fa640 1 client.6491.objecter ms_handle_reset 0x7f26cc028040 session 0x7f26cc028710 osd.4 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:30:40.594+0000 7f25c17fa640 10 monclient: _renew_subs 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:30:40.594+0000 7f25c17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:30:40.594+0000 7f26e4450640 10 monclient: get_auth_request con 0x7f25ac087880 auth_method 0 2024-09-14T11:30:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:30:40.598+0000 7f26e7f2c800 20 zone default found 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Realm: () 2024-09-14T11:30:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 zonegroup default 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started sync module instance, tier type = 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:30:40.599+0000 7f26e7f2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=0 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=1 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=2 2024-09-14T11:30:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=3 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=4 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=5 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:30:40.609+0000 7f26e7f2c800 20 add_watcher() i=6 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:30:40.610+0000 7f26e7f2c800 20 add_watcher() i=7 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:30:40.610+0000 7f26e7f2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding auth protocol: cephx 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: crc 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 AuthRegistry(0x7ffda8851090) adding con mode: secure 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:30:40.612+0000 7f2599fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache list hook 0x5579f6ef4940 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache inspect hook 0x5579f6ef4940 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache erase hook 0x5579f6ef4940 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command cache zap hook 0x5579f6ef4940 2024-09-14T11:30:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 note: GC not initialized 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:30:40.612+0000 7f2598fe1640 20 reqs_thread_entry: start 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:30:40.612+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace show hook 0x7f26dc004720 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace history hook 0x7f26dc004720 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace active hook 0x7f26dc004720 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 5 asok(0x5579f6c1a270) register_command sync trace active_short hook 0x7f26dc004720 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 Filter name: none 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:30:40.613+0000 7f25127fc640 20 reqs_thread_entry: start 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : miss 2024-09-14T11:30:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:30:40.613+0000 7f26e7f2c800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:30:40.614+0000 7f26e7f2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:30:40.618+0000 7f26e7f2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 93982322550608 notifier 6491 bl.length()=1023 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:30:40.619+0000 7f25c27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:30:40.619+0000 7f26e7f2c800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:30:40.620+0000 7f26e7f2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26e7f2c800 time 2024-09-14T11:30:40.620743+0000 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f26e978c76a] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:30:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:30:40.621+0000 7f26e7f2c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f26e7f2c800 thread_name:radosgw-admin 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f26e843e6f0] 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f26e848b99c] 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f26e978c7c4] 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f26e978c928] 2024-09-14T11:30:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5579f5e1a0b1] 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8900e) [0x5579f632e00e] 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5579f5e29efd] 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f26e8429590] 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:30:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:30:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:30:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:30:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:30:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:30:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:30:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25127fc640 / http_manager 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f2598fe1640 / http_manager 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f2599fe3640 / rgw_dt_lg_renew 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c17fa640 / ms_dispatch 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c27fc640 / io_context_pool 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c2ffd640 / io_context_pool 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25c97fa640 / ms_dispatch 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25cbfff640 / ms_dispatch 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f25d1e0b640 / io_context_pool 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26db44e640 / msgr-worker-2 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e3c4f640 / msgr-worker-1 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e4450640 / msgr-worker-0 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e4c51640 / io_context_pool 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7f26e7f2c800 / radosgw-admin 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:30:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:30:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:30:40.622638Z_fd8e7a8b-a8be-423e-adb2-1822d43a9f1e/log 2024-09-14T11:30:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:30:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.700+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 20 realm 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.701+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.702+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.702+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.702+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.702+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:40.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.905+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:40.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.905+0000 7fd2ee539800 20 searching for the correct realm 2024-09-14T11:30:40.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:40.907+0000 7fd2e99c6640 0 -- 172.21.15.130:0/526931316 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd2dc09e400 msgr2=0x7fd2dc09e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:41.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.113+0000 7fd2ea1c7640 0 -- 172.21.15.130:0/526931316 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd2e4017020 msgr2=0x7fd2e4068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:41.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.319+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 zone default found 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 4 Realm: () 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 zonegroup default 2024-09-14T11:30:41.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.320+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.321+0000 7fd2ee539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.321+0000 7fd2ee539800 20 started sync module instance, tier type = 2024-09-14T11:30:41.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.321+0000 7fd2ee539800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=0 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=1 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=2 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=3 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=4 2024-09-14T11:30:41.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.330+0000 7fd2ee539800 20 add_watcher() i=5 2024-09-14T11:30:41.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.331+0000 7fd2ee539800 20 add_watcher() i=6 2024-09-14T11:30:41.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.331+0000 7fd2ee539800 20 add_watcher() i=7 2024-09-14T11:30:41.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.331+0000 7fd2ee539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:41.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd1a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:41.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd2ee539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:41.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd2ee539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:41.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd2ee539800 5 note: GC not initialized 2024-09-14T11:30:41.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd11b7fe640 20 reqs_thread_entry: start 2024-09-14T11:30:41.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.333+0000 7fd2ee539800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:41.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.334+0000 7fd2ee539800 20 Filter name: none 2024-09-14T11:30:41.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.334+0000 7fd1197fa640 20 reqs_thread_entry: start 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.334+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.334+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.334+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:41.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:41.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:41.335 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.335+0000 7fd2ee539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:30:41.336 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.337+0000 7fd1a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:41.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.340+0000 7fd2ee539800 20 remove_watcher() i=0 2024-09-14T11:30:41.339 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.340+0000 7fd2ee539800 2 removed watcher, disabling cache 2024-09-14T11:30:41.340 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.342+0000 7fd2ee539800 20 remove_watcher() i=1 2024-09-14T11:30:41.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.342+0000 7fd2ee539800 20 remove_watcher() i=2 2024-09-14T11:30:41.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.344+0000 7fd2ee539800 20 remove_watcher() i=3 2024-09-14T11:30:41.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.345+0000 7fd2ee539800 20 remove_watcher() i=4 2024-09-14T11:30:41.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.346+0000 7fd2ee539800 20 remove_watcher() i=5 2024-09-14T11:30:41.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.347+0000 7fd2ee539800 20 remove_watcher() i=6 2024-09-14T11:30:41.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.348+0000 7fd2ee539800 20 remove_watcher() i=7 2024-09-14T11:30:41.357 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:30:41.357 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:30:41.357 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:30:41.359 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:41.359 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:41.365 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:30:41.365 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:30:41.409 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:30:41.440 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:30:41.440 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:30:41.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.478+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 20 realm 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:30:41.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.479+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.480+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.480+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.480+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:41.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.480+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.481+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:30:41.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.481+0000 7fc108cbb800 20 searching for the correct realm 2024-09-14T11:30:41.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.484+0000 7fc106fa6640 0 -- 172.21.15.130:0/2059061527 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc0f0020040 msgr2=0x7fc0f0072770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:30:41.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.690+0000 7fc106fa6640 0 -- 172.21.15.130:0/2059061527 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc0f0020040 msgr2=0x7fc0f0072770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:30:41.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.694+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 zone default found 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 4 Realm: () 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 zonegroup default 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.695+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.696+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.696+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.696+0000 7fc108cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:30:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.696+0000 7fc108cbb800 20 started sync module instance, tier type = 2024-09-14T11:30:41.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.696+0000 7fc108cbb800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=0 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=1 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=2 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=3 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=4 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=5 2024-09-14T11:30:41.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.705+0000 7fc108cbb800 20 add_watcher() i=6 2024-09-14T11:30:41.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.706+0000 7fc108cbb800 20 add_watcher() i=7 2024-09-14T11:30:41.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.706+0000 7fc108cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:30:41.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fbfbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:41.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fc108cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:30:41.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fc108cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:30:41.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fc108cbb800 5 note: GC not initialized 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fbf377fe640 20 reqs_thread_entry: start 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.708+0000 7fc108cbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 20 Filter name: none 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fbf357fa640 20 reqs_thread_entry: start 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:30:41.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : miss 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.709+0000 7fc108cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:30:41.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:30:41.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.710+0000 7fc108cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:30:41.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.711+0000 7fc108cbb800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to be held by another RGW process; skipping for now 2024-09-14T11:30:41.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.712+0000 7fbfbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:30:41.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.714+0000 7fc108cbb800 20 remove_watcher() i=0 2024-09-14T11:30:41.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.714+0000 7fc108cbb800 2 removed watcher, disabling cache 2024-09-14T11:30:41.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.715+0000 7fc108cbb800 20 remove_watcher() i=1 2024-09-14T11:30:41.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.716+0000 7fc108cbb800 20 remove_watcher() i=2 2024-09-14T11:30:41.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.717+0000 7fc108cbb800 20 remove_watcher() i=3 2024-09-14T11:30:41.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.718+0000 7fc108cbb800 20 remove_watcher() i=4 2024-09-14T11:30:41.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.718+0000 7fc108cbb800 20 remove_watcher() i=5 2024-09-14T11:30:41.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.719+0000 7fc108cbb800 20 remove_watcher() i=6 2024-09-14T11:30:41.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:30:41.720+0000 7fc108cbb800 20 remove_watcher() i=7 2024-09-14T11:30:41.729 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:31:11.761 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:11.796 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:11.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.840+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 realm 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:11.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.842+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:11.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.843+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:11.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.843+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:11.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.844+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:11.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.844+0000 7f8a36087800 20 searching for the correct realm 2024-09-14T11:31:11.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:11.847+0000 7f8a34379640 0 -- 172.21.15.130:0/2345997441 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8a280adb90 msgr2=0x7f8a280a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:12.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.054+0000 7f8a34379640 0 -- 172.21.15.130:0/2345997441 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8a280adb90 msgr2=0x7f8a280a4b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:12.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:12.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:12.057 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.058+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:12.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 zone default found 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 4 Realm: () 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:12.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 zonegroup default 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.059+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.060+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.060+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.060+0000 7f8a36087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.060+0000 7f8a36087800 20 started sync module instance, tier type = 2024-09-14T11:31:12.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.060+0000 7f8a36087800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=0 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=1 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=2 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=3 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=4 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=5 2024-09-14T11:31:12.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.070+0000 7f8a36087800 20 add_watcher() i=6 2024-09-14T11:31:12.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.071+0000 7f8a36087800 20 add_watcher() i=7 2024-09-14T11:31:12.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.071+0000 7f8a36087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.073+0000 7f88e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.073+0000 7f8a36087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.073+0000 7f8a36087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.073+0000 7f8a36087800 5 note: GC not initialized 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.073+0000 7f88e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 20 Filter name: none 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f88627fc640 20 reqs_thread_entry: start 2024-09-14T11:31:12.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : miss 2024-09-14T11:31:12.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.074+0000 7f8a36087800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.075+0000 7f8a36087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:31:12.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.076+0000 7f8a36087800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:12.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.082+0000 7f8a36087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.082+0000 7f8a36087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.082+0000 7f8a36087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.082+0000 7f8a36087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8912ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94768007562816 notifier 6981 bl.length()=1023 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8912ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8912ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8912ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:31:12.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.083+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:31:12.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.0 2024-09-14T11:31:12.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.0 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.1 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.1 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.2 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.2 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.3 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.3 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.4 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.4 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.5 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.5 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.6 2024-09-14T11:31:12.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.6 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.7 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.7 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.8 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.8 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.9 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.9 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.10 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.10 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.11 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.088+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2.11 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.089+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.0 2024-09-14T11:31:12.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.089+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.1 2024-09-14T11:31:12.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.089+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2 2024-09-14T11:31:12.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.090+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.3 2024-09-14T11:31:12.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.091+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.4 2024-09-14T11:31:12.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.091+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.5 2024-09-14T11:31:12.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.092+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.6 2024-09-14T11:31:12.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.093+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.7 2024-09-14T11:31:12.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.093+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.8 2024-09-14T11:31:12.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.094+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.9 2024-09-14T11:31:12.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.094+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.10 2024-09-14T11:31:12.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.098+0000 7f8a36087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:12.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.098+0000 7f8a36087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:31:12.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f8a36087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f8a36087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f8a36087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f8a36087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:31:12.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f89127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94768007562816 notifier 6981 bl.length()=1023 2024-09-14T11:31:12.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f89127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f89127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.099+0000 7f89127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.100+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.100+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.100+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:31:12.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.100+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:31:12.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.103+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.0 2024-09-14T11:31:12.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.103+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.1 2024-09-14T11:31:12.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.103+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.2 2024-09-14T11:31:12.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.104+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.3 2024-09-14T11:31:12.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.104+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.4 2024-09-14T11:31:12.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.104+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.5 2024-09-14T11:31:12.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.105+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.6 2024-09-14T11:31:12.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.105+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.7 2024-09-14T11:31:12.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.105+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.8 2024-09-14T11:31:12.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.106+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.9 2024-09-14T11:31:12.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.106+0000 7f8a36087800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.28.10 2024-09-14T11:31:12.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.106+0000 7f8a36087800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:12.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.106+0000 7f8a36087800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 2024-09-14T11:31:12.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8a36087800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8a36087800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8a36087800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8a36087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28, ofs0, ns] 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8912ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94768007562816 notifier 6981 bl.length()=991 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8912ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 info.flags=0x17 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8912ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:a588039c-1457-497f-adbd-8890a12279b7.4508.28 to cache LRU end 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.108+0000 7f8912ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:12.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.109+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_sources= new_sources= 2024-09-14T11:31:12.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.109+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential sources added=[] removed=[] 2024-09-14T11:31:12.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.109+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): orig_dests= new_dests= 2024-09-14T11:31:12.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.109+0000 7f8a36087800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[a588039c-1457-497f-adbd-8890a12279b7.4508.28]): potential dests added=[] removed=[] 2024-09-14T11:31:12.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.111+0000 7f8a36087800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:12.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.113+0000 7f88e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:12.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.115+0000 7f8a36087800 20 remove_watcher() i=0 2024-09-14T11:31:12.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.115+0000 7f8a36087800 2 removed watcher, disabling cache 2024-09-14T11:31:12.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.116+0000 7f8a36087800 20 remove_watcher() i=1 2024-09-14T11:31:12.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.117+0000 7f8a36087800 20 remove_watcher() i=2 2024-09-14T11:31:12.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.118+0000 7f8a36087800 20 remove_watcher() i=3 2024-09-14T11:31:12.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.120+0000 7f8a36087800 20 remove_watcher() i=4 2024-09-14T11:31:12.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.120+0000 7f8a36087800 20 remove_watcher() i=5 2024-09-14T11:31:12.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.121+0000 7f8a36087800 20 remove_watcher() i=6 2024-09-14T11:31:12.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.123+0000 7f8a36087800 20 remove_watcher() i=7 2024-09-14T11:31:12.133 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:31:12.162 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:12.162 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:12.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.200+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 realm 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.202+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.203+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:12.202 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.203+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.204+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:12.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.204+0000 7f572a03e800 20 searching for the correct realm 2024-09-14T11:31:12.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.206+0000 7f5728329640 0 -- 172.21.15.130:0/3492986733 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f571c01f050 msgr2=0x7f571c067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:12.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.412+0000 7f5728329640 0 -- 172.21.15.130:0/3492986733 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f571c01f050 msgr2=0x7f571c067af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:12.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.416+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:12.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:12.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 zone default found 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 4 Realm: () 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 zonegroup default 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.417+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.418+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.418+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.418+0000 7f572a03e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.418+0000 7f572a03e800 20 started sync module instance, tier type = 2024-09-14T11:31:12.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.418+0000 7f572a03e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=0 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=1 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=2 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=3 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=4 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=5 2024-09-14T11:31:12.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.427+0000 7f572a03e800 20 add_watcher() i=6 2024-09-14T11:31:12.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.428+0000 7f572a03e800 20 add_watcher() i=7 2024-09-14T11:31:12.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.428+0000 7f572a03e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:12.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.430+0000 7f55ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.430+0000 7f572a03e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.430+0000 7f572a03e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.430+0000 7f572a03e800 5 note: GC not initialized 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f55dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f572a03e800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f572a03e800 20 Filter name: none 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f55567fc640 20 reqs_thread_entry: start 2024-09-14T11:31:12.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:31:12.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.431+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.432+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.432+0000 7f572a03e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.432+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.432+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.432+0000 7f572a03e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.433+0000 7f572a03e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:31:12.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.433+0000 7f572a03e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:12.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.435+0000 7f55ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:12.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.437+0000 7f572a03e800 20 remove_watcher() i=0 2024-09-14T11:31:12.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.437+0000 7f572a03e800 2 removed watcher, disabling cache 2024-09-14T11:31:12.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.438+0000 7f572a03e800 20 remove_watcher() i=1 2024-09-14T11:31:12.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.439+0000 7f572a03e800 20 remove_watcher() i=2 2024-09-14T11:31:12.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.440+0000 7f572a03e800 20 remove_watcher() i=3 2024-09-14T11:31:12.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.441+0000 7f572a03e800 20 remove_watcher() i=4 2024-09-14T11:31:12.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.442+0000 7f572a03e800 20 remove_watcher() i=5 2024-09-14T11:31:12.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.443+0000 7f572a03e800 20 remove_watcher() i=6 2024-09-14T11:31:12.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.444+0000 7f572a03e800 20 remove_watcher() i=7 2024-09-14T11:31:12.453 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:12.453 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:12.453 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-trim-reshard-log-entries id: a588039c-1457-497f-adbd-8890a12279b7.4508.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:12.453 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:12.455 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.455 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.458 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.501 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.501 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.528 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:31:12.528 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:12.529 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.530 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.542 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.543 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.585 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.585 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.592 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.593 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.599 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.599 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.605 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.605 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.611 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.612 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.618 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.618 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.625 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.625 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.631 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.632 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.638 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.638 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.644 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.644 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.652 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.652 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.659 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.659 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.665 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.665 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.672 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.672 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.678 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.678 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.685 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.685 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.693 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.694 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.701 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.701 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.707 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.708 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.715 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:12.715 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:12.722 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:31:12.750 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:12.750 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:12.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.787+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 realm 2024-09-14T11:31:12.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:12.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:12.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.789+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.790+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:12.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.790+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:12.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.791+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:12.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.791+0000 7f3af692e800 20 searching for the correct realm 2024-09-14T11:31:12.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:12.793+0000 7f3af2ede640 0 -- 172.21.15.130:0/3684763164 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3ae80a1b80 msgr2=0x7f3ae8061950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:12.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.000+0000 7f3af2ede640 0 -- 172.21.15.130:0/3684763164 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3ae80a1b80 msgr2=0x7f3ae8061950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:13.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:13.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.004+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:13.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 zone default found 2024-09-14T11:31:13.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 4 Realm: () 2024-09-14T11:31:13.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 zonegroup default 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.005+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.006+0000 7f3af692e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.006+0000 7f3af692e800 20 started sync module instance, tier type = 2024-09-14T11:31:13.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.006+0000 7f3af692e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:13.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=0 2024-09-14T11:31:13.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=1 2024-09-14T11:31:13.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=2 2024-09-14T11:31:13.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=3 2024-09-14T11:31:13.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=4 2024-09-14T11:31:13.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=5 2024-09-14T11:31:13.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.014+0000 7f3af692e800 20 add_watcher() i=6 2024-09-14T11:31:13.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.015+0000 7f3af692e800 20 add_watcher() i=7 2024-09-14T11:31:13.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.015+0000 7f3af692e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:13.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.017+0000 7f39a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.017+0000 7f3af692e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.017+0000 7f3af692e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.017+0000 7f3af692e800 5 note: GC not initialized 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.017+0000 7f39237fe640 20 reqs_thread_entry: start 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f3af692e800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f3af692e800 20 Filter name: none 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f39217fa640 20 reqs_thread_entry: start 2024-09-14T11:31:13.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:13.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.018+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.019+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.019+0000 7f3af692e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.019+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.019+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.019+0000 7f3af692e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.020+0000 7f3af692e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:13.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.020+0000 7f3af692e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:13.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.021+0000 7f39a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.023+0000 7f3af692e800 20 remove_watcher() i=0 2024-09-14T11:31:13.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.023+0000 7f3af692e800 2 removed watcher, disabling cache 2024-09-14T11:31:13.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.024+0000 7f3af692e800 20 remove_watcher() i=1 2024-09-14T11:31:13.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.026+0000 7f3af692e800 20 remove_watcher() i=2 2024-09-14T11:31:13.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.027+0000 7f3af692e800 20 remove_watcher() i=3 2024-09-14T11:31:13.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.028+0000 7f3af692e800 20 remove_watcher() i=4 2024-09-14T11:31:13.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.029+0000 7f3af692e800 20 remove_watcher() i=5 2024-09-14T11:31:13.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.030+0000 7f3af692e800 20 remove_watcher() i=6 2024-09-14T11:31:13.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.031+0000 7f3af692e800 20 remove_watcher() i=7 2024-09-14T11:31:13.039 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:13.040 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:13.040 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:13.040 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:13.041 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:31:13.075 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:13.075 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:13.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.113+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 realm 2024-09-14T11:31:13.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:13.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.114+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.115+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.115+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.116+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:13.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.116+0000 7f1c0b13e800 20 searching for the correct realm 2024-09-14T11:31:13.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.118+0000 7f1c076ee640 0 -- 172.21.15.130:0/2585444550 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f1bfc02e940 msgr2=0x7f1bfc01d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:13.323 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.324+0000 7f1c076ee640 0 -- 172.21.15.130:0/2585444550 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f1bfc02e940 msgr2=0x7f1bfc01d430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:13.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.329 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.328+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 zone default found 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 4 Realm: () 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 zonegroup default 2024-09-14T11:31:13.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.329+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.330+0000 7f1c0b13e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.330+0000 7f1c0b13e800 20 started sync module instance, tier type = 2024-09-14T11:31:13.331 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.330+0000 7f1c0b13e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=0 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=1 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=2 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=3 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=4 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=5 2024-09-14T11:31:13.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.338+0000 7f1c0b13e800 20 add_watcher() i=6 2024-09-14T11:31:13.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.339+0000 7f1c0b13e800 20 add_watcher() i=7 2024-09-14T11:31:13.338 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.339+0000 7f1c0b13e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:13.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.340+0000 7f1abd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 5 note: GC not initialized 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1a37fff640 20 reqs_thread_entry: start 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 20 Filter name: none 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1a35ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.341+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:13.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : miss 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.342+0000 7f1c0b13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1aea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94555685210352 notifier 6593 bl.length()=999 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1aea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1aea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1aea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:13.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:13.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:13.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.347+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:13.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.0 2024-09-14T11:31:13.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.0 2024-09-14T11:31:13.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.1 2024-09-14T11:31:13.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.1 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.2 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.2 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.3 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.3 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.4 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.4 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.5 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.5 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.6 2024-09-14T11:31:13.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.6 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.7 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.7 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.8 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.8 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.9 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.9 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.10 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.10 2024-09-14T11:31:13.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.11 2024-09-14T11:31:13.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.11 2024-09-14T11:31:13.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.0 2024-09-14T11:31:13.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1 2024-09-14T11:31:13.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.352+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.2 2024-09-14T11:31:13.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.353+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.3 2024-09-14T11:31:13.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.353+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.4 2024-09-14T11:31:13.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.354+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.5 2024-09-14T11:31:13.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.354+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.6 2024-09-14T11:31:13.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.355+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.7 2024-09-14T11:31:13.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.355+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.8 2024-09-14T11:31:13.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.356+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.9 2024-09-14T11:31:13.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.356+0000 7f1c0b13e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.10 2024-09-14T11:31:13.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.359+0000 7f1c0b13e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:13.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.359+0000 7f1c0b13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1c0b13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1c0b13e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1c0b13e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1c0b13e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1ae9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94555685210352 notifier 6593 bl.length()=999 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1ae9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1ae9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.360+0000 7f1ae9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:13.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:31:13.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.361+0000 7f1c0b13e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:31:13.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.365+0000 7f1c0b13e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:13.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.365+0000 7f1c0b13e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1ae9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94555685210352 notifier 6593 bl.length()=967 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1ae9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1ae9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:13.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1ae9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:13.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:13.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:13.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:13.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.366+0000 7f1c0b13e800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:13.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.369+0000 7f1c0b13e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:31:13.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.370+0000 7f1abd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.372+0000 7f1c0b13e800 20 remove_watcher() i=0 2024-09-14T11:31:13.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.372+0000 7f1c0b13e800 2 removed watcher, disabling cache 2024-09-14T11:31:13.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.374+0000 7f1c0b13e800 20 remove_watcher() i=1 2024-09-14T11:31:13.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.375+0000 7f1c0b13e800 20 remove_watcher() i=2 2024-09-14T11:31:13.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.376+0000 7f1c0b13e800 20 remove_watcher() i=3 2024-09-14T11:31:13.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.376+0000 7f1c0b13e800 20 remove_watcher() i=4 2024-09-14T11:31:13.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.378+0000 7f1c0b13e800 20 remove_watcher() i=5 2024-09-14T11:31:13.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.378+0000 7f1c0b13e800 20 remove_watcher() i=6 2024-09-14T11:31:13.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.379+0000 7f1c0b13e800 20 remove_watcher() i=7 2024-09-14T11:31:13.389 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:31:13.418 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:13.418 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:13.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.456+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.457+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.457+0000 7f3e87f25800 20 realm 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.457+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.458+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.458+0000 7f3e87f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.458+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.458+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.457 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.458+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.459+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.459+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.459+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:13.458 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.459+0000 7f3e87f25800 20 searching for the correct realm 2024-09-14T11:31:13.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.461+0000 7f3e84334640 0 -- 172.21.15.130:0/3516579947 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3e6c0eb3e0 msgr2=0x7f3e6c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:13.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.667+0000 7f3e84334640 0 -- 172.21.15.130:0/3516579947 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3e6c0eb3e0 msgr2=0x7f3e6c0cc410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:13.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.670+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 zone default found 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 4 Realm: () 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:13.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 zonegroup default 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.671+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 started sync module instance, tier type = 2024-09-14T11:31:13.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.672+0000 7f3e87f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=0 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=1 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=2 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=3 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=4 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=5 2024-09-14T11:31:13.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.681+0000 7f3e87f25800 20 add_watcher() i=6 2024-09-14T11:31:13.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.682+0000 7f3e87f25800 20 add_watcher() i=7 2024-09-14T11:31:13.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.682+0000 7f3e87f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:13.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.683+0000 7f3d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:13.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:13.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 5 note: GC not initialized 2024-09-14T11:31:13.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3d38fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:13.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:13.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 20 Filter name: none 2024-09-14T11:31:13.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3cb27fc640 20 reqs_thread_entry: start 2024-09-14T11:31:13.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.684+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.685+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:13.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.685+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.685+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.685+0000 7f3e87f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.685+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.686+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.686+0000 7f3e87f25800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.686+0000 7f3e87f25800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:13.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.686+0000 7f3e87f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:13.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.688+0000 7f3d39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:13.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.690+0000 7f3e87f25800 20 remove_watcher() i=0 2024-09-14T11:31:13.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.690+0000 7f3e87f25800 2 removed watcher, disabling cache 2024-09-14T11:31:13.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.690+0000 7f3e87f25800 20 remove_watcher() i=1 2024-09-14T11:31:13.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.691+0000 7f3e87f25800 20 remove_watcher() i=2 2024-09-14T11:31:13.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.692+0000 7f3e87f25800 20 remove_watcher() i=3 2024-09-14T11:31:13.692 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.693+0000 7f3e87f25800 20 remove_watcher() i=4 2024-09-14T11:31:13.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.694+0000 7f3e87f25800 20 remove_watcher() i=5 2024-09-14T11:31:13.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.695+0000 7f3e87f25800 20 remove_watcher() i=6 2024-09-14T11:31:13.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.696+0000 7f3e87f25800 20 remove_watcher() i=7 2024-09-14T11:31:13.705 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:13.705 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:13.705 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:13.705 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:13.707 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:13.707 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:13.713 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:13.713 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:13.756 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:13.787 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:13.788 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:13.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.825+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 realm 2024-09-14T11:31:13.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.826 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:13.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:13.827 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.827+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.828+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:13.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.828+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:13.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.829+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:13.828 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.829+0000 7f73fe942800 20 searching for the correct realm 2024-09-14T11:31:13.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:13.831+0000 7f73faeee640 0 -- 172.21.15.130:0/4075228663 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f73e4026930 msgr2=0x7f73e4031410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:14.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.037+0000 7f73faeee640 0 -- 172.21.15.130:0/4075228663 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f73e4026930 msgr2=0x7f73e4031410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:14.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:14.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:14.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:14.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:14.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.041+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 zone default found 2024-09-14T11:31:14.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 4 Realm: () 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 zonegroup default 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.042+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.043+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.043+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.044 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.043+0000 7f73fe942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.043+0000 7f73fe942800 20 started sync module instance, tier type = 2024-09-14T11:31:14.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.043+0000 7f73fe942800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:14.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=0 2024-09-14T11:31:14.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=1 2024-09-14T11:31:14.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=2 2024-09-14T11:31:14.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=3 2024-09-14T11:31:14.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=4 2024-09-14T11:31:14.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=5 2024-09-14T11:31:14.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.051+0000 7f73fe942800 20 add_watcher() i=6 2024-09-14T11:31:14.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.052+0000 7f73fe942800 20 add_watcher() i=7 2024-09-14T11:31:14.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.052+0000 7f73fe942800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:14.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.053+0000 7f72b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:14.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:14.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 5 note: GC not initialized 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f722b7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 20 Filter name: none 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f72297fa640 20 reqs_thread_entry: start 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.054+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.055+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:14.055 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.055+0000 7f73fe942800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.055+0000 7f73fe942800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.055+0000 7f73fe942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : miss 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.055+0000 7f73fe942800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.056+0000 7f73fe942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.060+0000 7f73fe942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.060+0000 7f73fe942800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.060+0000 7f73fe942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.060+0000 7f73fe942800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f72ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 94567862366912 notifier 7074 bl.length()=999 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f72ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f72ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f72ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:14.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:14.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:14.061 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.061+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:14.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.0 2024-09-14T11:31:14.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.0 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.1 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.1 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.2 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.2 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.3 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.3 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.4 2024-09-14T11:31:14.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.4 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.5 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.5 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.6 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.6 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.7 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.7 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.8 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.8 2024-09-14T11:31:14.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.9 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.9 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.10 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.10 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.11 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1.11 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.065+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.0 2024-09-14T11:31:14.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.066+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.066+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.2 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.066+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.3 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.067+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.4 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.067+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.5 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.068+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.6 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.068+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.7 2024-09-14T11:31:14.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.069+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.8 2024-09-14T11:31:14.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.069+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.9 2024-09-14T11:31:14.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.069+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.10 2024-09-14T11:31:14.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.072+0000 7f73fe942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:14.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.072+0000 7f73fe942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:14.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f73fe942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f73fe942800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f73fe942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f73fe942800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f72dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94567862366912 notifier 7074 bl.length()=999 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f72dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f72dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.073+0000 7f72dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.074+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:14.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.074+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:14.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.074+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:14.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.074+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:14.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.076+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.0 2024-09-14T11:31:14.075 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.076+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.1 2024-09-14T11:31:14.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.076+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.2 2024-09-14T11:31:14.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.077+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.3 2024-09-14T11:31:14.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.077+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.4 2024-09-14T11:31:14.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.077+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.5 2024-09-14T11:31:14.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.078+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.6 2024-09-14T11:31:14.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.078+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.7 2024-09-14T11:31:14.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.078+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.8 2024-09-14T11:31:14.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.078+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.9 2024-09-14T11:31:14.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.079+0000 7f73fe942800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.29.10 2024-09-14T11:31:14.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.079+0000 7f73fe942800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:14.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.079+0000 7f73fe942800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.080+0000 7f73fe942800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.080+0000 7f73fe942800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.080+0000 7f73fe942800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.080+0000 7f73fe942800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29, ofs0, ns] 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f72dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94567862366912 notifier 7074 bl.length()=967 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f72dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 info.flags=0x17 2024-09-14T11:31:14.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f72dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.29 to cache LRU end 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f72dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_sources= new_sources= 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential sources added=[] removed=[] 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): orig_dests= new_dests= 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.081+0000 7f73fe942800 20 handle_bi_update(): bucket=:error-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.29]): potential dests added=[] removed=[] 2024-09-14T11:31:14.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.083+0000 7f73fe942800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:14.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.085+0000 7f72b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:14.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.087+0000 7f73fe942800 20 remove_watcher() i=0 2024-09-14T11:31:14.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.087+0000 7f73fe942800 2 removed watcher, disabling cache 2024-09-14T11:31:14.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.087+0000 7f73fe942800 20 remove_watcher() i=1 2024-09-14T11:31:14.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.088+0000 7f73fe942800 20 remove_watcher() i=2 2024-09-14T11:31:14.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.089+0000 7f73fe942800 20 remove_watcher() i=3 2024-09-14T11:31:14.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.090+0000 7f73fe942800 20 remove_watcher() i=4 2024-09-14T11:31:14.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.091+0000 7f73fe942800 20 remove_watcher() i=5 2024-09-14T11:31:14.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.092+0000 7f73fe942800 20 remove_watcher() i=6 2024-09-14T11:31:14.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.093+0000 7f73fe942800 20 remove_watcher() i=7 2024-09-14T11:31:14.103 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:31:14.132 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:14.132 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:14.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.170+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 realm 2024-09-14T11:31:14.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:14.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.172+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.173+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:14.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.173+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.173+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:14.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.173+0000 7f913ed26800 20 searching for the correct realm 2024-09-14T11:31:14.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.175+0000 7f913b1da640 0 -- 172.21.15.130:0/3997234917 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9130034060 msgr2=0x7f9130067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:14.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.381+0000 7f913b1da640 0 -- 172.21.15.130:0/3997234917 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9130034060 msgr2=0x7f9130067830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:14.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 zone default found 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 4 Realm: () 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:14.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 zonegroup default 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.385+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 started sync module instance, tier type = 2024-09-14T11:31:14.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.386+0000 7f913ed26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=0 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=1 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=2 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=3 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=4 2024-09-14T11:31:14.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=5 2024-09-14T11:31:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.395+0000 7f913ed26800 20 add_watcher() i=6 2024-09-14T11:31:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.396+0000 7f913ed26800 20 add_watcher() i=7 2024-09-14T11:31:14.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.396+0000 7f913ed26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:14.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.398+0000 7f8ff17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:14.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:14.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:14.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 5 note: GC not initialized 2024-09-14T11:31:14.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f8f6bfff640 20 reqs_thread_entry: start 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 20 Filter name: none 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f8f69ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.399+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.400+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:14.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.400+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:14.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:14.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:14.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.401+0000 7f913ed26800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:14.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.402+0000 7f913ed26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:14.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.403+0000 7f8ff17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:14.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.405+0000 7f913ed26800 20 remove_watcher() i=0 2024-09-14T11:31:14.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.405+0000 7f913ed26800 2 removed watcher, disabling cache 2024-09-14T11:31:14.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.406+0000 7f913ed26800 20 remove_watcher() i=1 2024-09-14T11:31:14.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.407+0000 7f913ed26800 20 remove_watcher() i=2 2024-09-14T11:31:14.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.408+0000 7f913ed26800 20 remove_watcher() i=3 2024-09-14T11:31:14.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.409+0000 7f913ed26800 20 remove_watcher() i=4 2024-09-14T11:31:14.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.410+0000 7f913ed26800 20 remove_watcher() i=5 2024-09-14T11:31:14.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.411+0000 7f913ed26800 20 remove_watcher() i=6 2024-09-14T11:31:14.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.412+0000 7f913ed26800 20 remove_watcher() i=7 2024-09-14T11:31:14.421 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:14.421 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:14.421 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:14.421 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:14.422 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.423 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.426 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.426 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.469 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.469 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.495 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:31:14.495 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:14.497 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.497 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.508 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.508 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.551 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.551 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.559 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.559 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.565 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.565 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.574 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.574 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.580 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.580 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.587 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.587 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.593 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.593 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.599 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.600 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.606 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.606 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.612 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.612 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.619 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.619 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.625 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.626 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.632 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.632 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.638 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.639 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.644 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.645 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.651 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.651 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.657 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.657 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.664 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.664 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.670 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.671 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.678 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:14.678 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:14.686 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:31:14.714 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:14.714 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:14.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.753+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 realm 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:14.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.755+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.756+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:14.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.756+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:14.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.757+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:14.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.757+0000 7fea75613800 20 searching for the correct realm 2024-09-14T11:31:14.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.758+0000 7fea70591640 0 -- 172.21.15.130:0/2671595230 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fea680c0ae0 msgr2=0x7fea680a5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:14.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:14.963+0000 7fea70d92640 0 -- 172.21.15.130:0/2671595230 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fea60065e30 msgr2=0x7fea6006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:15.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.168+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 zone default found 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 4 Realm: () 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:15.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 zonegroup default 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.169+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.170+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.170+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.170+0000 7fea75613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.170+0000 7fea75613800 20 started sync module instance, tier type = 2024-09-14T11:31:15.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.170+0000 7fea75613800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=0 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=1 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=2 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=3 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=4 2024-09-14T11:31:15.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=5 2024-09-14T11:31:15.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.179+0000 7fea75613800 20 add_watcher() i=6 2024-09-14T11:31:15.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.180+0000 7fea75613800 20 add_watcher() i=7 2024-09-14T11:31:15.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.180+0000 7fea75613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:15.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fe9277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:15.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fea75613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:15.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fea75613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:15.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fea75613800 5 note: GC not initialized 2024-09-14T11:31:15.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fe9267e4640 20 reqs_thread_entry: start 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fea75613800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.182+0000 7fea75613800 20 Filter name: none 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.183+0000 7fe91f7fe640 20 reqs_thread_entry: start 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.183+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.183+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:15.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.183+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.184+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.184+0000 7fea75613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.184+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.184+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.184+0000 7fea75613800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.185+0000 7fea75613800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.185+0000 7fea75613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:15.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.186+0000 7fe9277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:15.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.188+0000 7fea75613800 20 remove_watcher() i=0 2024-09-14T11:31:15.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.188+0000 7fea75613800 2 removed watcher, disabling cache 2024-09-14T11:31:15.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.189+0000 7fea75613800 20 remove_watcher() i=1 2024-09-14T11:31:15.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.190+0000 7fea75613800 20 remove_watcher() i=2 2024-09-14T11:31:15.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.191+0000 7fea75613800 20 remove_watcher() i=3 2024-09-14T11:31:15.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.192+0000 7fea75613800 20 remove_watcher() i=4 2024-09-14T11:31:15.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.193+0000 7fea75613800 20 remove_watcher() i=5 2024-09-14T11:31:15.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.194+0000 7fea75613800 20 remove_watcher() i=6 2024-09-14T11:31:15.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.195+0000 7fea75613800 20 remove_watcher() i=7 2024-09-14T11:31:15.204 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.204 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:15.204 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:15.204 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.206 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:31:15.240 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:15.241 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:15.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.278+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 realm 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:15.279 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.280 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.281+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:15.281 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.281+0000 7fb820323800 20 searching for the correct realm 2024-09-14T11:31:15.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.485+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.690+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.694+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 zone default found 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 4 Realm: () 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 zonegroup default 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.696+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.696+0000 7fb820323800 20 started sync module instance, tier type = 2024-09-14T11:31:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.696+0000 7fb820323800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:15.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=0 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=1 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=2 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=3 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=4 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=5 2024-09-14T11:31:15.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=6 2024-09-14T11:31:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.706+0000 7fb820323800 20 add_watcher() i=7 2024-09-14T11:31:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.706+0000 7fb820323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:15.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.707+0000 7fb6d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:15.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:15.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:15.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.707+0000 7fb820323800 5 note: GC not initialized 2024-09-14T11:31:15.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb6d1fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 20 Filter name: none 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb6437fe640 20 reqs_thread_entry: start 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : miss 2024-09-14T11:31:15.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:15.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.709+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.714+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.0 2024-09-14T11:31:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1 2024-09-14T11:31:15.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2 2024-09-14T11:31:15.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.3 2024-09-14T11:31:15.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.4 2024-09-14T11:31:15.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.5 2024-09-14T11:31:15.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.6 2024-09-14T11:31:15.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.7 2024-09-14T11:31:15.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.8 2024-09-14T11:31:15.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.9 2024-09-14T11:31:15.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.10 2024-09-14T11:31:15.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.731+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:15.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.731+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.733 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb820323800 time 2024-09-14T11:31:15.735027+0000 2024-09-14T11:31:15.733 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb82198c76a] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:31:15.734 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fb820323800 thread_name:radosgw-admin 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.734+0000 7fb820323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb820323800 time 2024-09-14T11:31:15.735027+0000 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb82198c76a] 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.735 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:31:15.736 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb82063e6f0] 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb82068b99c] 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:15.758 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb82198c7c4] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.735+0000 7fb820323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fb820323800 thread_name:radosgw-admin 2024-09-14T11:31:15.759 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb82063e6f0] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb82068b99c] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb82198c7c4] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.760 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:31:15.263+0000 7fb820323800 5 AuthRegistry(0x55e867cc73a0) adding con mode: crc 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:31:15.263+0000 7fb820323800 5 AuthRegistry(0x55e867cc73a0) adding con mode: secure 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:31:15.263+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:31:15.263+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.761 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:31:15.263+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key hook 0x55e867cc74e8 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867b50f80 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867c105b0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867cca9d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.747716s 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867c105b0 auth_method 0 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.762 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867b50f80 auth_method 0 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.763 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867cca9d0 auth_method 0 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:31:15.264+0000 7fb81b80b640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:31:15.264+0000 7fb81b80b640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:31:15.264+0000 7fb81b80b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: dump: 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.764 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.765 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: dump: 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.766 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:31:15.264+0000 7fb820323800 5 monclient: authenticate success, global_id 7119 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:31:15.264+0000 7fb70a60c640 4 set_mon_vals no callback set 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:31:15.264+0000 7fb820323800 1 librados: init done 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.767 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:31:15.266+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb704077260 auth_method 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:31:15.266+0000 7fb81c80d640 10 monclient: get_auth_request con 0x55e867ce8380 auth_method 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:31:15.267+0000 7fb81c00c640 10 monclient: get_auth_request con 0x55e867d13680 auth_method 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:31:15.268+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867d178c0 auth_method 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:31:15.269+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.768 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.769 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:31:15.269+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:31:15.269+0000 7fb820323800 5 asok(0x55e867aa7270) register_command objecter_requests cmddesc objecter_requests hook 0x55e867d201f0 EEXIST 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.770 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.771 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:31:15.270+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:31:15.270+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:31:15.270+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x55e867d1afa0 EEXIST 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d43ee0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d461b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d426b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.772 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.754350s 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d43ee0 auth_method 0 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867d426b0 auth_method 0 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d461b0 auth_method 0 2024-09-14T11:31:15.773 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_done global_id 7122 payload 824 2024-09-14T11:31:15.774 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:31:15.270+0000 7fb81c00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: dump: 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.775 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: dump: 2024-09-14T11:31:15.776 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:31:15.270+0000 7fb820323800 5 monclient: authenticate success, global_id 7122 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:31:15.270+0000 7fb81d00e640 4 set_mon_vals no callback set 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.777 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:31:15.273+0000 7fb81b80b640 10 monclient: get_auth_request con 0x7fb6f4077140 auth_method 0 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: get_monmap_and_config 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:31:15.273+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.778 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.779 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:31:15.273+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.780 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.781 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:31:15.273+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:31:15.274+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:31:15.274+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x7ffe59164f68 EEXIST 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d980a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d889f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d934d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.782 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.758175s 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d980a0 auth_method 0 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d889f0 auth_method 0 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.783 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_done global_id 7125 payload 274 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.784 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:31:15.274+0000 7fb81c00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: dump: 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.785 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.786 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: dump: 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.787 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:31:15.274+0000 7fb820323800 5 monclient: authenticate success, global_id 7125 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:31:15.274+0000 7fb820323800 4 set_mon_vals no callback set 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: shutdown 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:31:15.275+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.788 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.789 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:31:15.275+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: starting msgr at 2024-09-14T11:31:15.790 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: starting objecter 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:31:15.275+0000 7fb820323800 5 asok(0x55e867aa7270) register_command objecter_requests cmddesc objecter_requests hook 0x55e867d44560 EEXIST 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: setting wanted keys 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: calling monclient init 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.791 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:31:15.276+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:31:15.276+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:31:15.276+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x55e867d5bdd8 EEXIST 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.792 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d889f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d934d0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d980a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.760312s 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867d980a0 auth_method 0 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.793 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d934d0 auth_method 0 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d889f0 auth_method 0 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.794 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_done global_id 7128 payload 824 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:31:15.276+0000 7fb81c80d640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: dump: 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.795 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: dump: 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.796 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:31:15.276+0000 7fb820323800 5 monclient: authenticate success, global_id 7128 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:31:15.276+0000 7fb6f37fe640 4 set_mon_vals no callback set 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:31:15.277+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.797 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:31:15.277+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:31:15.277+0000 7fb820323800 1 librados: init done 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:31:15.277+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cr dump hook 0x55e867d87928 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:31:15.278+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:31:15.279+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb6e4077230 auth_method 0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:31:15.279+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867db2660 auth_method 0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:31:15.280+0000 7fb820323800 20 realm 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:31:15.280+0000 7fb820323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:15.798 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:31:15.280+0000 7fb81c00c640 10 monclient: get_auth_request con 0x55e867db68a0 auth_method 0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:31:15.281+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867dba100 auth_method 0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:31:15.281+0000 7fb820323800 20 searching for the correct realm 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:31:15.483+0000 7fb81c80d640 10 monclient: get_auth_request con 0x55e867dbee50 auth_method 0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:31:15.484+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb81401f070 auth_method 0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:31:15.485+0000 7fb81b80b640 10 monclient: get_auth_request con 0x7fb80c08d060 auth_method 0 2024-09-14T11:31:15.799 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:31:15.485+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb81001f060 auth_method 0 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:31:15.485+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:31:15.686+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb81001f060 auth_method 0 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:31:15.690+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb814065cb0 auth_method 0 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:31:15.690+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 1 client.7128.objecter ms_handle_reset 0x7fb81001f060 session 0x7fb810005040 osd.4 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 10 monclient: _renew_subs 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:31:15.691+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb6e40878d0 auth_method 0 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:15.800 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:31:15.694+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:31:15.694+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:31:15.695+0000 7fb820323800 20 zone default found 2024-09-14T11:31:15.801 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:31:15.695+0000 7fb820323800 4 Realm: () 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:31:15.695+0000 7fb820323800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:31:15.695+0000 7fb820323800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:31:15.695+0000 7fb820323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:31:15.695+0000 7fb820323800 20 zonegroup default 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:31:15.696+0000 7fb820323800 20 started sync module instance, tier type = 2024-09-14T11:31:15.802 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:31:15.696+0000 7fb820323800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=0 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=1 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=2 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=3 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=4 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=5 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=6 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:31:15.706+0000 7fb820323800 20 add_watcher() i=7 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:31:15.706+0000 7fb820323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.803 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.804 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:31:15.707+0000 7fb6d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:31:15.707+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache list hook 0x55e867d8d1f0 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache inspect hook 0x55e867d8d1f0 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache erase hook 0x55e867d8d1f0 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache zap hook 0x55e867d8d1f0 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:31:15.707+0000 7fb820323800 5 note: GC not initialized 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:31:15.708+0000 7fb6d1fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace show hook 0x7fb80c076f20 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace history hook 0x7fb80c076f20 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace active hook 0x7fb80c076f20 2024-09-14T11:31:15.805 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace active_short hook 0x7fb80c076f20 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:31:15.708+0000 7fb820323800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:31:15.708+0000 7fb820323800 20 Filter name: none 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:31:15.708+0000 7fb6437fe640 20 reqs_thread_entry: start 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:31:15.708+0000 7fb820323800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : miss 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:31:15.709+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:15.806 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:31:15.709+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:31:15.709+0000 7fb820323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:31:15.709+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:31:15.714+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:31:15.715+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:31:15.715+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:31:15.715+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.807 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.808 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.809 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.0 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.3 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.4 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.5 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.6 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.7 2024-09-14T11:31:15.810 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.8 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.9 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.10 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:31:15.731+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:31:15.731+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:31:15.733+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:31:15.733+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.811 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:31:15.733+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.812 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:31:15.733+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.812 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.812 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.812 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.812 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:31:15.734+0000 7fb820323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb820323800 time 2024-09-14T11:31:15.735027+0000 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb82198c76a] 2024-09-14T11:31:15.813 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:31:15.735+0000 7fb820323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fb820323800 thread_name:radosgw-admin 2024-09-14T11:31:15.814 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb82063e6f0] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb82068b99c] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb82198c7c4] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:31:15.815 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:31:15.816 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:15.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:31:15.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:15.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:31:15.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:15.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:15.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:15.823 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6437fe640 / http_manager 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6d1fdb640 / http_manager 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6d2fdd640 / rgw_dt_lg_renew 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6f1ffb640 / ms_dispatch 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6f37fe640 / io_context_pool 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb701ffb640 / ms_dispatch 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb708e09640 / ms_dispatch 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb70a60c640 / io_context_pool 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81b80b640 / msgr-worker-2 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81c00c640 / msgr-worker-1 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81c80d640 / msgr-worker-0 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81d00e640 / io_context_pool 2024-09-14T11:31:15.824 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb820323800 / radosgw-admin 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.113945.log 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:31:15.263+0000 7fb820323800 5 AuthRegistry(0x55e867cc73a0) adding con mode: crc 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:31:15.263+0000 7fb820323800 5 AuthRegistry(0x55e867cc73a0) adding con mode: secure 2024-09-14T11:31:15.825 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:31:15.263+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:31:15.263+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:31:15.263+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key hook 0x55e867cc74e8 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867b50f80 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867c105b0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867cca9d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.826 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:31:15.263+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.747716s 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867c105b0 auth_method 0 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867b50f80 auth_method 0 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.827 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:31:15.263+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867cca9d0 auth_method 0 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:31:15.263+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:31:15.263+0000 7fb81b80b640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:31:15.264+0000 7fb81b80b640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.828 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:31:15.264+0000 7fb81b80b640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:31:15.264+0000 7fb81b80b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: dump: 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.829 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:31:15.264+0000 7fb708e09640 10 monclient: dump: 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.830 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.831 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:31:15.264+0000 7fb820323800 5 monclient: authenticate success, global_id 7119 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:31:15.264+0000 7fb70a60c640 4 set_mon_vals no callback set 2024-09-14T11:31:15.832 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:31:15.264+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:31:15.264+0000 7fb820323800 1 librados: init done 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:31:15.266+0000 7fb708e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:31:15.266+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb704077260 auth_method 0 2024-09-14T11:31:15.833 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:31:15.266+0000 7fb81c80d640 10 monclient: get_auth_request con 0x55e867ce8380 auth_method 0 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:31:15.267+0000 7fb81c00c640 10 monclient: get_auth_request con 0x55e867d13680 auth_method 0 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:31:15.268+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867d178c0 auth_method 0 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:31:15.269+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.834 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding auth protocol: cephx 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.835 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: crc 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1c7a0) adding con mode: secure 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:31:15.269+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:31:15.269+0000 7fb820323800 5 asok(0x55e867aa7270) register_command objecter_requests cmddesc objecter_requests hook 0x55e867d201f0 EEXIST 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:31:15.269+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding auth protocol: cephx 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.836 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: crc 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:31:15.269+0000 7fb820323800 5 AuthRegistry(0x55e867d1ae58) adding con mode: secure 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:31:15.270+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:31:15.270+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:31:15.270+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x55e867d1afa0 EEXIST 2024-09-14T11:31:15.837 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d43ee0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d461b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d426b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.754350s 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d43ee0 auth_method 0 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.838 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867d426b0 auth_method 0 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d461b0 auth_method 0 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:31:15.270+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.839 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:31:15.270+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient(hunting): handle_auth_done global_id 7122 payload 824 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:31:15.270+0000 7fb81c00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:31:15.270+0000 7fb81c00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: dump: 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.840 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:31:15.270+0000 7fb701ffb640 10 monclient: dump: 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.841 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:31:15.270+0000 7fb820323800 5 monclient: authenticate success, global_id 7122 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:31:15.270+0000 7fb81d00e640 4 set_mon_vals no callback set 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:31:15.270+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:31:15.271+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.842 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:31:15.272+0000 7fb701ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:31:15.273+0000 7fb81b80b640 10 monclient: get_auth_request con 0x7fb6f4077140 auth_method 0 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: get_monmap_and_config 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:31:15.273+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.843 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding auth protocol: cephx 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.844 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: crc 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x55e867d63ae0) adding con mode: secure 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:31:15.273+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:31:15.273+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding auth protocol: cephx 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.845 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: crc 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:31:15.273+0000 7fb820323800 5 AuthRegistry(0x7ffe59164e20) adding con mode: secure 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:31:15.273+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:31:15.274+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:31:15.274+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x7ffe59164f68 EEXIST 2024-09-14T11:31:15.846 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d980a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d889f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d934d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.758175s 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d980a0 auth_method 0 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.847 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d889f0 auth_method 0 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:31:15.274+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient(hunting): handle_auth_done global_id 7125 payload 274 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.848 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:31:15.274+0000 7fb81c00c640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:31:15.274+0000 7fb81c00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: dump: 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.849 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:31:15.274+0000 7fb6f37fe640 10 monclient: dump: 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.850 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:31:15.274+0000 7fb820323800 5 monclient: authenticate success, global_id 7125 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:31:15.274+0000 7fb820323800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:31:15.274+0000 7fb820323800 4 set_mon_vals no callback set 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: shutdown 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: build_initial_monmap 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:31:15.275+0000 7fb820323800 1 build_initial for_mkfs: 0 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: monmap: 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:15.851 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding auth protocol: cephx 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.852 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: crc 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d67600) adding con mode: secure 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:31:15.275+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: starting msgr at 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: starting objecter 2024-09-14T11:31:15.853 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:31:15.275+0000 7fb820323800 5 asok(0x55e867aa7270) register_command objecter_requests cmddesc objecter_requests hook 0x55e867d44560 EEXIST 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: setting wanted keys 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:31:15.275+0000 7fb820323800 1 librados: calling monclient init 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:31:15.275+0000 7fb820323800 10 monclient: init 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding auth protocol: cephx 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.854 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: crc 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:31:15.275+0000 7fb820323800 5 AuthRegistry(0x55e867d5bc90) adding con mode: secure 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:31:15.276+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:31:15.276+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:31:15.276+0000 7fb820323800 5 asok(0x55e867aa7270) register_command rotate-key cmddesc rotate-key hook 0x55e867d5bdd8 EEXIST 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:15.855 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-b con 0x55e867d889f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-c con 0x55e867d934d0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): picked mon.noname-a con 0x55e867d980a0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient(hunting): authenticate will time out at 1991.760312s 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): get_auth_request con 0x55e867d980a0 auth_method 0 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.856 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): get_auth_request con 0x55e867d934d0 auth_method 0 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:31:15.276+0000 7fb81b80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): get_auth_request con 0x55e867d889f0 auth_method 0 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:15.857 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:31:15.276+0000 7fb81c00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient(hunting): handle_auth_done global_id 7128 payload 824 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient: _finish_hunting 0 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:31:15.276+0000 7fb81c80d640 1 monclient: found mon.noname-a 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:31:15.276+0000 7fb81c80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: dump: 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.858 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:31:15.276+0000 7fb6f1ffb640 10 monclient: dump: 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:15.859 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:31:15.276+0000 7fb820323800 5 monclient: authenticate success, global_id 7128 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:31:15.276+0000 7fb6f37fe640 4 set_mon_vals no callback set 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:31:15.276+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:31:15.277+0000 7fb820323800 10 monclient: _renew_subs 2024-09-14T11:31:15.860 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:31:15.277+0000 7fb820323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:31:15.277+0000 7fb820323800 1 librados: init done 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:31:15.277+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cr dump hook 0x55e867d87928 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:31:15.278+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:31:15.279+0000 7fb6f1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:31:15.279+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb6e4077230 auth_method 0 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:31:15.279+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867db2660 auth_method 0 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:31:15.280+0000 7fb820323800 20 realm 2024-09-14T11:31:15.861 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:31:15.280+0000 7fb820323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:31:15.280+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:31:15.280+0000 7fb81c00c640 10 monclient: get_auth_request con 0x55e867db68a0 auth_method 0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:31:15.281+0000 7fb81b80b640 10 monclient: get_auth_request con 0x55e867dba100 auth_method 0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:31:15.281+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:31:15.281+0000 7fb820323800 20 searching for the correct realm 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:31:15.483+0000 7fb81c80d640 10 monclient: get_auth_request con 0x55e867dbee50 auth_method 0 2024-09-14T11:31:15.862 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:31:15.484+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb81401f070 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:31:15.485+0000 7fb81b80b640 10 monclient: get_auth_request con 0x7fb80c08d060 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:31:15.485+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb81001f060 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:31:15.485+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:31:15.686+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb81001f060 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:31:15.690+0000 7fb81c00c640 10 monclient: get_auth_request con 0x7fb814065cb0 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:31:15.690+0000 7fb81c80d640 0 -- 172.21.15.130:0/3928130636 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb81001f060 msgr2=0x7fb810067c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 1 client.7128.objecter ms_handle_reset 0x7fb81001f060 session 0x7fb810005040 osd.4 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 10 monclient: _renew_subs 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:31:15.691+0000 7fb6f1ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:31:15.691+0000 7fb81c80d640 10 monclient: get_auth_request con 0x7fb6e40878d0 auth_method 0 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:15.863 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:31:15.694+0000 7fb820323800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:31:15.694+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:31:15.694+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:31:15.695+0000 7fb820323800 20 zone default found 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:31:15.695+0000 7fb820323800 4 Realm: () 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:31:15.695+0000 7fb820323800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:31:15.695+0000 7fb820323800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:15.864 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:31:15.695+0000 7fb820323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:31:15.695+0000 7fb820323800 20 zonegroup default 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:31:15.695+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:31:15.696+0000 7fb820323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:31:15.696+0000 7fb820323800 20 started sync module instance, tier type = 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:31:15.696+0000 7fb820323800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=0 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=1 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=2 2024-09-14T11:31:15.865 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=3 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=4 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=5 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:31:15.705+0000 7fb820323800 20 add_watcher() i=6 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:31:15.706+0000 7fb820323800 20 add_watcher() i=7 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:31:15.706+0000 7fb820323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding auth protocol: cephx 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.866 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: crc 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:31:15.707+0000 7fb820323800 5 AuthRegistry(0x7ffe59165300) adding con mode: secure 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:31:15.707+0000 7fb6d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:31:15.707+0000 7fb820323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:31:15.707+0000 7fb820323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:15.867 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache list hook 0x55e867d8d1f0 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache inspect hook 0x55e867d8d1f0 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache erase hook 0x55e867d8d1f0 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:31:15.707+0000 7fb820323800 5 asok(0x55e867aa7270) register_command cache zap hook 0x55e867d8d1f0 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:31:15.707+0000 7fb820323800 5 note: GC not initialized 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:31:15.708+0000 7fb6d1fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace show hook 0x7fb80c076f20 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace history hook 0x7fb80c076f20 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace active hook 0x7fb80c076f20 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:31:15.708+0000 7fb820323800 5 asok(0x55e867aa7270) register_command sync trace active_short hook 0x7fb80c076f20 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:31:15.708+0000 7fb820323800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:31:15.708+0000 7fb820323800 20 Filter name: none 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:31:15.708+0000 7fb6437fe640 20 reqs_thread_entry: start 2024-09-14T11:31:15.868 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:31:15.708+0000 7fb820323800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:31:15.708+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : miss 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:31:15.708+0000 7fb820323800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:31:15.709+0000 7fb820323800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:31:15.709+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:31:15.709+0000 7fb820323800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:31:15.709+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:31:15.709+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:31:15.714+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.869 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:31:15.715+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:31:15.715+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:31:15.715+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:31:15.715+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:31:15.715+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.0 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.870 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.1 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.2 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.3 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.4 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.5 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.6 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.7 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.871 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.8 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.9 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.10 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:31:15.721+0000 7fb820323800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1.11 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:31:15.721+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.0 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:31:15.722+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.3 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:31:15.723+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.4 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.5 2024-09-14T11:31:15.872 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:31:15.724+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.6 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.7 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:31:15.725+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.8 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.9 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:31:15.726+0000 7fb820323800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.10 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:31:15.731+0000 7fb820323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:31:15.731+0000 7fb820323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:31:15.733+0000 7fb820323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:31:15.733+0000 7fb820323800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:31:15.733+0000 7fb820323800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:31:15.733+0000 7fb820323800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94456663254960 notifier 7128 bl.length()=999 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:15.873 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:31:15.733+0000 7fb6f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:31:15.733+0000 7fb820323800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:31:15.734+0000 7fb820323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb820323800 time 2024-09-14T11:31:15.735027+0000 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb82198c76a] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.874 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:31:15.735+0000 7fb820323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fb820323800 thread_name:radosgw-admin 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb82063e6f0] 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb82068b99c] 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb82198c7c4] 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb82198c928] 2024-09-14T11:31:15.875 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e865e5e0b1] 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55e865e6d18e] 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55e865e6dfc4] 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb820629590] 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:31:15.876 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:31:15.877 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:31:15.878 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:15.879 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:31:15.880 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:15.881 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:31:15.882 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6437fe640 / http_manager 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6d1fdb640 / http_manager 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6d2fdd640 / rgw_dt_lg_renew 2024-09-14T11:31:15.883 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6f1ffb640 / ms_dispatch 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb6f37fe640 / io_context_pool 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb701ffb640 / ms_dispatch 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb708e09640 / ms_dispatch 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb70a60c640 / io_context_pool 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81b80b640 / msgr-worker-2 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81c00c640 / msgr-worker-1 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81c80d640 / msgr-worker-0 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb81d00e640 / io_context_pool 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: 7fb820323800 / radosgw-admin 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:31:15.884 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:31:15.736847Z_9b7e62f0-4b9a-4311-849d-391ee9525bac/log 2024-09-14T11:31:15.885 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:31:15.885 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.810+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 realm 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.812+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.813+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.813+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.813+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.814+0000 7ff7ceb36800 20 searching for the correct realm 2024-09-14T11:31:15.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:15.816+0000 7ff7cb0b8640 0 -- 172.21.15.130:0/1300846621 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff7b4016c00 msgr2=0x7ff7b40685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:16.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.022+0000 7ff7cb0b8640 0 -- 172.21.15.130:0/1300846621 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff7b4016c00 msgr2=0x7ff7b40685f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:16.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.025+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:16.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 zone default found 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 4 Realm: () 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 zonegroup default 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.026+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 started sync module instance, tier type = 2024-09-14T11:31:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.027+0000 7ff7ceb36800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:16.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=0 2024-09-14T11:31:16.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=1 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=2 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=3 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=4 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=5 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.036+0000 7ff7ceb36800 20 add_watcher() i=6 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.037+0000 7ff7ceb36800 20 add_watcher() i=7 2024-09-14T11:31:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.037+0000 7ff7ceb36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:16.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.038+0000 7ff6817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 5 note: GC not initialized 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff5fbfff640 20 reqs_thread_entry: start 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 20 Filter name: none 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff5f9ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:16.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.039+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.040+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.040+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.040+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.040+0000 7ff7ceb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.041+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.041+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:16.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.041+0000 7ff7ceb36800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.041+0000 7ff7ceb36800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:16.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.041+0000 7ff7ceb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:16.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.043+0000 7ff6817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:16.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.045+0000 7ff7ceb36800 20 remove_watcher() i=0 2024-09-14T11:31:16.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.045+0000 7ff7ceb36800 2 removed watcher, disabling cache 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.046+0000 7ff7ceb36800 20 remove_watcher() i=1 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.047+0000 7ff7ceb36800 20 remove_watcher() i=2 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.048+0000 7ff7ceb36800 20 remove_watcher() i=3 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.049+0000 7ff7ceb36800 20 remove_watcher() i=4 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.050+0000 7ff7ceb36800 20 remove_watcher() i=5 2024-09-14T11:31:16.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.051+0000 7ff7ceb36800 20 remove_watcher() i=6 2024-09-14T11:31:16.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.052+0000 7ff7ceb36800 20 remove_watcher() i=7 2024-09-14T11:31:16.074 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:16.074 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:16.074 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:16.074 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:16.075 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:16.076 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:16.082 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:16.082 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:16.125 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:16.158 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:16.158 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:16.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.196+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 realm 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.198+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.199+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:16.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.199+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.200+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:16.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.200+0000 7f2721092800 20 searching for the correct realm 2024-09-14T11:31:16.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.202+0000 7f271637b640 0 -- 172.21.15.130:0/2015989932 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f2710018070 msgr2=0x7f2710096150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:16.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.205+0000 7f271eb7c640 0 -- 172.21.15.130:0/2015989932 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f27180b3330 msgr2=0x7f27180b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:16.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:16.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:16.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:16.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:16.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.411+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 zone default found 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 4 Realm: () 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:16.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 zonegroup default 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 started sync module instance, tier type = 2024-09-14T11:31:16.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.412+0000 7f2721092800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:16.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=0 2024-09-14T11:31:16.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=1 2024-09-14T11:31:16.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=2 2024-09-14T11:31:16.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=3 2024-09-14T11:31:16.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=4 2024-09-14T11:31:16.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=5 2024-09-14T11:31:16.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.422+0000 7f2721092800 20 add_watcher() i=6 2024-09-14T11:31:16.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.423+0000 7f2721092800 20 add_watcher() i=7 2024-09-14T11:31:16.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.423+0000 7f2721092800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.424+0000 7f25d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 5 note: GC not initialized 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f254ffff640 20 reqs_thread_entry: start 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:16.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 20 Filter name: none 2024-09-14T11:31:16.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f254dffb640 20 reqs_thread_entry: start 2024-09-14T11:31:16.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:16.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.425+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : miss 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 20 rados->read ofs=0 len=0 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:16.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:16.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:16.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.426+0000 7f2721092800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:16.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.427+0000 7f2721092800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to be held by another RGW process; skipping for now 2024-09-14T11:31:16.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.428+0000 7f25d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:16.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.430+0000 7f2721092800 20 remove_watcher() i=0 2024-09-14T11:31:16.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.430+0000 7f2721092800 2 removed watcher, disabling cache 2024-09-14T11:31:16.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.432+0000 7f2721092800 20 remove_watcher() i=1 2024-09-14T11:31:16.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.433+0000 7f2721092800 20 remove_watcher() i=2 2024-09-14T11:31:16.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.434+0000 7f2721092800 20 remove_watcher() i=3 2024-09-14T11:31:16.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.435+0000 7f2721092800 20 remove_watcher() i=4 2024-09-14T11:31:16.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.436+0000 7f2721092800 20 remove_watcher() i=5 2024-09-14T11:31:16.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.436+0000 7f2721092800 20 remove_watcher() i=6 2024-09-14T11:31:16.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:16.437+0000 7f2721092800 20 remove_watcher() i=7 2024-09-14T11:31:16.446 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:31:46.451 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:46.486 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:46.487 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:46.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.529+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 realm 2024-09-14T11:31:46.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:46.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.531+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.532+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.532+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.533+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:46.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.533+0000 7f5d2f60e800 20 searching for the correct realm 2024-09-14T11:31:46.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.535+0000 7f5d22458640 0 -- 172.21.15.130:0/882179247 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f5d1c0b8020 msgr2=0x7f5d1c0aca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:46.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.539+0000 7f5d2ac59640 0 -- 172.21.15.130:0/882179247 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f5d24043910 msgr2=0x7f5d240353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:46.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.745+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:46.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.745+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:46.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.745+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:46.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.745+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:46.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.746+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 zone default found 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 4 Realm: () 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 zonegroup default 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.747+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.748+0000 7f5d2f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.748+0000 7f5d2f60e800 20 started sync module instance, tier type = 2024-09-14T11:31:46.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.748+0000 7f5d2f60e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:46.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=0 2024-09-14T11:31:46.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=1 2024-09-14T11:31:46.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=2 2024-09-14T11:31:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=3 2024-09-14T11:31:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=4 2024-09-14T11:31:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=5 2024-09-14T11:31:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.757+0000 7f5d2f60e800 20 add_watcher() i=6 2024-09-14T11:31:46.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.758+0000 7f5d2f60e800 20 add_watcher() i=7 2024-09-14T11:31:46.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.758+0000 7f5d2f60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:46.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.760+0000 7f5be17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 5 note: GC not initialized 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5b5bfff640 20 reqs_thread_entry: start 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 20 Filter name: none 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5b59ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:31:46.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.761+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:31:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:31:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : miss 2024-09-14T11:31:46.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:31:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:46.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.762+0000 7f5d2f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:46.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.763+0000 7f5d2f60e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:46.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5d2f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5d2f60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5d2f60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5d2f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5c0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94089738604144 notifier 6719 bl.length()=999 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5c0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5c0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.770+0000 7f5c0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.771+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.771+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.771+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:46.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.771+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:46.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.0 2024-09-14T11:31:46.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.0 2024-09-14T11:31:46.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.1 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.1 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.2 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.2 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.3 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.3 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.4 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.4 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.5 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.5 2024-09-14T11:31:46.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.6 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.6 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.7 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.7 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.8 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.8 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.9 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.9 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.10 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.10 2024-09-14T11:31:46.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.11 2024-09-14T11:31:46.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2.11 2024-09-14T11:31:46.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.0 2024-09-14T11:31:46.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.777+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1 2024-09-14T11:31:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.778+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2 2024-09-14T11:31:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.779+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.3 2024-09-14T11:31:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.779+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.4 2024-09-14T11:31:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.780+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.5 2024-09-14T11:31:46.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.780+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.6 2024-09-14T11:31:46.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.781+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.7 2024-09-14T11:31:46.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.781+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.8 2024-09-14T11:31:46.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.782+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.9 2024-09-14T11:31:46.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.782+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.10 2024-09-14T11:31:46.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.785+0000 7f5d2f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:46.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.785+0000 7f5d2f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:46.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5d2f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5d2f60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5d2f60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5d2f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5c0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94089738604144 notifier 6719 bl.length()=999 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5c0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5c0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5c0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.787+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.788+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.788+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:46.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.788+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:46.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.790+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.0 2024-09-14T11:31:46.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.791+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.1 2024-09-14T11:31:46.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.791+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.2 2024-09-14T11:31:46.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.791+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.3 2024-09-14T11:31:46.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.792+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.4 2024-09-14T11:31:46.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.792+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.5 2024-09-14T11:31:46.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.792+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.6 2024-09-14T11:31:46.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.793+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.7 2024-09-14T11:31:46.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.793+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.8 2024-09-14T11:31:46.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.794+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.9 2024-09-14T11:31:46.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.794+0000 7f5d2f60e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.30.10 2024-09-14T11:31:46.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.794+0000 7f5d2f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:46.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.794+0000 7f5d2f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 2024-09-14T11:31:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5d2f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5d2f60e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5d2f60e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5d2f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30, ofs0, ns] 2024-09-14T11:31:46.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5c0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94089738604144 notifier 6719 bl.length()=967 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5c0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 info.flags=0x17 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5c0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.30 to cache LRU end 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.796+0000 7f5c0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.797+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_sources= new_sources= 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.797+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential sources added=[] removed=[] 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.797+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): orig_dests= new_dests= 2024-09-14T11:31:46.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.797+0000 7f5d2f60e800 20 handle_bi_update(): bucket=:abort-at-block-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.30]): potential dests added=[] removed=[] 2024-09-14T11:31:46.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.799+0000 7f5d2f60e800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:46.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.801+0000 7f5be17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:46.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.803+0000 7f5d2f60e800 20 remove_watcher() i=0 2024-09-14T11:31:46.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.803+0000 7f5d2f60e800 2 removed watcher, disabling cache 2024-09-14T11:31:46.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.804+0000 7f5d2f60e800 20 remove_watcher() i=1 2024-09-14T11:31:46.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.805+0000 7f5d2f60e800 20 remove_watcher() i=2 2024-09-14T11:31:46.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.806+0000 7f5d2f60e800 20 remove_watcher() i=3 2024-09-14T11:31:46.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.807+0000 7f5d2f60e800 20 remove_watcher() i=4 2024-09-14T11:31:46.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.808+0000 7f5d2f60e800 20 remove_watcher() i=5 2024-09-14T11:31:46.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.809+0000 7f5d2f60e800 20 remove_watcher() i=6 2024-09-14T11:31:46.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.810+0000 7f5d2f60e800 20 remove_watcher() i=7 2024-09-14T11:31:46.821 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:31:46.851 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:46.851 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:46.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.890+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 realm 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:46.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.892+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.893+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:46.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.893+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:46.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.893+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:46.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.893+0000 7f74e9840800 20 searching for the correct realm 2024-09-14T11:31:46.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:46.896+0000 7f74e7b2b640 0 -- 172.21.15.130:0/3294191 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f74d0001c20 msgr2=0x7f74d0010950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:47.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.102+0000 7f74e7b2b640 0 -- 172.21.15.130:0/3294191 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f74d0001c20 msgr2=0x7f74d0010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:47.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:47.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:47.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.106+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:47.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 zone default found 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 4 Realm: () 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 zonegroup default 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.107+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.108+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.108+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.108+0000 7f74e9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.108+0000 7f74e9840800 20 started sync module instance, tier type = 2024-09-14T11:31:47.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.108+0000 7f74e9840800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=0 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=1 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=2 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=3 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=4 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=5 2024-09-14T11:31:47.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.117+0000 7f74e9840800 20 add_watcher() i=6 2024-09-14T11:31:47.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.118+0000 7f74e9840800 20 add_watcher() i=7 2024-09-14T11:31:47.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.118+0000 7f74e9840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:47.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.119+0000 7f739dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:47.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:47.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 5 note: GC not initialized 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f739cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 20 Filter name: none 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f73167fc640 20 reqs_thread_entry: start 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.120+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.121+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:47.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.121+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.121+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:47.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.121+0000 7f74e9840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.121+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.122+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.122+0000 7f74e9840800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.122+0000 7f74e9840800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.122+0000 7f74e9840800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:47.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.124+0000 7f739dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:47.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.126+0000 7f74e9840800 20 remove_watcher() i=0 2024-09-14T11:31:47.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.126+0000 7f74e9840800 2 removed watcher, disabling cache 2024-09-14T11:31:47.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.127+0000 7f74e9840800 20 remove_watcher() i=1 2024-09-14T11:31:47.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.128+0000 7f74e9840800 20 remove_watcher() i=2 2024-09-14T11:31:47.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.129+0000 7f74e9840800 20 remove_watcher() i=3 2024-09-14T11:31:47.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.130+0000 7f74e9840800 20 remove_watcher() i=4 2024-09-14T11:31:47.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.131+0000 7f74e9840800 20 remove_watcher() i=5 2024-09-14T11:31:47.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.131+0000 7f74e9840800 20 remove_watcher() i=6 2024-09-14T11:31:47.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.132+0000 7f74e9840800 20 remove_watcher() i=7 2024-09-14T11:31:47.141 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:47.141 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:47.141 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-block-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:47.141 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:47.143 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.143 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.146 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.146 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.189 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.189 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.216 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:31:47.216 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:47.217 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.217 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.228 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.228 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.271 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.272 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.279 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.279 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.286 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.286 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.292 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.292 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.299 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.300 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.306 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.306 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.312 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.312 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.319 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.319 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.325 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.325 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.332 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.332 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.338 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.338 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.346 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.346 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.353 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.353 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.359 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.360 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.366 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.366 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.372 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.372 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.379 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.379 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.385 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.385 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.391 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.391 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.399 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:47.399 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:47.406 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:47.434 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:47.434 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:47.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.471+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 realm 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.473+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.474+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:47.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.474+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.475+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:47.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.475+0000 7f854c440800 20 searching for the correct realm 2024-09-14T11:31:47.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.477+0000 7f854a72b640 0 -- 172.21.15.130:0/3216883546 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8540025070 msgr2=0x7f8540047330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:47.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.682+0000 7f854a72b640 0 -- 172.21.15.130:0/3216883546 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8540025070 msgr2=0x7f8540047330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:47.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:47.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:47.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.686+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:47.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 zone default found 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 4 Realm: () 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 zonegroup default 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.687+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.688+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.688+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.688+0000 7f854c440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.688+0000 7f854c440800 20 started sync module instance, tier type = 2024-09-14T11:31:47.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.688+0000 7f854c440800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:47.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=0 2024-09-14T11:31:47.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=1 2024-09-14T11:31:47.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=2 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=3 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=4 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=5 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.696+0000 7f854c440800 20 add_watcher() i=6 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.697+0000 7f854c440800 20 add_watcher() i=7 2024-09-14T11:31:47.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.697+0000 7f854c440800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:47.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.699+0000 7f83fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.699+0000 7f854c440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.699+0000 7f854c440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.699+0000 7f854c440800 5 note: GC not initialized 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.699+0000 7f83faffd640 20 reqs_thread_entry: start 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f854c440800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f854c440800 20 Filter name: none 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f83f8ff9640 20 reqs_thread_entry: start 2024-09-14T11:31:47.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.700+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:47.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.701+0000 7f854c440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:47.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.703+0000 7f83fbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:47.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.705+0000 7f854c440800 20 remove_watcher() i=0 2024-09-14T11:31:47.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.705+0000 7f854c440800 2 removed watcher, disabling cache 2024-09-14T11:31:47.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.706+0000 7f854c440800 20 remove_watcher() i=1 2024-09-14T11:31:47.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.707+0000 7f854c440800 20 remove_watcher() i=2 2024-09-14T11:31:47.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.708+0000 7f854c440800 20 remove_watcher() i=3 2024-09-14T11:31:47.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.709+0000 7f854c440800 20 remove_watcher() i=4 2024-09-14T11:31:47.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.710+0000 7f854c440800 20 remove_watcher() i=5 2024-09-14T11:31:47.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.711+0000 7f854c440800 20 remove_watcher() i=6 2024-09-14T11:31:47.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.712+0000 7f854c440800 20 remove_watcher() i=7 2024-09-14T11:31:47.721 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:47.721 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:47.721 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:47.721 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:47.723 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:31:47.757 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:47.757 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:47.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.796+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 realm 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:47.797 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.797+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.798+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:47.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.798+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:47.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.799+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:47.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.799+0000 7f33bcf28800 20 searching for the correct realm 2024-09-14T11:31:47.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:47.801+0000 7f33b94d7640 0 -- 172.21.15.130:0/3103056583 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f33a0081070 msgr2=0x7f33a00aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.008+0000 7f33b94d7640 0 -- 172.21.15.130:0/3103056583 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f33a0081070 msgr2=0x7f33a00aad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.012+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 zone default found 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 4 Realm: () 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 zonegroup default 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.013+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.014+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.014+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.014+0000 7f33bcf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.014+0000 7f33bcf28800 20 started sync module instance, tier type = 2024-09-14T11:31:48.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.014+0000 7f33bcf28800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=0 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=1 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=2 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=3 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=4 2024-09-14T11:31:48.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=5 2024-09-14T11:31:48.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.022+0000 7f33bcf28800 20 add_watcher() i=6 2024-09-14T11:31:48.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.023+0000 7f33bcf28800 20 add_watcher() i=7 2024-09-14T11:31:48.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.023+0000 7f33bcf28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:48.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.025+0000 7f326f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.025+0000 7f33bcf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.025+0000 7f33bcf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.025+0000 7f33bcf28800 5 note: GC not initialized 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f326e7e4640 20 reqs_thread_entry: start 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 20 Filter name: none 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f32677fe640 20 reqs_thread_entry: start 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:48.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 : miss 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.026+0000 7f33bcf28800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.027+0000 7f33bcf28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 2024-09-14T11:31:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f33bcf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f33bcf28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f33bcf28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f33bcf28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31, ofs0, ns] 2024-09-14T11:31:48.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f328ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 93996887793424 notifier 7242 bl.length()=1015 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f328ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f328ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.031+0000 7f328ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.032+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_sources= new_sources= 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.032+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential sources added=[] removed=[] 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.032+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_dests= new_dests= 2024-09-14T11:31:48.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.032+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential dests added=[] removed=[] 2024-09-14T11:31:48.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.0 2024-09-14T11:31:48.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.0 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.1 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.1 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.2 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.2 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.3 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.3 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.4 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.4 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.5 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.5 2024-09-14T11:31:48.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.6 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.6 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.7 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.7 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.8 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.8 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.9 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.9 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.10 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.10 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.11 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1.11 2024-09-14T11:31:48.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.038+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.0 2024-09-14T11:31:48.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.039+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.039+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.040+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.3 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.041+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.4 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.041+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.5 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.042+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.6 2024-09-14T11:31:48.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.042+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.7 2024-09-14T11:31:48.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.042+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.8 2024-09-14T11:31:48.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.043+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.9 2024-09-14T11:31:48.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.043+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.10 2024-09-14T11:31:48.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.048+0000 7f33bcf28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:48.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.048+0000 7f33bcf28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.049+0000 7f33bcf28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.049+0000 7f33bcf28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.049+0000 7f33bcf28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.049+0000 7f33bcf28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31, ofs0, ns] 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f328f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 93996887793424 notifier 7242 bl.length()=1015 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f328f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f328f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f328f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_sources= new_sources= 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential sources added=[] removed=[] 2024-09-14T11:31:48.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_dests= new_dests= 2024-09-14T11:31:48.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.050+0000 7f33bcf28800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential dests added=[] removed=[] 2024-09-14T11:31:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.052+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.0 2024-09-14T11:31:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.053+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1 2024-09-14T11:31:48.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.053+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2 2024-09-14T11:31:48.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.053+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.3 2024-09-14T11:31:48.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.053+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.4 2024-09-14T11:31:48.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.054+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.5 2024-09-14T11:31:48.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.054+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.6 2024-09-14T11:31:48.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.054+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.7 2024-09-14T11:31:48.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.055+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.8 2024-09-14T11:31:48.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.055+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.9 2024-09-14T11:31:48.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.055+0000 7f33bcf28800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.10 2024-09-14T11:31:48.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.055+0000 7f33bcf28800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:31:48.054 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.055+0000 7f33bcf28800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:31:48.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.061+0000 7f326f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.063+0000 7f33bcf28800 20 remove_watcher() i=0 2024-09-14T11:31:48.062 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.063+0000 7f33bcf28800 2 removed watcher, disabling cache 2024-09-14T11:31:48.063 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.064+0000 7f33bcf28800 20 remove_watcher() i=1 2024-09-14T11:31:48.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.065+0000 7f33bcf28800 20 remove_watcher() i=2 2024-09-14T11:31:48.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.066+0000 7f33bcf28800 20 remove_watcher() i=3 2024-09-14T11:31:48.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.067+0000 7f33bcf28800 20 remove_watcher() i=4 2024-09-14T11:31:48.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.068+0000 7f33bcf28800 20 remove_watcher() i=5 2024-09-14T11:31:48.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.069+0000 7f33bcf28800 20 remove_watcher() i=6 2024-09-14T11:31:48.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.070+0000 7f33bcf28800 20 remove_watcher() i=7 2024-09-14T11:31:48.080 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:48.109 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:48.109 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:48.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.146+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 realm 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.148+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.149+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.149+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.149+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:48.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.149+0000 7fb64a12c800 20 searching for the correct realm 2024-09-14T11:31:48.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.151+0000 7fb646650640 0 -- 172.21.15.130:0/2791559835 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb630043060 msgr2=0x7fb63006b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.357+0000 7fb646650640 0 -- 172.21.15.130:0/2791559835 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb630043060 msgr2=0x7fb63006b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:48.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.361+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 zone default found 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 4 Realm: () 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 zonegroup default 2024-09-14T11:31:48.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.362+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.363+0000 7fb64a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.363+0000 7fb64a12c800 20 started sync module instance, tier type = 2024-09-14T11:31:48.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.363+0000 7fb64a12c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=0 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=1 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=2 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=3 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=4 2024-09-14T11:31:48.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=5 2024-09-14T11:31:48.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.371+0000 7fb64a12c800 20 add_watcher() i=6 2024-09-14T11:31:48.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.372+0000 7fb64a12c800 20 add_watcher() i=7 2024-09-14T11:31:48.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.372+0000 7fb64a12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:48.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb64a12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb64a12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb64a12c800 5 note: GC not initialized 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb4f67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.374+0000 7fb64a12c800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.375+0000 7fb64a12c800 20 Filter name: none 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.375+0000 7fb467fff640 20 reqs_thread_entry: start 2024-09-14T11:31:48.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.375+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.375+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.375+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:48.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.376+0000 7fb64a12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:48.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.378+0000 7fb4f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.380+0000 7fb64a12c800 20 remove_watcher() i=0 2024-09-14T11:31:48.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.380+0000 7fb64a12c800 2 removed watcher, disabling cache 2024-09-14T11:31:48.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.381+0000 7fb64a12c800 20 remove_watcher() i=1 2024-09-14T11:31:48.380 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.382+0000 7fb64a12c800 20 remove_watcher() i=2 2024-09-14T11:31:48.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.383+0000 7fb64a12c800 20 remove_watcher() i=3 2024-09-14T11:31:48.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.384+0000 7fb64a12c800 20 remove_watcher() i=4 2024-09-14T11:31:48.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.385+0000 7fb64a12c800 20 remove_watcher() i=5 2024-09-14T11:31:48.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.386+0000 7fb64a12c800 20 remove_watcher() i=6 2024-09-14T11:31:48.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.387+0000 7fb64a12c800 20 remove_watcher() i=7 2024-09-14T11:31:48.397 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:48.397 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:48.397 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:48.397 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:48.398 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:48.399 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:48.405 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:48.405 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:48.448 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:31:48.479 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:48.479 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:48.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.517+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 20 realm 2024-09-14T11:31:48.517 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.518+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.519+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.519+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.519+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.519+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.520+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:48.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.520+0000 7fbc8d346800 20 searching for the correct realm 2024-09-14T11:31:48.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.523+0000 7fbc8b631640 0 -- 172.21.15.130:0/3059540882 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fbc74087ab0 msgr2=0x7fbc74064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.729+0000 7fbc8b631640 0 -- 172.21.15.130:0/3059540882 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fbc74087ab0 msgr2=0x7fbc74064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:48.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.733+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 zone default found 2024-09-14T11:31:48.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 4 Realm: () 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 zonegroup default 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.734+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.735+0000 7fbc8d346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.735+0000 7fbc8d346800 20 started sync module instance, tier type = 2024-09-14T11:31:48.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.735+0000 7fbc8d346800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:48.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=0 2024-09-14T11:31:48.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=1 2024-09-14T11:31:48.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=2 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=3 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=4 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=5 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.743+0000 7fbc8d346800 20 add_watcher() i=6 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.744+0000 7fbc8d346800 20 add_watcher() i=7 2024-09-14T11:31:48.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.744+0000 7fbc8d346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.746+0000 7fbb417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.746+0000 7fbc8d346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.746+0000 7fbc8d346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.746+0000 7fbc8d346800 5 note: GC not initialized 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbabbfff640 20 reqs_thread_entry: start 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 20 Filter name: none 2024-09-14T11:31:48.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbab9ffb640 20 reqs_thread_entry: start 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 : miss 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.747+0000 7fbc8d346800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:48.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:48.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.748+0000 7fbc8d346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 2024-09-14T11:31:48.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.749+0000 7fbc8d346800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:31:48.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbc8d346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbc8d346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbc8d346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbc8d346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31, ofs0, ns] 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbb6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 93865781794720 notifier 7278 bl.length()=1015 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbb6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbb6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.755+0000 7fbb6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.756+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_sources= new_sources= 2024-09-14T11:31:48.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.756+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential sources added=[] removed=[] 2024-09-14T11:31:48.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.756+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_dests= new_dests= 2024-09-14T11:31:48.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.756+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential dests added=[] removed=[] 2024-09-14T11:31:48.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.0 2024-09-14T11:31:48.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.0 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.1 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.1 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.2 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.2 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.3 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.3 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.4 2024-09-14T11:31:48.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.4 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.5 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.5 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.6 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.6 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.7 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.7 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.8 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.8 2024-09-14T11:31:48.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.9 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.9 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.10 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.10 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.11 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2.11 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.760+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.0 2024-09-14T11:31:48.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.761+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.761+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.762+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.3 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.762+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.4 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.763+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.5 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.763+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.6 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.764+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.7 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.764+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.8 2024-09-14T11:31:48.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.765+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.9 2024-09-14T11:31:48.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.765+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.10 2024-09-14T11:31:48.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.770+0000 7fbc8d346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:48.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.770+0000 7fbc8d346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 2024-09-14T11:31:48.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbc8d346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbc8d346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbc8d346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbc8d346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31, ofs0, ns] 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbb6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 93865781794720 notifier 7278 bl.length()=1015 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbb6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbb6e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.771+0000 7fbb6e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.772+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_sources= new_sources= 2024-09-14T11:31:48.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.772+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential sources added=[] removed=[] 2024-09-14T11:31:48.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.772+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_dests= new_dests= 2024-09-14T11:31:48.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.772+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential dests added=[] removed=[] 2024-09-14T11:31:48.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.776+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.0 2024-09-14T11:31:48.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.777+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.1 2024-09-14T11:31:48.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.777+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.2 2024-09-14T11:31:48.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.777+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.3 2024-09-14T11:31:48.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.778+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.4 2024-09-14T11:31:48.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.778+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.5 2024-09-14T11:31:48.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.778+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.6 2024-09-14T11:31:48.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.779+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.7 2024-09-14T11:31:48.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.779+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.8 2024-09-14T11:31:48.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.779+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.9 2024-09-14T11:31:48.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.779+0000 7fbc8d346800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.31.10 2024-09-14T11:31:48.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.780+0000 7fbc8d346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:48.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.780+0000 7fbc8d346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 2024-09-14T11:31:48.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbc8d346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbc8d346800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbc8d346800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbc8d346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31, ofs0, ns] 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbb6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 93865781794720 notifier 7278 bl.length()=983 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbb6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 info.flags=0x17 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbb6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.31 to cache LRU end 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.781+0000 7fbb6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.782+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_sources= new_sources= 2024-09-14T11:31:48.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.782+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential sources added=[] removed=[] 2024-09-14T11:31:48.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.782+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): orig_dests= new_dests= 2024-09-14T11:31:48.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.782+0000 7fbc8d346800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.31]): potential dests added=[] removed=[] 2024-09-14T11:31:48.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.784+0000 7fbc8d346800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:48.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.786+0000 7fbb417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:48.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.787+0000 7fbc8d346800 20 remove_watcher() i=0 2024-09-14T11:31:48.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.787+0000 7fbc8d346800 2 removed watcher, disabling cache 2024-09-14T11:31:48.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.788+0000 7fbc8d346800 20 remove_watcher() i=1 2024-09-14T11:31:48.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.789+0000 7fbc8d346800 20 remove_watcher() i=2 2024-09-14T11:31:48.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.790+0000 7fbc8d346800 20 remove_watcher() i=3 2024-09-14T11:31:48.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.791+0000 7fbc8d346800 20 remove_watcher() i=4 2024-09-14T11:31:48.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.792+0000 7fbc8d346800 20 remove_watcher() i=5 2024-09-14T11:31:48.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.793+0000 7fbc8d346800 20 remove_watcher() i=6 2024-09-14T11:31:48.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.794+0000 7fbc8d346800 20 remove_watcher() i=7 2024-09-14T11:31:48.804 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:48.833 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:48.833 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:48.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.870+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 realm 2024-09-14T11:31:48.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:48.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.872+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.873+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:48.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.873+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:48.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.874+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:48.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.874+0000 7f4523b2a800 20 searching for the correct realm 2024-09-14T11:31:48.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:48.876+0000 7f4520018640 0 -- 172.21.15.130:0/3304315321 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4508076cc0 msgr2=0x7f450804cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:31:49.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.082+0000 7f4520018640 0 -- 172.21.15.130:0/3304315321 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4508076cc0 msgr2=0x7f450804cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:49.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 zone default found 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 4 Realm: () 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:49.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 zonegroup default 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.086+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 started sync module instance, tier type = 2024-09-14T11:31:49.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.087+0000 7f4523b2a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:49.094 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=0 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=1 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=2 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=3 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=4 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=5 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.096+0000 7f4523b2a800 20 add_watcher() i=6 2024-09-14T11:31:49.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.097+0000 7f4523b2a800 20 add_watcher() i=7 2024-09-14T11:31:49.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.097+0000 7f4523b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.098+0000 7f43d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 5 note: GC not initialized 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f43d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:49.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 20 Filter name: none 2024-09-14T11:31:49.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f434e7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:49.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.099+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.100+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.100+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.100+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.100+0000 7f4523b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.100+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.101+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.101+0000 7f4523b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.101+0000 7f4523b2a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:49.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.101+0000 7f4523b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:49.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.103+0000 7f43d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:49.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.105+0000 7f4523b2a800 20 remove_watcher() i=0 2024-09-14T11:31:49.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.105+0000 7f4523b2a800 2 removed watcher, disabling cache 2024-09-14T11:31:49.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.106+0000 7f4523b2a800 20 remove_watcher() i=1 2024-09-14T11:31:49.106 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.107+0000 7f4523b2a800 20 remove_watcher() i=2 2024-09-14T11:31:49.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.108+0000 7f4523b2a800 20 remove_watcher() i=3 2024-09-14T11:31:49.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.109+0000 7f4523b2a800 20 remove_watcher() i=4 2024-09-14T11:31:49.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.110+0000 7f4523b2a800 20 remove_watcher() i=5 2024-09-14T11:31:49.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.111+0000 7f4523b2a800 20 remove_watcher() i=6 2024-09-14T11:31:49.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.112+0000 7f4523b2a800 20 remove_watcher() i=7 2024-09-14T11:31:49.121 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:49.121 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:49.121 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:31:49.121 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:49.123 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.123 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.126 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.127 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.170 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.170 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.196 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:31:49.197 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:49.197 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.198 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.208 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.208 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.250 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.250 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.257 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.257 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.264 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.264 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.270 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.270 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.276 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.276 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.283 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.283 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.290 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.290 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.296 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.297 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.303 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.303 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.309 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.309 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.315 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.316 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.322 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.322 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.327 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.328 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.333 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.333 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.340 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.340 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.346 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.346 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.353 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.353 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.359 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.359 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.365 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.365 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.371 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:49.371 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:49.378 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:49.406 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:49.406 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:49.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.443+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 realm 2024-09-14T11:31:49.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:49.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.445+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.446+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:49.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.446+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.447+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:49.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.447+0000 7f64ca1af800 20 searching for the correct realm 2024-09-14T11:31:49.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.449+0000 7f64c849a640 0 -- 172.21.15.130:0/2900927095 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f64bc072230 msgr2=0x7f64bc067ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:49.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.655+0000 7f64c849a640 0 -- 172.21.15.130:0/2900927095 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f64bc072230 msgr2=0x7f64bc067ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:49.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.659+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 zone default found 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 4 Realm: () 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:49.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 zonegroup default 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.660+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.661+0000 7f64ca1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.661+0000 7f64ca1af800 20 started sync module instance, tier type = 2024-09-14T11:31:49.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.661+0000 7f64ca1af800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:49.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=0 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=1 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=2 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=3 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=4 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=5 2024-09-14T11:31:49.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.670+0000 7f64ca1af800 20 add_watcher() i=6 2024-09-14T11:31:49.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.671+0000 7f64ca1af800 20 add_watcher() i=7 2024-09-14T11:31:49.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.671+0000 7f64ca1af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.672+0000 7f637dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.672+0000 7f64ca1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.672+0000 7f64ca1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f64ca1af800 5 note: GC not initialized 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f637cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:49.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f64ca1af800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f64ca1af800 20 Filter name: none 2024-09-14T11:31:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f62f67fc640 20 reqs_thread_entry: start 2024-09-14T11:31:49.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.673+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.674+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:49.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.674+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.674+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.674+0000 7f64ca1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.674+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.675+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.675+0000 7f64ca1af800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.675+0000 7f64ca1af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:49.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.675+0000 7f64ca1af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:49.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.677+0000 7f637dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:49.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.678+0000 7f64ca1af800 20 remove_watcher() i=0 2024-09-14T11:31:49.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.678+0000 7f64ca1af800 2 removed watcher, disabling cache 2024-09-14T11:31:49.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.679+0000 7f64ca1af800 20 remove_watcher() i=1 2024-09-14T11:31:49.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.680+0000 7f64ca1af800 20 remove_watcher() i=2 2024-09-14T11:31:49.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.681+0000 7f64ca1af800 20 remove_watcher() i=3 2024-09-14T11:31:49.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.682+0000 7f64ca1af800 20 remove_watcher() i=4 2024-09-14T11:31:49.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.683+0000 7f64ca1af800 20 remove_watcher() i=5 2024-09-14T11:31:49.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.684+0000 7f64ca1af800 20 remove_watcher() i=6 2024-09-14T11:31:49.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.685+0000 7f64ca1af800 20 remove_watcher() i=7 2024-09-14T11:31:49.694 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:49.694 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:49.694 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:49.694 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:49.695 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:31:49.731 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:49.732 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:49.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.770+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 realm 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:49.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.772+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.773+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.773+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.773+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.773+0000 7f7f96263800 20 searching for the correct realm 2024-09-14T11:31:49.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.774+0000 7f7f93d54640 0 -- 172.21.15.130:0/546335127 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f7f8c01f040 msgr2=0x7f7f8c02d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:49.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.979+0000 7f7f93553640 0 -- 172.21.15.130:0/546335127 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f7f84052b80 msgr2=0x7f7f84075750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:49.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:49.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.985+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 zone default found 2024-09-14T11:31:49.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 4 Realm: () 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 zonegroup default 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.986+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.987+0000 7f7f96263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:49.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.987+0000 7f7f96263800 20 started sync module instance, tier type = 2024-09-14T11:31:49.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.987+0000 7f7f96263800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:49.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=0 2024-09-14T11:31:49.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=1 2024-09-14T11:31:49.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=2 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=3 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=4 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=5 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.995+0000 7f7f96263800 20 add_watcher() i=6 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.996+0000 7f7f96263800 20 add_watcher() i=7 2024-09-14T11:31:49.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.996+0000 7f7f96263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:49.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.998+0000 7f7e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:49.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.998+0000 7f7f96263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.998+0000 7f7f96263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.998+0000 7f7f96263800 5 note: GC not initialized 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7e48fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 20 Filter name: none 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7dc27fc640 20 reqs_thread_entry: start 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:49.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 : miss 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:49.999+0000 7f7f96263800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.000+0000 7f7f96263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 2024-09-14T11:31:50.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.006+0000 7f7f96263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.006+0000 7f7f96263800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.006+0000 7f7f96263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.006+0000 7f7f96263800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32, ofs0, ns] 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7e72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94217086411744 notifier 6857 bl.length()=1015 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7e72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7e72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7e72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_sources= new_sources= 2024-09-14T11:31:50.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential sources added=[] removed=[] 2024-09-14T11:31:50.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_dests= new_dests= 2024-09-14T11:31:50.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.007+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential dests added=[] removed=[] 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.0 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.0 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.1 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.1 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.2 2024-09-14T11:31:50.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.2 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.3 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.3 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.4 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.4 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.5 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.5 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.6 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.6 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.7 2024-09-14T11:31:50.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.7 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.8 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.8 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.9 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.9 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.10 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.10 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.11 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1.11 2024-09-14T11:31:50.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.011+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.0 2024-09-14T11:31:50.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.012+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1 2024-09-14T11:31:50.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.012+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.2 2024-09-14T11:31:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.013+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.3 2024-09-14T11:31:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.013+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.4 2024-09-14T11:31:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.014+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.5 2024-09-14T11:31:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.014+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.6 2024-09-14T11:31:50.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.015+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.7 2024-09-14T11:31:50.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.015+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.8 2024-09-14T11:31:50.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.016+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.9 2024-09-14T11:31:50.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.016+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.10 2024-09-14T11:31:50.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.019+0000 7f7f96263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:50.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.019+0000 7f7f96263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32, ofs0, ns] 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7e727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94217086411744 notifier 6857 bl.length()=1015 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7e727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7e727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7e727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_sources= new_sources= 2024-09-14T11:31:50.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential sources added=[] removed=[] 2024-09-14T11:31:50.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_dests= new_dests= 2024-09-14T11:31:50.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.021+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential dests added=[] removed=[] 2024-09-14T11:31:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.023+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.0 2024-09-14T11:31:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.023+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.1 2024-09-14T11:31:50.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.024+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.2 2024-09-14T11:31:50.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.024+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.3 2024-09-14T11:31:50.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.024+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.4 2024-09-14T11:31:50.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.025+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.5 2024-09-14T11:31:50.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.025+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.6 2024-09-14T11:31:50.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.025+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.7 2024-09-14T11:31:50.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.025+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.8 2024-09-14T11:31:50.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.026+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.9 2024-09-14T11:31:50.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.026+0000 7f7f96263800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.32.10 2024-09-14T11:31:50.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.026+0000 7f7f96263800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:31:50.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.026+0000 7f7f96263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:50.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.026+0000 7f7f96263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 2024-09-14T11:31:50.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.027+0000 7f7f96263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.027+0000 7f7f96263800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.027+0000 7f7f96263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.027+0000 7f7f96263800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32, ofs0, ns] 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7e72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497014 cookie 94217086411744 notifier 6857 bl.length()=983 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7e72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 info.flags=0x17 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7e72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.32 to cache LRU end 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7e72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_sources= new_sources= 2024-09-14T11:31:50.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential sources added=[] removed=[] 2024-09-14T11:31:50.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): orig_dests= new_dests= 2024-09-14T11:31:50.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.028+0000 7f7f96263800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.32]): potential dests added=[] removed=[] 2024-09-14T11:31:50.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.030+0000 7f7f96263800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:31:50.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.032+0000 7f7e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:50.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.034+0000 7f7f96263800 20 remove_watcher() i=0 2024-09-14T11:31:50.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.034+0000 7f7f96263800 2 removed watcher, disabling cache 2024-09-14T11:31:50.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.035+0000 7f7f96263800 20 remove_watcher() i=1 2024-09-14T11:31:50.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.036+0000 7f7f96263800 20 remove_watcher() i=2 2024-09-14T11:31:50.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.037+0000 7f7f96263800 20 remove_watcher() i=3 2024-09-14T11:31:50.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.038+0000 7f7f96263800 20 remove_watcher() i=4 2024-09-14T11:31:50.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.039+0000 7f7f96263800 20 remove_watcher() i=5 2024-09-14T11:31:50.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.040+0000 7f7f96263800 20 remove_watcher() i=6 2024-09-14T11:31:50.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.041+0000 7f7f96263800 20 remove_watcher() i=7 2024-09-14T11:31:50.051 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:31:50.080 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:50.080 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:50.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.117+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 realm 2024-09-14T11:31:50.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:50.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.119+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.120+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:50.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.120+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.121+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:50.120 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.121+0000 7f24eb526800 20 searching for the correct realm 2024-09-14T11:31:50.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.123+0000 7f24e795e640 0 -- 172.21.15.130:0/858466909 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f24d006d070 msgr2=0x7f24d0089920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:50.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.328+0000 7f24e795e640 0 -- 172.21.15.130:0/858466909 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f24d006d070 msgr2=0x7f24d0089920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:50.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:50.332 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.332+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 zone default found 2024-09-14T11:31:50.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 4 Realm: () 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 zonegroup default 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.333+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.334+0000 7f24eb526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.334+0000 7f24eb526800 20 started sync module instance, tier type = 2024-09-14T11:31:50.334 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.334+0000 7f24eb526800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=0 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=1 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=2 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=3 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=4 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=5 2024-09-14T11:31:50.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.342+0000 7f24eb526800 20 add_watcher() i=6 2024-09-14T11:31:50.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.343+0000 7f24eb526800 20 add_watcher() i=7 2024-09-14T11:31:50.342 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.343+0000 7f24eb526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:50.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.345+0000 7f239dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.345+0000 7f24eb526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.345+0000 7f24eb526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.345+0000 7f24eb526800 5 note: GC not initialized 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.345+0000 7f239cfe1640 20 reqs_thread_entry: start 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f24eb526800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f24eb526800 20 Filter name: none 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f23167fc640 20 reqs_thread_entry: start 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.346+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.347+0000 7f24eb526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:50.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.349+0000 7f239dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:50.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.351+0000 7f24eb526800 20 remove_watcher() i=0 2024-09-14T11:31:50.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.351+0000 7f24eb526800 2 removed watcher, disabling cache 2024-09-14T11:31:50.350 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.352+0000 7f24eb526800 20 remove_watcher() i=1 2024-09-14T11:31:50.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.353+0000 7f24eb526800 20 remove_watcher() i=2 2024-09-14T11:31:50.352 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.354+0000 7f24eb526800 20 remove_watcher() i=3 2024-09-14T11:31:50.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.355+0000 7f24eb526800 20 remove_watcher() i=4 2024-09-14T11:31:50.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.356+0000 7f24eb526800 20 remove_watcher() i=5 2024-09-14T11:31:50.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.357+0000 7f24eb526800 20 remove_watcher() i=6 2024-09-14T11:31:50.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.358+0000 7f24eb526800 20 remove_watcher() i=7 2024-09-14T11:31:50.367 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:50.367 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:50.367 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:31:50.367 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:50.369 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.369 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.371 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.372 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.415 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.415 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.443 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:31:50.444 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:50.445 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.445 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.456 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.457 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.499 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.499 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.507 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.507 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.514 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.514 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.520 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.521 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.527 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.528 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.534 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.534 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.540 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.540 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.547 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.547 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.554 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.554 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.560 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.560 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.566 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.566 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.572 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.572 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.579 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.579 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.586 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.586 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.593 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.593 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.600 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.600 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.607 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.607 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.613 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.614 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.620 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.620 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.627 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:50.627 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:31:50.634 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:31:50.663 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:50.663 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:50.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.700+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.702+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.702+0000 7f1a9471f800 20 realm 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.702+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.703+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.703+0000 7f1a9471f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.703+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.703+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.703+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.704+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:50.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.704+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.704+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:50.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.704+0000 7f1a9471f800 20 searching for the correct realm 2024-09-14T11:31:50.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.706+0000 7f1a87ca1640 0 -- 172.21.15.130:0/1488556039 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f1a80096400 msgr2=0x7f1a80096820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:50.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.710+0000 7f1a904a2640 0 -- 172.21.15.130:0/1488556039 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f1a8808d070 msgr2=0x7f1a8805f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:50.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:50.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:50.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:50.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:50.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:50.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.916+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:50.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 zone default found 2024-09-14T11:31:50.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 4 Realm: () 2024-09-14T11:31:50.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:50.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 zonegroup default 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.917+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.918+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.918+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.918+0000 7f1a9471f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.918+0000 7f1a9471f800 20 started sync module instance, tier type = 2024-09-14T11:31:50.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.918+0000 7f1a9471f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:50.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=0 2024-09-14T11:31:50.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=1 2024-09-14T11:31:50.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=2 2024-09-14T11:31:50.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=3 2024-09-14T11:31:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=4 2024-09-14T11:31:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=5 2024-09-14T11:31:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=6 2024-09-14T11:31:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 20 add_watcher() i=7 2024-09-14T11:31:50.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.928+0000 7f1a9471f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:50.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:50.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1a9471f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1a9471f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1a9471f800 5 note: GC not initialized 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1945fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.930+0000 7f1a9471f800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.931+0000 7f1a9471f800 20 Filter name: none 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.931+0000 7f18b77fe640 20 reqs_thread_entry: start 2024-09-14T11:31:50.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.931+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.931+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:50.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.931+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:50.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:50.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:50.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 rados->read ofs=0 len=0 2024-09-14T11:31:50.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:50.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.932+0000 7f1a9471f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:50.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.934+0000 7f1946fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:50.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.936+0000 7f1a9471f800 20 remove_watcher() i=0 2024-09-14T11:31:50.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.936+0000 7f1a9471f800 2 removed watcher, disabling cache 2024-09-14T11:31:50.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.937+0000 7f1a9471f800 20 remove_watcher() i=1 2024-09-14T11:31:50.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.938+0000 7f1a9471f800 20 remove_watcher() i=2 2024-09-14T11:31:50.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.939+0000 7f1a9471f800 20 remove_watcher() i=3 2024-09-14T11:31:50.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.940+0000 7f1a9471f800 20 remove_watcher() i=4 2024-09-14T11:31:50.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.941+0000 7f1a9471f800 20 remove_watcher() i=5 2024-09-14T11:31:50.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.942+0000 7f1a9471f800 20 remove_watcher() i=6 2024-09-14T11:31:50.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:50.943+0000 7f1a9471f800 20 remove_watcher() i=7 2024-09-14T11:31:50.951 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:50.951 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:50.951 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:50.952 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:50.953 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:31:50.987 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:50.987 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:51.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.024+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 20 realm 2024-09-14T11:31:51.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:51.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.028+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:51.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.028+0000 7f47ce420800 20 searching for the correct realm 2024-09-14T11:31:51.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.030+0000 7f47cc70b640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f47c0090060 msgr2=0x7f47c00b92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.637+0000 7f47cbf0a640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f47c400e040 msgr2=0x7f47c403f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:51.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.642+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 zone default found 2024-09-14T11:31:51.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 4 Realm: () 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 zonegroup default 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 started sync module instance, tier type = 2024-09-14T11:31:51.646 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.644+0000 7f47ce420800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=0 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=1 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=2 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=3 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=4 2024-09-14T11:31:51.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=5 2024-09-14T11:31:51.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=6 2024-09-14T11:31:51.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.654+0000 7f47ce420800 20 add_watcher() i=7 2024-09-14T11:31:51.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.654+0000 7f47ce420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:51.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f4681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:51.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f47ce420800 5 note: GC not initialized 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f4680fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.656+0000 7f47ce420800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 20 Filter name: none 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f45fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:51.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : miss 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:51.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.657+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.662+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.662+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.662+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.662+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.672+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.677+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:51.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.677+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.678+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.678+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.678+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.678+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.681+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47ce420800 time 2024-09-14T11:31:51.686145+0000 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.684 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d198c76a] 2024-09-14T11:31:51.685 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.685 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.685 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.686 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:31:51.686 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.686 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:31:51.686 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.685+0000 7f47ce420800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47ce420800 time 2024-09-14T11:31:51.686145+0000 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d198c76a] 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:31:51.687 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.688 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:31:51.688 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:31:51.688 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.688 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:31:51.688 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f47ce420800 thread_name:radosgw-admin 2024-09-14T11:31:51.705 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d063e6f0] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d068b99c] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d198c7c4] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:31:51.706 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.686+0000 7f47ce420800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f47ce420800 thread_name:radosgw-admin 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d063e6f0] 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d068b99c] 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d198c7c4] 2024-09-14T11:31:51.707 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:31:51.708 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bdb8ec0 auth_method 0 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.709 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 7377 payload 824 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: dump: 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.710 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.711 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: dump: 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.712 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:31:51.010+0000 7f47ce420800 5 monclient: authenticate success, global_id 7377 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:31:51.010+0000 7f46b9e0b640 4 set_mon_vals no callback set 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:31:51.010+0000 7f47ce420800 1 librados: init done 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.713 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:31:51.013+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f46b4077230 auth_method 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:31:51.013+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866bf32500 auth_method 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:31:51.013+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x55866bf58230 auth_method 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:31:51.014+0000 7f47cb709640 10 monclient: get_auth_request con 0x55866bf5c420 auth_method 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:31:51.015+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:31:51.015+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:31:51.015+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.714 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.715 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:31:51.015+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.716 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 asok(0x55866bcec270) register_command objecter_requests cmddesc objecter_requests hook 0x55866bf64810 EEXIST 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.717 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:31:51.016+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:31:51.016+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x55866bf5fa10 EEXIST 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bf88b30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.718 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bf88f10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bf87840 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.500777s 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bf88b30 auth_method 0 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bf87840 auth_method 0 2024-09-14T11:31:51.719 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bf88f10 auth_method 0 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.720 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 6902 payload 824 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 1 monclient: found mon.noname-c 2024-09-14T11:31:51.721 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: dump: 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.722 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: dump: 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.723 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:31:51.017+0000 7f47ce420800 5 monclient: authenticate success, global_id 6902 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.724 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:31:51.017+0000 7f47ccf0c640 4 set_mon_vals no callback set 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:31:51.019+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f46a4077140 auth_method 0 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: get_monmap_and_config 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:31:51.019+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.725 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.726 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.727 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:31:51.019+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.728 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:31:51.020+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:31:51.020+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.729 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x7ffe0c95cdc8 EEXIST 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bfac750 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bfd71c0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bfd8570 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.504521s 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bfac750 auth_method 0 2024-09-14T11:31:51.730 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bfd71c0 auth_method 0 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.731 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bfd8570 auth_method 0 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 7383 payload 274 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: dump: 2024-09-14T11:31:51.732 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.733 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: dump: 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.734 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 monclient: authenticate success, global_id 7383 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:31:51.021+0000 7f47ce420800 4 set_mon_vals no callback set 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: shutdown 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:31:51.021+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.735 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.736 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:31:51.021+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: starting msgr at 2024-09-14T11:31:51.737 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: starting objecter 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 asok(0x55866bcec270) register_command objecter_requests cmddesc objecter_requests hook 0x55866bfd9da0 EEXIST 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: setting wanted keys 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: calling monclient init 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.738 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:31:51.022+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:31:51.022+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x55866bf9d538 EEXIST 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.739 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bfac750 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bfd8570 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bfd1490 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.506726s 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bfd8570 auth_method 0 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.740 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bfd1490 auth_method 0 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bfac750 auth_method 0 2024-09-14T11:31:51.741 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:31:51.023+0000 7f47cb709640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.742 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: dump: 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.743 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: dump: 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.744 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:31:51.023+0000 7f47ce420800 5 monclient: authenticate success, global_id 7386 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:31:51.023+0000 7f46aaffd640 4 set_mon_vals no callback set 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:31:51.023+0000 7f47ce420800 1 librados: init done 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:31:51.023+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cr dump hook 0x7f47bc061b18 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:31:51.024+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.745 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:31:51.025+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f4694077230 auth_method 0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:31:51.026+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866bff70f0 auth_method 0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 realm 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:31:51.026+0000 7f47ce420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.746 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:31:51.027+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x55866bffb520 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:31:51.027+0000 7f47cb709640 10 monclient: get_auth_request con 0x55866bffec60 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:31:51.028+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:31:51.028+0000 7f47ce420800 20 searching for the correct realm 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:31:51.028+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866c003a00 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:31:51.029+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f47c401e040 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:31:51.029+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f47bc029060 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:31:51.030+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.747 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:31:51.030+0000 7f47cc70b640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f47c0090060 msgr2=0x7f47c00b92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:31:51.231+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:31:51.632+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:31:51.636+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f47c400e040 auth_method 0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:31:51.637+0000 7f47cbf0a640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f47c400e040 msgr2=0x7f47c403f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:31:51.637+0000 7f46a97fa640 1 client.7386.objecter ms_handle_reset 0x7f47c400e040 session 0x7f47c4034040 osd.0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:31:51.637+0000 7f46a97fa640 10 monclient: _renew_subs 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:31:51.637+0000 7f46a97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:31:51.637+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f46940878d0 auth_method 0 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:31:51.639+0000 7f46a97fa640 1 client.7386.objecter ms_handle_reset 0x7f47bc029060 session 0x7f47bc06d4d0 osd.2 2024-09-14T11:31:51.748 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:31:51.640+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f47c400e040 auth_method 0 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.749 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 zone default found 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 Realm: () 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:31:51.643+0000 7f47ce420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 zonegroup default 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.750 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 started sync module instance, tier type = 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=0 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=1 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=2 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=3 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=4 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=5 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=6 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:31:51.654+0000 7f47ce420800 20 add_watcher() i=7 2024-09-14T11:31:51.751 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:31:51.654+0000 7f47ce420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.752 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:31:51.656+0000 7f4681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:31:51.656+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache list hook 0x55866bfd18b0 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache inspect hook 0x55866bfd18b0 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache erase hook 0x55866bfd18b0 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache zap hook 0x55866bfd18b0 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 note: GC not initialized 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:31:51.656+0000 7f4680fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:51.753 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace show hook 0x7f47c400be50 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace history hook 0x7f47c400be50 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace active hook 0x7f47c400be50 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace active_short hook 0x7f47c400be50 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 Filter name: none 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:31:51.657+0000 7f45fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : miss 2024-09-14T11:31:51.754 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.755 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.756 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.757 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:31:51.672+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.758 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:31:51.677+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:31:51.677+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.759 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:31:51.681+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.760 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:31:51.685+0000 7f47ce420800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47ce420800 time 2024-09-14T11:31:51.686145+0000 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d198c76a] 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.761 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:31:51.686+0000 7f47ce420800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f47ce420800 thread_name:radosgw-admin 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d063e6f0] 2024-09-14T11:31:51.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d068b99c] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d198c7c4] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.763 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:51.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:51.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:31:51.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:51.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:31:51.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:51.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:31:51.770 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f45fa7fc640 / http_manager 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4680fe1640 / http_manager 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4681fe3640 / rgw_dt_lg_renew 2024-09-14T11:31:51.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46a97fa640 / ms_dispatch 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46aa7fc640 / io_context_pool 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46aaffd640 / io_context_pool 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b17fa640 / ms_dispatch 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b3fff640 / ms_dispatch 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b9e0b640 / io_context_pool 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cb709640 / msgr-worker-2 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cbf0a640 / msgr-worker-1 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cc70b640 / msgr-worker-0 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47ccf0c640 / io_context_pool 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47ce420800 / radosgw-admin 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:31:51.772 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.122191.log 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:31:51.010+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bdb8ec0 auth_method 0 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.773 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:31:51.010+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 7377 payload 824 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:31:51.010+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: dump: 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.774 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:31:51.010+0000 7f46b3fff640 10 monclient: dump: 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.775 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:31:51.010+0000 7f47ce420800 5 monclient: authenticate success, global_id 7377 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:31:51.010+0000 7f46b9e0b640 4 set_mon_vals no callback set 2024-09-14T11:31:51.776 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:31:51.010+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:31:51.010+0000 7f47ce420800 1 librados: init done 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:31:51.012+0000 7f46b3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:31:51.013+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f46b4077230 auth_method 0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:31:51.013+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866bf32500 auth_method 0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:31:51.013+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x55866bf58230 auth_method 0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:31:51.014+0000 7f47cb709640 10 monclient: get_auth_request con 0x55866bf5c420 auth_method 0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:31:51.015+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:31:51.015+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.777 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:31:51.015+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding auth protocol: cephx 2024-09-14T11:31:51.778 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: crc 2024-09-14T11:31:51.779 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:31:51.015+0000 7f47ce420800 5 AuthRegistry(0x55866bf61300) adding con mode: secure 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:31:51.015+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 asok(0x55866bcec270) register_command objecter_requests cmddesc objecter_requests hook 0x55866bf64810 EEXIST 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding auth protocol: cephx 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.780 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: crc 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 AuthRegistry(0x55866bf5f8c8) adding con mode: secure 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:31:51.016+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:31:51.016+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:31:51.016+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x55866bf5fa10 EEXIST 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:31:51.781 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bf88b30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bf88f10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bf87840 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:31:51.016+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.500777s 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bf88b30 auth_method 0 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bf87840 auth_method 0 2024-09-14T11:31:51.782 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:31:51.016+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:31:51.016+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bf88f10 auth_method 0 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.783 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:31:51.016+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:31:51.017+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 6902 payload 824 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 1 monclient: found mon.noname-c 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:31:51.017+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:31:51.784 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: dump: 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.785 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:31:51.017+0000 7f46b17fa640 10 monclient: dump: 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.786 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:31:51.017+0000 7f47ce420800 5 monclient: authenticate success, global_id 6902 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:31:51.017+0000 7f47ccf0c640 4 set_mon_vals no callback set 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:31:51.017+0000 7f47ce420800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.787 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:31:51.019+0000 7f46b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:31:51.019+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f46a4077140 auth_method 0 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: get_monmap_and_config 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:31:51.019+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:31:51.019+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.788 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding auth protocol: cephx 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.789 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: crc 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:31:51.019+0000 7f47ce420800 5 AuthRegistry(0x55866bfa8600) adding con mode: secure 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:31:51.019+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding auth protocol: cephx 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.790 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: crc 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95cc80) adding con mode: secure 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:31:51.020+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:31:51.020+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:31:51.020+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x7ffe0c95cdc8 EEXIST 2024-09-14T11:31:51.791 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bfac750 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bfd71c0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bfd8570 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:31:51.020+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.504521s 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bfac750 auth_method 0 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.792 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bfd71c0 auth_method 0 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:31:51.020+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bfd8570 auth_method 0 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.793 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:31:51.020+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_done global_id 7383 payload 274 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:31:51.020+0000 7f47cbf0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: dump: 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.794 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:31:51.021+0000 7f46aaffd640 10 monclient: dump: 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.795 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 monclient: authenticate success, global_id 7383 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: get_monmap_and_config success 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:31:51.021+0000 7f47ce420800 4 set_mon_vals no callback set 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: shutdown 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: build_initial_monmap 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:31:51.021+0000 7f47ce420800 1 build_initial for_mkfs: 0 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:31:51.021+0000 7f47ce420800 10 monclient: monmap: 2024-09-14T11:31:51.796 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding auth protocol: cephx 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.797 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: crc 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:31:51.021+0000 7f47ce420800 5 AuthRegistry(0x55866bfd8c90) adding con mode: secure 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:31:51.021+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: starting msgr at 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: starting objecter 2024-09-14T11:31:51.798 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 asok(0x55866bcec270) register_command objecter_requests cmddesc objecter_requests hook 0x55866bfd9da0 EEXIST 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: setting wanted keys 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:31:51.022+0000 7f47ce420800 1 librados: calling monclient init 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: init 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding auth protocol: cephx 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.799 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: crc 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 AuthRegistry(0x55866bf9d3f0) adding con mode: secure 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:31:51.022+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:31:51.022+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:31:51.022+0000 7f47ce420800 5 asok(0x55866bcec270) register_command rotate-key cmddesc rotate-key hook 0x55866bf9d538 EEXIST 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: _reopen_session rank -1 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-b con 0x55866bfac750 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:31:51.800 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-a con 0x55866bfd8570 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): picked mon.noname-c con 0x55866bfd1490 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): start opening mon connection 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): _renew_subs 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:31:51.022+0000 7f47ce420800 10 monclient(hunting): authenticate will time out at 2027.506726s 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): get_auth_request con 0x55866bfd8570 auth_method 0 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): get_auth_request con 0x55866bfd1490 auth_method 0 2024-09-14T11:31:51.801 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:31:51.022+0000 7f47cb709640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:31:51.022+0000 7f47cc70b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request con 0x55866bfac750 auth_method 0 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:31:51.802 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:31:51.022+0000 7f47cbf0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient(hunting): handle_auth_done global_id 7386 payload 824 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient: _finish_hunting 0 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:31:51.023+0000 7f47cb709640 1 monclient: found mon.noname-a 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:31:51.023+0000 7f47cb709640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: dump: 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.803 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: _finish_auth 0 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: _check_auth_tickets 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:31:51.023+0000 7f46a97fa640 10 monclient: dump: 2024-09-14T11:31:51.804 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:31:51.023+0000 7f47ce420800 5 monclient: authenticate success, global_id 7386 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:31:51.023+0000 7f46aaffd640 4 set_mon_vals no callback set 2024-09-14T11:31:51.805 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _renew_subs 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:31:51.023+0000 7f47ce420800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:31:51.023+0000 7f47ce420800 1 librados: init done 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:31:51.023+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cr dump hook 0x7f47bc061b18 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:31:51.024+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:31:51.025+0000 7f46a97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:31:51.025+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f4694077230 auth_method 0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:31:51.026+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866bff70f0 auth_method 0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 realm 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.806 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:31:51.026+0000 7f47ce420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:31:51.026+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:31:51.027+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x55866bffb520 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:31:51.027+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:31:51.027+0000 7f47cb709640 10 monclient: get_auth_request con 0x55866bffec60 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:31:51.028+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:31:51.028+0000 7f47ce420800 20 searching for the correct realm 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:31:51.028+0000 7f47cc70b640 10 monclient: get_auth_request con 0x55866c003a00 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:31:51.029+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f47c401e040 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:31:51.029+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f47bc029060 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:31:51.030+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.807 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:31:51.030+0000 7f47cc70b640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f47c0090060 msgr2=0x7f47c00b92c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:31:51.231+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:31:51.632+0000 7f47cc70b640 10 monclient: get_auth_request con 0x7f47c0090060 auth_method 0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:31:51.636+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f47c400e040 auth_method 0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:31:51.637+0000 7f47cbf0a640 0 -- 172.21.15.130:0/3164608348 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f47c400e040 msgr2=0x7f47c403f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:31:51.637+0000 7f46a97fa640 1 client.7386.objecter ms_handle_reset 0x7f47c400e040 session 0x7f47c4034040 osd.0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:31:51.637+0000 7f46a97fa640 10 monclient: _renew_subs 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:31:51.637+0000 7f46a97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:31:51.637+0000 7f47cbf0a640 10 monclient: get_auth_request con 0x7f46940878d0 auth_method 0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:31:51.639+0000 7f46a97fa640 1 client.7386.objecter ms_handle_reset 0x7f47bc029060 session 0x7f47bc06d4d0 osd.2 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:31:51.640+0000 7f47cb709640 10 monclient: get_auth_request con 0x7f47c400e040 auth_method 0 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:51.808 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:31:51.642+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 zone default found 2024-09-14T11:31:51.809 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 Realm: () 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:31:51.643+0000 7f47ce420800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:31:51.643+0000 7f47ce420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 zonegroup default 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:31:51.643+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 started sync module instance, tier type = 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:31:51.644+0000 7f47ce420800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=0 2024-09-14T11:31:51.810 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=1 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=2 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=3 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=4 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=5 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:31:51.653+0000 7f47ce420800 20 add_watcher() i=6 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:31:51.654+0000 7f47ce420800 20 add_watcher() i=7 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:31:51.654+0000 7f47ce420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding auth protocol: cephx 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.811 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:31:51.656+0000 7f4681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: crc 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 AuthRegistry(0x7ffe0c95d160) adding con mode: secure 2024-09-14T11:31:51.812 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:31:51.656+0000 7f47ce420800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache list hook 0x55866bfd18b0 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache inspect hook 0x55866bfd18b0 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache erase hook 0x55866bfd18b0 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command cache zap hook 0x55866bfd18b0 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 note: GC not initialized 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:31:51.656+0000 7f4680fe1640 20 reqs_thread_entry: start 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace show hook 0x7f47c400be50 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace history hook 0x7f47c400be50 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace active hook 0x7f47c400be50 2024-09-14T11:31:51.813 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:31:51.656+0000 7f47ce420800 5 asok(0x55866bcec270) register_command sync trace active_short hook 0x7f47c400be50 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:31:51.656+0000 7f47ce420800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 Filter name: none 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:31:51.657+0000 7f45fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : miss 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:31:51.657+0000 7f47ce420800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.814 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:31:51.657+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:31:51.662+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:31:51.663+0000 7f46aa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.815 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:31:51.663+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:31:51.816 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:31:51.669+0000 7f47ce420800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.817 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:31:51.669+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:31:51.670+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:31:51.671+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:31:51.672+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:31:51.673+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:31:51.674+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:31:51.677+0000 7f47ce420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:31:51.818 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:31:51.677+0000 7f47ce420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:31:51.678+0000 7f47ce420800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94035825960768 notifier 7386 bl.length()=1015 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:31:51.679+0000 7f46aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:31:51.819 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:31:51.679+0000 7f47ce420800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:31:51.681+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:31:51.682+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:31:51.683+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:31:51.684+0000 7f47ce420800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:31:51.685+0000 7f47ce420800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f47ce420800 time 2024-09-14T11:31:51.686145+0000 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:31:51.820 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f47d198c76a] 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:31:51.686+0000 7f47ce420800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f47ce420800 thread_name:radosgw-admin 2024-09-14T11:31:51.821 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f47d063e6f0] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f47d068b99c] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f47d198c7c4] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f47d198c928] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55866a5c80b1] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55866a5d8217] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f47d0629590] 2024-09-14T11:31:51.822 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:31:51.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:31:51.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:31:51.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:31:51.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:31:51.827 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:31:51.828 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:31:51.829 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f45fa7fc640 / http_manager 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4680fe1640 / http_manager 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4681fe3640 / rgw_dt_lg_renew 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46a97fa640 / ms_dispatch 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46aa7fc640 / io_context_pool 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46aaffd640 / io_context_pool 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b17fa640 / ms_dispatch 2024-09-14T11:31:51.830 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b3fff640 / ms_dispatch 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f46b9e0b640 / io_context_pool 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cb709640 / msgr-worker-2 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cbf0a640 / msgr-worker-1 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47cc70b640 / msgr-worker-0 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47ccf0c640 / io_context_pool 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: 7f47ce420800 / radosgw-admin 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:31:51.687542Z_64ea6c60-5bfb-41a2-94f1-b1e3cfc07164/log 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:31:51.831 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.760+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 realm 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.762+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.763+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.763+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.764+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.764+0000 7fb3f0940800 20 searching for the correct realm 2024-09-14T11:31:51.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.766+0000 7fb3ecec1640 0 -- 172.21.15.130:0/2279840814 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb3e0080950 msgr2=0x7fb3e0066430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.972+0000 7fb3ecec1640 0 -- 172.21.15.130:0/2279840814 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb3e0080950 msgr2=0x7fb3e0066430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:31:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:31:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:31:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:31:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:31:51.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:31:51.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:31:51.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.975+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:31:51.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 zone default found 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 4 Realm: () 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 zonegroup default 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.976+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.977+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.977+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.977+0000 7fb3f0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:31:51.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.977+0000 7fb3f0940800 20 started sync module instance, tier type = 2024-09-14T11:31:51.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.977+0000 7fb3f0940800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:31:51.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=0 2024-09-14T11:31:51.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=1 2024-09-14T11:31:51.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=2 2024-09-14T11:31:51.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=3 2024-09-14T11:31:51.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=4 2024-09-14T11:31:51.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=5 2024-09-14T11:31:51.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=6 2024-09-14T11:31:51.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 20 add_watcher() i=7 2024-09-14T11:31:51.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.986+0000 7fb3f0940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:31:51.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.988+0000 7fb2a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:51.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.988+0000 7fb3f0940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:31:51.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.988+0000 7fb3f0940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:31:51.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.988+0000 7fb3f0940800 5 note: GC not initialized 2024-09-14T11:31:51.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.988+0000 7fb2a1fdb640 20 reqs_thread_entry: start 2024-09-14T11:31:51.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb3f0940800 20 init_complete bucket index max shards: 11 2024-09-14T11:31:51.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb3f0940800 20 Filter name: none 2024-09-14T11:31:51.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb2137fe640 20 reqs_thread_entry: start 2024-09-14T11:31:51.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.989+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 rados->read ofs=0 len=0 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:31:51.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.990+0000 7fb3f0940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:31:51.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.992+0000 7fb2a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:31:51.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.994+0000 7fb3f0940800 20 remove_watcher() i=0 2024-09-14T11:31:51.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.994+0000 7fb3f0940800 2 removed watcher, disabling cache 2024-09-14T11:31:51.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.995+0000 7fb3f0940800 20 remove_watcher() i=1 2024-09-14T11:31:51.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.996+0000 7fb3f0940800 20 remove_watcher() i=2 2024-09-14T11:31:51.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.997+0000 7fb3f0940800 20 remove_watcher() i=3 2024-09-14T11:31:51.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.998+0000 7fb3f0940800 20 remove_watcher() i=4 2024-09-14T11:31:51.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:51.999+0000 7fb3f0940800 20 remove_watcher() i=5 2024-09-14T11:31:51.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:52.000+0000 7fb3f0940800 20 remove_watcher() i=6 2024-09-14T11:31:51.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:31:52.001+0000 7fb3f0940800 20 remove_watcher() i=7 2024-09-14T11:31:52.010 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:52.010 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:31:52.010 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:31:52.010 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:31:52.011 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:31:52.011 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.052 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.052 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.096 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:22.130 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:22.130 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:22.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.172+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 20 realm 2024-09-14T11:32:22.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.173+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.174+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.174+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.175+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.175+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.175+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:22.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.175+0000 7fdd93f25800 20 searching for the correct realm 2024-09-14T11:32:22.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.178+0000 7fdd903af640 0 -- 172.21.15.130:0/3190893617 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdd78018070 msgr2=0x7fdd780920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.384+0000 7fdd903af640 0 -- 172.21.15.130:0/3190893617 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdd78018070 msgr2=0x7fdd780920c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:22.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.389+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 zone default found 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 4 Realm: () 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:22.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 zonegroup default 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.390+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 started sync module instance, tier type = 2024-09-14T11:32:22.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.391+0000 7fdd93f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=0 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=1 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=2 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=3 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=4 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=5 2024-09-14T11:32:22.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.401+0000 7fdd93f25800 20 add_watcher() i=6 2024-09-14T11:32:22.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.402+0000 7fdd93f25800 20 add_watcher() i=7 2024-09-14T11:32:22.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.402+0000 7fdd93f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.404+0000 7fdc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.404+0000 7fdd93f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.404+0000 7fdd93f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.404+0000 7fdd93f25800 5 note: GC not initialized 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdc44fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 20 Filter name: none 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdbbe7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:32:22.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : miss 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.405+0000 7fdd93f25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:22.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.406+0000 7fdd93f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:32:22.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.411+0000 7fdd93f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.411+0000 7fdd93f25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.411+0000 7fdd93f25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.411+0000 7fdd93f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdc6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94732193246768 notifier 7422 bl.length()=1015 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdc6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdc6e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdc6e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:32:22.411 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:32:22.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.412+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.0 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.1 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.2 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.3 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.4 2024-09-14T11:32:22.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.5 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.6 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.7 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.8 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.9 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.10 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1.11 2024-09-14T11:32:22.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.417+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:32:22.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.418+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:32:22.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.418+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:32:22.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.418+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:32:22.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.419+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:32:22.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.419+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:32:22.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.420+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:32:22.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.421+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:32:22.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.421+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:32:22.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.422+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:32:22.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.422+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:32:22.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.425+0000 7fdd93f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:22.424 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.425+0000 7fdd93f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:32:22.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.426+0000 7fdd93f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.426+0000 7fdd93f25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.426+0000 7fdd93f25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.426+0000 7fdd93f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdc6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94732193246768 notifier 7422 bl.length()=1015 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdc6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdc6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdc6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:32:22.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:32:22.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:32:22.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.427+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:32:22.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.430+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.0 2024-09-14T11:32:22.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.430+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.1 2024-09-14T11:32:22.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.430+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.2 2024-09-14T11:32:22.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.431+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.3 2024-09-14T11:32:22.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.431+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.4 2024-09-14T11:32:22.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.431+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.5 2024-09-14T11:32:22.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.432+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.6 2024-09-14T11:32:22.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.432+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.7 2024-09-14T11:32:22.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.432+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.8 2024-09-14T11:32:22.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.433+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.9 2024-09-14T11:32:22.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.433+0000 7fdd93f25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.33.10 2024-09-14T11:32:22.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.433+0000 7fdd93f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:22.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.433+0000 7fdd93f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 2024-09-14T11:32:22.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33, ofs0, ns] 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdc6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94732193246768 notifier 7422 bl.length()=983 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdc6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 info.flags=0x17 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdc6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:a588039c-1457-497f-adbd-8890a12279b7.4508.33 to cache LRU end 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdc6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_sources= new_sources= 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential sources added=[] removed=[] 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): orig_dests= new_dests= 2024-09-14T11:32:22.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.435+0000 7fdd93f25800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[a588039c-1457-497f-adbd-8890a12279b7.4508.33]): potential dests added=[] removed=[] 2024-09-14T11:32:22.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.438+0000 7fdd93f25800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:22.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.439+0000 7fdc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.442+0000 7fdd93f25800 20 remove_watcher() i=0 2024-09-14T11:32:22.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.442+0000 7fdd93f25800 2 removed watcher, disabling cache 2024-09-14T11:32:22.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.443+0000 7fdd93f25800 20 remove_watcher() i=1 2024-09-14T11:32:22.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.444+0000 7fdd93f25800 20 remove_watcher() i=2 2024-09-14T11:32:22.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.445+0000 7fdd93f25800 20 remove_watcher() i=3 2024-09-14T11:32:22.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.446+0000 7fdd93f25800 20 remove_watcher() i=4 2024-09-14T11:32:22.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.447+0000 7fdd93f25800 20 remove_watcher() i=5 2024-09-14T11:32:22.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.448+0000 7fdd93f25800 20 remove_watcher() i=6 2024-09-14T11:32:22.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.449+0000 7fdd93f25800 20 remove_watcher() i=7 2024-09-14T11:32:22.460 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:32:22.489 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:22.489 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:22.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.526+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.528+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.528+0000 7fb886736800 20 realm 2024-09-14T11:32:22.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.528+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.529+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.529+0000 7fb886736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.529+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.529+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.529+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.530+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.530+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.530+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:22.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.530+0000 7fb886736800 20 searching for the correct realm 2024-09-14T11:32:22.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.532+0000 7fb881cb6640 0 -- 172.21.15.130:0/2814560515 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fb87408d040 msgr2=0x7fb87409a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.536+0000 7fb8824b7640 0 -- 172.21.15.130:0/2814560515 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fb87c06cbe0 msgr2=0x7fb87c06dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:22.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.743+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 zone default found 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 4 Realm: () 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 zonegroup default 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.744+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.745+0000 7fb886736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:22.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.745+0000 7fb886736800 20 started sync module instance, tier type = 2024-09-14T11:32:22.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.745+0000 7fb886736800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=0 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=1 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=2 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=3 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=4 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=5 2024-09-14T11:32:22.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.754+0000 7fb886736800 20 add_watcher() i=6 2024-09-14T11:32:22.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.755+0000 7fb886736800 20 add_watcher() i=7 2024-09-14T11:32:22.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.755+0000 7fb886736800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:22.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.756+0000 7fb738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:22.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:22.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 5 note: GC not initialized 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb6b37fe640 20 reqs_thread_entry: start 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 20 Filter name: none 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb6b17fa640 20 reqs_thread_entry: start 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.757+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:22.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.758+0000 7fb886736800 20 rados->read ofs=0 len=0 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.759+0000 7fb886736800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:32:22.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.759+0000 7fb886736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:22.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.760+0000 7fb738fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:22.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.763+0000 7fb886736800 20 remove_watcher() i=0 2024-09-14T11:32:22.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.763+0000 7fb886736800 2 removed watcher, disabling cache 2024-09-14T11:32:22.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.764+0000 7fb886736800 20 remove_watcher() i=1 2024-09-14T11:32:22.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.765+0000 7fb886736800 20 remove_watcher() i=2 2024-09-14T11:32:22.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.766+0000 7fb886736800 20 remove_watcher() i=3 2024-09-14T11:32:22.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.767+0000 7fb886736800 20 remove_watcher() i=4 2024-09-14T11:32:22.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.768+0000 7fb886736800 20 remove_watcher() i=5 2024-09-14T11:32:22.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.769+0000 7fb886736800 20 remove_watcher() i=6 2024-09-14T11:32:22.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:22.770+0000 7fb886736800 20 remove_watcher() i=7 2024-09-14T11:32:22.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:22.778 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:22.778 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-commit-target-layout id: a588039c-1457-497f-adbd-8890a12279b7.4508.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:22.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:22.780 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.780 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.784 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.784 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.827 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.827 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.855 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:32:22.855 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:22.857 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.857 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.867 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.867 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.910 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.910 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.917 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.918 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.925 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.925 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.932 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.932 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.939 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.946 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.946 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.953 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.953 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:22.959 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:22.960 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.002 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.002 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.010 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.010 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.017 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.017 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.024 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.024 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.030 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.030 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.037 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.037 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.044 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.044 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.050 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.050 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.056 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.057 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.063 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.063 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.070 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.070 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.076 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:23.076 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:23.083 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:23.111 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.111 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.148+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 20 realm 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.150+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.151+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.151+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.151+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.151+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.152+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.152+0000 7f96d2122800 20 searching for the correct realm 2024-09-14T11:32:23.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.154+0000 7f96ce5d3640 0 -- 172.21.15.130:0/3318469677 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f96b801dcb0 msgr2=0x7f96b8067ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:23.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.360+0000 7f96ce5d3640 0 -- 172.21.15.130:0/3318469677 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f96b801dcb0 msgr2=0x7f96b8067ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 zone default found 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 4 Realm: () 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:23.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 zonegroup default 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.364+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 started sync module instance, tier type = 2024-09-14T11:32:23.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.365+0000 7f96d2122800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=0 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=1 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=2 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=3 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=4 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=5 2024-09-14T11:32:23.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.374+0000 7f96d2122800 20 add_watcher() i=6 2024-09-14T11:32:23.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.375+0000 7f96d2122800 20 add_watcher() i=7 2024-09-14T11:32:23.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.375+0000 7f96d2122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:23.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f957f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f96d2122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:23.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f96d2122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:23.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f96d2122800 5 note: GC not initialized 2024-09-14T11:32:23.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f957e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:23.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f96d2122800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:23.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.377+0000 7f96d2122800 20 Filter name: none 2024-09-14T11:32:23.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.378+0000 7f94effff640 20 reqs_thread_entry: start 2024-09-14T11:32:23.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.378+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.378+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.378+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.379+0000 7f96d2122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:23.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.381+0000 7f957f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.383+0000 7f96d2122800 20 remove_watcher() i=0 2024-09-14T11:32:23.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.383+0000 7f96d2122800 2 removed watcher, disabling cache 2024-09-14T11:32:23.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.384+0000 7f96d2122800 20 remove_watcher() i=1 2024-09-14T11:32:23.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.385+0000 7f96d2122800 20 remove_watcher() i=2 2024-09-14T11:32:23.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.386+0000 7f96d2122800 20 remove_watcher() i=3 2024-09-14T11:32:23.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.387+0000 7f96d2122800 20 remove_watcher() i=4 2024-09-14T11:32:23.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.388+0000 7f96d2122800 20 remove_watcher() i=5 2024-09-14T11:32:23.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.389+0000 7f96d2122800 20 remove_watcher() i=6 2024-09-14T11:32:23.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.390+0000 7f96d2122800 20 remove_watcher() i=7 2024-09-14T11:32:23.398 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:23.398 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:23.398 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:23.399 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:23.400 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.435 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.474+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 20 realm 2024-09-14T11:32:23.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.475+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.476+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.476+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.476+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.476+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.477+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.477+0000 7ff456b2c800 20 searching for the correct realm 2024-09-14T11:32:23.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.479+0000 7ff452f62640 0 -- 172.21.15.130:0/248207095 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff44806b020 msgr2=0x7ff4480a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:23.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.684+0000 7ff452f62640 0 -- 172.21.15.130:0/248207095 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff44806b020 msgr2=0x7ff4480a43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:23.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:23.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:23.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:23.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.688+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 zone default found 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 4 Realm: () 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:23.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 zonegroup default 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.689+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.690+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.690+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.690+0000 7ff456b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.690+0000 7ff456b2c800 20 started sync module instance, tier type = 2024-09-14T11:32:23.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.690+0000 7ff456b2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=0 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=1 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=2 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=3 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=4 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=5 2024-09-14T11:32:23.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.699+0000 7ff456b2c800 20 add_watcher() i=6 2024-09-14T11:32:23.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.700+0000 7ff456b2c800 20 add_watcher() i=7 2024-09-14T11:32:23.699 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.700+0000 7ff456b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:23.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff3097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff456b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:23.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff456b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:23.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff456b2c800 5 note: GC not initialized 2024-09-14T11:32:23.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff3037fe640 20 reqs_thread_entry: start 2024-09-14T11:32:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff456b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.702+0000 7ff456b2c800 20 Filter name: none 2024-09-14T11:32:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff3017fa640 20 reqs_thread_entry: start 2024-09-14T11:32:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:32:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 : miss 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.703+0000 7ff456b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:23.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:23.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:23.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.704+0000 7ff456b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff456b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff456b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff456b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff456b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34, ofs0, ns] 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff3357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 94320494422768 notifier 6992 bl.length()=995 2024-09-14T11:32:23.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff3357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff3357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.708+0000 7ff3357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.709+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_sources= new_sources= 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.709+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential sources added=[] removed=[] 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.709+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_dests= new_dests= 2024-09-14T11:32:23.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.709+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential dests added=[] removed=[] 2024-09-14T11:32:23.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.714+0000 7ff456b2c800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:32:23.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.720+0000 7ff456b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:23.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.720+0000 7ff456b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 2024-09-14T11:32:23.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34, ofs0, ns] 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff3357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94320494422768 notifier 6992 bl.length()=963 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff3357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff3357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:23.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff3357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_sources= new_sources= 2024-09-14T11:32:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential sources added=[] removed=[] 2024-09-14T11:32:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_dests= new_dests= 2024-09-14T11:32:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential dests added=[] removed=[] 2024-09-14T11:32:23.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.722+0000 7ff456b2c800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:32:23.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.724+0000 7ff3097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:23.724 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.726+0000 7ff456b2c800 20 remove_watcher() i=0 2024-09-14T11:32:23.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.726+0000 7ff456b2c800 2 removed watcher, disabling cache 2024-09-14T11:32:23.725 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.727+0000 7ff456b2c800 20 remove_watcher() i=1 2024-09-14T11:32:23.726 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.728+0000 7ff456b2c800 20 remove_watcher() i=2 2024-09-14T11:32:23.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.729+0000 7ff456b2c800 20 remove_watcher() i=3 2024-09-14T11:32:23.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.730+0000 7ff456b2c800 20 remove_watcher() i=4 2024-09-14T11:32:23.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.731+0000 7ff456b2c800 20 remove_watcher() i=5 2024-09-14T11:32:23.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.732+0000 7ff456b2c800 20 remove_watcher() i=6 2024-09-14T11:32:23.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.733+0000 7ff456b2c800 20 remove_watcher() i=7 2024-09-14T11:32:23.743 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:23.772 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:23.772 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:23.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.810+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 20 realm 2024-09-14T11:32:23.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.811 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:23.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.812+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.813+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:23.812 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.813+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.813+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:23.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.813+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:23.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.814+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:23.813 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.814+0000 7f33de863800 20 searching for the correct realm 2024-09-14T11:32:23.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:23.816+0000 7f33dbb53640 0 -- 172.21.15.130:0/10808123 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f33cc079040 msgr2=0x7f33cc0683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:24.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.022+0000 7f33dc354640 0 -- 172.21.15.130:0/10808123 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f33d405b070 msgr2=0x7f33d40bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:24.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:24.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:24.228 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.228+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 zone default found 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 4 Realm: () 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:24.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 zonegroup default 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 started sync module instance, tier type = 2024-09-14T11:32:24.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.229+0000 7f33de863800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=0 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=1 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=2 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=3 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=4 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=5 2024-09-14T11:32:24.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.238+0000 7f33de863800 20 add_watcher() i=6 2024-09-14T11:32:24.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.239+0000 7f33de863800 20 add_watcher() i=7 2024-09-14T11:32:24.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.239+0000 7f33de863800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:24.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f3292fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f33de863800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:24.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f33de863800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:24.240 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f33de863800 5 note: GC not initialized 2024-09-14T11:32:24.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f3291fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:24.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f33de863800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:24.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.241+0000 7f33de863800 20 Filter name: none 2024-09-14T11:32:24.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.242+0000 7f32037fe640 20 reqs_thread_entry: start 2024-09-14T11:32:24.241 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.242+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.242+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.242+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:24.242 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:24.243 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.243+0000 7f33de863800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:24.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.245+0000 7f3292fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.247+0000 7f33de863800 20 remove_watcher() i=0 2024-09-14T11:32:24.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.247+0000 7f33de863800 2 removed watcher, disabling cache 2024-09-14T11:32:24.247 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.248+0000 7f33de863800 20 remove_watcher() i=1 2024-09-14T11:32:24.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.249+0000 7f33de863800 20 remove_watcher() i=2 2024-09-14T11:32:24.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.250+0000 7f33de863800 20 remove_watcher() i=3 2024-09-14T11:32:24.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.251+0000 7f33de863800 20 remove_watcher() i=4 2024-09-14T11:32:24.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.252+0000 7f33de863800 20 remove_watcher() i=5 2024-09-14T11:32:24.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.253+0000 7f33de863800 20 remove_watcher() i=6 2024-09-14T11:32:24.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.254+0000 7f33de863800 20 remove_watcher() i=7 2024-09-14T11:32:24.263 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:24.263 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:24.263 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:24.263 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:24.265 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.265 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:24.271 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:24.271 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:24.314 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:24.345 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:24.345 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:24.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.383+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.384+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.384+0000 7feda852c800 20 realm 2024-09-14T11:32:24.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.384+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.385+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.386+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:24.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.386+0000 7feda852c800 20 searching for the correct realm 2024-09-14T11:32:24.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.388+0000 7feda493f640 0 -- 172.21.15.130:0/1284837579 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fed8c085040 msgr2=0x7fed8c065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.594+0000 7feda493f640 0 -- 172.21.15.130:0/1284837579 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fed8c085040 msgr2=0x7fed8c065d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.598 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.598+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 zone default found 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 4 Realm: () 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 zonegroup default 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.599 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.599+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.600+0000 7feda852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.600+0000 7feda852c800 20 started sync module instance, tier type = 2024-09-14T11:32:24.600 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.600+0000 7feda852c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:24.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=0 2024-09-14T11:32:24.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=1 2024-09-14T11:32:24.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=2 2024-09-14T11:32:24.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=3 2024-09-14T11:32:24.608 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=4 2024-09-14T11:32:24.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=5 2024-09-14T11:32:24.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.609+0000 7feda852c800 20 add_watcher() i=6 2024-09-14T11:32:24.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.610+0000 7feda852c800 20 add_watcher() i=7 2024-09-14T11:32:24.609 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.610+0000 7feda852c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:24.612 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.612+0000 7fec5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.612+0000 7feda852c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.612+0000 7feda852c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.612+0000 7feda852c800 5 note: GC not initialized 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.612+0000 7fec59fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 20 Filter name: none 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7febcb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 : miss 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.613+0000 7feda852c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.614+0000 7feda852c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7feda852c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7feda852c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7feda852c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7feda852c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34, ofs0, ns] 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7fec7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94006949812640 notifier 7512 bl.length()=995 2024-09-14T11:32:24.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7fec7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7fec7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.618+0000 7fec7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.619+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_sources= new_sources= 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.619+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential sources added=[] removed=[] 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.619+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_dests= new_dests= 2024-09-14T11:32:24.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.619+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential dests added=[] removed=[] 2024-09-14T11:32:24.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.0 2024-09-14T11:32:24.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.0 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.1 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.1 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.2 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.2 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.3 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.3 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.4 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.4 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.5 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.5 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.6 2024-09-14T11:32:24.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.6 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.7 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.7 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.8 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.8 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.9 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.9 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.10 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.10 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.11 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1.11 2024-09-14T11:32:24.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.623+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.0 2024-09-14T11:32:24.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.624+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1 2024-09-14T11:32:24.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.624+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.2 2024-09-14T11:32:24.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.625+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.3 2024-09-14T11:32:24.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.625+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.4 2024-09-14T11:32:24.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.626+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.5 2024-09-14T11:32:24.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.626+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.6 2024-09-14T11:32:24.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.626+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.7 2024-09-14T11:32:24.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.627+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.8 2024-09-14T11:32:24.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.628+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.9 2024-09-14T11:32:24.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.629+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.10 2024-09-14T11:32:24.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.632+0000 7feda852c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:24.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.632+0000 7feda852c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 2024-09-14T11:32:24.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.633+0000 7feda852c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.633+0000 7feda852c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.633+0000 7feda852c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.633+0000 7feda852c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34, ofs0, ns] 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7fec7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94006949812640 notifier 7512 bl.length()=995 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7fec7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7fec7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7fec7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_sources= new_sources= 2024-09-14T11:32:24.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential sources added=[] removed=[] 2024-09-14T11:32:24.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_dests= new_dests= 2024-09-14T11:32:24.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.634+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential dests added=[] removed=[] 2024-09-14T11:32:24.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.637+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.0 2024-09-14T11:32:24.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.637+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.1 2024-09-14T11:32:24.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.637+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.2 2024-09-14T11:32:24.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.638+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.3 2024-09-14T11:32:24.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.638+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.4 2024-09-14T11:32:24.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.638+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.5 2024-09-14T11:32:24.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.638+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.6 2024-09-14T11:32:24.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.639+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.7 2024-09-14T11:32:24.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.639+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.8 2024-09-14T11:32:24.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.640+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.9 2024-09-14T11:32:24.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.640+0000 7feda852c800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.34.10 2024-09-14T11:32:24.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.641+0000 7feda852c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:24.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.641+0000 7feda852c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34, ofs0, ns] 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7fec7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94006949812640 notifier 7512 bl.length()=963 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7fec7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 info.flags=0x17 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7fec7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.34 to cache LRU end 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7fec7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:24.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_sources= new_sources= 2024-09-14T11:32:24.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential sources added=[] removed=[] 2024-09-14T11:32:24.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): orig_dests= new_dests= 2024-09-14T11:32:24.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.642+0000 7feda852c800 20 handle_bi_update(): bucket=:error-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.34]): potential dests added=[] removed=[] 2024-09-14T11:32:24.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.644+0000 7feda852c800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:24.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.646+0000 7fec5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:24.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.648+0000 7feda852c800 20 remove_watcher() i=0 2024-09-14T11:32:24.647 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.648+0000 7feda852c800 2 removed watcher, disabling cache 2024-09-14T11:32:24.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.649+0000 7feda852c800 20 remove_watcher() i=1 2024-09-14T11:32:24.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.650+0000 7feda852c800 20 remove_watcher() i=2 2024-09-14T11:32:24.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.651+0000 7feda852c800 20 remove_watcher() i=3 2024-09-14T11:32:24.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.652+0000 7feda852c800 20 remove_watcher() i=4 2024-09-14T11:32:24.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.653+0000 7feda852c800 20 remove_watcher() i=5 2024-09-14T11:32:24.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.654+0000 7feda852c800 20 remove_watcher() i=6 2024-09-14T11:32:24.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.655+0000 7feda852c800 20 remove_watcher() i=7 2024-09-14T11:32:24.665 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:24.697 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:24.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.920+0000 7fbf7f236640 0 --2- 172.21.15.130:0/770473871 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55edcd1836e0 0x55edcd308200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:32:24.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.939+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 realm 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:24.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.941+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.942+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:24.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.942+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:24.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.943+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:24.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.943+0000 7fbf81f46800 20 searching for the correct realm 2024-09-14T11:32:24.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:24.944+0000 7fbf7fa37640 0 -- 172.21.15.130:0/1552666642 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7fbf78072040 msgr2=0x7fbf78055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.149+0000 7fbf7f236640 0 -- 172.21.15.130:0/1552666642 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fbf70091040 msgr2=0x7fbf70060370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.155+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 zone default found 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 4 Realm: () 2024-09-14T11:32:25.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 zonegroup default 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.156+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 started sync module instance, tier type = 2024-09-14T11:32:25.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.157+0000 7fbf81f46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=0 2024-09-14T11:32:25.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=1 2024-09-14T11:32:25.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=2 2024-09-14T11:32:25.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=3 2024-09-14T11:32:25.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=4 2024-09-14T11:32:25.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=5 2024-09-14T11:32:25.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.166+0000 7fbf81f46800 20 add_watcher() i=6 2024-09-14T11:32:25.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.168+0000 7fbf81f46800 20 add_watcher() i=7 2024-09-14T11:32:25.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.168+0000 7fbf81f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.170+0000 7fbe35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.170+0000 7fbf81f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.170+0000 7fbf81f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.170+0000 7fbf81f46800 5 note: GC not initialized 2024-09-14T11:32:25.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbe34fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbf81f46800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbf81f46800 20 Filter name: none 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbdae7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.171+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.172+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.172+0000 7fbf81f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.172+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.172+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.173+0000 7fbf81f46800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.173+0000 7fbf81f46800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.173+0000 7fbf81f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.174+0000 7fbe35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.176+0000 7fbf81f46800 20 remove_watcher() i=0 2024-09-14T11:32:25.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.176+0000 7fbf81f46800 2 removed watcher, disabling cache 2024-09-14T11:32:25.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.177+0000 7fbf81f46800 20 remove_watcher() i=1 2024-09-14T11:32:25.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.178+0000 7fbf81f46800 20 remove_watcher() i=2 2024-09-14T11:32:25.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.179+0000 7fbf81f46800 20 remove_watcher() i=3 2024-09-14T11:32:25.179 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.180+0000 7fbf81f46800 20 remove_watcher() i=4 2024-09-14T11:32:25.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.181+0000 7fbf81f46800 20 remove_watcher() i=5 2024-09-14T11:32:25.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.182+0000 7fbf81f46800 20 remove_watcher() i=6 2024-09-14T11:32:25.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.183+0000 7fbf81f46800 20 remove_watcher() i=7 2024-09-14T11:32:25.192 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.192 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:25.192 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:25.192 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.194 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.194 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.197 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.197 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.240 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.240 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.269 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:32:25.269 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.270 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.271 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.284 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.284 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.327 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.327 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.335 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.335 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.341 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.341 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.348 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.348 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.354 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.354 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.360 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.361 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.367 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.367 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.373 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.373 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.380 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.380 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.386 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.387 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.393 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.393 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.399 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.399 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.406 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.406 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.413 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.413 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.419 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.419 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.426 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.426 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.433 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.433 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.440 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.440 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.447 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.447 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.453 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:25.453 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:25.460 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:25.489 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:25.489 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:25.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.527+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 realm 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.529+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.530+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.530+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.530+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.530+0000 7fb09f498800 20 searching for the correct realm 2024-09-14T11:32:25.532 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.533+0000 7fb09d783640 0 -- 172.21.15.130:0/3299659817 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb084037070 msgr2=0x7fb0840678c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.536+0000 7fb09d783640 0 -- 172.21.15.130:0/3299659817 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7faf680878d0 msgr2=0x7faf68089d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.540+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 zone default found 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 4 Realm: () 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 zonegroup default 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 started sync module instance, tier type = 2024-09-14T11:32:25.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.541+0000 7fb09f498800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=0 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=1 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=2 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=3 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=4 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=5 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.553+0000 7fb09f498800 20 add_watcher() i=6 2024-09-14T11:32:25.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.554+0000 7fb09f498800 20 add_watcher() i=7 2024-09-14T11:32:25.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.554+0000 7fb09f498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7faf52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 5 note: GC not initialized 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7faf51fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 20 Filter name: none 2024-09-14T11:32:25.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7faec37fe640 20 reqs_thread_entry: start 2024-09-14T11:32:25.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.556+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.557+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.557+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.558+0000 7fb09f498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.560+0000 7faf52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.562+0000 7fb09f498800 20 remove_watcher() i=0 2024-09-14T11:32:25.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.562+0000 7fb09f498800 2 removed watcher, disabling cache 2024-09-14T11:32:25.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.563+0000 7fb09f498800 20 remove_watcher() i=1 2024-09-14T11:32:25.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.564+0000 7fb09f498800 20 remove_watcher() i=2 2024-09-14T11:32:25.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.566+0000 7fb09f498800 20 remove_watcher() i=3 2024-09-14T11:32:25.565 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.566+0000 7fb09f498800 20 remove_watcher() i=4 2024-09-14T11:32:25.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.567+0000 7fb09f498800 20 remove_watcher() i=5 2024-09-14T11:32:25.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.568+0000 7fb09f498800 20 remove_watcher() i=6 2024-09-14T11:32:25.568 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.569+0000 7fb09f498800 20 remove_watcher() i=7 2024-09-14T11:32:25.578 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:25.578 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:25.578 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.579 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:32:25.613 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:25.613 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:25.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.651+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 20 realm 2024-09-14T11:32:25.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.652 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.655+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.655+0000 7f4d9f173800 20 searching for the correct realm 2024-09-14T11:32:25.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.656+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x56297b4c3c20 msgr2=0x56297b4c60e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.658+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6816/3369137395,v1:172.21.15.130:6817/3369137395] conn(0x56297b4b7610 msgr2=0x56297b4b9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zone default found 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Realm: () 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zonegroup default 2024-09-14T11:32:25.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started sync module instance, tier type = 2024-09-14T11:32:25.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=0 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=1 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=2 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=3 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=4 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=5 2024-09-14T11:32:25.674 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=6 2024-09-14T11:32:25.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.676+0000 7f4d9f173800 20 add_watcher() i=7 2024-09-14T11:32:25.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.676+0000 7f4d9f173800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.677+0000 7f4c4eff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.677+0000 7f4d9f173800 5 note: GC not initialized 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4c4dff3640 20 reqs_thread_entry: start 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 20 Filter name: none 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4c46ffd640 20 reqs_thread_entry: start 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:25.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : miss 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.679+0000 7f4d9f173800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:25.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94736162196624 notifier 7076 bl.length()=995 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:25.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:25.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:25.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:25.688 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d9f173800 time 2024-09-14T11:32:25.691461+0000 2024-09-14T11:32:25.688 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.689 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.689 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4da278c76a] 2024-09-14T11:32:25.689 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.689 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.690 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.690 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:32:25.690 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.690 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:32:25.690 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:32:25.691 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d9f173800 time 2024-09-14T11:32:25.691461+0000 2024-09-14T11:32:25.691 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.691 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.691 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.691 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4da278c76a] 2024-09-14T11:32:25.692 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.692 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.692 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.692 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:25.693 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f4d9f173800 thread_name:radosgw-admin 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4da143e6f0] 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4da148b99c] 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:25.711 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4da278c7c4] 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f4d9f173800 thread_name:radosgw-admin 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.712 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4da143e6f0] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4da148b99c] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4da278c7c4] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:32:25.713 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b2802a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b280be0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b31ca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.120432s 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b2802a0 auth_method 0 2024-09-14T11:32:25.714 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b31ca10 auth_method 0 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.715 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b280be0 auth_method 0 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.716 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_done global_id 7067 payload 824 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: dump: 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.717 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: dump: 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.718 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:32:25.637+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7067 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.719 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:32:25.637+0000 7f4c8ae0d640 4 set_mon_vals no callback set 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:32:25.637+0000 7f4d9f173800 1 librados: init done 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:32:25.639+0000 7f4d9445c640 10 monclient: get_auth_request con 0x7f4c84077230 auth_method 0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:32:25.639+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b3fc3c0 auth_method 0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:32:25.640+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b41f030 auth_method 0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:32:25.641+0000 7f4d9445c640 10 monclient: get_auth_request con 0x56297b4232b0 auth_method 0 2024-09-14T11:32:25.720 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:32:25.642+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.721 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.722 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:32:25.642+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command objecter_requests cmddesc objecter_requests hook 0x56297b42bbb0 EEXIST 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.723 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:32:25.642+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:32:25.643+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:32:25.643+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x56297b426990 EEXIST 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b44f8a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b451b70 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.724 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b44e070 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.127286s 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b44e070 auth_method 0 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b451b70 auth_method 0 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.725 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b44f8a0 auth_method 0 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_done global_id 7070 payload 824 2024-09-14T11:32:25.726 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: dump: 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.727 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: dump: 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.728 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:32:25.643+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7070 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:32:25.643+0000 7f4d9dc5f640 4 set_mon_vals no callback set 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:32:25.644+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:32:25.644+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.729 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:32:25.645+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4c74077140 auth_method 0 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: get_monmap_and_config 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:32:25.646+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.730 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.731 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.732 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x7ffd3ad33098 EEXIST 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:25.733 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b4a3c30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b49f5a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.130987s 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.734 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.735 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:32:25.647+0000 7f4d9445c640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: dump: 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.736 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:32:25.647+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7560 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:32:25.647+0000 7f4d9f173800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:32:25.647+0000 7f4d9f173800 4 set_mon_vals no callback set 2024-09-14T11:32:25.737 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: dump: 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: shutdown 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.738 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.739 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.740 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:32:25.648+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: starting msgr at 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: starting objecter 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command objecter_requests cmddesc objecter_requests hook 0x56297b473ef0 EEXIST 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: setting wanted keys 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: calling monclient init 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.741 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.742 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:32:25.648+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:32:25.649+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x56297b467798 EEXIST 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b49f5a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b4a3c30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.743 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.133200s 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.744 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:32:25.649+0000 7f4d9445c640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.745 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7076 2024-09-14T11:32:25.746 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.747 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:32:25.649+0000 7f4c73fff640 4 set_mon_vals no callback set 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:32:25.649+0000 7f4d9f173800 1 librados: init done 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cr dump hook 0x56297b491fe8 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.b con 0x56297b4a3c30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.c con 0x7f4c68004c20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.748 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x7f4c68004c20 auth_method 0 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.749 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7076 payload 293 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:32:25.650+0000 7f4d9445c640 1 monclient: found mon.c 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.750 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.751 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:32:25.651+0000 7f4c737fe640 4 set_mon_vals no callback set 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:32:25.651+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:32:25.653+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:32:25.653+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4b7610 auth_method 0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 realm 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.752 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:32:25.653+0000 7f4d9f173800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:32:25.654+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b4bb670 auth_method 0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:32:25.655+0000 7f4d9445c640 10 monclient: get_auth_request con 0x56297b4beed0 auth_method 0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:32:25.655+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:32:25.655+0000 7f4d9f173800 20 searching for the correct realm 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:32:25.655+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4c3c20 auth_method 0 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:32:25.656+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x56297b4c3c20 msgr2=0x56297b4c60e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:32:25.656+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x56297b4c3c20 session 0x56297b4c35a0 osd.3 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:32:25.656+0000 7f4c727fc640 10 monclient: _renew_subs 2024-09-14T11:32:25.753 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:32:25.656+0000 7f4c727fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:32:25.656+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4d9802e070 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:32:25.656+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x7f4c6808f380 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:32:25.657+0000 7f4d9445c640 10 monclient: get_auth_request con 0x7f4d8c0a6c20 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:32:25.657+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x7f4d84047070 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:32:25.658+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6816/3369137395,v1:172.21.15.130:6817/3369137395] conn(0x56297b4b7610 msgr2=0x56297b4b9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:32:25.658+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x56297b4b7610 session 0x56297b4b6f90 osd.1 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:32:25.659+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4c3c20 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:32:25.660+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4d98025040 auth_method 0 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.754 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zone default found 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Realm: () 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:32:25.665+0000 7f4d9f173800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zonegroup default 2024-09-14T11:32:25.755 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started sync module instance, tier type = 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=0 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=1 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=2 2024-09-14T11:32:25.756 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=3 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=4 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=5 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=6 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:32:25.676+0000 7f4d9f173800 20 add_watcher() i=7 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:32:25.676+0000 7f4d9f173800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.757 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:32:25.677+0000 7f4c4eff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:32:25.677+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache list hook 0x56297b49bfd0 2024-09-14T11:32:25.758 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache inspect hook 0x56297b49bfd0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache erase hook 0x56297b49bfd0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache zap hook 0x56297b49bfd0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 note: GC not initialized 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:32:25.678+0000 7f4c4dff3640 20 reqs_thread_entry: start 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace show hook 0x7f4d8400c5f0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace history hook 0x7f4d8400c5f0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace active hook 0x7f4d8400c5f0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace active_short hook 0x7f4d8400c5f0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 Filter name: none 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:32:25.678+0000 7f4c46ffd640 20 reqs_thread_entry: start 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.759 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : miss 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:32:25.679+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.760 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94736162196624 notifier 7076 bl.length()=995 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:32:25.685+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x7f4c6808f380 session 0x56297b4c35a0 osd.3 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:32:25.685+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4b7610 auth_method 0 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d9f173800 time 2024-09-14T11:32:25.691461+0000 2024-09-14T11:32:25.761 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4da278c76a] 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.762 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f4d9f173800 thread_name:radosgw-admin 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4da143e6f0] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4da148b99c] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4da278c7c4] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:32:25.763 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:25.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:32:25.765 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:32:25.766 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:25.767 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:32:25.768 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:25.769 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:25.770 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c46ffd640 / http_manager 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c4dff3640 / http_manager 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c4eff5640 / rgw_dt_lg_renew 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c727fc640 / ms_dispatch 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c737fe640 / io_context_pool 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c73fff640 / io_context_pool 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c827fc640 / ms_dispatch 2024-09-14T11:32:25.771 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c8960a640 / ms_dispatch 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c8ae0d640 / io_context_pool 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9445c640 / msgr-worker-2 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9cc5d640 / msgr-worker-1 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9d45e640 / msgr-worker-0 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9dc5f640 / io_context_pool 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9f173800 / radosgw-admin 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.128081.log 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b2802a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.772 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b280be0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b31ca10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:32:25.636+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.120432s 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b2802a0 auth_method 0 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b31ca10 auth_method 0 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.773 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b280be0 auth_method 0 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:32:25.636+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:32:25.636+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_done global_id 7067 payload 824 2024-09-14T11:32:25.774 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:32:25.636+0000 7f4d9cc5d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: dump: 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.775 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:32:25.637+0000 7f4c8960a640 10 monclient: dump: 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.776 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:32:25.637+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7067 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:32:25.637+0000 7f4c8ae0d640 4 set_mon_vals no callback set 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:32:25.637+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:32:25.637+0000 7f4d9f173800 1 librados: init done 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:32:25.639+0000 7f4c8960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:32:25.639+0000 7f4d9445c640 10 monclient: get_auth_request con 0x7f4c84077230 auth_method 0 2024-09-14T11:32:25.777 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:32:25.639+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b3fc3c0 auth_method 0 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:32:25.640+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b41f030 auth_method 0 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:32:25.641+0000 7f4d9445c640 10 monclient: get_auth_request con 0x56297b4232b0 auth_method 0 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:32:25.642+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.778 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding auth protocol: cephx 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.779 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: crc 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b428120) adding con mode: secure 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:32:25.642+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command objecter_requests cmddesc objecter_requests hook 0x56297b42bbb0 EEXIST 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:32:25.642+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding auth protocol: cephx 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.780 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: crc 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:32:25.642+0000 7f4d9f173800 5 AuthRegistry(0x56297b426848) adding con mode: secure 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:32:25.642+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:32:25.643+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:32:25.643+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x56297b426990 EEXIST 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.781 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b44f8a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b451b70 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b44e070 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.127286s 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b44e070 auth_method 0 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b451b70 auth_method 0 2024-09-14T11:32:25.782 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:32:25.643+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b44f8a0 auth_method 0 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:32:25.643+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_done global_id 7070 payload 824 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.783 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:32:25.643+0000 7f4d9d45e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: dump: 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.784 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:32:25.643+0000 7f4c827fc640 10 monclient: dump: 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.785 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:32:25.643+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7070 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:32:25.643+0000 7f4d9dc5f640 4 set_mon_vals no callback set 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:32:25.643+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:32:25.644+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:32:25.644+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:32:25.645+0000 7f4c827fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.786 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:32:25.645+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4c74077140 auth_method 0 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: get_monmap_and_config 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:32:25.646+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.787 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding auth protocol: cephx 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: crc 2024-09-14T11:32:25.788 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x56297b46f670) adding con mode: secure 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding auth protocol: cephx 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.789 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: crc 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad32f50) adding con mode: secure 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:32:25.646+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:32:25.646+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x7ffd3ad33098 EEXIST 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b4a3c30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b49f5a0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.790 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:32:25.646+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.130987s 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.791 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:32:25.647+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:32:25.647+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.792 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:32:25.647+0000 7f4d9445c640 1 monclient: found mon.noname-a 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:32:25.647+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: dump: 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.793 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:32:25.647+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7560 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:32:25.647+0000 7f4d9f173800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:32:25.647+0000 7f4d9f173800 4 set_mon_vals no callback set 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:32:25.647+0000 7f4c73fff640 10 monclient: dump: 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.794 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: shutdown 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: build_initial_monmap 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 build_initial for_mkfs: 0 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: monmap: 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:25.795 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding auth protocol: cephx 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.796 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: crc 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b4743c0) adding con mode: secure 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:32:25.648+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: starting msgr at 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: starting objecter 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command objecter_requests cmddesc objecter_requests hook 0x56297b473ef0 EEXIST 2024-09-14T11:32:25.797 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: setting wanted keys 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:32:25.648+0000 7f4d9f173800 1 librados: calling monclient init 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:32:25.648+0000 7f4d9f173800 10 monclient: init 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding auth protocol: cephx 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.798 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: crc 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:32:25.648+0000 7f4d9f173800 5 AuthRegistry(0x56297b467650) adding con mode: secure 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:32:25.648+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:32:25.649+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command rotate-key cmddesc rotate-key hook 0x56297b467798 EEXIST 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-c con 0x56297b49f5a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): picked mon.noname-b con 0x56297b4a3c30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.799 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient(hunting): authenticate will time out at 2062.133200s 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.800 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:32:25.649+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:32:25.649+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.801 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:32:25.649+0000 7f4d9445c640 1 monclient: found mon.noname-c 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:32:25.649+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.802 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 monclient: authenticate success, global_id 7076 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:32:25.649+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.803 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:32:25.649+0000 7f4c73fff640 4 set_mon_vals no callback set 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _renew_subs 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:32:25.649+0000 7f4d9f173800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:32:25.649+0000 7f4d9f173800 1 librados: init done 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:32:25.649+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cr dump hook 0x56297b491fe8 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.b con 0x56297b4a3c30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:25.804 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.c con 0x7f4c68004c20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): picked mon.a con 0x56297b474d10 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:32:25.650+0000 7f4c727fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): get_auth_request con 0x7f4c68004c20 auth_method 0 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request con 0x56297b474d10 auth_method 0 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.805 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request con 0x56297b4a3c30 auth_method 0 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:32:25.650+0000 7f4d9d45e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:32:25.650+0000 7f4d9cc5d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient(hunting): handle_auth_done global_id 7076 payload 293 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _finish_hunting 0 2024-09-14T11:32:25.806 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:32:25.650+0000 7f4d9445c640 1 monclient: found mon.c 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _finish_auth 0 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:32:25.650+0000 7f4d9445c640 10 monclient: _check_auth_tickets 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: dump: 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:25.807 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:32:25.651+0000 7f4c727fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:32:25.651+0000 7f4c737fe640 4 set_mon_vals no callback set 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:32:25.651+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:32:25.652+0000 7f4c727fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:32:25.653+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b49f5a0 auth_method 0 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:32:25.653+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4b7610 auth_method 0 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 realm 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.808 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:32:25.653+0000 7f4d9f173800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:32:25.653+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:32:25.654+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x56297b4bb670 auth_method 0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:32:25.654+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:32:25.655+0000 7f4d9445c640 10 monclient: get_auth_request con 0x56297b4beed0 auth_method 0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:32:25.655+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:32:25.655+0000 7f4d9f173800 20 searching for the correct realm 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:32:25.655+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4c3c20 auth_method 0 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:32:25.656+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6800/4189242858,v1:172.21.15.130:6801/4189242858] conn(0x56297b4c3c20 msgr2=0x56297b4c60e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:32:25.656+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x56297b4c3c20 session 0x56297b4c35a0 osd.3 2024-09-14T11:32:25.809 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:32:25.656+0000 7f4c727fc640 10 monclient: _renew_subs 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:32:25.656+0000 7f4c727fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:32:25.656+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4d9802e070 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:32:25.656+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x7f4c6808f380 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:32:25.657+0000 7f4d9445c640 10 monclient: get_auth_request con 0x7f4d8c0a6c20 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:32:25.657+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x7f4d84047070 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:32:25.658+0000 7f4d9d45e640 0 -- 172.21.15.130:0/3575144512 >> [v2:172.21.15.130:6816/3369137395,v1:172.21.15.130:6817/3369137395] conn(0x56297b4b7610 msgr2=0x56297b4b9a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:32:25.658+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x56297b4b7610 session 0x56297b4b6f90 osd.1 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:32:25.659+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4c3c20 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:32:25.660+0000 7f4d9cc5d640 10 monclient: get_auth_request con 0x7f4d98025040 auth_method 0 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.810 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zone default found 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Realm: () 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:32:25.665+0000 7f4d9f173800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:32:25.665+0000 7f4d9f173800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 zonegroup default 2024-09-14T11:32:25.811 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:32:25.665+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started sync module instance, tier type = 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:32:25.666+0000 7f4d9f173800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=0 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=1 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=2 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=3 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=4 2024-09-14T11:32:25.812 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=5 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:32:25.675+0000 7f4d9f173800 20 add_watcher() i=6 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:32:25.676+0000 7f4d9f173800 20 add_watcher() i=7 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:32:25.676+0000 7f4d9f173800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding auth protocol: cephx 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.813 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: crc 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 AuthRegistry(0x7ffd3ad33430) adding con mode: secure 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:32:25.677+0000 7f4c4eff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:32:25.677+0000 7f4d9f173800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:32:25.677+0000 7f4d9f173800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache list hook 0x56297b49bfd0 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache inspect hook 0x56297b49bfd0 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache erase hook 0x56297b49bfd0 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command cache zap hook 0x56297b49bfd0 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:32:25.677+0000 7f4d9f173800 5 note: GC not initialized 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:32:25.678+0000 7f4c4dff3640 20 reqs_thread_entry: start 2024-09-14T11:32:25.814 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace show hook 0x7f4d8400c5f0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace history hook 0x7f4d8400c5f0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace active hook 0x7f4d8400c5f0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:32:25.678+0000 7f4d9f173800 5 asok(0x56297b1b3270) register_command sync trace active_short hook 0x7f4d8400c5f0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 Filter name: none 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:32:25.678+0000 7f4c46ffd640 20 reqs_thread_entry: start 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:32:25.678+0000 7f4d9f173800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : miss 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:32:25.678+0000 7f4d9f173800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.815 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:32:25.679+0000 7f4d9f173800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:32:25.679+0000 7f4d9f173800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:32:25.684+0000 7f4d9f173800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94736162196624 notifier 7076 bl.length()=995 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:32:25.684+0000 7f4c737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:25.816 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:32:25.684+0000 7f4d9f173800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:32:25.685+0000 7f4c727fc640 1 client.7076.objecter ms_handle_reset 0x7f4c6808f380 session 0x56297b4c35a0 osd.3 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:32:25.685+0000 7f4d9d45e640 10 monclient: get_auth_request con 0x56297b4b7610 auth_method 0 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4d9f173800 time 2024-09-14T11:32:25.691461+0000 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4da278c76a] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.817 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:32:25.691+0000 7f4d9f173800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f4d9f173800 thread_name:radosgw-admin 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4da143e6f0] 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4da148b99c] 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4da278c7c4] 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f4da278c928] 2024-09-14T11:32:25.818 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5629798880b1] 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x562979897f6a] 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f4da1429590] 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:32:25.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:32:25.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:32:25.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:32:25.822 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:32:25.823 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:32:25.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:32:25.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c46ffd640 / http_manager 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c4dff3640 / http_manager 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c4eff5640 / rgw_dt_lg_renew 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c727fc640 / ms_dispatch 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c737fe640 / io_context_pool 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c73fff640 / io_context_pool 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c827fc640 / ms_dispatch 2024-09-14T11:32:25.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c8960a640 / ms_dispatch 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4c8ae0d640 / io_context_pool 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9445c640 / msgr-worker-2 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9cc5d640 / msgr-worker-1 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9d45e640 / msgr-worker-0 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9dc5f640 / io_context_pool 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f4d9f173800 / radosgw-admin 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:25.692880Z_0948d8f5-15b4-4b20-b480-c80519cd191a/log 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:32:25.827 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:25.828 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.766+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.767+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.767+0000 7f455490c800 20 realm 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.767+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.767+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.767+0000 7f455490c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.768+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.768+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.768+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.768+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.768+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.769+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:25.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.769+0000 7f455490c800 20 searching for the correct realm 2024-09-14T11:32:25.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.771+0000 7f4552bfe640 0 -- 172.21.15.130:0/2523053317 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4548077040 msgr2=0x7f4548067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.977+0000 7f4552bfe640 0 -- 172.21.15.130:0/2523053317 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4548077040 msgr2=0x7f4548067440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:25.979 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.980 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.980+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 zone default found 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 4 Realm: () 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:25.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 zonegroup default 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.981+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.982+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.982+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.982+0000 7f455490c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.982+0000 7f455490c800 20 started sync module instance, tier type = 2024-09-14T11:32:25.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.982+0000 7f455490c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:25.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=0 2024-09-14T11:32:25.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=1 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=2 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=3 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=4 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=5 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.991+0000 7f455490c800 20 add_watcher() i=6 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.992+0000 7f455490c800 20 add_watcher() i=7 2024-09-14T11:32:25.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.992+0000 7f455490c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:25.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.993+0000 7f4408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:25.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:25.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 5 note: GC not initialized 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f43837fe640 20 reqs_thread_entry: start 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 20 Filter name: none 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f43817fa640 20 reqs_thread_entry: start 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.994+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.995+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.994 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.995+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.995+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.995+0000 7f455490c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.995+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.996+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.996+0000 7f455490c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.996+0000 7f455490c800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:25.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.996+0000 7f455490c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:25.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:25.998+0000 7f4408fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:25.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.000+0000 7f455490c800 20 remove_watcher() i=0 2024-09-14T11:32:25.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.000+0000 7f455490c800 2 removed watcher, disabling cache 2024-09-14T11:32:25.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.001+0000 7f455490c800 20 remove_watcher() i=1 2024-09-14T11:32:26.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.002+0000 7f455490c800 20 remove_watcher() i=2 2024-09-14T11:32:26.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.003+0000 7f455490c800 20 remove_watcher() i=3 2024-09-14T11:32:26.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.004+0000 7f455490c800 20 remove_watcher() i=4 2024-09-14T11:32:26.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.005+0000 7f455490c800 20 remove_watcher() i=5 2024-09-14T11:32:26.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.006+0000 7f455490c800 20 remove_watcher() i=6 2024-09-14T11:32:26.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.006+0000 7f455490c800 20 remove_watcher() i=7 2024-09-14T11:32:26.015 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:26.015 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:26.016 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:26.016 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:26.017 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:26.017 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:26.024 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:26.024 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:26.067 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:26.100 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:26.101 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:26.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.138+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 realm 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.140+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.141+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:26.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.141+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.142+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:26.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.142+0000 7f2c02663800 20 searching for the correct realm 2024-09-14T11:32:26.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.144+0000 7f2c00955640 0 -- 172.21.15.130:0/2415628059 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2be801b040 msgr2=0x7f2be80768b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:26.349 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.350+0000 7f2c00955640 0 -- 172.21.15.130:0/2415628059 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2be801b040 msgr2=0x7f2be80768b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:26.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.354+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 20 zone default found 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 4 Realm: () 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:26.355 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 20 zonegroup default 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.355+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.356+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.356+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.356+0000 7f2c02663800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.356+0000 7f2c02663800 20 started sync module instance, tier type = 2024-09-14T11:32:26.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.356+0000 7f2c02663800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=0 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=1 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=2 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=3 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=4 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=5 2024-09-14T11:32:26.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.364+0000 7f2c02663800 20 add_watcher() i=6 2024-09-14T11:32:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.365+0000 7f2c02663800 20 add_watcher() i=7 2024-09-14T11:32:26.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.365+0000 7f2c02663800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.367+0000 7f2ab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:26.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.367+0000 7f2c02663800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.367+0000 7f2c02663800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.367+0000 7f2c02663800 5 note: GC not initialized 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.367+0000 7f2ab5fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 20 Filter name: none 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2a277fe640 20 reqs_thread_entry: start 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:26.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:26.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:26.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:26.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : miss 2024-09-14T11:32:26.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.368+0000 7f2c02663800 20 rados->read ofs=0 len=0 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.369+0000 7f2c02663800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:26.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.370+0000 7f2c02663800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to be held by another RGW process; skipping for now 2024-09-14T11:32:26.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.371+0000 7f2ab6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:26.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.373+0000 7f2c02663800 20 remove_watcher() i=0 2024-09-14T11:32:26.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.373+0000 7f2c02663800 2 removed watcher, disabling cache 2024-09-14T11:32:26.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.374+0000 7f2c02663800 20 remove_watcher() i=1 2024-09-14T11:32:26.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.374+0000 7f2c02663800 20 remove_watcher() i=2 2024-09-14T11:32:26.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.375+0000 7f2c02663800 20 remove_watcher() i=3 2024-09-14T11:32:26.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.376+0000 7f2c02663800 20 remove_watcher() i=4 2024-09-14T11:32:26.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.377+0000 7f2c02663800 20 remove_watcher() i=5 2024-09-14T11:32:26.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.378+0000 7f2c02663800 20 remove_watcher() i=6 2024-09-14T11:32:26.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:26.379+0000 7f2c02663800 20 remove_watcher() i=7 2024-09-14T11:32:26.388 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:32:56.398 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:56.434 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:56.435 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:56.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.478+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.479+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.479+0000 7faad6c20800 20 realm 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.479+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.480+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.480+0000 7faad6c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.480+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.480+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.480+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.481+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.481+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.482+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:56.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.482+0000 7faad6c20800 20 searching for the correct realm 2024-09-14T11:32:56.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.484+0000 7faad3f09640 0 -- 172.21.15.130:0/2767017957 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7faac4083890 msgr2=0x7faac40887a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:56.689 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.690+0000 7faad470a640 0 -- 172.21.15.130:0/2767017957 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7faacc066020 msgr2=0x7faacc06a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:56.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:56.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:56.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.899+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 zone default found 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 4 Realm: () 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:56.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 zonegroup default 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.900+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.901+0000 7faad6c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.901+0000 7faad6c20800 20 started sync module instance, tier type = 2024-09-14T11:32:56.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.901+0000 7faad6c20800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=0 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=1 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=2 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=3 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=4 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=5 2024-09-14T11:32:56.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.911+0000 7faad6c20800 20 add_watcher() i=6 2024-09-14T11:32:56.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.912+0000 7faad6c20800 20 add_watcher() i=7 2024-09-14T11:32:56.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.912+0000 7faad6c20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:56.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.914+0000 7fa98afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7faad6c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7faad6c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7faad6c20800 5 note: GC not initialized 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7fa989fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7faad6c20800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:56.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7faad6c20800 20 Filter name: none 2024-09-14T11:32:56.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.915+0000 7fa8fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:56.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:32:56.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:56.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : miss 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.916+0000 7faad6c20800 20 rados->read ofs=0 len=0 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.917+0000 7faad6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:56.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.918+0000 7faad6c20800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:32:56.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7faad6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7faad6c20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7faad6c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7faad6c20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7fa9aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94188763781920 notifier 7130 bl.length()=995 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7fa9aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7fa9aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.926+0000 7fa9aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.927+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:56.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.927+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:56.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.927+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:56.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.927+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.0 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.0 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.1 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.1 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.2 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.2 2024-09-14T11:32:56.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.3 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.3 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.4 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.4 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.5 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.5 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.6 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.6 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.7 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.7 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.8 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.8 2024-09-14T11:32:56.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.9 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.9 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.10 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.10 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.11 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2.11 2024-09-14T11:32:56.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.933+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.0 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.934+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.1 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.934+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.935+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.3 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.935+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.4 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.936+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.5 2024-09-14T11:32:56.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.936+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.6 2024-09-14T11:32:56.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.937+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.7 2024-09-14T11:32:56.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.938+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.8 2024-09-14T11:32:56.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.938+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.9 2024-09-14T11:32:56.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.939+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.10 2024-09-14T11:32:56.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.944+0000 7faad6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:56.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.944+0000 7faad6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:56.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.945+0000 7faad6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.945+0000 7faad6c20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.945+0000 7faad6c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.945+0000 7faad6c20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7fa9ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94188763781920 notifier 7130 bl.length()=995 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7fa9ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7fa9ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7fa9ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:56.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.946+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:56.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.949+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.0 2024-09-14T11:32:56.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.950+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.1 2024-09-14T11:32:56.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.950+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.2 2024-09-14T11:32:56.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.950+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.3 2024-09-14T11:32:56.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.950+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.4 2024-09-14T11:32:56.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.951+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.5 2024-09-14T11:32:56.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.951+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.6 2024-09-14T11:32:56.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.952+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.7 2024-09-14T11:32:56.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.952+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.8 2024-09-14T11:32:56.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.952+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.9 2024-09-14T11:32:56.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.952+0000 7faad6c20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.35.10 2024-09-14T11:32:56.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.953+0000 7faad6c20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:56.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.953+0000 7faad6c20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 2024-09-14T11:32:56.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35, ofs0, ns] 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7fa9aaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94188763781920 notifier 7130 bl.length()=963 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7fa9aaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 info.flags=0x17 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7fa9aaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:a588039c-1457-497f-adbd-8890a12279b7.4508.35 to cache LRU end 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7fa9aaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_sources= new_sources= 2024-09-14T11:32:56.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential sources added=[] removed=[] 2024-09-14T11:32:56.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): orig_dests= new_dests= 2024-09-14T11:32:56.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.955+0000 7faad6c20800 20 handle_bi_update(): bucket=:abort-at-do-reshard[a588039c-1457-497f-adbd-8890a12279b7.4508.35]): potential dests added=[] removed=[] 2024-09-14T11:32:56.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.958+0000 7faad6c20800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:56.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.960+0000 7fa98afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:56.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.962+0000 7faad6c20800 20 remove_watcher() i=0 2024-09-14T11:32:56.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.962+0000 7faad6c20800 2 removed watcher, disabling cache 2024-09-14T11:32:56.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.963+0000 7faad6c20800 20 remove_watcher() i=1 2024-09-14T11:32:56.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.965+0000 7faad6c20800 20 remove_watcher() i=2 2024-09-14T11:32:56.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.966+0000 7faad6c20800 20 remove_watcher() i=3 2024-09-14T11:32:56.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.967+0000 7faad6c20800 20 remove_watcher() i=4 2024-09-14T11:32:56.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.968+0000 7faad6c20800 20 remove_watcher() i=5 2024-09-14T11:32:56.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.969+0000 7faad6c20800 20 remove_watcher() i=6 2024-09-14T11:32:56.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:56.970+0000 7faad6c20800 20 remove_watcher() i=7 2024-09-14T11:32:56.981 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:32:57.012 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.012 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.051+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 realm 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.053+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.052 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.054+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.054+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.055+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.055+0000 7ff49b7af800 20 searching for the correct realm 2024-09-14T11:32:57.056 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.058+0000 7ff499299640 0 -- 172.21.15.130:0/783666059 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7ff49406b5a0 msgr2=0x7ff494060d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.062+0000 7ff499299640 0 -- 172.21.15.130:0/783666059 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7ff3640878d0 msgr2=0x7ff364089d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.065 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.065+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 zone default found 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 4 Realm: () 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 zonegroup default 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 started sync module instance, tier type = 2024-09-14T11:32:57.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.066+0000 7ff49b7af800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:57.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=0 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=1 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=2 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=3 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=4 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=5 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.075+0000 7ff49b7af800 20 add_watcher() i=6 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.076+0000 7ff49b7af800 20 add_watcher() i=7 2024-09-14T11:32:57.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.076+0000 7ff49b7af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.077+0000 7ff34f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.077+0000 7ff49b7af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.077+0000 7ff49b7af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.077+0000 7ff49b7af800 5 note: GC not initialized 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff34e7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff49b7af800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff49b7af800 20 Filter name: none 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff2bffff640 20 reqs_thread_entry: start 2024-09-14T11:32:57.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.078+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.079+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.079+0000 7ff49b7af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.079+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.079+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:32:57.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.079+0000 7ff49b7af800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.080+0000 7ff49b7af800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:32:57.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.080+0000 7ff49b7af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.081+0000 7ff34f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.083+0000 7ff49b7af800 20 remove_watcher() i=0 2024-09-14T11:32:57.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.083+0000 7ff49b7af800 2 removed watcher, disabling cache 2024-09-14T11:32:57.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.084+0000 7ff49b7af800 20 remove_watcher() i=1 2024-09-14T11:32:57.084 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.085+0000 7ff49b7af800 20 remove_watcher() i=2 2024-09-14T11:32:57.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.086+0000 7ff49b7af800 20 remove_watcher() i=3 2024-09-14T11:32:57.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.087+0000 7ff49b7af800 20 remove_watcher() i=4 2024-09-14T11:32:57.086 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.088+0000 7ff49b7af800 20 remove_watcher() i=5 2024-09-14T11:32:57.087 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.089+0000 7ff49b7af800 20 remove_watcher() i=6 2024-09-14T11:32:57.088 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.090+0000 7ff49b7af800 20 remove_watcher() i=7 2024-09-14T11:32:57.099 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:57.099 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:57.099 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-do-reshard id: a588039c-1457-497f-adbd-8890a12279b7.4508.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:57.099 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:57.100 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.101 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.104 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.104 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.147 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.147 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.173 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:32:57.174 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:57.175 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.175 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.186 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.186 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.229 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.229 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.236 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.236 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.243 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.243 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.250 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.250 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.255 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.255 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.262 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.262 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.268 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.268 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.275 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.275 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.282 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.282 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.289 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.289 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.296 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.296 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.302 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.302 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.309 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.309 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.315 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.315 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.322 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.322 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.328 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.329 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.335 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.335 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.341 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.341 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.347 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.347 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.354 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:57.354 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:57.361 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:57.389 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.389 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.427+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.428+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.428+0000 7f9396726800 20 realm 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.428+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.429+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.430+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.430+0000 7f9396726800 20 searching for the correct realm 2024-09-14T11:32:57.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.432+0000 7f9392b0a640 0 -- 172.21.15.130:0/3916135628 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f937c04ab70 msgr2=0x7f937c042410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:57.636 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.637+0000 7f9392b0a640 0 -- 172.21.15.130:0/3916135628 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f937c04ab70 msgr2=0x7f937c042410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.641+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 zone default found 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 4 Realm: () 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 zonegroup default 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.642+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.643+0000 7f9396726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.643+0000 7f9396726800 20 started sync module instance, tier type = 2024-09-14T11:32:57.643 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.643+0000 7f9396726800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=0 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=1 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=2 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=3 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=4 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=5 2024-09-14T11:32:57.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.651+0000 7f9396726800 20 add_watcher() i=6 2024-09-14T11:32:57.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.652+0000 7f9396726800 20 add_watcher() i=7 2024-09-14T11:32:57.651 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.652+0000 7f9396726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f9248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f9396726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f9396726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f9396726800 5 note: GC not initialized 2024-09-14T11:32:57.653 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f91c37fe640 20 reqs_thread_entry: start 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.654+0000 7f9396726800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.655+0000 7f9396726800 20 Filter name: none 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.655+0000 7f91c17fa640 20 reqs_thread_entry: start 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.655+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.655+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:57.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.655+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.656+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:57.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.656+0000 7f9396726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.656+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.656+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:57.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.656+0000 7f9396726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.657+0000 7f9396726800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:57.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.657+0000 7f9396726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:57.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.658+0000 7f9248fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.658 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.660+0000 7f9396726800 20 remove_watcher() i=0 2024-09-14T11:32:57.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.660+0000 7f9396726800 2 removed watcher, disabling cache 2024-09-14T11:32:57.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.661+0000 7f9396726800 20 remove_watcher() i=1 2024-09-14T11:32:57.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.662+0000 7f9396726800 20 remove_watcher() i=2 2024-09-14T11:32:57.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.663+0000 7f9396726800 20 remove_watcher() i=3 2024-09-14T11:32:57.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.664+0000 7f9396726800 20 remove_watcher() i=4 2024-09-14T11:32:57.663 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.665+0000 7f9396726800 20 remove_watcher() i=5 2024-09-14T11:32:57.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.666+0000 7f9396726800 20 remove_watcher() i=6 2024-09-14T11:32:57.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.667+0000 7f9396726800 20 remove_watcher() i=7 2024-09-14T11:32:57.675 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:57.676 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:57.676 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:57.676 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:57.677 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:32:57.711 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:57.711 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:57.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.749+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 realm 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.750+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.751+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.751+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.752+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:57.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.752+0000 7fe21072a800 20 searching for the correct realm 2024-09-14T11:32:57.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.754+0000 7fe20ccdb640 0 -- 172.21.15.130:0/1588254373 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe1f40b7020 msgr2=0x7fe1f4003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.960+0000 7fe20ccdb640 0 -- 172.21.15.130:0/1588254373 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe1f40b7020 msgr2=0x7fe1f4003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.964+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 zone default found 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 4 Realm: () 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 zonegroup default 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.965+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.966+0000 7fe21072a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:57.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.966+0000 7fe21072a800 20 started sync module instance, tier type = 2024-09-14T11:32:57.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.966+0000 7fe21072a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=0 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=1 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=2 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=3 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=4 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=5 2024-09-14T11:32:57.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.974+0000 7fe21072a800 20 add_watcher() i=6 2024-09-14T11:32:57.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.975+0000 7fe21072a800 20 add_watcher() i=7 2024-09-14T11:32:57.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.975+0000 7fe21072a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:57.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.977+0000 7fe0c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.977+0000 7fe21072a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:57.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.977+0000 7fe21072a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:57.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.977+0000 7fe21072a800 5 note: GC not initialized 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.977+0000 7fe0c1fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 20 Filter name: none 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe0337fe640 20 reqs_thread_entry: start 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:32:57.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 : miss 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.978+0000 7fe21072a800 20 rados->read ofs=0 len=0 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.979+0000 7fe21072a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 2024-09-14T11:32:57.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:57.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:57.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36, ofs0, ns] 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe0e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94609351061568 notifier 7671 bl.length()=1007 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe0e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe0e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe0e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_sources= new_sources= 2024-09-14T11:32:57.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential sources added=[] removed=[] 2024-09-14T11:32:57.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_dests= new_dests= 2024-09-14T11:32:57.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.984+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential dests added=[] removed=[] 2024-09-14T11:32:57.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.986+0000 7fe21072a800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:32:57.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.986+0000 7fe21072a800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:32:57.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.991+0000 7fe21072a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:57.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.991+0000 7fe21072a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36, ofs0, ns] 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe0e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94609351061568 notifier 7671 bl.length()=975 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe0e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe0e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:57.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe0e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:57.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_sources= new_sources= 2024-09-14T11:32:57.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential sources added=[] removed=[] 2024-09-14T11:32:57.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_dests= new_dests= 2024-09-14T11:32:57.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.992+0000 7fe21072a800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential dests added=[] removed=[] 2024-09-14T11:32:57.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.994+0000 7fe0c2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:57.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.996+0000 7fe21072a800 20 remove_watcher() i=0 2024-09-14T11:32:57.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.996+0000 7fe21072a800 2 removed watcher, disabling cache 2024-09-14T11:32:57.995 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.997+0000 7fe21072a800 20 remove_watcher() i=1 2024-09-14T11:32:57.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.998+0000 7fe21072a800 20 remove_watcher() i=2 2024-09-14T11:32:57.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:57.999+0000 7fe21072a800 20 remove_watcher() i=3 2024-09-14T11:32:57.999 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.000+0000 7fe21072a800 20 remove_watcher() i=4 2024-09-14T11:32:58.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.001+0000 7fe21072a800 20 remove_watcher() i=5 2024-09-14T11:32:58.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.002+0000 7fe21072a800 20 remove_watcher() i=6 2024-09-14T11:32:58.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.003+0000 7fe21072a800 20 remove_watcher() i=7 2024-09-14T11:32:58.013 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:58.043 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.043 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.080+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.082+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.082+0000 7f3ed8b2c800 20 realm 2024-09-14T11:32:58.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.082+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.083+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.083+0000 7f3ed8b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.083+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.083+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.083+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.084+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.084+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.085+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:58.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.085+0000 7f3ed8b2c800 20 searching for the correct realm 2024-09-14T11:32:58.085 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.087+0000 7f3ed5050640 0 -- 172.21.15.130:0/414343232 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3ebc089bf0 msgr2=0x7f3ebc003420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.292+0000 7f3ed5050640 0 -- 172.21.15.130:0/414343232 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3ebc089bf0 msgr2=0x7f3ebc003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.296+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 zone default found 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 4 Realm: () 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 zonegroup default 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.297+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.298+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.298+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.298+0000 7f3ed8b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.298+0000 7f3ed8b2c800 20 started sync module instance, tier type = 2024-09-14T11:32:58.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.298+0000 7f3ed8b2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=0 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=1 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=2 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=3 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=4 2024-09-14T11:32:58.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=5 2024-09-14T11:32:58.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.307+0000 7f3ed8b2c800 20 add_watcher() i=6 2024-09-14T11:32:58.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.308+0000 7f3ed8b2c800 20 add_watcher() i=7 2024-09-14T11:32:58.307 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.308+0000 7f3ed8b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:58.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.310+0000 7f3d8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.310+0000 7f3ed8b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.310+0000 7f3ed8b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.310+0000 7f3ed8b2c800 5 note: GC not initialized 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.311+0000 7f3d89fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.311+0000 7f3ed8b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.311+0000 7f3ed8b2c800 20 Filter name: none 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.311+0000 7f3cfb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.311+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.312+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:58.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.312+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.311 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.312+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.312+0000 7f3ed8b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.312+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.313+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.313+0000 7f3ed8b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.313+0000 7f3ed8b2c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:58.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.313+0000 7f3ed8b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:58.313 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.315+0000 7f3d8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.317+0000 7f3ed8b2c800 20 remove_watcher() i=0 2024-09-14T11:32:58.315 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.317+0000 7f3ed8b2c800 2 removed watcher, disabling cache 2024-09-14T11:32:58.316 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.318+0000 7f3ed8b2c800 20 remove_watcher() i=1 2024-09-14T11:32:58.317 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.319+0000 7f3ed8b2c800 20 remove_watcher() i=2 2024-09-14T11:32:58.318 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.320+0000 7f3ed8b2c800 20 remove_watcher() i=3 2024-09-14T11:32:58.319 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.320+0000 7f3ed8b2c800 20 remove_watcher() i=4 2024-09-14T11:32:58.320 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.321+0000 7f3ed8b2c800 20 remove_watcher() i=5 2024-09-14T11:32:58.321 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.322+0000 7f3ed8b2c800 20 remove_watcher() i=6 2024-09-14T11:32:58.322 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.323+0000 7f3ed8b2c800 20 remove_watcher() i=7 2024-09-14T11:32:58.332 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:58.332 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:58.332 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:58.332 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:58.333 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.334 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:58.340 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:58.340 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:58.383 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:32:58.415 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.415 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.452+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 realm 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.454+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.455+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.455+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.455+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:58.454 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.455+0000 7f7b92d42800 20 searching for the correct realm 2024-09-14T11:32:58.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.458+0000 7f7b8f287640 0 -- 172.21.15.130:0/957282513 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f7b78035040 msgr2=0x7f7b7801dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:58.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.663+0000 7f7b8f287640 0 -- 172.21.15.130:0/957282513 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f7b78035040 msgr2=0x7f7b7801dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:58.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:58.665 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:58.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 zone default found 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 4 Realm: () 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 zonegroup default 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.667+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:58.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 started sync module instance, tier type = 2024-09-14T11:32:58.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.668+0000 7f7b92d42800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=0 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=1 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=2 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=3 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=4 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=5 2024-09-14T11:32:58.676 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.677+0000 7f7b92d42800 20 add_watcher() i=6 2024-09-14T11:32:58.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.678+0000 7f7b92d42800 20 add_watcher() i=7 2024-09-14T11:32:58.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.678+0000 7f7b92d42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:58.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7a457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 5 note: GC not initialized 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f79bffff640 20 reqs_thread_entry: start 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:58.679 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 20 Filter name: none 2024-09-14T11:32:58.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f79bdffb640 20 reqs_thread_entry: start 2024-09-14T11:32:58.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:32:58.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.680+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 : miss 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 20 rados->read ofs=0 len=0 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.681+0000 7f7b92d42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 2024-09-14T11:32:58.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.686+0000 7f7b92d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.686+0000 7f7b92d42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.686+0000 7f7b92d42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.686+0000 7f7b92d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36, ofs0, ns] 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.687+0000 7f7a727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94915510495488 notifier 7707 bl.length()=1007 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.687+0000 7f7a727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.687+0000 7f7a727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.687+0000 7f7a727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.688+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_sources= new_sources= 2024-09-14T11:32:58.686 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.688+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential sources added=[] removed=[] 2024-09-14T11:32:58.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.688+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_dests= new_dests= 2024-09-14T11:32:58.687 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.688+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential dests added=[] removed=[] 2024-09-14T11:32:58.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.694+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.0 2024-09-14T11:32:58.693 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.694+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.0 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.1 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.1 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.2 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.2 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.3 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.3 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.4 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.4 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.5 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.5 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.6 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.6 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.7 2024-09-14T11:32:58.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.7 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.8 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.8 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.9 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.9 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.10 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.10 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.11 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1.11 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.0 2024-09-14T11:32:58.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1 2024-09-14T11:32:58.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.695+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.2 2024-09-14T11:32:58.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.696+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.3 2024-09-14T11:32:58.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.697+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.4 2024-09-14T11:32:58.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.697+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.5 2024-09-14T11:32:58.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.698+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.6 2024-09-14T11:32:58.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.698+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.7 2024-09-14T11:32:58.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.699+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.8 2024-09-14T11:32:58.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.699+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.9 2024-09-14T11:32:58.698 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.700+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.10 2024-09-14T11:32:58.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.702+0000 7f7b92d42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:58.701 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.702+0000 7f7b92d42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 2024-09-14T11:32:58.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.702 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36, ofs0, ns] 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7a727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94915510495488 notifier 7707 bl.length()=1007 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7a727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7a727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7a727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_sources= new_sources= 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential sources added=[] removed=[] 2024-09-14T11:32:58.703 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_dests= new_dests= 2024-09-14T11:32:58.704 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.704+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential dests added=[] removed=[] 2024-09-14T11:32:58.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.706+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.0 2024-09-14T11:32:58.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.707+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.1 2024-09-14T11:32:58.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.707+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.2 2024-09-14T11:32:58.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.707+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.3 2024-09-14T11:32:58.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.708+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.4 2024-09-14T11:32:58.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.708+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.5 2024-09-14T11:32:58.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.708+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.6 2024-09-14T11:32:58.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.709+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.7 2024-09-14T11:32:58.707 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.709+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.8 2024-09-14T11:32:58.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.709+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.9 2024-09-14T11:32:58.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.709+0000 7f7b92d42800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.36.10 2024-09-14T11:32:58.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.710+0000 7f7b92d42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:32:58.708 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.710+0000 7f7b92d42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 2024-09-14T11:32:58.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7b92d42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7b92d42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7b92d42800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7b92d42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36, ofs0, ns] 2024-09-14T11:32:58.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7a727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94915510495488 notifier 7707 bl.length()=975 2024-09-14T11:32:58.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7a727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 info.flags=0x17 2024-09-14T11:32:58.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7a727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.36 to cache LRU end 2024-09-14T11:32:58.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.711+0000 7f7a727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:58.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.712+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_sources= new_sources= 2024-09-14T11:32:58.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.712+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential sources added=[] removed=[] 2024-09-14T11:32:58.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.712+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): orig_dests= new_dests= 2024-09-14T11:32:58.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.712+0000 7f7b92d42800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.36]): potential dests added=[] removed=[] 2024-09-14T11:32:58.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.714+0000 7f7b92d42800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:32:58.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.716+0000 7f7a457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:58.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.717+0000 7f7b92d42800 20 remove_watcher() i=0 2024-09-14T11:32:58.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.717+0000 7f7b92d42800 2 removed watcher, disabling cache 2024-09-14T11:32:58.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.718+0000 7f7b92d42800 20 remove_watcher() i=1 2024-09-14T11:32:58.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.719+0000 7f7b92d42800 20 remove_watcher() i=2 2024-09-14T11:32:58.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.721+0000 7f7b92d42800 20 remove_watcher() i=3 2024-09-14T11:32:58.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.722+0000 7f7b92d42800 20 remove_watcher() i=4 2024-09-14T11:32:58.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.723+0000 7f7b92d42800 20 remove_watcher() i=5 2024-09-14T11:32:58.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.724+0000 7f7b92d42800 20 remove_watcher() i=6 2024-09-14T11:32:58.723 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:58.724+0000 7f7b92d42800 20 remove_watcher() i=7 2024-09-14T11:32:58.735 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:32:58.763 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:58.763 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:58.998 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.000+0000 7f4643383640 0 --2- 172.21.15.130:0/628963280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a438c639e0 0x55a438c71170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:32:59.000 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.001+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.003+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.003+0000 7f4645098800 20 realm 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.003+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.004+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.004+0000 7f4645098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.004+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.004+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.004+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.005+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.005+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.005+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:59.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.005+0000 7f4645098800 20 searching for the correct realm 2024-09-14T11:32:59.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.007+0000 7f4642b82640 0 -- 172.21.15.130:0/628963280 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f463c011c60 msgr2=0x7f463c032450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.010+0000 7f4642b82640 0 -- 172.21.15.130:0/628963280 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f450c08fab0 msgr2=0x7f450c091ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 zone default found 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 4 Realm: () 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 zonegroup default 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.016+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 started sync module instance, tier type = 2024-09-14T11:32:59.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.017+0000 7f4645098800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:59.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=0 2024-09-14T11:32:59.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=1 2024-09-14T11:32:59.024 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=2 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=3 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=4 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=5 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.026+0000 7f4645098800 20 add_watcher() i=6 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.027+0000 7f4645098800 20 add_watcher() i=7 2024-09-14T11:32:59.025 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.027+0000 7f4645098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:59.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f44f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 5 note: GC not initialized 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f44f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:59.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 20 Filter name: none 2024-09-14T11:32:59.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f44f1ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:59.029 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.029+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.030+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.030+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.030+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.030+0000 7f4645098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.030+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.031+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.031+0000 7f4645098800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.031+0000 7f4645098800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:59.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.031+0000 7f4645098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.033+0000 7f44f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.035+0000 7f4645098800 20 remove_watcher() i=0 2024-09-14T11:32:59.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.035+0000 7f4645098800 2 removed watcher, disabling cache 2024-09-14T11:32:59.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.036+0000 7f4645098800 20 remove_watcher() i=1 2024-09-14T11:32:59.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.037+0000 7f4645098800 20 remove_watcher() i=2 2024-09-14T11:32:59.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.038+0000 7f4645098800 20 remove_watcher() i=3 2024-09-14T11:32:59.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.039+0000 7f4645098800 20 remove_watcher() i=4 2024-09-14T11:32:59.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.040+0000 7f4645098800 20 remove_watcher() i=5 2024-09-14T11:32:59.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.040+0000 7f4645098800 20 remove_watcher() i=6 2024-09-14T11:32:59.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.041+0000 7f4645098800 20 remove_watcher() i=7 2024-09-14T11:32:59.050 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.050 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:59.050 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:32:59.051 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.052 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.052 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.056 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.056 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.099 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.099 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.132 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:32:59.132 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.133 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.133 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.144 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.144 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.187 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.187 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.194 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.194 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.200 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.201 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.209 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.209 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.215 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.215 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.222 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.222 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.228 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.229 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.235 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.235 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.242 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.242 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.248 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.248 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.255 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.255 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.262 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.262 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.268 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.268 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.275 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.275 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.281 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.281 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.287 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.287 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.294 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.294 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.301 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.301 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.308 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.308 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.315 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:32:59.315 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:32:59.322 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:32:59.350 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:59.351 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:59.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.388+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 20 realm 2024-09-14T11:32:59.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:59.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.390+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.391+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.391+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.391+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.391+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.392+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:59.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.392+0000 7f217593e800 20 searching for the correct realm 2024-09-14T11:32:59.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.394+0000 7f216bfff640 0 -- 172.21.15.130:0/3952111441 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f2164083040 msgr2=0x7f2164058050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.397+0000 7f21716c0640 0 -- 172.21.15.130:0/3952111441 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f216c01a040 msgr2=0x7f216c02a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:59.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:59.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:59.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:59.602 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.603+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.603 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 zone default found 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 4 Realm: () 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 zonegroup default 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.604+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.604 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.605+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.605+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.606+0000 7f217593e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.606+0000 7f217593e800 20 started sync module instance, tier type = 2024-09-14T11:32:59.605 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.606+0000 7f217593e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=0 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=1 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=2 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=3 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=4 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=5 2024-09-14T11:32:59.613 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.614+0000 7f217593e800 20 add_watcher() i=6 2024-09-14T11:32:59.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.615+0000 7f217593e800 20 add_watcher() i=7 2024-09-14T11:32:59.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.615+0000 7f217593e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:59.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.617+0000 7f2027fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.617+0000 7f217593e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.617+0000 7f217593e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.617+0000 7f217593e800 5 note: GC not initialized 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f2026fe5640 20 reqs_thread_entry: start 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f217593e800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f217593e800 20 Filter name: none 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f2024fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:59.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:59.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.618+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.619+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:59.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.619+0000 7f217593e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.619+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.620+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:59.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.620+0000 7f217593e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.620+0000 7f217593e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:59.619 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.620+0000 7f217593e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:32:59.620 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.622+0000 7f2027fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.624+0000 7f217593e800 20 remove_watcher() i=0 2024-09-14T11:32:59.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.624+0000 7f217593e800 2 removed watcher, disabling cache 2024-09-14T11:32:59.623 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.625+0000 7f217593e800 20 remove_watcher() i=1 2024-09-14T11:32:59.624 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.626+0000 7f217593e800 20 remove_watcher() i=2 2024-09-14T11:32:59.625 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.627+0000 7f217593e800 20 remove_watcher() i=3 2024-09-14T11:32:59.626 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.628+0000 7f217593e800 20 remove_watcher() i=4 2024-09-14T11:32:59.627 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.629+0000 7f217593e800 20 remove_watcher() i=5 2024-09-14T11:32:59.628 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.630+0000 7f217593e800 20 remove_watcher() i=6 2024-09-14T11:32:59.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.631+0000 7f217593e800 20 remove_watcher() i=7 2024-09-14T11:32:59.639 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.639 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:32:59.640 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:32:59.640 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.641 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:32:59.675 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:59.675 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:59.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.713+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 20 realm 2024-09-14T11:32:59.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:59.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.714 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.716+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:59.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.716+0000 7f3a29325800 20 searching for the correct realm 2024-09-14T11:32:59.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.718+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.923+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:59.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:59.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:59.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:59.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 zone default found 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 4 Realm: () 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:32:59.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 zonegroup default 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.929+0000 7f3a29325800 20 started sync module instance, tier type = 2024-09-14T11:32:59.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.929+0000 7f3a29325800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=0 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=1 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=2 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=3 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=4 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=5 2024-09-14T11:32:59.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=6 2024-09-14T11:32:59.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.939+0000 7f3a29325800 20 add_watcher() i=7 2024-09-14T11:32:59.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.939+0000 7f3a29325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:59.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f38dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 5 note: GC not initialized 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f38d9fe3640 20 reqs_thread_entry: start 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:59.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 20 Filter name: none 2024-09-14T11:32:59.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f384b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:59.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:32:59.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.941+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : miss 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.942+0000 7f3a29325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f3a29325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f3a29325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94217329010640 notifier 7761 bl.length()=1007 2024-09-14T11:32:59.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:32:59.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:32:59.948 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a29325800 time 2024-09-14T11:32:59.951142+0000 2024-09-14T11:32:59.948 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a2a98c76a] 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:32:59.949 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.950+0000 7f3a29325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a29325800 time 2024-09-14T11:32:59.951142+0000 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a2a98c76a] 2024-09-14T11:32:59.950 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:32:59.951 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3a29325800 thread_name:radosgw-admin 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a2963e6f0] 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a2968b99c] 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a2a98c7c4] 2024-09-14T11:32:59.967 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:32:59.951+0000 7f3a29325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3a29325800 thread_name:radosgw-admin 2024-09-14T11:32:59.968 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a2963e6f0] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a2968b99c] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a2a98c7c4] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:32:59.969 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:32:59.696+0000 7f3a29325800 5 monclient: authenticate success, global_id 7749 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:32:59.696+0000 7f3a29325800 10 monclient: get_monmap_and_config success 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:32:59.696+0000 7f3a29325800 4 set_mon_vals no callback set 2024-09-14T11:32:59.970 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: dump: 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.971 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:32:59.696+0000 7f3a29325800 10 monclient: shutdown 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:32:59.696+0000 7f3a29325800 5 asok(0x55b0ae3b8270) unregister_commands rotate-key 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:59.972 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.973 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: starting msgr at 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: starting objecter 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests hook 0x55b0ae5df6a0 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: setting wanted keys 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: calling monclient init 2024-09-14T11:32:59.974 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: init 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.975 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:32:59.698+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key hook 0x55b0ae5d8648 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae461ce0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae48d390 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae5df7b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.976 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.182101s 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae48d390 auth_method 0 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae5df7b0 auth_method 0 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.977 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae461ce0 auth_method 0 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.978 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_done global_id 7752 payload 824 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient: _finish_hunting 0 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:32:59.698+0000 7f3a1c732640 1 monclient: found mon.noname-a 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: dump: 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.979 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: _finish_auth 0 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: _check_auth_tickets 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:59.980 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: dump: 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.981 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:32:59.698+0000 7f3a29325800 5 monclient: authenticate success, global_id 7752 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:32:59.698+0000 7f3912e0d640 4 set_mon_vals no callback set 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:32:59.698+0000 7f3a29325800 1 librados: init done 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:32:59.700+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f390c077230 auth_method 0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:32:59.701+0000 7f3a25734640 10 monclient: get_auth_request con 0x55b0ae601400 auth_method 0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:32:59.701+0000 7f3a24f33640 10 monclient: get_auth_request con 0x55b0ae624040 auth_method 0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:32:59.702+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae628470 auth_method 0 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:32:59.703+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:32:59.982 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:32:59.703+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:32:59.703+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:32:59.983 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.984 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ae630a10 EEXIST 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: init 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.985 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x55b0ae62bb50 EEXIST 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae654d30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae655110 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae653a40 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.188827s 2024-09-14T11:32:59.986 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae654d30 auth_method 0 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae653a40 auth_method 0 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.987 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae655110 auth_method 0 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient: _finish_hunting 0 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:32:59.705+0000 7f3a24f33640 1 monclient: found mon.noname-c 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: dump: 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.988 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:59.989 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: dump: 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.990 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:32:59.705+0000 7f3a29325800 5 monclient: authenticate success, global_id 7253 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:32:59.705+0000 7f3a25f35640 4 set_mon_vals no callback set 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:32:59.991 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:32:59.707+0000 7f3a1c732640 10 monclient: get_auth_request con 0x7f38fc077140 auth_method 0 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: get_monmap_and_config 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:32:59.707+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.992 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.993 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: init 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.994 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x7fffda8aec38 EEXIST 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae678d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae6a3790 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:32:59.995 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae6a4b40 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.192713s 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae6a3790 auth_method 0 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae6a4b40 auth_method 0 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:32:59.996 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_done global_id 7256 payload 274 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient: _finish_hunting 0 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:32:59.708+0000 7f3a1c732640 1 monclient: found mon.noname-c 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:32:59.997 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: dump: 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:32:59.998 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: _finish_auth 0 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 monclient: authenticate success, global_id 7256 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: dump: 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:32:59.999 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:32:59.709+0000 7f3a29325800 4 set_mon_vals no callback set 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: shutdown 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.000 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:32:59.709+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:00.001 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.002 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: starting msgr at 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: starting objecter 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ae6793d0 EEXIST 2024-09-14T11:33:00.003 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: setting wanted keys 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: calling monclient init 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: init 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.004 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x55b0ae669738 EEXIST 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae678d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae6a4b40 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:00.005 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae6b65c0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.194914s 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae6b65c0 auth_method 0 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae6a4b40 auth_method 0 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.006 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae678d20 auth_method 0 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.007 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_done global_id 7761 payload 824 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:32:59.711+0000 7f3a25734640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: dump: 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.008 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: dump: 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.009 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:32:59.711+0000 7f3a29325800 5 monclient: authenticate success, global_id 7761 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:32:59.711+0000 7f38fbfff640 4 set_mon_vals no callback set 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.010 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:32:59.711+0000 7f3a29325800 1 librados: init done 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:32:59.711+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cr dump hook 0x55b0ae69f488 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:32:59.713+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:32:59.714+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f38f0077230 auth_method 0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:32:59.714+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae6c3c60 auth_method 0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 realm 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:32:59.714+0000 7f3a29325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.011 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:32:59.715+0000 7f3a24f33640 10 monclient: get_auth_request con 0x55b0ae6c7ee0 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:32:59.715+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae6cb740 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:32:59.716+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:32:59.716+0000 7f3a29325800 20 searching for the correct realm 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:32:59.716+0000 7f3a25734640 10 monclient: get_auth_request con 0x55b0ae6d0210 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:32:59.717+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f3a20028040 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:32:59.717+0000 7f3a1c732640 10 monclient: get_auth_request con 0x7f3a140695a0 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:32:59.718+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f3a0c0c1070 auth_method 0 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:32:59.718+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.012 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:32:59.919+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f3a0c0c1070 auth_method 0 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:32:59.923+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f3a20017040 auth_method 0 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:32:59.923+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 1 client.7761.objecter ms_handle_reset 0x7f3a0c0c1070 session 0x7f3a0c005040 osd.4 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 10 monclient: _renew_subs 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:32:59.924+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f38f00878d0 auth_method 0 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.013 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 zone default found 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 Realm: () 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:32:59.928+0000 7f3a29325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 zonegroup default 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.014 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 started sync module instance, tier type = 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=0 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=1 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=2 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=3 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=4 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=5 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=6 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:32:59.939+0000 7f3a29325800 20 add_watcher() i=7 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:32:59.939+0000 7f3a29325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.015 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.016 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:32:59.941+0000 7f38dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:32:59.941+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache list hook 0x55b0ae6a92d0 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache inspect hook 0x55b0ae6a92d0 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache erase hook 0x55b0ae6a92d0 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache zap hook 0x55b0ae6a92d0 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 note: GC not initialized 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:32:59.941+0000 7f38d9fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace show hook 0x7f3a14004600 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace history hook 0x7f3a14004600 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace active hook 0x7f3a14004600 2024-09-14T11:33:00.017 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace active_short hook 0x7f3a14004600 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 Filter name: none 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:32:59.941+0000 7f384b7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:32:59.941+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : miss 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.018 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94217329010640 notifier 7761 bl.length()=1007 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:33:00.019 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:32:59.950+0000 7f3a29325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a29325800 time 2024-09-14T11:32:59.951142+0000 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a2a98c76a] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:00.020 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:32:59.951+0000 7f3a29325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3a29325800 thread_name:radosgw-admin 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a2963e6f0] 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a2968b99c] 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:00.021 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a2a98c7c4] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:33:00.022 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:33:00.023 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:33:00.024 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:33:00.025 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:33:00.026 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:33:00.027 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:00.028 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:00.029 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f384b7fe640 / http_manager 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38d9fe3640 / http_manager 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38dafe5640 / rgw_dt_lg_renew 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fa7fc640 / ms_dispatch 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fb7fe640 / io_context_pool 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fbfff640 / io_context_pool 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f390a7fc640 / ms_dispatch 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f391160a640 / ms_dispatch 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3912e0d640 / io_context_pool 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a1c732640 / msgr-worker-2 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a24f33640 / msgr-worker-1 2024-09-14T11:33:00.030 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a25734640 / msgr-worker-0 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a25f35640 / io_context_pool 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a29325800 / radosgw-admin 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.134560.log 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:32:59.696+0000 7f3a29325800 5 monclient: authenticate success, global_id 7749 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:32:59.696+0000 7f3a29325800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:32:59.696+0000 7f3a29325800 4 set_mon_vals no callback set 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.031 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:32:59.696+0000 7f3912e0d640 10 monclient: dump: 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:32:59.696+0000 7f3a29325800 10 monclient: shutdown 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:32:59.696+0000 7f3a29325800 5 asok(0x55b0ae3b8270) unregister_commands rotate-key 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.032 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.033 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding auth protocol: cephx 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.034 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: crc 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5de170) adding con mode: secure 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: starting msgr at 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: starting objecter 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests hook 0x55b0ae5df6a0 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: setting wanted keys 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:32:59.697+0000 7f3a29325800 1 librados: calling monclient init 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:32:59.697+0000 7f3a29325800 10 monclient: init 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding auth protocol: cephx 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.035 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: crc 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:32:59.697+0000 7f3a29325800 5 AuthRegistry(0x55b0ae5d8500) adding con mode: secure 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:32:59.697+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.036 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:32:59.698+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key hook 0x55b0ae5d8648 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae461ce0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae48d390 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae5df7b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.182101s 2024-09-14T11:33:00.037 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae48d390 auth_method 0 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae5df7b0 auth_method 0 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.038 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:32:59.698+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae461ce0 auth_method 0 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:32:59.698+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient(hunting): handle_auth_done global_id 7752 payload 824 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:32:59.698+0000 7f3a1c732640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:32:59.698+0000 7f3a1c732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.039 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: dump: 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.040 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:32:59.698+0000 7f391160a640 10 monclient: dump: 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.041 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:32:59.698+0000 7f3a29325800 5 monclient: authenticate success, global_id 7752 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:32:59.698+0000 7f3912e0d640 4 set_mon_vals no callback set 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:32:59.698+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:32:59.698+0000 7f3a29325800 1 librados: init done 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:32:59.700+0000 7f391160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:32:59.700+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f390c077230 auth_method 0 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:32:59.701+0000 7f3a25734640 10 monclient: get_auth_request con 0x55b0ae601400 auth_method 0 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:32:59.701+0000 7f3a24f33640 10 monclient: get_auth_request con 0x55b0ae624040 auth_method 0 2024-09-14T11:33:00.042 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:32:59.702+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae628470 auth_method 0 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:32:59.703+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:32:59.703+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:32:59.703+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:00.043 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding auth protocol: cephx 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.044 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: crc 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:32:59.703+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62d500) adding con mode: secure 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ae630a10 EEXIST 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: init 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding auth protocol: cephx 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.045 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: crc 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 AuthRegistry(0x55b0ae62ba08) adding con mode: secure 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:32:59.704+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:32:59.704+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x55b0ae62bb50 EEXIST 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:00.046 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae654d30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae655110 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae653a40 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:32:59.704+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.188827s 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae654d30 auth_method 0 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae653a40 auth_method 0 2024-09-14T11:33:00.047 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:32:59.704+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:32:59.704+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:32:59.705+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae655110 auth_method 0 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:32:59.705+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.048 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:32:59.705+0000 7f3a24f33640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:32:59.705+0000 7f3a24f33640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: dump: 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.049 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:32:59.705+0000 7f390a7fc640 10 monclient: dump: 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.050 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:32:59.705+0000 7f3a29325800 5 monclient: authenticate success, global_id 7253 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:32:59.705+0000 7f3a25f35640 4 set_mon_vals no callback set 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:32:59.705+0000 7f3a29325800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.051 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:32:59.707+0000 7f390a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:32:59.707+0000 7f3a1c732640 10 monclient: get_auth_request con 0x7f38fc077140 auth_method 0 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: get_monmap_and_config 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:32:59.707+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:32:59.707+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.052 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding auth protocol: cephx 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.053 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: crc 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:32:59.707+0000 7f3a29325800 5 AuthRegistry(0x55b0ae674be0) adding con mode: secure 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: init 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding auth protocol: cephx 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.054 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: crc 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aeaf0) adding con mode: secure 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:32:59.708+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:32:59.708+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x7fffda8aec38 EEXIST 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:00.055 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae678d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae6a3790 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae6a4b40 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:32:59.708+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.192713s 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae6a3790 auth_method 0 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae6a4b40 auth_method 0 2024-09-14T11:33:00.056 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:32:59.708+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient(hunting): handle_auth_done global_id 7256 payload 274 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:32:59.708+0000 7f3a1c732640 1 monclient: found mon.noname-c 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:32:59.708+0000 7f3a1c732640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:00.057 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: dump: 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.058 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 monclient: authenticate success, global_id 7256 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:32:59.709+0000 7f38fbfff640 10 monclient: dump: 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.059 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:32:59.709+0000 7f3a29325800 4 set_mon_vals no callback set 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: shutdown 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: build_initial_monmap 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:32:59.709+0000 7f3a29325800 1 build_initial for_mkfs: 0 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:32:59.709+0000 7f3a29325800 10 monclient: monmap: 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:00.060 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding auth protocol: cephx 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.061 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: crc 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:32:59.709+0000 7f3a29325800 5 AuthRegistry(0x55b0ae679900) adding con mode: secure 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: starting msgr at 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: starting objecter 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command objecter_requests cmddesc objecter_requests hook 0x55b0ae6793d0 EEXIST 2024-09-14T11:33:00.062 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: setting wanted keys 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:32:59.710+0000 7f3a29325800 1 librados: calling monclient init 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: init 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding auth protocol: cephx 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.063 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: crc 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 AuthRegistry(0x55b0ae6695f0) adding con mode: secure 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:32:59.710+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:32:59.710+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command rotate-key cmddesc rotate-key hook 0x55b0ae669738 EEXIST 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-b con 0x55b0ae678d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-c con 0x55b0ae6a4b40 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): picked mon.noname-a con 0x55b0ae6b65c0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.064 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:32:59.710+0000 7f3a29325800 10 monclient(hunting): authenticate will time out at 2096.194914s 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): get_auth_request con 0x55b0ae6b65c0 auth_method 0 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): get_auth_request con 0x55b0ae6a4b40 auth_method 0 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.065 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): get_auth_request con 0x55b0ae678d20 auth_method 0 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:32:59.711+0000 7f3a1c732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:32:59.711+0000 7f3a24f33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient(hunting): handle_auth_done global_id 7761 payload 824 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient: _finish_hunting 0 2024-09-14T11:33:00.066 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:32:59.711+0000 7f3a25734640 1 monclient: found mon.noname-a 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:32:59.711+0000 7f3a25734640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: dump: 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.067 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:32:59.711+0000 7f38fa7fc640 10 monclient: dump: 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:00.068 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:32:59.711+0000 7f3a29325800 5 monclient: authenticate success, global_id 7761 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:32:59.711+0000 7f38fbfff640 4 set_mon_vals no callback set 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _renew_subs 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:32:59.711+0000 7f3a29325800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:32:59.711+0000 7f3a29325800 1 librados: init done 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:32:59.711+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cr dump hook 0x55b0ae69f488 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:32:59.713+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.069 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:32:59.713+0000 7f38fa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:32:59.714+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f38f0077230 auth_method 0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:32:59.714+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae6c3c60 auth_method 0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 realm 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:32:59.714+0000 7f3a29325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:32:59.714+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.070 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:32:59.715+0000 7f3a24f33640 10 monclient: get_auth_request con 0x55b0ae6c7ee0 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:32:59.715+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:32:59.715+0000 7f3a1c732640 10 monclient: get_auth_request con 0x55b0ae6cb740 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:32:59.716+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:32:59.716+0000 7f3a29325800 20 searching for the correct realm 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:32:59.716+0000 7f3a25734640 10 monclient: get_auth_request con 0x55b0ae6d0210 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:32:59.717+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f3a20028040 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:32:59.717+0000 7f3a1c732640 10 monclient: get_auth_request con 0x7f3a140695a0 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:32:59.718+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f3a0c0c1070 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:32:59.718+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:32:59.919+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f3a0c0c1070 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:32:59.923+0000 7f3a24f33640 10 monclient: get_auth_request con 0x7f3a20017040 auth_method 0 2024-09-14T11:33:00.071 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:32:59.923+0000 7f3a25734640 0 -- 172.21.15.130:0/248355545 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f3a0c0c1070 msgr2=0x7f3a0c0adf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 1 client.7761.objecter ms_handle_reset 0x7f3a0c0c1070 session 0x7f3a0c005040 osd.4 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 10 monclient: _renew_subs 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:32:59.924+0000 7f38fa7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:32:59.924+0000 7f3a25734640 10 monclient: get_auth_request con 0x7f38f00878d0 auth_method 0 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.072 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:32:59.927+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 zone default found 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 Realm: () 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:32:59.928+0000 7f3a29325800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:32:59.928+0000 7f3a29325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 zonegroup default 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.073 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:32:59.928+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 started sync module instance, tier type = 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:32:59.929+0000 7f3a29325800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=0 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=1 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=2 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=3 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=4 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=5 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:32:59.938+0000 7f3a29325800 20 add_watcher() i=6 2024-09-14T11:33:00.074 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:32:59.939+0000 7f3a29325800 20 add_watcher() i=7 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:32:59.939+0000 7f3a29325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding auth protocol: cephx 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.075 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: crc 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 AuthRegistry(0x7fffda8aefd0) adding con mode: secure 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:32:59.941+0000 7f38dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:32:59.941+0000 7f3a29325800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache list hook 0x55b0ae6a92d0 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache inspect hook 0x55b0ae6a92d0 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache erase hook 0x55b0ae6a92d0 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command cache zap hook 0x55b0ae6a92d0 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 note: GC not initialized 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:32:59.941+0000 7f38d9fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:00.076 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace show hook 0x7f3a14004600 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace history hook 0x7f3a14004600 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace active hook 0x7f3a14004600 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:32:59.941+0000 7f3a29325800 5 asok(0x55b0ae3b8270) register_command sync trace active_short hook 0x7f3a14004600 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 Filter name: none 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:32:59.941+0000 7f384b7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:32:59.941+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:32:59.941+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : miss 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.077 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:32:59.942+0000 7f3a29325800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:32:59.942+0000 7f3a29325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.078 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:32:59.947+0000 7f3a29325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496984 cookie 94217329010640 notifier 7761 bl.length()=1007 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:32:59.947+0000 7f38fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:32:59.948+0000 7f3a29325800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:32:59.950+0000 7f3a29325800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3a29325800 time 2024-09-14T11:32:59.951142+0000 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.079 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3a2a98c76a] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:32:59.951+0000 7f3a29325800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:00.080 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3a29325800 thread_name:radosgw-admin 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3a2963e6f0] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3a2968b99c] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3a2a98c7c4] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3a2a98c928] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b0ac56d0b1] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55b0aca8107c] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b0ac57cefd] 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:00.081 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3a29629590] 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:33:00.082 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:00.083 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:33:00.084 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:00.085 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:33:00.086 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:33:00.087 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:33:00.088 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f384b7fe640 / http_manager 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38d9fe3640 / http_manager 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38dafe5640 / rgw_dt_lg_renew 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fa7fc640 / ms_dispatch 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fb7fe640 / io_context_pool 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f38fbfff640 / io_context_pool 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f390a7fc640 / ms_dispatch 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f391160a640 / ms_dispatch 2024-09-14T11:33:00.089 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3912e0d640 / io_context_pool 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a1c732640 / msgr-worker-2 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a24f33640 / msgr-worker-1 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a25734640 / msgr-worker-0 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a25f35640 / io_context_pool 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3a29325800 / radosgw-admin 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:32:59.952789Z_038db4db-546e-4cc9-bc9f-b85ba93fa3be/log 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:33:00.090 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.026+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 realm 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.028+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.029+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.029+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.029+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.029+0000 7eff11e0f800 20 searching for the correct realm 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.032+0000 7eff10101640 0 -- 172.21.15.130:0/424993128 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7eff040b9150 msgr2=0x7eff040ac490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.036+0000 7eff10101640 0 -- 172.21.15.130:0/424993128 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7efdd8087900 msgr2=0x7efdd8089d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:00.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.039+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 zone default found 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 4 Realm: () 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 zonegroup default 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.040+0000 7eff11e0f800 20 started sync module instance, tier type = 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.041+0000 7eff11e0f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=0 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=1 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=2 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=3 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=4 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=5 2024-09-14T11:33:00.099 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.048+0000 7eff11e0f800 20 add_watcher() i=6 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.049+0000 7eff11e0f800 20 add_watcher() i=7 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.049+0000 7eff11e0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7efdc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7eff11e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7eff11e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7eff11e0f800 5 note: GC not initialized 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7efdc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7eff11e0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.052+0000 7eff11e0f800 20 Filter name: none 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.053+0000 7efd3e7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.053+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.053+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:00.100 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.053+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.054+0000 7eff11e0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.056+0000 7efdc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.058+0000 7eff11e0f800 20 remove_watcher() i=0 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.058+0000 7eff11e0f800 2 removed watcher, disabling cache 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.059+0000 7eff11e0f800 20 remove_watcher() i=1 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.060+0000 7eff11e0f800 20 remove_watcher() i=2 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.060+0000 7eff11e0f800 20 remove_watcher() i=3 2024-09-14T11:33:00.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.061+0000 7eff11e0f800 20 remove_watcher() i=4 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.062+0000 7eff11e0f800 20 remove_watcher() i=5 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.063+0000 7eff11e0f800 20 remove_watcher() i=6 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.064+0000 7eff11e0f800 20 remove_watcher() i=7 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:00.102 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:00.124 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:00.155 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:00.156 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:00.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.193+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 realm 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.195+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.196+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.196+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.197+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:00.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.197+0000 7f4886746800 20 searching for the correct realm 2024-09-14T11:33:00.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.199+0000 7f4884a31640 0 -- 172.21.15.130:0/3372332958 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f486c062c60 msgr2=0x7f486c0616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.404+0000 7f4884a31640 0 -- 172.21.15.130:0/3372332958 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f486c062c60 msgr2=0x7f486c0616d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:00.408 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.408+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 zone default found 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 4 Realm: () 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 zonegroup default 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.409 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:00.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 started sync module instance, tier type = 2024-09-14T11:33:00.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.409+0000 7f4886746800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=0 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=1 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=2 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=3 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=4 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=5 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.418+0000 7f4886746800 20 add_watcher() i=6 2024-09-14T11:33:00.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.419+0000 7f4886746800 20 add_watcher() i=7 2024-09-14T11:33:00.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.419+0000 7f4886746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:00.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.420+0000 7f473a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 5 note: GC not initialized 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f47397e2640 20 reqs_thread_entry: start 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 20 Filter name: none 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f46aaffd640 20 reqs_thread_entry: start 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.421+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : miss 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 20 rados->read ofs=0 len=0 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:00.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.422+0000 7f4886746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:00.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.423+0000 7f4886746800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to be held by another RGW process; skipping for now 2024-09-14T11:33:00.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.424+0000 7f473a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:00.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.426+0000 7f4886746800 20 remove_watcher() i=0 2024-09-14T11:33:00.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.426+0000 7f4886746800 2 removed watcher, disabling cache 2024-09-14T11:33:00.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.427+0000 7f4886746800 20 remove_watcher() i=1 2024-09-14T11:33:00.427 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.428+0000 7f4886746800 20 remove_watcher() i=2 2024-09-14T11:33:00.428 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.430+0000 7f4886746800 20 remove_watcher() i=3 2024-09-14T11:33:00.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.430+0000 7f4886746800 20 remove_watcher() i=4 2024-09-14T11:33:00.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.431+0000 7f4886746800 20 remove_watcher() i=5 2024-09-14T11:33:00.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.432+0000 7f4886746800 20 remove_watcher() i=6 2024-09-14T11:33:00.431 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:00.433+0000 7f4886746800 20 remove_watcher() i=7 2024-09-14T11:33:00.442 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:33:30.448 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:30.482 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:30.483 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:30.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.526+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 20 realm 2024-09-14T11:33:30.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:30.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.528+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.529+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.529+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.530+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.530+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.531+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:30.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.531+0000 7f2e8cf2e800 20 searching for the correct realm 2024-09-14T11:33:30.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.532+0000 7f2e88b64640 0 -- 172.21.15.130:0/1116175708 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f2e80011040 msgr2=0x7f2e8002b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:30.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.737+0000 7f2e89365640 0 -- 172.21.15.130:0/1116175708 >> [v2:172.21.15.130:6816/3369137395,v1:172.21.15.130:6817/3369137395] conn(0x565525db59b0 msgr2=0x565525db7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:30.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:30.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:30.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:30.744 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:30.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:30.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:30.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.745+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 zone default found 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 4 Realm: () 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 zonegroup default 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.746+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 started sync module instance, tier type = 2024-09-14T11:33:30.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.747+0000 7f2e8cf2e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:30.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=0 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=1 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=2 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=3 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=4 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=5 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.757+0000 7f2e8cf2e800 20 add_watcher() i=6 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.758+0000 7f2e8cf2e800 20 add_watcher() i=7 2024-09-14T11:33:30.756 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.758+0000 7f2e8cf2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:30.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2d3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:30.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2e8cf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:30.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2e8cf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:30.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2e8cf2e800 5 note: GC not initialized 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2d3dfe3640 20 reqs_thread_entry: start 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2e8cf2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.760+0000 7f2e8cf2e800 20 Filter name: none 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2caf7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:33:30.760 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:30.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:33:30.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:33:30.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : miss 2024-09-14T11:33:30.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.761+0000 7f2e8cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.762+0000 7f2e8cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:30.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.763+0000 7f2e8cf2e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:33:30.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.769+0000 7f2e8cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.769+0000 7f2e8cf2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.769+0000 7f2e8cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.769+0000 7f2e8cf2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2d5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94923707410096 notifier 7818 bl.length()=1007 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2d5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2d5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2d5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.770+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.0 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.0 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.1 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.1 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.2 2024-09-14T11:33:30.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.2 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.3 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.3 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.4 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.4 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.5 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.5 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.6 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.6 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.7 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.7 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.8 2024-09-14T11:33:30.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.8 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.9 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.9 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.10 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.10 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.11 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2.11 2024-09-14T11:33:30.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.774+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.0 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.775+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.1 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.775+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.776+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.3 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.776+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.4 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.777+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.5 2024-09-14T11:33:30.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.777+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.6 2024-09-14T11:33:30.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.778+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.7 2024-09-14T11:33:30.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.779+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.8 2024-09-14T11:33:30.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.779+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.9 2024-09-14T11:33:30.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.780+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.10 2024-09-14T11:33:30.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.784+0000 7f2e8cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:30.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.784+0000 7f2e8cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:30.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2e8cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2e8cf2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2e8cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2e8cf2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:33:30.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2d5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94923707410096 notifier 7818 bl.length()=1007 2024-09-14T11:33:30.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2d5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2d5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.785+0000 7f2d5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.786+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.786+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.786+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:33:30.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.786+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:33:30.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.788+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.0 2024-09-14T11:33:30.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.788+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.1 2024-09-14T11:33:30.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.789+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.2 2024-09-14T11:33:30.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.789+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.3 2024-09-14T11:33:30.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.789+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.4 2024-09-14T11:33:30.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.790+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.5 2024-09-14T11:33:30.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.790+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.6 2024-09-14T11:33:30.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.790+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.7 2024-09-14T11:33:30.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.791+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.8 2024-09-14T11:33:30.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.791+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.9 2024-09-14T11:33:30.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.791+0000 7f2e8cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.37.10 2024-09-14T11:33:30.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.792+0000 7f2e8cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:30.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.792+0000 7f2e8cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2e8cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2e8cf2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2e8cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2e8cf2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37, ofs0, ns] 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2d5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94923707410096 notifier 7818 bl.length()=975 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2d5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 info.flags=0x17 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2d5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:a588039c-1457-497f-adbd-8890a12279b7.4508.37 to cache LRU end 2024-09-14T11:33:30.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.793+0000 7f2d5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:30.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.794+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_sources= new_sources= 2024-09-14T11:33:30.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.794+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential sources added=[] removed=[] 2024-09-14T11:33:30.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.794+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): orig_dests= new_dests= 2024-09-14T11:33:30.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.794+0000 7f2e8cf2e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[a588039c-1457-497f-adbd-8890a12279b7.4508.37]): potential dests added=[] removed=[] 2024-09-14T11:33:30.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.796+0000 7f2e8cf2e800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:30.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.797+0000 7f2d3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:30.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.800+0000 7f2e8cf2e800 20 remove_watcher() i=0 2024-09-14T11:33:30.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.800+0000 7f2e8cf2e800 2 removed watcher, disabling cache 2024-09-14T11:33:30.799 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.801+0000 7f2e8cf2e800 20 remove_watcher() i=1 2024-09-14T11:33:30.800 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.802+0000 7f2e8cf2e800 20 remove_watcher() i=2 2024-09-14T11:33:30.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.803+0000 7f2e8cf2e800 20 remove_watcher() i=3 2024-09-14T11:33:30.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.804+0000 7f2e8cf2e800 20 remove_watcher() i=4 2024-09-14T11:33:30.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.805+0000 7f2e8cf2e800 20 remove_watcher() i=5 2024-09-14T11:33:30.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.806+0000 7f2e8cf2e800 20 remove_watcher() i=6 2024-09-14T11:33:30.805 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.807+0000 7f2e8cf2e800 20 remove_watcher() i=7 2024-09-14T11:33:30.817 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:33:30.847 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:30.847 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:30.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.885+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 realm 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:30.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.887+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.888+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.888+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.889+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:30.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.889+0000 7f5059326800 20 searching for the correct realm 2024-09-14T11:33:30.889 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:30.891+0000 7f50557da640 0 -- 172.21.15.130:0/1272934113 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f503c00b040 msgr2=0x7f503c071ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.097+0000 7f50557da640 0 -- 172.21.15.130:0/1272934113 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f503c00b040 msgr2=0x7f503c071ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.101+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 zone default found 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 4 Realm: () 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 zonegroup default 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.102+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.103+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.103+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.103+0000 7f5059326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.103 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.103+0000 7f5059326800 20 started sync module instance, tier type = 2024-09-14T11:33:31.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.103+0000 7f5059326800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=0 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=1 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=2 2024-09-14T11:33:31.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=3 2024-09-14T11:33:31.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=4 2024-09-14T11:33:31.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=5 2024-09-14T11:33:31.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.113+0000 7f5059326800 20 add_watcher() i=6 2024-09-14T11:33:31.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.114+0000 7f5059326800 20 add_watcher() i=7 2024-09-14T11:33:31.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.114+0000 7f5059326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.115+0000 7f4f0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 5 note: GC not initialized 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f4f09fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 20 Filter name: none 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f4e7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.116+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.117+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:31.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.117+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.117+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.117+0000 7f5059326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.117+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.118+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.118+0000 7f5059326800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.118+0000 7f5059326800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:33:31.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.118+0000 7f5059326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.120+0000 7f4f0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.122+0000 7f5059326800 20 remove_watcher() i=0 2024-09-14T11:33:31.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.122+0000 7f5059326800 2 removed watcher, disabling cache 2024-09-14T11:33:31.121 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.123+0000 7f5059326800 20 remove_watcher() i=1 2024-09-14T11:33:31.122 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.124+0000 7f5059326800 20 remove_watcher() i=2 2024-09-14T11:33:31.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.125+0000 7f5059326800 20 remove_watcher() i=3 2024-09-14T11:33:31.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.126+0000 7f5059326800 20 remove_watcher() i=4 2024-09-14T11:33:31.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.127+0000 7f5059326800 20 remove_watcher() i=5 2024-09-14T11:33:31.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.128+0000 7f5059326800 20 remove_watcher() i=6 2024-09-14T11:33:31.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.129+0000 7f5059326800 20 remove_watcher() i=7 2024-09-14T11:33:31.138 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:31.138 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:31.138 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-logrecord-writes id: a588039c-1457-497f-adbd-8890a12279b7.4508.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:31.138 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:31.140 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.140 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.144 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.144 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.187 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.187 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.217 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:33:31.217 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:31.218 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.219 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.230 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.230 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.272 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.273 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.281 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.281 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.287 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.288 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.294 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.295 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.301 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.301 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.307 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.307 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.314 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.314 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.321 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.321 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.328 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.328 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.334 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.334 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.340 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.341 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.348 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.348 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.355 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.355 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.361 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.361 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.368 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.368 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.374 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.375 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.381 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.381 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.387 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.388 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.394 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.394 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.401 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:31.402 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:31.409 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:31.437 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.437 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.474+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.476+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 realm 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.477+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.478+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.478+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.478+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.478+0000 7fbff540d800 20 searching for the correct realm 2024-09-14T11:33:31.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.480+0000 7fbfebfff640 0 -- 172.21.15.130:0/3138008349 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fbebc0878d0 msgr2=0x7fbebc089d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.686+0000 7fbff2ef7640 0 -- 172.21.15.130:0/3138008349 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fbfec078170 msgr2=0x7fbfec042340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.893+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 zone default found 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 4 Realm: () 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 zonegroup default 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.894+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.895+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.895+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.895+0000 7fbff540d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.895+0000 7fbff540d800 20 started sync module instance, tier type = 2024-09-14T11:33:31.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.895+0000 7fbff540d800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:31.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=0 2024-09-14T11:33:31.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=1 2024-09-14T11:33:31.902 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=2 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=3 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=4 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=5 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.904+0000 7fbff540d800 20 add_watcher() i=6 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.905+0000 7fbff540d800 20 add_watcher() i=7 2024-09-14T11:33:31.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.905+0000 7fbff540d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.906+0000 7fbea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 5 note: GC not initialized 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbe23fff640 20 reqs_thread_entry: start 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 20 Filter name: none 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbe21ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:31.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.907+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.908+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:31.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.908+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.908+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:31.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.908+0000 7fbff540d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.908+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.909+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:31.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.909+0000 7fbff540d800 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.910+0000 7fbff540d800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:31.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.910+0000 7fbff540d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.911+0000 7fbea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.913+0000 7fbff540d800 20 remove_watcher() i=0 2024-09-14T11:33:31.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.913+0000 7fbff540d800 2 removed watcher, disabling cache 2024-09-14T11:33:31.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.914+0000 7fbff540d800 20 remove_watcher() i=1 2024-09-14T11:33:31.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.915+0000 7fbff540d800 20 remove_watcher() i=2 2024-09-14T11:33:31.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.916+0000 7fbff540d800 20 remove_watcher() i=3 2024-09-14T11:33:31.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.917+0000 7fbff540d800 20 remove_watcher() i=4 2024-09-14T11:33:31.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.918+0000 7fbff540d800 20 remove_watcher() i=5 2024-09-14T11:33:31.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.919+0000 7fbff540d800 20 remove_watcher() i=6 2024-09-14T11:33:31.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:31.920+0000 7fbff540d800 20 remove_watcher() i=7 2024-09-14T11:33:31.929 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:31.929 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:31.929 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:31.929 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:31.931 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:33:31.965 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.965 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.003+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 realm 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.206+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.207+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.207+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.208+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.208+0000 7f3633d1f800 20 searching for the correct realm 2024-09-14T11:33:32.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.210+0000 7f362f2a8640 0 -- 172.21.15.130:0/3751051821 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f3620024070 msgr2=0x7f36200747a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.212 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.213+0000 7f362faa9640 0 -- 172.21.15.130:0/3751051821 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f362803f040 msgr2=0x7f362803f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.420+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 zone default found 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 4 Realm: () 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 zonegroup default 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.421+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.422+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.422+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.422+0000 7f3633d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.422+0000 7f3633d1f800 20 started sync module instance, tier type = 2024-09-14T11:33:32.422 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.422+0000 7f3633d1f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:32.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=0 2024-09-14T11:33:32.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=1 2024-09-14T11:33:32.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=2 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=3 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=4 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=5 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.431+0000 7f3633d1f800 20 add_watcher() i=6 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.432+0000 7f3633d1f800 20 add_watcher() i=7 2024-09-14T11:33:32.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.432+0000 7f3633d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.433+0000 7f34e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 5 note: GC not initialized 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f34e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 20 Filter name: none 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f345e7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:32.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.434+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:32.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:32.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:32.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 : miss 2024-09-14T11:33:32.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.435+0000 7f3633d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 2024-09-14T11:33:32.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:32.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:32.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38, ofs0, ns] 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f350effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 93998554559312 notifier 7875 bl.length()=1015 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f350effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f350effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f350effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_sources= new_sources= 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential sources added=[] removed=[] 2024-09-14T11:33:32.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_dests= new_dests= 2024-09-14T11:33:32.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.442+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential dests added=[] removed=[] 2024-09-14T11:33:32.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.0 2024-09-14T11:33:32.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.0 2024-09-14T11:33:32.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.1 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.1 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.2 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.2 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.3 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.3 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.4 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.4 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.5 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.5 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.6 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.6 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.7 2024-09-14T11:33:32.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.7 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.8 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.8 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.9 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.9 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.10 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.10 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.11 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.11 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.446+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.0 2024-09-14T11:33:32.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.447+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.447+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.2 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.448+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.3 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.448+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.4 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.449+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.5 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.449+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.6 2024-09-14T11:33:32.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.450+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.7 2024-09-14T11:33:32.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.450+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.8 2024-09-14T11:33:32.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.451+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.9 2024-09-14T11:33:32.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.451+0000 7f3633d1f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.10 2024-09-14T11:33:32.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.454+0000 7f3633d1f800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:33:32.453 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.454+0000 7f3633d1f800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:33:32.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.463+0000 7f3633d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:32.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.463+0000 7f3633d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38, ofs0, ns] 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f350effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 93998554559312 notifier 7875 bl.length()=983 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f350effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f350effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f350effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_sources= new_sources= 2024-09-14T11:33:32.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential sources added=[] removed=[] 2024-09-14T11:33:32.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_dests= new_dests= 2024-09-14T11:33:32.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential dests added=[] removed=[] 2024-09-14T11:33:32.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.465+0000 7f3633d1f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:33:32.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.467+0000 7f34e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.469+0000 7f3633d1f800 20 remove_watcher() i=0 2024-09-14T11:33:32.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.469+0000 7f3633d1f800 2 removed watcher, disabling cache 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.470+0000 7f3633d1f800 20 remove_watcher() i=1 2024-09-14T11:33:32.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.471+0000 7f3633d1f800 20 remove_watcher() i=2 2024-09-14T11:33:32.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.472+0000 7f3633d1f800 20 remove_watcher() i=3 2024-09-14T11:33:32.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.473+0000 7f3633d1f800 20 remove_watcher() i=4 2024-09-14T11:33:32.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.474+0000 7f3633d1f800 20 remove_watcher() i=5 2024-09-14T11:33:32.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.475+0000 7f3633d1f800 20 remove_watcher() i=6 2024-09-14T11:33:32.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.476+0000 7f3633d1f800 20 remove_watcher() i=7 2024-09-14T11:33:32.486 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:32.515 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:32.515 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.553+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 realm 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.555+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.556+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.556+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.557+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.557+0000 7f126a740800 20 searching for the correct realm 2024-09-14T11:33:32.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.559+0000 7f125ffff640 0 -- 172.21.15.130:0/4220985836 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f1258096190 msgr2=0x7f1258088710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.562+0000 7f12664ed640 0 -- 172.21.15.130:0/4220985836 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f1260083910 msgr2=0x7f12600743e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:32.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.767+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 zone default found 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 4 Realm: () 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 zonegroup default 2024-09-14T11:33:32.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.768+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.769+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.769+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.769+0000 7f126a740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.769+0000 7f126a740800 20 started sync module instance, tier type = 2024-09-14T11:33:32.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.769+0000 7f126a740800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:32.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=0 2024-09-14T11:33:32.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=1 2024-09-14T11:33:32.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=2 2024-09-14T11:33:32.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=3 2024-09-14T11:33:32.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=4 2024-09-14T11:33:32.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=5 2024-09-14T11:33:32.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.778+0000 7f126a740800 20 add_watcher() i=6 2024-09-14T11:33:32.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.779+0000 7f126a740800 20 add_watcher() i=7 2024-09-14T11:33:32.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.779+0000 7f126a740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.780+0000 7f111cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.780+0000 7f126a740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.780+0000 7f126a740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f126a740800 5 note: GC not initialized 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f10977fe640 20 reqs_thread_entry: start 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f126a740800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f126a740800 20 Filter name: none 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f10957fa640 20 reqs_thread_entry: start 2024-09-14T11:33:32.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.781+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.782+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:32.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.782+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.783+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:32.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.783+0000 7f126a740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.783+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.783+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:32.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.783+0000 7f126a740800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.784+0000 7f126a740800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:32.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.784+0000 7f126a740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:32.784 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.785+0000 7f111cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.787+0000 7f126a740800 20 remove_watcher() i=0 2024-09-14T11:33:32.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.787+0000 7f126a740800 2 removed watcher, disabling cache 2024-09-14T11:33:32.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.788+0000 7f126a740800 20 remove_watcher() i=1 2024-09-14T11:33:32.788 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.789+0000 7f126a740800 20 remove_watcher() i=2 2024-09-14T11:33:32.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.790+0000 7f126a740800 20 remove_watcher() i=3 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.791+0000 7f126a740800 20 remove_watcher() i=4 2024-09-14T11:33:32.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.792+0000 7f126a740800 20 remove_watcher() i=5 2024-09-14T11:33:32.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.793+0000 7f126a740800 20 remove_watcher() i=6 2024-09-14T11:33:32.792 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.794+0000 7f126a740800 20 remove_watcher() i=7 2024-09-14T11:33:32.802 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:32.802 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:32.802 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:32.803 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.804 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:32.810 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:32.811 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:32.854 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:32.886 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:32.886 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.924+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 20 realm 2024-09-14T11:33:32.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.925+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.926+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.926+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.926+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.926+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.927+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.927+0000 7fa14df40800 20 searching for the correct realm 2024-09-14T11:33:32.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.929+0000 7fa1414c6640 0 -- 172.21.15.130:0/3577688476 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fa13c086060 msgr2=0x7fa13c0b5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:32.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:32.933+0000 7fa149cc7640 0 -- 172.21.15.130:0/3577688476 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fa144013b80 msgr2=0x7fa14404b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.139+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:33.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 zone default found 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 4 Realm: () 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 zonegroup default 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 started sync module instance, tier type = 2024-09-14T11:33:33.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.140+0000 7fa14df40800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:33.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=0 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=1 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=2 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=3 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=4 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=5 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.149+0000 7fa14df40800 20 add_watcher() i=6 2024-09-14T11:33:33.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.150+0000 7fa14df40800 20 add_watcher() i=7 2024-09-14T11:33:33.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.150+0000 7fa14df40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:33.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.151+0000 7f9ffb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 5 note: GC not initialized 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7f9ffa7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 Filter name: none 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7f9f6bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:33.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 : miss 2024-09-14T11:33:33.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.152+0000 7fa14df40800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.153+0000 7fa14df40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 2024-09-14T11:33:33.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.157+0000 7fa14df40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.157+0000 7fa14df40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.157+0000 7fa14df40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.157+0000 7fa14df40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38, ofs0, ns] 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa02d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94792744983248 notifier 7388 bl.length()=1015 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa02d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa02d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa02d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_sources= new_sources= 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential sources added=[] removed=[] 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_dests= new_dests= 2024-09-14T11:33:33.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.158+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential dests added=[] removed=[] 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.0 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.0 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.1 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.1 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.2 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.2 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.3 2024-09-14T11:33:33.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.3 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.4 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.4 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.5 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.5 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.6 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.6 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.7 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.7 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.8 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.8 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.9 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.9 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.10 2024-09-14T11:33:33.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.10 2024-09-14T11:33:33.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.11 2024-09-14T11:33:33.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1.11 2024-09-14T11:33:33.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.0 2024-09-14T11:33:33.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.162+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.163+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.2 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.163+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.3 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.164+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.4 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.164+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.5 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.165+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.6 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.165+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.7 2024-09-14T11:33:33.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.166+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.8 2024-09-14T11:33:33.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.167+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.9 2024-09-14T11:33:33.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.167+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.10 2024-09-14T11:33:33.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.170+0000 7fa14df40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:33.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.170+0000 7fa14df40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.171+0000 7fa14df40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.171+0000 7fa14df40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.171+0000 7fa14df40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.171+0000 7fa14df40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38, ofs0, ns] 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.171+0000 7fa02cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94792744983248 notifier 7388 bl.length()=1015 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa02cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.170 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa02cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa02cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_sources= new_sources= 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential sources added=[] removed=[] 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_dests= new_dests= 2024-09-14T11:33:33.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.172+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential dests added=[] removed=[] 2024-09-14T11:33:33.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.174+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.0 2024-09-14T11:33:33.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.174+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.1 2024-09-14T11:33:33.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.175+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.2 2024-09-14T11:33:33.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.175+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.3 2024-09-14T11:33:33.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.175+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.4 2024-09-14T11:33:33.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.175+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.5 2024-09-14T11:33:33.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.176+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.6 2024-09-14T11:33:33.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.176+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.7 2024-09-14T11:33:33.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.176+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.8 2024-09-14T11:33:33.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.177+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.9 2024-09-14T11:33:33.175 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.177+0000 7fa14df40800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.38.10 2024-09-14T11:33:33.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.177+0000 7fa14df40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:33.176 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.177+0000 7fa14df40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 2024-09-14T11:33:33.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.178+0000 7fa14df40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.178+0000 7fa14df40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.178+0000 7fa14df40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.178+0000 7fa14df40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38, ofs0, ns] 2024-09-14T11:33:33.177 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa02d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94792744983248 notifier 7388 bl.length()=983 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa02d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 info.flags=0x17 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa02d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.38 to cache LRU end 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa02d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_sources= new_sources= 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential sources added=[] removed=[] 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): orig_dests= new_dests= 2024-09-14T11:33:33.178 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.179+0000 7fa14df40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.38]): potential dests added=[] removed=[] 2024-09-14T11:33:33.180 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.181+0000 7fa14df40800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:33.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.183+0000 7f9ffb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.185+0000 7fa14df40800 20 remove_watcher() i=0 2024-09-14T11:33:33.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.185+0000 7fa14df40800 2 removed watcher, disabling cache 2024-09-14T11:33:33.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.186+0000 7fa14df40800 20 remove_watcher() i=1 2024-09-14T11:33:33.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.187+0000 7fa14df40800 20 remove_watcher() i=2 2024-09-14T11:33:33.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.188+0000 7fa14df40800 20 remove_watcher() i=3 2024-09-14T11:33:33.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.189+0000 7fa14df40800 20 remove_watcher() i=4 2024-09-14T11:33:33.188 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.189+0000 7fa14df40800 20 remove_watcher() i=5 2024-09-14T11:33:33.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.190+0000 7fa14df40800 20 remove_watcher() i=6 2024-09-14T11:33:33.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.191+0000 7fa14df40800 20 remove_watcher() i=7 2024-09-14T11:33:33.202 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:33.230 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:33.231 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:33.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.268+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 realm 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.270+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.271+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.271+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.271+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:33.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.271+0000 7fc687739800 20 searching for the correct realm 2024-09-14T11:33:33.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.274+0000 7fc683bc8640 0 -- 172.21.15.130:0/449415818 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc66c069c20 msgr2=0x7fc66c067670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.480+0000 7fc683bc8640 0 -- 172.21.15.130:0/449415818 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc66c069c20 msgr2=0x7fc66c067670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:33.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:33.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.483+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 zone default found 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 4 Realm: () 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 zonegroup default 2024-09-14T11:33:33.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.484+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.485+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.485+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.485+0000 7fc687739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.485+0000 7fc687739800 20 started sync module instance, tier type = 2024-09-14T11:33:33.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.485+0000 7fc687739800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=0 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=1 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=2 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=3 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=4 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=5 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.494+0000 7fc687739800 20 add_watcher() i=6 2024-09-14T11:33:33.493 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.495+0000 7fc687739800 20 add_watcher() i=7 2024-09-14T11:33:33.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.495+0000 7fc687739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:33.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 5 note: GC not initialized 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc538fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:33.496 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 20 Filter name: none 2024-09-14T11:33:33.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc4b27fc640 20 reqs_thread_entry: start 2024-09-14T11:33:33.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.497+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.498+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.498+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.499+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.499+0000 7fc687739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.499+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.499+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.499+0000 7fc687739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:33.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.500+0000 7fc687739800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:33.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.500+0000 7fc687739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:33.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.501+0000 7fc539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:33.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.503+0000 7fc687739800 20 remove_watcher() i=0 2024-09-14T11:33:33.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.503+0000 7fc687739800 2 removed watcher, disabling cache 2024-09-14T11:33:33.503 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.504+0000 7fc687739800 20 remove_watcher() i=1 2024-09-14T11:33:33.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.505+0000 7fc687739800 20 remove_watcher() i=2 2024-09-14T11:33:33.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.506+0000 7fc687739800 20 remove_watcher() i=3 2024-09-14T11:33:33.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.508+0000 7fc687739800 20 remove_watcher() i=4 2024-09-14T11:33:33.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.509+0000 7fc687739800 20 remove_watcher() i=5 2024-09-14T11:33:33.508 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.510+0000 7fc687739800 20 remove_watcher() i=6 2024-09-14T11:33:33.509 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:33.511+0000 7fc687739800 20 remove_watcher() i=7 2024-09-14T11:33:33.519 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:33.519 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:33.520 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:33.520 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:33.521 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.521 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.524 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.525 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.568 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.568 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.597 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:33:33.597 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:33.598 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.598 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.608 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.608 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.650 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.650 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.657 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.657 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.664 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.664 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.670 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.670 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.677 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.678 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.684 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.684 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.690 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.690 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.696 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.697 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.703 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.703 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.709 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.709 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.715 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.715 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.721 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.727 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.728 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.734 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.740 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.740 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.746 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.746 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.752 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.752 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.758 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.758 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.764 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.764 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.772 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:33.772 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:33.778 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:33.807 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:33.807 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.048+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 20 realm 2024-09-14T11:33:34.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.048 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.049+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.050+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.050+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.050+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.050+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.051+0000 7fe0e6918640 0 -- 172.21.15.130:0/2600955204 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x55c5f89a95d0 msgr2=0x55c5f89ab9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:34.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.253+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.253+0000 7fe0f162f800 20 searching for the correct realm 2024-09-14T11:33:34.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.255+0000 7fe0ef91a640 0 -- 172.21.15.130:0/2600955204 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe0d8017070 msgr2=0x7fe0d8077d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:34.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.465+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.466 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 zone default found 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 4 Realm: () 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 zonegroup default 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 started sync module instance, tier type = 2024-09-14T11:33:34.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.466+0000 7fe0f162f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:34.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=0 2024-09-14T11:33:34.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=1 2024-09-14T11:33:34.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=2 2024-09-14T11:33:34.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=3 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=4 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=5 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.475+0000 7fe0f162f800 20 add_watcher() i=6 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.476+0000 7fe0f162f800 20 add_watcher() i=7 2024-09-14T11:33:34.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.476+0000 7fe0f162f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.478+0000 7fdfa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.478+0000 7fe0f162f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.478+0000 7fe0f162f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.478+0000 7fe0f162f800 5 note: GC not initialized 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.478+0000 7fdfa4fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fe0f162f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fe0f162f800 20 Filter name: none 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fdf1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:34.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.479+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.480+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.480+0000 7fe0f162f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.480+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.480+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:34.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.480+0000 7fe0f162f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.481+0000 7fe0f162f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:34.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.481+0000 7fe0f162f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:34.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.483+0000 7fdfa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.485+0000 7fe0f162f800 20 remove_watcher() i=0 2024-09-14T11:33:34.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.485+0000 7fe0f162f800 2 removed watcher, disabling cache 2024-09-14T11:33:34.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.486+0000 7fe0f162f800 20 remove_watcher() i=1 2024-09-14T11:33:34.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.487+0000 7fe0f162f800 20 remove_watcher() i=2 2024-09-14T11:33:34.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.488+0000 7fe0f162f800 20 remove_watcher() i=3 2024-09-14T11:33:34.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.489+0000 7fe0f162f800 20 remove_watcher() i=4 2024-09-14T11:33:34.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.490+0000 7fe0f162f800 20 remove_watcher() i=5 2024-09-14T11:33:34.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.491+0000 7fe0f162f800 20 remove_watcher() i=6 2024-09-14T11:33:34.491 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.492+0000 7fe0f162f800 20 remove_watcher() i=7 2024-09-14T11:33:34.501 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:34.501 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:34.501 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:34.502 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:34.503 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:33:34.539 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:34.539 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.577+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 realm 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.578 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.579+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.580+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.580+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.581+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.581+0000 7f966cf2e800 20 searching for the correct realm 2024-09-14T11:33:34.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.582+0000 7f9668b64640 0 -- 172.21.15.130:0/1771377186 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x55d439d00cf0 msgr2=0x7f966006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.786 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.787+0000 7f9668363640 0 -- 172.21.15.130:0/1771377186 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f965807d070 msgr2=0x7f965808d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:34.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 zone default found 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 4 Realm: () 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 zonegroup default 2024-09-14T11:33:34.795 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.793+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 started sync module instance, tier type = 2024-09-14T11:33:34.796 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.794+0000 7f966cf2e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=0 2024-09-14T11:33:34.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=1 2024-09-14T11:33:34.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=2 2024-09-14T11:33:34.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=3 2024-09-14T11:33:34.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=4 2024-09-14T11:33:34.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=5 2024-09-14T11:33:34.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.803+0000 7f966cf2e800 20 add_watcher() i=6 2024-09-14T11:33:34.806 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.804+0000 7f966cf2e800 20 add_watcher() i=7 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.804+0000 7f966cf2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f951efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f966cf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f966cf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f966cf2e800 5 note: GC not initialized 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f951dfe3640 20 reqs_thread_entry: start 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f966cf2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.806+0000 7f966cf2e800 20 Filter name: none 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f948f7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:34.807 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 : miss 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:34.808 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.809 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.807+0000 7f966cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 2024-09-14T11:33:34.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.815+0000 7f966cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.815+0000 7f966cf2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.814 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.815+0000 7f966cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.815 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.815+0000 7f966cf2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39, ofs0, ns] 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f953f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94369993938992 notifier 7439 bl.length()=1015 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f953f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f953f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f953f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_sources= new_sources= 2024-09-14T11:33:34.816 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential sources added=[] removed=[] 2024-09-14T11:33:34.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_dests= new_dests= 2024-09-14T11:33:34.817 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.816+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential dests added=[] removed=[] 2024-09-14T11:33:34.819 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.0 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.0 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.1 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.1 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.2 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.2 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.3 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.3 2024-09-14T11:33:34.820 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.4 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.4 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.5 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.5 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.6 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.6 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.7 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.7 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.8 2024-09-14T11:33:34.821 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.8 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.9 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.9 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.10 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.10 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.11 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1.11 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.0 2024-09-14T11:33:34.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.821+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1 2024-09-14T11:33:34.823 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.822+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.2 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.822+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.3 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.823+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.4 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.823+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.5 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.824+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.6 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.824+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.7 2024-09-14T11:33:34.824 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.825+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.8 2024-09-14T11:33:34.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.825+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.9 2024-09-14T11:33:34.825 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.826+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.10 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.834+0000 7f966cf2e800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.834+0000 7f966cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:34.833 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.834+0000 7f966cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 2024-09-14T11:33:34.834 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.835+0000 7f966cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.835+0000 7f966cf2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.835+0000 7f966cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.835 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.835+0000 7f966cf2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39, ofs0, ns] 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f953ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94369993938992 notifier 7439 bl.length()=1015 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f953ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f953ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f953ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_sources= new_sources= 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential sources added=[] removed=[] 2024-09-14T11:33:34.836 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_dests= new_dests= 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.836+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential dests added=[] removed=[] 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.838+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.0 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.839+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.1 2024-09-14T11:33:34.837 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.839+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.2 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.839+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.3 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.839+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.4 2024-09-14T11:33:34.838 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.840+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.5 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.840+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.6 2024-09-14T11:33:34.839 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.840+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.7 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.841+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.8 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.841+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.9 2024-09-14T11:33:34.840 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.841+0000 7f966cf2e800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.39.10 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.842+0000 7f966cf2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:34.841 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.842+0000 7f966cf2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f966cf2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f966cf2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f966cf2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f966cf2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39, ofs0, ns] 2024-09-14T11:33:34.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f953f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94369993938992 notifier 7439 bl.length()=983 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f953f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 info.flags=0x17 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f953f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.39 to cache LRU end 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.843+0000 7f953f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.844+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_sources= new_sources= 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.844+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential sources added=[] removed=[] 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.844+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): orig_dests= new_dests= 2024-09-14T11:33:34.843 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.844+0000 7f966cf2e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.39]): potential dests added=[] removed=[] 2024-09-14T11:33:34.845 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.846+0000 7f966cf2e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:34.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.848+0000 7f951efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.850+0000 7f966cf2e800 20 remove_watcher() i=0 2024-09-14T11:33:34.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.850+0000 7f966cf2e800 2 removed watcher, disabling cache 2024-09-14T11:33:34.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.851+0000 7f966cf2e800 20 remove_watcher() i=1 2024-09-14T11:33:34.851 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.852+0000 7f966cf2e800 20 remove_watcher() i=2 2024-09-14T11:33:34.852 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.853+0000 7f966cf2e800 20 remove_watcher() i=3 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.854+0000 7f966cf2e800 20 remove_watcher() i=4 2024-09-14T11:33:34.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.855+0000 7f966cf2e800 20 remove_watcher() i=5 2024-09-14T11:33:34.854 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.856+0000 7f966cf2e800 20 remove_watcher() i=6 2024-09-14T11:33:34.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.857+0000 7f966cf2e800 20 remove_watcher() i=7 2024-09-14T11:33:34.867 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:34.896 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:34.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.934+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.935+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.935+0000 7f4449739800 20 realm 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.935+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.936+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.936+0000 7f4449739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.936+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.936+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.936+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.937+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:34.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.937+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.937+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:34.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.937+0000 7f4449739800 20 searching for the correct realm 2024-09-14T11:33:34.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:34.939+0000 7f4445c26640 0 -- 172.21.15.130:0/967992030 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4430027030 msgr2=0x7f4430069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:35.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.145+0000 7f4445c26640 0 -- 172.21.15.130:0/967992030 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4430027030 msgr2=0x7f4430069d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:35.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.149+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 zone default found 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 4 Realm: () 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 zonegroup default 2024-09-14T11:33:35.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.150+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.151+0000 7f4449739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.151+0000 7f4449739800 20 started sync module instance, tier type = 2024-09-14T11:33:35.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.151+0000 7f4449739800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=0 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=1 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=2 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=3 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=4 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=5 2024-09-14T11:33:35.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.159+0000 7f4449739800 20 add_watcher() i=6 2024-09-14T11:33:35.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.160+0000 7f4449739800 20 add_watcher() i=7 2024-09-14T11:33:35.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.160+0000 7f4449739800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.160 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.161+0000 7f42fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 5 note: GC not initialized 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f42fa7e4640 20 reqs_thread_entry: start 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:35.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 20 Filter name: none 2024-09-14T11:33:35.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f426bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:35.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.162+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.163+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.163+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.164+0000 7f4449739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:35.164 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.166+0000 7f42fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.166 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.168+0000 7f4449739800 20 remove_watcher() i=0 2024-09-14T11:33:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.168+0000 7f4449739800 2 removed watcher, disabling cache 2024-09-14T11:33:35.167 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.169+0000 7f4449739800 20 remove_watcher() i=1 2024-09-14T11:33:35.168 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.170+0000 7f4449739800 20 remove_watcher() i=2 2024-09-14T11:33:35.169 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.171+0000 7f4449739800 20 remove_watcher() i=3 2024-09-14T11:33:35.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.172+0000 7f4449739800 20 remove_watcher() i=4 2024-09-14T11:33:35.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.173+0000 7f4449739800 20 remove_watcher() i=5 2024-09-14T11:33:35.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.174+0000 7f4449739800 20 remove_watcher() i=6 2024-09-14T11:33:35.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.175+0000 7f4449739800 20 remove_watcher() i=7 2024-09-14T11:33:35.183 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.183 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:35.184 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: error-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:33:35.184 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.186 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.186 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.189 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.189 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.232 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.232 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.260 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:33:35.260 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.261 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.262 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.272 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.272 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.315 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.315 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.322 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.322 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.329 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.329 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.336 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.336 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.343 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.343 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.349 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.350 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.356 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.356 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.362 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.362 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.368 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.368 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.374 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.374 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.381 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.381 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.387 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.387 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.394 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.394 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.401 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.401 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.408 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.408 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.415 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.415 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.421 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.421 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.428 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.428 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.434 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.434 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.441 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:35.441 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:35.448 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:33:35.476 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:35.476 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:35.512 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.513+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 realm 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.514 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.515+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.516+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.516+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.517+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:35.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.517+0000 7fadd4a0f800 20 searching for the correct realm 2024-09-14T11:33:35.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.519+0000 7fadd0993640 0 -- 172.21.15.130:0/3892935029 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fadb806e2e0 msgr2=0x7fadb8074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.522 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.523+0000 7fadc7991640 0 -- 172.21.15.130:0/3892935029 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x562f8f354e30 msgr2=0x562f8f357220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.526+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 zone default found 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 4 Realm: () 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 zonegroup default 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.527+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.528+0000 7fadd4a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.528+0000 7fadd4a0f800 20 started sync module instance, tier type = 2024-09-14T11:33:35.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.528+0000 7fadd4a0f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=0 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=1 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=2 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=3 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=4 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=5 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.536+0000 7fadd4a0f800 20 add_watcher() i=6 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.537+0000 7fadd4a0f800 20 add_watcher() i=7 2024-09-14T11:33:35.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.537+0000 7fadd4a0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.538+0000 7fac86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 5 note: GC not initialized 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fac85fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 20 Filter name: none 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fabf77fe640 20 reqs_thread_entry: start 2024-09-14T11:33:35.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.539+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.540+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.540+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.540+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.540+0000 7fadd4a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:35.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.540+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.541+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.541+0000 7fadd4a0f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.541+0000 7fadd4a0f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.541+0000 7fadd4a0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:35.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.543+0000 7fac86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.545+0000 7fadd4a0f800 20 remove_watcher() i=0 2024-09-14T11:33:35.543 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.545+0000 7fadd4a0f800 2 removed watcher, disabling cache 2024-09-14T11:33:35.544 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.546+0000 7fadd4a0f800 20 remove_watcher() i=1 2024-09-14T11:33:35.545 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.547+0000 7fadd4a0f800 20 remove_watcher() i=2 2024-09-14T11:33:35.546 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.548+0000 7fadd4a0f800 20 remove_watcher() i=3 2024-09-14T11:33:35.547 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.548+0000 7fadd4a0f800 20 remove_watcher() i=4 2024-09-14T11:33:35.548 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.549+0000 7fadd4a0f800 20 remove_watcher() i=5 2024-09-14T11:33:35.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.550+0000 7fadd4a0f800 20 remove_watcher() i=6 2024-09-14T11:33:35.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.551+0000 7fadd4a0f800 20 remove_watcher() i=7 2024-09-14T11:33:35.560 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.560 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:35.560 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:35.560 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.561 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:33:35.596 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:35.596 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:35.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.633+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.633 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.634+0000 7fc846d25800 20 realm 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.635+0000 7fc846d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.634 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:35.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.636+0000 7fc846d25800 20 searching for the correct realm 2024-09-14T11:33:35.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.638+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.842 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.844+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.846 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.847 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.848 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 zone default found 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 4 Realm: () 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 zonegroup default 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 started sync module instance, tier type = 2024-09-14T11:33:35.850 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.849+0000 7fc846d25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:35.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=0 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=1 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=2 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=3 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=4 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=5 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=6 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.859+0000 7fc846d25800 20 add_watcher() i=7 2024-09-14T11:33:35.857 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.859+0000 7fc846d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.859 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.860+0000 7fc6f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 5 note: GC not initialized 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc673fff640 20 reqs_thread_entry: start 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 20 Filter name: none 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc671ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.861+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.861 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : miss 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.862 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.862+0000 7fc846d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:33:35.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.867+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.867+0000 7fc846d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.867+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.866 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.867+0000 7fc846d25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94255960696480 notifier 7487 bl.length()=1015 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:33:35.867 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:33:35.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:35.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:35.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:35.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:35.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.0 2024-09-14T11:33:35.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1 2024-09-14T11:33:35.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2 2024-09-14T11:33:35.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.3 2024-09-14T11:33:35.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.4 2024-09-14T11:33:35.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.5 2024-09-14T11:33:35.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.6 2024-09-14T11:33:35.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.7 2024-09-14T11:33:35.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.8 2024-09-14T11:33:35.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.9 2024-09-14T11:33:35.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.877+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.10 2024-09-14T11:33:35.879 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc846d25800 time 2024-09-14T11:33:35.882129+0000 2024-09-14T11:33:35.879 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc84838c76a] 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.880 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:35.881 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.881 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:35.881 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:35.882 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:35.882 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fc846d25800 thread_name:radosgw-admin 2024-09-14T11:33:35.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.881+0000 7fc846d25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc846d25800 time 2024-09-14T11:33:35.882129+0000 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc84838c76a] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:35.883 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:35.884 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc84703e6f0] 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc84708b99c] 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc84838c7c4] 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.903 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.882+0000 7fc846d25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fc846d25800 thread_name:radosgw-admin 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc84703e6f0] 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc84708b99c] 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:35.904 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc84838c7c4] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.905 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:33:35.618+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:33:35.618+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key hook 0x55b9acfe3778 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ace90b20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ace97f50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9acfea960 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.906 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.102803s 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ace90b20 auth_method 0 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9acfea960 auth_method 0 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.907 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:33:35.618+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ace97f50 auth_method 0 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient(hunting): handle_auth_done global_id 7478 payload 824 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.908 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:33:35.619+0000 7fc8429ae640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: dump: 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.909 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: dump: 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.910 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:33:35.619+0000 7fc846d25800 5 monclient: authenticate success, global_id 7478 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:33:35.619+0000 7fc730e09640 4 set_mon_vals no callback set 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:33:35.619+0000 7fc846d25800 1 librados: init done 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.911 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:33:35.621+0000 7fc8421ad640 10 monclient: get_auth_request con 0x7fc728077230 auth_method 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:33:35.621+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad02c3d0 auth_method 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:33:35.622+0000 7fc8429ae640 10 monclient: get_auth_request con 0x55b9ad02f5b0 auth_method 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:33:35.623+0000 7fc8421ad640 10 monclient: get_auth_request con 0x55b9ad0337f0 auth_method 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:33:35.624+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:33:35.624+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:33:35.624+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.912 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.913 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:33:35.624+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command objecter_requests cmddesc objecter_requests hook 0x55b9ad03bc00 EEXIST 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.914 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:33:35.625+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:33:35.625+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x55b9ad036ed0 EEXIST 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.915 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad05ff20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad060300 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad05ec30 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.109721s 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad05ec30 auth_method 0 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.916 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad060300 auth_method 0 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad05ff20 auth_method 0 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.917 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient(hunting): handle_auth_done global_id 7481 payload 824 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:33:35.626+0000 7fc8421ad640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: dump: 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.918 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: dump: 2024-09-14T11:33:35.919 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:33:35.626+0000 7fc846d25800 5 monclient: authenticate success, global_id 7481 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:33:35.626+0000 7fc8439b0640 4 set_mon_vals no callback set 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.920 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:33:35.628+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc71c077140 auth_method 0 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: get_monmap_and_config 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:33:35.628+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.921 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.922 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:33:35.628+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.923 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:33:35.629+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:33:35.629+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.924 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:33:35.629+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x7fffb03bfbf8 EEXIST 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad083f80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad0ae9f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad0afda0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.113458s 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad0ae9f0 auth_method 0 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.925 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad0afda0 auth_method 0 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad083f80 auth_method 0 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.926 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_done global_id 7484 payload 274 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:33:35.629+0000 7fc8431af640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: dump: 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.927 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: dump: 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.928 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 monclient: authenticate success, global_id 7484 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:33:35.630+0000 7fc846d25800 4 set_mon_vals no callback set 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: shutdown 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.929 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.930 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.931 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:33:35.630+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 librados: starting msgr at 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 librados: starting objecter 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command objecter_requests cmddesc objecter_requests hook 0x55b9ad0b15d0 EEXIST 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:33:35.631+0000 7fc846d25800 1 librados: setting wanted keys 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:33:35.631+0000 7fc846d25800 1 librados: calling monclient init 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.932 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:33:35.631+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:33:35.631+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.933 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x55b9ad074928 EEXIST 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad083f80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad0afda0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad0b8640 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.115612s 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad0afda0 auth_method 0 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.934 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad0b8640 auth_method 0 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad083f80 auth_method 0 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.935 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_done global_id 7487 payload 824 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:33:35.631+0000 7fc8421ad640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: dump: 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.936 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: dump: 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.937 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:33:35.632+0000 7fc846d25800 5 monclient: authenticate success, global_id 7487 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:33:35.632+0000 7fc7267fc640 4 set_mon_vals no callback set 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:33:35.632+0000 7fc846d25800 1 librados: init done 2024-09-14T11:33:35.938 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:33:35.632+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cr dump hook 0x55b9ad0b7618 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:33:35.633+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:33:35.634+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc70c077230 auth_method 0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:33:35.634+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad0cf2f0 auth_method 0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 realm 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:33:35.635+0000 7fc846d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.939 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:33:35.635+0000 7fc8429ae640 10 monclient: get_auth_request con 0x55b9ad0d3580 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:33:35.636+0000 7fc8421ad640 10 monclient: get_auth_request con 0x55b9ad0d6de0 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 searching for the correct realm 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:33:35.636+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad0dbb80 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:33:35.637+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc83c034040 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:33:35.638+0000 7fc8421ad640 10 monclient: get_auth_request con 0x7fc8340d1040 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:33:35.638+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc82c089fa0 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:33:35.638+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:33:35.839+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc82c089fa0 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:33:35.843+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc83c01c040 auth_method 0 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:33:35.844+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.940 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:33:35.844+0000 7fc724ff9640 1 client.7487.objecter ms_handle_reset 0x7fc82c089fa0 session 0x7fc82c089690 osd.4 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:33:35.844+0000 7fc724ff9640 10 monclient: _renew_subs 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:33:35.844+0000 7fc724ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:33:35.844+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc70c0878d0 auth_method 0 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.941 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 zone default found 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 Realm: () 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:33:35.849+0000 7fc846d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 zonegroup default 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.942 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 started sync module instance, tier type = 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=0 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=1 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=2 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=3 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=4 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=5 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=6 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:33:35.859+0000 7fc846d25800 20 add_watcher() i=7 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:33:35.859+0000 7fc846d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:35.943 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:33:35.860+0000 7fc6f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:35.944 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:33:35.861+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache list hook 0x55b9ad0b8590 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache inspect hook 0x55b9ad0b8590 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache erase hook 0x55b9ad0b8590 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache zap hook 0x55b9ad0b8590 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 note: GC not initialized 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:33:35.861+0000 7fc673fff640 20 reqs_thread_entry: start 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace show hook 0x7fc83c00d870 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace history hook 0x7fc83c00d870 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace active hook 0x7fc83c00d870 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace active_short hook 0x7fc83c00d870 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:35.945 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 Filter name: none 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:33:35.861+0000 7fc671ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:33:35.861+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : miss 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:33:35.946 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94255960696480 notifier 7487 bl.length()=1015 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:35.947 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:35.948 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.0 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.3 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.4 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.5 2024-09-14T11:33:35.949 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.6 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.7 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.8 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.9 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:33:35.877+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.10 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:33:35.881+0000 7fc846d25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc846d25800 time 2024-09-14T11:33:35.882129+0000 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc84838c76a] 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.950 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:33:35.882+0000 7fc846d25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fc846d25800 thread_name:radosgw-admin 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc84703e6f0] 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc84708b99c] 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc84838c7c4] 2024-09-14T11:33:35.951 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:33:35.952 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:33:35.953 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:33:35.954 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:35.955 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:33:35.956 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:33:35.957 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:35.958 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc671ffb640 / http_manager 2024-09-14T11:33:35.959 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc673fff640 / http_manager 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc6f97e2640 / rgw_dt_lg_renew 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc724ff9640 / ms_dispatch 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc7267fc640 / io_context_pool 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc72ce01640 / ms_dispatch 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc72f606640 / ms_dispatch 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc730e09640 / io_context_pool 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8421ad640 / msgr-worker-2 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8429ae640 / msgr-worker-1 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8431af640 / msgr-worker-0 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8439b0640 / io_context_pool 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc846d25800 / radosgw-admin 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:33:35.960 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.142807.log 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: crc 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 AuthRegistry(0x55b9acfe3630) adding con mode: secure 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:33:35.618+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:33:35.618+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.961 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:33:35.618+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key hook 0x55b9acfe3778 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ace90b20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ace97f50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9acfea960 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:33:35.618+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.102803s 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ace90b20 auth_method 0 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.962 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9acfea960 auth_method 0 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:33:35.618+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:33:35.618+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:33:35.618+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ace97f50 auth_method 0 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.963 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:33:35.619+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:33:35.619+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient(hunting): handle_auth_done global_id 7478 payload 824 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:33:35.619+0000 7fc8429ae640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:33:35.619+0000 7fc8429ae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: dump: 2024-09-14T11:33:35.964 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.965 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:33:35.619+0000 7fc72f606640 10 monclient: dump: 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.966 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:33:35.619+0000 7fc846d25800 5 monclient: authenticate success, global_id 7478 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:33:35.619+0000 7fc730e09640 4 set_mon_vals no callback set 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:33:35.619+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:33:35.619+0000 7fc846d25800 1 librados: init done 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:33:35.621+0000 7fc72f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:33:35.621+0000 7fc8421ad640 10 monclient: get_auth_request con 0x7fc728077230 auth_method 0 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:33:35.621+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad02c3d0 auth_method 0 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:33:35.622+0000 7fc8429ae640 10 monclient: get_auth_request con 0x55b9ad02f5b0 auth_method 0 2024-09-14T11:33:35.967 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:33:35.623+0000 7fc8421ad640 10 monclient: get_auth_request con 0x55b9ad0337f0 auth_method 0 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:33:35.624+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:33:35.624+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:33:35.624+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.968 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding auth protocol: cephx 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.969 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: crc 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:33:35.624+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0386d0) adding con mode: secure 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:33:35.624+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command objecter_requests cmddesc objecter_requests hook 0x55b9ad03bc00 EEXIST 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding auth protocol: cephx 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.970 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: crc 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 AuthRegistry(0x55b9ad036d88) adding con mode: secure 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:33:35.625+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:33:35.625+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:33:35.625+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x55b9ad036ed0 EEXIST 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad05ff20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad060300 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.971 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad05ec30 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:33:35.625+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.109721s 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad05ec30 auth_method 0 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad060300 auth_method 0 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.972 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad05ff20 auth_method 0 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:33:35.625+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:33:35.625+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.973 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:33:35.625+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient(hunting): handle_auth_done global_id 7481 payload 824 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:33:35.626+0000 7fc8421ad640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:33:35.626+0000 7fc8421ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: dump: 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.974 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:33:35.626+0000 7fc72ce01640 10 monclient: dump: 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.975 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:33:35.626+0000 7fc846d25800 5 monclient: authenticate success, global_id 7481 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:33:35.626+0000 7fc8439b0640 4 set_mon_vals no callback set 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.976 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:33:35.626+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:33:35.628+0000 7fc72ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:33:35.628+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc71c077140 auth_method 0 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: get_monmap_and_config 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:33:35.628+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.977 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding auth protocol: cephx 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.978 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: crc 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x55b9ad07fdf0) adding con mode: secure 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:33:35.628+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:33:35.628+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding auth protocol: cephx 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.979 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: crc 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:33:35.628+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bfab0) adding con mode: secure 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:33:35.629+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:33:35.629+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:33:35.629+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x7fffb03bfbf8 EEXIST 2024-09-14T11:33:35.980 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad083f80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad0ae9f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad0afda0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:33:35.629+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.113458s 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad0ae9f0 auth_method 0 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.981 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad0afda0 auth_method 0 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad083f80 auth_method 0 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:33:35.629+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.982 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:33:35.629+0000 7fc8429ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient(hunting): handle_auth_done global_id 7484 payload 274 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:33:35.629+0000 7fc8431af640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:33:35.629+0000 7fc8431af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: dump: 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.983 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:33:35.630+0000 7fc7267fc640 10 monclient: dump: 2024-09-14T11:33:35.984 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 monclient: authenticate success, global_id 7484 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: get_monmap_and_config success 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:33:35.630+0000 7fc846d25800 4 set_mon_vals no callback set 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: shutdown 2024-09-14T11:33:35.985 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: build_initial_monmap 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 build_initial for_mkfs: 0 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:33:35.630+0000 7fc846d25800 10 monclient: monmap: 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.986 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding auth protocol: cephx 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: crc 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:33:35.630+0000 7fc846d25800 5 AuthRegistry(0x55b9ad084b60) adding con mode: secure 2024-09-14T11:33:35.987 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:33:35.630+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 librados: starting msgr at 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:33:35.630+0000 7fc846d25800 1 librados: starting objecter 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command objecter_requests cmddesc objecter_requests hook 0x55b9ad0b15d0 EEXIST 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:33:35.631+0000 7fc846d25800 1 librados: setting wanted keys 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:33:35.631+0000 7fc846d25800 1 librados: calling monclient init 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: init 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding auth protocol: cephx 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.988 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: crc 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 AuthRegistry(0x55b9ad0747e0) adding con mode: secure 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:33:35.631+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:33:35.631+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:33:35.631+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command rotate-key cmddesc rotate-key hook 0x55b9ad074928 EEXIST 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: _reopen_session rank -1 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:35.989 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-b con 0x55b9ad083f80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-c con 0x55b9ad0afda0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): picked mon.noname-a con 0x55b9ad0b8640 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): _renew_subs 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:33:35.631+0000 7fc846d25800 10 monclient(hunting): authenticate will time out at 2132.115612s 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): get_auth_request con 0x55b9ad0afda0 auth_method 0 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): get_auth_request con 0x55b9ad0b8640 auth_method 0 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.990 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:33:35.631+0000 7fc8431af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): get_auth_request con 0x55b9ad083f80 auth_method 0 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:33:35.631+0000 7fc8429ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient(hunting): handle_auth_done global_id 7487 payload 824 2024-09-14T11:33:35.991 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient: _finish_hunting 0 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:33:35.631+0000 7fc8421ad640 1 monclient: found mon.noname-c 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:33:35.631+0000 7fc8421ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: dump: 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.992 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: _finish_auth 0 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:33:35.632+0000 7fc724ff9640 10 monclient: dump: 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:33:35.993 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:33:35.632+0000 7fc846d25800 5 monclient: authenticate success, global_id 7487 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:33:35.632+0000 7fc7267fc640 4 set_mon_vals no callback set 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _renew_subs 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:33:35.632+0000 7fc846d25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:33:35.632+0000 7fc846d25800 1 librados: init done 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:33:35.632+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cr dump hook 0x55b9ad0b7618 2024-09-14T11:33:35.994 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:33:35.633+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:33:35.633+0000 7fc724ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:33:35.634+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc70c077230 auth_method 0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:33:35.634+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad0cf2f0 auth_method 0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 realm 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:33:35.634+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:33:35.635+0000 7fc846d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:33:35.635+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.995 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:33:35.635+0000 7fc8429ae640 10 monclient: get_auth_request con 0x55b9ad0d3580 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:33:35.636+0000 7fc8421ad640 10 monclient: get_auth_request con 0x55b9ad0d6de0 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:33:35.636+0000 7fc846d25800 20 searching for the correct realm 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:33:35.636+0000 7fc8431af640 10 monclient: get_auth_request con 0x55b9ad0dbb80 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:33:35.637+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc83c034040 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:33:35.638+0000 7fc8421ad640 10 monclient: get_auth_request con 0x7fc8340d1040 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:33:35.638+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc82c089fa0 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:33:35.638+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:33:35.839+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc82c089fa0 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:33:35.843+0000 7fc8429ae640 10 monclient: get_auth_request con 0x7fc83c01c040 auth_method 0 2024-09-14T11:33:35.996 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:33:35.844+0000 7fc8431af640 0 -- 172.21.15.130:0/3625827123 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc82c089fa0 msgr2=0x7fc82c088a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:33:35.844+0000 7fc724ff9640 1 client.7487.objecter ms_handle_reset 0x7fc82c089fa0 session 0x7fc82c089690 osd.4 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:33:35.844+0000 7fc724ff9640 10 monclient: _renew_subs 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:33:35.844+0000 7fc724ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:33:35.844+0000 7fc8431af640 10 monclient: get_auth_request con 0x7fc70c0878d0 auth_method 0 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.997 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:33:35.848+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 zone default found 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 Realm: () 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:33:35.849+0000 7fc846d25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:33:35.849+0000 7fc846d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 zonegroup default 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:35.998 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 started sync module instance, tier type = 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:33:35.849+0000 7fc846d25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=0 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=1 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=2 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=3 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=4 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=5 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:33:35.858+0000 7fc846d25800 20 add_watcher() i=6 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:33:35.859+0000 7fc846d25800 20 add_watcher() i=7 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:33:35.859+0000 7fc846d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:35.999 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding auth protocol: cephx 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:33:35.860+0000 7fc6f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.000 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: crc 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:33:35.860+0000 7fc846d25800 5 AuthRegistry(0x7fffb03bff90) adding con mode: secure 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:33:35.861+0000 7fc846d25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache list hook 0x55b9ad0b8590 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache inspect hook 0x55b9ad0b8590 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache erase hook 0x55b9ad0b8590 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command cache zap hook 0x55b9ad0b8590 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 note: GC not initialized 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:33:35.861+0000 7fc673fff640 20 reqs_thread_entry: start 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace show hook 0x7fc83c00d870 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace history hook 0x7fc83c00d870 2024-09-14T11:33:36.001 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace active hook 0x7fc83c00d870 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:33:35.861+0000 7fc846d25800 5 asok(0x55b9acdc3270) register_command sync trace active_short hook 0x7fc83c00d870 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 Filter name: none 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:33:35.861+0000 7fc671ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:33:35.861+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:33:35.861+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : miss 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:33:35.862+0000 7fc846d25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:33:36.002 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:33:35.862+0000 7fc846d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:33:35.867+0000 7fc846d25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94255960696480 notifier 7487 bl.length()=1015 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:33:35.868+0000 7fc7267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:33:36.003 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:33:35.868+0000 7fc846d25800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.0 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.1 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.2 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.3 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.4 2024-09-14T11:33:36.004 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.5 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.6 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.7 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.8 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.9 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.10 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:33:35.872+0000 7fc846d25800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:36.005 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1.11 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:33:35.872+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.0 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:33:35.873+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.3 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.4 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:33:35.874+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.5 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.6 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:33:35.875+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.7 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.8 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:33:35.876+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.9 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:33:35.877+0000 7fc846d25800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.10 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:33:35.881+0000 7fc846d25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc846d25800 time 2024-09-14T11:33:35.882129+0000 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:36.006 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc84838c76a] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:33:35.882+0000 7fc846d25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fc846d25800 thread_name:radosgw-admin 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.007 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc84703e6f0] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc84708b99c] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc84838c7c4] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fc84838c928] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9aacee0b1] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b9aacfd124] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b9aacfdfc4] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc847029590] 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:33:36.008 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:36.009 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:36.010 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:33:36.011 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:33:36.012 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:33:36.013 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:36.014 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc671ffb640 / http_manager 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc673fff640 / http_manager 2024-09-14T11:33:36.015 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc6f97e2640 / rgw_dt_lg_renew 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc724ff9640 / ms_dispatch 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc7267fc640 / io_context_pool 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc72ce01640 / ms_dispatch 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc72f606640 / ms_dispatch 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc730e09640 / io_context_pool 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8421ad640 / msgr-worker-2 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8429ae640 / msgr-worker-1 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8431af640 / msgr-worker-0 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc8439b0640 / io_context_pool 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: 7fc846d25800 / radosgw-admin 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:35.883823Z_6d8c2ece-0a8c-4fb8-9484-2a863880db38/log 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:33:36.016 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.957+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 realm 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.959+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.960+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.960+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.961+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.961+0000 7f181b32c800 20 searching for the correct realm 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.963+0000 7f180e744640 0 -- 172.21.15.130:0/4026391069 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f180804e020 msgr2=0x7f18080a57f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:36.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:35.966+0000 7f1816f45640 0 -- 172.21.15.130:0/4026391069 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f18100afe10 msgr2=0x7f18100609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:36.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:36.171 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.172+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 zone default found 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 4 Realm: () 2024-09-14T11:33:36.172 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 zonegroup default 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.173 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 started sync module instance, tier type = 2024-09-14T11:33:36.174 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.173+0000 7f181b32c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=0 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=1 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=2 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=3 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=4 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=5 2024-09-14T11:33:36.181 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.182+0000 7f181b32c800 20 add_watcher() i=6 2024-09-14T11:33:36.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.183+0000 7f181b32c800 20 add_watcher() i=7 2024-09-14T11:33:36.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.183+0000 7f181b32c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.184+0000 7f16cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 5 note: GC not initialized 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f1647fff640 20 reqs_thread_entry: start 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 20 Filter name: none 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f1645ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:36.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.185+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.186+0000 7f181b32c800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.187+0000 7f181b32c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:36.186 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.187+0000 7f181b32c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:36.187 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.188+0000 7f16cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:36.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.190+0000 7f181b32c800 20 remove_watcher() i=0 2024-09-14T11:33:36.189 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.190+0000 7f181b32c800 2 removed watcher, disabling cache 2024-09-14T11:33:36.190 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.191+0000 7f181b32c800 20 remove_watcher() i=1 2024-09-14T11:33:36.191 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.192+0000 7f181b32c800 20 remove_watcher() i=2 2024-09-14T11:33:36.192 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.193+0000 7f181b32c800 20 remove_watcher() i=3 2024-09-14T11:33:36.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.194+0000 7f181b32c800 20 remove_watcher() i=4 2024-09-14T11:33:36.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.195+0000 7f181b32c800 20 remove_watcher() i=5 2024-09-14T11:33:36.195 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.196+0000 7f181b32c800 20 remove_watcher() i=6 2024-09-14T11:33:36.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.197+0000 7f181b32c800 20 remove_watcher() i=7 2024-09-14T11:33:36.206 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.206 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:33:36.206 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:36.206 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:33:36.207 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:36.208 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:36.214 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:33:36.214 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:33:36.257 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:36.288 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:36.288 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:36.324 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.326+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.326 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 realm 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.328+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.327 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.329+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:36.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.329+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.330+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:36.328 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.330+0000 7fec45f1f800 20 searching for the correct realm 2024-09-14T11:33:36.330 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.332+0000 7fec41391640 0 -- 172.21.15.130:0/320236929 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fec3c092040 msgr2=0x7fec3c064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:36.333 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.335+0000 7fec41b92640 0 -- 172.21.15.130:0/320236929 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fec3406cc90 msgr2=0x7fec34069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:36.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:36.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:36.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.540+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.540 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:36.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:36.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 zone default found 2024-09-14T11:33:36.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 4 Realm: () 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 zonegroup default 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.541+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.542+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.542+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.542+0000 7fec45f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.542+0000 7fec45f1f800 20 started sync module instance, tier type = 2024-09-14T11:33:36.542 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.542+0000 7fec45f1f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:33:36.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=0 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=1 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=2 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=3 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=4 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=5 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.551+0000 7fec45f1f800 20 add_watcher() i=6 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.552+0000 7fec45f1f800 20 add_watcher() i=7 2024-09-14T11:33:36.550 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.552+0000 7fec45f1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.553+0000 7feaf37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 5 note: GC not initialized 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7feaf27fc640 20 reqs_thread_entry: start 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 20 Filter name: none 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fea63fff640 20 reqs_thread_entry: start 2024-09-14T11:33:36.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:33:36.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.554+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:33:36.554 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : miss 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 20 rados->read ofs=0 len=0 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:33:36.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.555+0000 7fec45f1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:33:36.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.556+0000 7fec45f1f800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to be held by another RGW process; skipping for now 2024-09-14T11:33:36.556 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.557+0000 7feaf37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:36.557 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.559+0000 7fec45f1f800 20 remove_watcher() i=0 2024-09-14T11:33:36.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.559+0000 7fec45f1f800 2 removed watcher, disabling cache 2024-09-14T11:33:36.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.560+0000 7fec45f1f800 20 remove_watcher() i=1 2024-09-14T11:33:36.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.561+0000 7fec45f1f800 20 remove_watcher() i=2 2024-09-14T11:33:36.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.562+0000 7fec45f1f800 20 remove_watcher() i=3 2024-09-14T11:33:36.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.563+0000 7fec45f1f800 20 remove_watcher() i=4 2024-09-14T11:33:36.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.564+0000 7fec45f1f800 20 remove_watcher() i=5 2024-09-14T11:33:36.563 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.565+0000 7fec45f1f800 20 remove_watcher() i=6 2024-09-14T11:33:36.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:33:36.566+0000 7fec45f1f800 20 remove_watcher() i=7 2024-09-14T11:33:36.575 INFO:tasks.workunit.client.0.smithi130.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:06.601 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:06.636 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:06.636 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:06.678 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.680+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 20 realm 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:06.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.682+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.683+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.683+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.683+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.683+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.684+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:06.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.684+0000 7f2b1592a800 20 searching for the correct realm 2024-09-14T11:34:06.684 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.687+0000 7f2b11e18640 0 -- 172.21.15.130:0/2509298555 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2afc063070 msgr2=0x7f2afc04d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:06.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.895+0000 7f2b11e18640 0 -- 172.21.15.130:0/2509298555 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2afc063070 msgr2=0x7f2afc04d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:06.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:06.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:06.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.899+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.900+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.900+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.900+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:06.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.900+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.900+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 zone default found 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 4 Realm: () 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 zonegroup default 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.901+0000 7f2b1592a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.902+0000 7f2b1592a800 20 started sync module instance, tier type = 2024-09-14T11:34:06.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.902+0000 7f2b1592a800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=0 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=1 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=2 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=3 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=4 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=5 2024-09-14T11:34:06.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.911+0000 7f2b1592a800 20 add_watcher() i=6 2024-09-14T11:34:06.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.912+0000 7f2b1592a800 20 add_watcher() i=7 2024-09-14T11:34:06.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.912+0000 7f2b1592a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:06.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.914+0000 7f29c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 5 note: GC not initialized 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f29c67e4640 20 reqs_thread_entry: start 2024-09-14T11:34:06.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 20 Filter name: none 2024-09-14T11:34:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2937fff640 20 reqs_thread_entry: start 2024-09-14T11:34:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:34:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.915+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.914 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : miss 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 20 rados->read ofs=0 len=0 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.916+0000 7f2b1592a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:34:06.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.918+0000 7f2b1592a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.925+0000 7f2b1592a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.925+0000 7f2b1592a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.925+0000 7f2b1592a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.925+0000 7f2b1592a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.925+0000 7f29e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94201735418528 notifier 8079 bl.length()=1015 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f29e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f29e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f29e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:34:06.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.926+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.0 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.0 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.1 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.1 2024-09-14T11:34:06.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.2 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.2 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.3 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.3 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.4 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.4 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.5 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.5 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.6 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.6 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.7 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.7 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.8 2024-09-14T11:34:06.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.8 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.9 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.9 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.10 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.10 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.11 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2.11 2024-09-14T11:34:06.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.931+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.0 2024-09-14T11:34:06.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.932+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1 2024-09-14T11:34:06.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.933+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2 2024-09-14T11:34:06.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.933+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.3 2024-09-14T11:34:06.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.934+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.4 2024-09-14T11:34:06.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.934+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.5 2024-09-14T11:34:06.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.935+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.6 2024-09-14T11:34:06.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.935+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.7 2024-09-14T11:34:06.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.936+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.8 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.936+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.9 2024-09-14T11:34:06.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.937+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.10 2024-09-14T11:34:06.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.941+0000 7f2b1592a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:06.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.941+0000 7f2b1592a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:34:06.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f29f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94201735418528 notifier 8079 bl.length()=1015 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f29f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f29f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f29f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:34:06.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.943+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:34:06.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.947+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.0 2024-09-14T11:34:06.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.947+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.1 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.947+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.2 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.948+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.3 2024-09-14T11:34:06.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.948+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.4 2024-09-14T11:34:06.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.948+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.5 2024-09-14T11:34:06.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.949+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.6 2024-09-14T11:34:06.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.949+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.7 2024-09-14T11:34:06.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.950+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.8 2024-09-14T11:34:06.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.950+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.9 2024-09-14T11:34:06.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.950+0000 7f2b1592a800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.40.10 2024-09-14T11:34:06.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.951+0000 7f2b1592a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:06.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.951+0000 7f2b1592a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 2024-09-14T11:34:06.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.952+0000 7f2b1592a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.952+0000 7f2b1592a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.952+0000 7f2b1592a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.950 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.952+0000 7f2b1592a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40, ofs0, ns] 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f29f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94201735418528 notifier 8079 bl.length()=983 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f29f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 info.flags=0x17 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f29f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:a588039c-1457-497f-adbd-8890a12279b7.4508.40 to cache LRU end 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f29f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_sources= new_sources= 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential sources added=[] removed=[] 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): orig_dests= new_dests= 2024-09-14T11:34:06.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.953+0000 7f2b1592a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[a588039c-1457-497f-adbd-8890a12279b7.4508.40]): potential dests added=[] removed=[] 2024-09-14T11:34:06.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.955+0000 7f2b1592a800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:06.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.957+0000 7f29c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:06.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.959+0000 7f2b1592a800 20 remove_watcher() i=0 2024-09-14T11:34:06.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.959+0000 7f2b1592a800 2 removed watcher, disabling cache 2024-09-14T11:34:06.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.960+0000 7f2b1592a800 20 remove_watcher() i=1 2024-09-14T11:34:06.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.961+0000 7f2b1592a800 20 remove_watcher() i=2 2024-09-14T11:34:06.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.963+0000 7f2b1592a800 20 remove_watcher() i=3 2024-09-14T11:34:06.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.964+0000 7f2b1592a800 20 remove_watcher() i=4 2024-09-14T11:34:06.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.965+0000 7f2b1592a800 20 remove_watcher() i=5 2024-09-14T11:34:06.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.966+0000 7f2b1592a800 20 remove_watcher() i=6 2024-09-14T11:34:06.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:06.967+0000 7f2b1592a800 20 remove_watcher() i=7 2024-09-14T11:34:06.976 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:34:07.006 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.006 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.046+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 20 realm 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.045 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.047+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.048+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.048+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.048+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.046 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.048+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.049+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.049+0000 7f4fc522f800 20 searching for the correct realm 2024-09-14T11:34:07.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.052+0000 7f4fc351a640 0 -- 172.21.15.130:0/710271716 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4fb80ec170 msgr2=0x7f4fb80653e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.053 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.055+0000 7f4fc2518640 0 -- 172.21.15.130:0/710271716 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x558370a748e0 msgr2=0x558370a76cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.059+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.058 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 zone default found 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 4 Realm: () 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 zonegroup default 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.059 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.060+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.061+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.061+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.061+0000 7f4fc522f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.061+0000 7f4fc522f800 20 started sync module instance, tier type = 2024-09-14T11:34:07.060 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.061+0000 7f4fc522f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=0 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=1 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=2 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=3 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=4 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=5 2024-09-14T11:34:07.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.069+0000 7f4fc522f800 20 add_watcher() i=6 2024-09-14T11:34:07.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.070+0000 7f4fc522f800 20 add_watcher() i=7 2024-09-14T11:34:07.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.070+0000 7f4fc522f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.069 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.072+0000 7f4e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.072+0000 7f4fc522f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.072+0000 7f4fc522f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.070 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.072+0000 7f4fc522f800 5 note: GC not initialized 2024-09-14T11:34:07.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.072+0000 7f4df3fff640 20 reqs_thread_entry: start 2024-09-14T11:34:07.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4fc522f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4fc522f800 20 Filter name: none 2024-09-14T11:34:07.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4df1ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:07.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.073+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.074+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.074+0000 7f4fc522f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.074+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.074+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:34:07.072 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.074+0000 7f4fc522f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.075+0000 7f4fc522f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:34:07.073 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.075+0000 7f4fc522f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.074 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.077+0000 7f4e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.079+0000 7f4fc522f800 20 remove_watcher() i=0 2024-09-14T11:34:07.076 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.079+0000 7f4fc522f800 2 removed watcher, disabling cache 2024-09-14T11:34:07.077 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.080+0000 7f4fc522f800 20 remove_watcher() i=1 2024-09-14T11:34:07.078 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.081+0000 7f4fc522f800 20 remove_watcher() i=2 2024-09-14T11:34:07.079 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.082+0000 7f4fc522f800 20 remove_watcher() i=3 2024-09-14T11:34:07.080 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.083+0000 7f4fc522f800 20 remove_watcher() i=4 2024-09-14T11:34:07.081 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.084+0000 7f4fc522f800 20 remove_watcher() i=5 2024-09-14T11:34:07.082 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.085+0000 7f4fc522f800 20 remove_watcher() i=6 2024-09-14T11:34:07.083 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.086+0000 7f4fc522f800 20 remove_watcher() i=7 2024-09-14T11:34:07.093 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:07.093 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:34:07.093 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: abort-at-change-reshard-state id: a588039c-1457-497f-adbd-8890a12279b7.4508.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:07.094 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:07.095 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.095 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:07.099 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.099 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:07.142 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:07.142 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:07.167 INFO:tasks.workunit.client.0.smithi130.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:34:07.169 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:07.197 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.197 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.236+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 realm 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.237+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.238+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.238+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.239+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.239+0000 7f9dc6294800 20 searching for the correct realm 2024-09-14T11:34:07.239 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.241+0000 7f9dc457f640 0 -- 172.21.15.130:0/457987263 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9dac084040 msgr2=0x7f9dac084420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:07.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.447+0000 7f9dc457f640 0 -- 172.21.15.130:0/457987263 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f9dac084040 msgr2=0x7f9dac084420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.451+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 zone default found 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 4 Realm: () 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 zonegroup default 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.451 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.452+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.453+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.453+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.453+0000 7f9dc6294800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.453+0000 7f9dc6294800 20 started sync module instance, tier type = 2024-09-14T11:34:07.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.453+0000 7f9dc6294800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:07.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=0 2024-09-14T11:34:07.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=1 2024-09-14T11:34:07.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=2 2024-09-14T11:34:07.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=3 2024-09-14T11:34:07.459 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=4 2024-09-14T11:34:07.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=5 2024-09-14T11:34:07.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=6 2024-09-14T11:34:07.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 20 add_watcher() i=7 2024-09-14T11:34:07.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.462+0000 7f9dc6294800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.464+0000 7f9c79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.464+0000 7f9dc6294800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.464+0000 7f9dc6294800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.464+0000 7f9dc6294800 5 note: GC not initialized 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9c78fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9dc6294800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9dc6294800 20 Filter name: none 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9bf27fc640 20 reqs_thread_entry: start 2024-09-14T11:34:07.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.465+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.464 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:07.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:07.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.466+0000 7f9dc6294800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.465 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.468+0000 7f9c79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.470+0000 7f9dc6294800 20 remove_watcher() i=0 2024-09-14T11:34:07.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.470+0000 7f9dc6294800 2 removed watcher, disabling cache 2024-09-14T11:34:07.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.471+0000 7f9dc6294800 20 remove_watcher() i=1 2024-09-14T11:34:07.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.472+0000 7f9dc6294800 20 remove_watcher() i=2 2024-09-14T11:34:07.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.473+0000 7f9dc6294800 20 remove_watcher() i=3 2024-09-14T11:34:07.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.474+0000 7f9dc6294800 20 remove_watcher() i=4 2024-09-14T11:34:07.472 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.474+0000 7f9dc6294800 20 remove_watcher() i=5 2024-09-14T11:34:07.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.475+0000 7f9dc6294800 20 remove_watcher() i=6 2024-09-14T11:34:07.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.476+0000 7f9dc6294800 20 remove_watcher() i=7 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:34:07.484 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:07.485 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:07.514 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.514 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.549 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.552+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.553+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.553+0000 7f8e2a92f800 20 realm 2024-09-14T11:34:07.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.553+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.551 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.554+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.554+0000 7f8e2a92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.554+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.554+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.554+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.555+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.552 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.555+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.555+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.555+0000 7f8e2a92f800 20 searching for the correct realm 2024-09-14T11:34:07.555 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.558+0000 7f8e26e77640 0 -- 172.21.15.130:0/2171587139 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8e10064950 msgr2=0x7f8e10095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.764+0000 7f8e26e77640 0 -- 172.21.15.130:0/2171587139 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8e10064950 msgr2=0x7f8e10095430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:07.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:07.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:07.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:07.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:07.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:07.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.768+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 zone default found 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 4 Realm: () 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 zonegroup default 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.769+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.770+0000 7f8e2a92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.770+0000 7f8e2a92f800 20 started sync module instance, tier type = 2024-09-14T11:34:07.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.770+0000 7f8e2a92f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:07.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=0 2024-09-14T11:34:07.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=1 2024-09-14T11:34:07.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=2 2024-09-14T11:34:07.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=3 2024-09-14T11:34:07.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=4 2024-09-14T11:34:07.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=5 2024-09-14T11:34:07.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.779+0000 7f8e2a92f800 20 add_watcher() i=6 2024-09-14T11:34:07.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.780+0000 7f8e2a92f800 20 add_watcher() i=7 2024-09-14T11:34:07.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.780+0000 7f8e2a92f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:07.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.781+0000 7f8cdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 5 note: GC not initialized 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8c577fe640 20 reqs_thread_entry: start 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 20 Filter name: none 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8c557fa640 20 reqs_thread_entry: start 2024-09-14T11:34:07.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.782+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.783+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:07.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.783+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.783+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:07.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.783+0000 7f8e2a92f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.783+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.784+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:07.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.784+0000 7f8e2a92f800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.784+0000 7f8e2a92f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:07.782 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.784+0000 7f8e2a92f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:07.783 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.786+0000 7f8cdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:07.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.788+0000 7f8e2a92f800 20 remove_watcher() i=0 2024-09-14T11:34:07.785 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.788+0000 7f8e2a92f800 2 removed watcher, disabling cache 2024-09-14T11:34:07.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.789+0000 7f8e2a92f800 20 remove_watcher() i=1 2024-09-14T11:34:07.787 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.790+0000 7f8e2a92f800 20 remove_watcher() i=2 2024-09-14T11:34:07.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.791+0000 7f8e2a92f800 20 remove_watcher() i=3 2024-09-14T11:34:07.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.792+0000 7f8e2a92f800 20 remove_watcher() i=4 2024-09-14T11:34:07.791 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.794+0000 7f8e2a92f800 20 remove_watcher() i=5 2024-09-14T11:34:07.793 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.795+0000 7f8e2a92f800 20 remove_watcher() i=6 2024-09-14T11:34:07.794 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.797+0000 7f8e2a92f800 20 remove_watcher() i=7 2024-09-14T11:34:07.806 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:07.840 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:07.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.881+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 realm 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:07.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:07.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:07.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.884+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:07.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.884+0000 7f3ebb216800 20 searching for the correct realm 2024-09-14T11:34:07.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.886+0000 7f3eb61e6640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f3ea807a040 msgr2=0x7f3ea801caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:07.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:07.890+0000 7f3eb69e7640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f3eb001a070 msgr2=0x7f3eb007b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.095 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:08.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.096 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.097 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zone default found 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Realm: () 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zonegroup default 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started sync module instance, tier type = 2024-09-14T11:34:08.098 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:08.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=0 2024-09-14T11:34:08.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=1 2024-09-14T11:34:08.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=2 2024-09-14T11:34:08.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=3 2024-09-14T11:34:08.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=4 2024-09-14T11:34:08.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=5 2024-09-14T11:34:08.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=6 2024-09-14T11:34:08.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=7 2024-09-14T11:34:08.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.111+0000 7f3ebb216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.110 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.113+0000 7f3d6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.113+0000 7f3ebb216800 5 note: GC not initialized 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ce7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 20 Filter name: none 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ce5ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:08.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:08.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.115+0000 7f3ebb216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:08.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94762201196832 notifier 7604 bl.length()=911 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:08.118 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:08.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:08.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.125 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.131 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ebb216800 time 2024-09-14T11:34:08.134188+0000 2024-09-14T11:34:08.131 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ebc38c76a] 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.132 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.134+0000 7f3ebb216800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ebb216800 time 2024-09-14T11:34:08.134188+0000 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ebc38c76a] 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.133 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:08.134 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3ebb216800 thread_name:radosgw-admin 2024-09-14T11:34:08.151 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.151 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ebb03e6f0] 2024-09-14T11:34:08.151 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ebb08b99c] 2024-09-14T11:34:08.151 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:08.151 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ebc38c7c4] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.135+0000 7f3ebb216800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3ebb216800 thread_name:radosgw-admin 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.152 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ebb03e6f0] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ebb08b99c] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ebc38c7c4] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.153 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b31dec0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b326210 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.348960s 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b31dae0 auth_method 0 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.154 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b31dec0 auth_method 0 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7595 payload 824 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.155 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:34:07.866+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b326210 auth_method 0 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: dump: 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.156 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:34:07.866+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7595 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: dump: 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.157 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:34:07.866+0000 7f3da4e09640 4 set_mon_vals no callback set 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:34:07.866+0000 7f3ebb216800 1 librados: init done 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.158 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:34:07.868+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d9c077230 auth_method 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:34:07.869+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b4b8910 auth_method 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:34:07.869+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x562f8b4bbc60 auth_method 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:34:07.870+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x562f8b4c03d0 auth_method 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:34:07.871+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:34:07.871+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:34:07.871+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.159 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.160 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command objecter_requests cmddesc objecter_requests hook 0x562f8b4c86b0 EEXIST 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.161 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x562f8b4c38b0 EEXIST 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:08.162 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b4ec9d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b4ecdb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b4eb6e0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.356016s 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b4ec9d0 auth_method 0 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b4eb6e0 auth_method 0 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.163 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b4ecdb0 auth_method 0 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.164 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: dump: 2024-09-14T11:34:08.165 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.166 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: dump: 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:34:07.873+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7598 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:34:07.873+0000 7f3eb79e9640 4 set_mon_vals no callback set 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.167 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:34:07.875+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3d90079350 auth_method 0 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: get_monmap_and_config 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:34:07.875+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.168 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.169 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.170 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.171 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x7ffe39cd8e48 EEXIST 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b50f9b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b53b190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b5318f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.359640s 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b50f9b0 auth_method 0 2024-09-14T11:34:08.172 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b5318f0 auth_method 0 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b53b190 auth_method 0 2024-09-14T11:34:08.173 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7601 payload 274 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: dump: 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.174 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7601 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:34:07.877+0000 7f3ebb216800 4 set_mon_vals no callback set 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.175 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: dump: 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: shutdown 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.176 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:34:07.877+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.177 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.178 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: starting msgr at 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: starting objecter 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command objecter_requests cmddesc objecter_requests hook 0x562f8b53b590 EEXIST 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: setting wanted keys 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: calling monclient init 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.179 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x562f8b5013d8 EEXIST 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.180 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b50f9b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b5318f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b53b190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.361788s 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b50f9b0 auth_method 0 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b5318f0 auth_method 0 2024-09-14T11:34:08.181 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b53b190 auth_method 0 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.182 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7604 payload 824 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: dump: 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.183 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: dump: 2024-09-14T11:34:08.184 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:34:07.879+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7604 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:34:07.879+0000 7f3d9a7fc640 4 set_mon_vals no callback set 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.185 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:34:07.879+0000 7f3ebb216800 1 librados: init done 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:34:07.879+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cr dump hook 0x562f8b54cf78 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:34:07.881+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d80077260 auth_method 0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:34:07.881+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:34:07.882+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b55da20 auth_method 0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 realm 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.186 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:34:07.882+0000 7f3ebb216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:34:07.883+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x562f8b561db0 auth_method 0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:34:07.884+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x562f8b5654d0 auth_method 0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:34:07.884+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:34:07.884+0000 7f3ebb216800 20 searching for the correct realm 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:34:07.884+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b56a2b0 auth_method 0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:34:07.885+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3eb0023020 auth_method 0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3ea807a040 auth_method 0 2024-09-14T11:34:08.187 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f3ea807a040 msgr2=0x7f3ea801caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 1 client.7604.objecter ms_handle_reset 0x7f3ea807a040 session 0x7f3ea801a630 osd.2 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 10 monclient: _renew_subs 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d80087960 auth_method 0 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:34:07.887+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x7f3eac08a040 auth_method 0 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:34:07.890+0000 7f3eb69e7640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f3eb001a070 msgr2=0x7f3eb007b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:34:08.092+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3eb001a070 auth_method 0 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.188 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zone default found 2024-09-14T11:34:08.189 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Realm: () 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:34:08.098+0000 7f3ebb216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zonegroup default 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started sync module instance, tier type = 2024-09-14T11:34:08.190 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=0 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=1 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=2 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=3 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=4 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=5 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=6 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=7 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:34:08.111+0000 7f3ebb216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.191 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:34:08.113+0000 7f3d6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.192 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:34:08.113+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache list hook 0x562f8b5382a0 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache inspect hook 0x562f8b5382a0 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache erase hook 0x562f8b5382a0 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache zap hook 0x562f8b5382a0 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 note: GC not initialized 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:34:08.114+0000 7f3ce7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace show hook 0x7f3ea801d070 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace history hook 0x7f3ea801d070 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace active hook 0x7f3ea801d070 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace active_short hook 0x7f3ea801d070 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.193 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 Filter name: none 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:34:08.114+0000 7f3ce5ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:34:08.115+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.194 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94762201196832 notifier 7604 bl.length()=911 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.195 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.196 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.197 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.198 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.199 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:34:08.134+0000 7f3ebb216800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ebb216800 time 2024-09-14T11:34:08.134188+0000 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ebc38c76a] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.200 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:34:08.135+0000 7f3ebb216800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3ebb216800 thread_name:radosgw-admin 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ebb03e6f0] 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ebb08b99c] 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ebc38c7c4] 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.201 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:34:08.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:34:08.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:34:08.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:34:08.205 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:34:08.206 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:08.207 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:08.208 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ce5ffb640 / http_manager 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ce7fff640 / http_manager 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d6d7e2640 / rgw_dt_lg_renew 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d98ff9640 / ms_dispatch 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d99ffb640 / io_context_pool 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d9a7fc640 / io_context_pool 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da0e01640 / ms_dispatch 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da3606640 / ms_dispatch 2024-09-14T11:34:08.209 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da4e09640 / io_context_pool 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb61e6640 / msgr-worker-2 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb69e7640 / msgr-worker-1 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb71e8640 / msgr-worker-0 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb79e9640 / io_context_pool 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ebb216800 / radosgw-admin 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.146931.log 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b31dec0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b326210 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.210 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:34:07.865+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.348960s 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b31dae0 auth_method 0 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b31dec0 auth_method 0 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.211 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:34:07.866+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7595 payload 824 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:34:07.866+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:34:07.866+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b326210 auth_method 0 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: dump: 2024-09-14T11:34:08.212 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:34:07.866+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7595 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.213 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:34:07.866+0000 7f3da3606640 10 monclient: dump: 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.214 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:34:07.866+0000 7f3da4e09640 4 set_mon_vals no callback set 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:34:07.866+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:34:07.866+0000 7f3ebb216800 1 librados: init done 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:34:07.868+0000 7f3da3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:34:07.868+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d9c077230 auth_method 0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:34:07.869+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b4b8910 auth_method 0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:34:07.869+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x562f8b4bbc60 auth_method 0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:34:07.870+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x562f8b4c03d0 auth_method 0 2024-09-14T11:34:08.215 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:34:07.871+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:34:07.871+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:34:07.871+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.216 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding auth protocol: cephx 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.217 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: crc 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:34:07.871+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c51b0) adding con mode: secure 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command objecter_requests cmddesc objecter_requests hook 0x562f8b4c86b0 EEXIST 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding auth protocol: cephx 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.218 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: crc 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 AuthRegistry(0x562f8b4c3768) adding con mode: secure 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:34:07.872+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:34:07.872+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x562f8b4c38b0 EEXIST 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b4ec9d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b4ecdb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.219 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b4eb6e0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:34:07.872+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.356016s 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b4ec9d0 auth_method 0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b4eb6e0 auth_method 0 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.220 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b4ecdb0 auth_method 0 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:34:07.873+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.221 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:34:07.873+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:34:07.873+0000 7f3eb71e8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: dump: 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.222 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:34:07.873+0000 7f3da0e01640 10 monclient: dump: 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.223 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:34:07.873+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7598 2024-09-14T11:34:08.224 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:34:07.873+0000 7f3eb79e9640 4 set_mon_vals no callback set 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:34:07.873+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:34:07.875+0000 7f3da0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:34:07.875+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3d90079350 auth_method 0 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: get_monmap_and_config 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:34:07.875+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.225 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:34:07.875+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.226 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding auth protocol: cephx 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: crc 2024-09-14T11:34:08.227 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:34:07.875+0000 7f3ebb216800 5 AuthRegistry(0x562f8b50bb30) adding con mode: secure 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding auth protocol: cephx 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.228 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: crc 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd8d00) adding con mode: secure 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:34:07.876+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:34:07.876+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x7ffe39cd8e48 EEXIST 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b50f9b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b53b190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b5318f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.229 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:34:07.876+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.359640s 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b50f9b0 auth_method 0 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b5318f0 auth_method 0 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.230 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:34:07.876+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b53b190 auth_method 0 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:34:07.876+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7601 payload 274 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:34:07.876+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.231 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: dump: 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.232 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7601 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:34:07.877+0000 7f3ebb216800 4 set_mon_vals no callback set 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:34:07.877+0000 7f3d9a7fc640 10 monclient: dump: 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.233 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: shutdown 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: build_initial_monmap 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:34:07.877+0000 7f3ebb216800 1 build_initial for_mkfs: 0 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:34:07.877+0000 7f3ebb216800 10 monclient: monmap: 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:08.234 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding auth protocol: cephx 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.235 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: crc 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:34:07.877+0000 7f3ebb216800 5 AuthRegistry(0x562f8b531e20) adding con mode: secure 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: starting msgr at 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: starting objecter 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command objecter_requests cmddesc objecter_requests hook 0x562f8b53b590 EEXIST 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: setting wanted keys 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:34:07.878+0000 7f3ebb216800 1 librados: calling monclient init 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: init 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.236 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding auth protocol: cephx 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: crc 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 AuthRegistry(0x562f8b501290) adding con mode: secure 2024-09-14T11:34:08.237 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:34:07.878+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:34:07.878+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command rotate-key cmddesc rotate-key hook 0x562f8b5013d8 EEXIST 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-c con 0x562f8b50f9b0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-a con 0x562f8b5318f0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): picked mon.noname-b con 0x562f8b53b190 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:34:07.878+0000 7f3ebb216800 10 monclient(hunting): authenticate will time out at 2164.361788s 2024-09-14T11:34:08.238 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request con 0x562f8b50f9b0 auth_method 0 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request con 0x562f8b5318f0 auth_method 0 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:34:07.878+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request con 0x562f8b53b190 auth_method 0 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:08.239 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:34:07.878+0000 7f3eb61e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:34:07.878+0000 7f3eb71e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient(hunting): handle_auth_done global_id 7604 payload 824 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient: _finish_hunting 0 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 1 monclient: found mon.noname-c 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:34:07.879+0000 7f3eb69e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: dump: 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.240 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:08.241 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:34:07.879+0000 7f3d98ff9640 10 monclient: dump: 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:34:07.879+0000 7f3ebb216800 5 monclient: authenticate success, global_id 7604 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:34:07.879+0000 7f3d9a7fc640 4 set_mon_vals no callback set 2024-09-14T11:34:08.242 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _renew_subs 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:34:07.879+0000 7f3ebb216800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:34:07.879+0000 7f3ebb216800 1 librados: init done 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:34:07.879+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cr dump hook 0x562f8b54cf78 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:34:07.881+0000 7f3d98ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:34:07.881+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d80077260 auth_method 0 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:34:07.881+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:34:07.882+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b55da20 auth_method 0 2024-09-14T11:34:08.243 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 realm 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:34:07.882+0000 7f3ebb216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:34:07.882+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:34:07.883+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x562f8b561db0 auth_method 0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:34:07.883+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:34:07.884+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x562f8b5654d0 auth_method 0 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:34:07.884+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.244 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:34:07.884+0000 7f3ebb216800 20 searching for the correct realm 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:34:07.884+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x562f8b56a2b0 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:34:07.885+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3eb0023020 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3ea807a040 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f3ea807a040 msgr2=0x7f3ea801caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 1 client.7604.objecter ms_handle_reset 0x7f3ea807a040 session 0x7f3ea801a630 osd.2 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 10 monclient: _renew_subs 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:34:07.886+0000 7f3d98ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:34:07.886+0000 7f3eb61e6640 10 monclient: get_auth_request con 0x7f3d80087960 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:34:07.887+0000 7f3eb71e8640 10 monclient: get_auth_request con 0x7f3eac08a040 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:34:07.890+0000 7f3eb69e7640 0 -- 172.21.15.130:0/3490129918 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f3eb001a070 msgr2=0x7f3eb007b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:34:08.092+0000 7f3eb69e7640 10 monclient: get_auth_request con 0x7f3eb001a070 auth_method 0 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.245 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:34:08.097+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zone default found 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Realm: () 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:08.246 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:34:08.098+0000 7f3ebb216800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:34:08.098+0000 7f3ebb216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 zonegroup default 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:34:08.098+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started sync module instance, tier type = 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:34:08.099+0000 7f3ebb216800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=0 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=1 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=2 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=3 2024-09-14T11:34:08.247 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=4 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=5 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=6 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:34:08.111+0000 7f3ebb216800 20 add_watcher() i=7 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:34:08.111+0000 7f3ebb216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding auth protocol: cephx 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.248 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: crc 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:34:08.113+0000 7f3d6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 AuthRegistry(0x7ffe39cd91e0) adding con mode: secure 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:34:08.113+0000 7f3ebb216800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:34:08.113+0000 7f3ebb216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache list hook 0x562f8b5382a0 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache inspect hook 0x562f8b5382a0 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache erase hook 0x562f8b5382a0 2024-09-14T11:34:08.249 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command cache zap hook 0x562f8b5382a0 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:34:08.113+0000 7f3ebb216800 5 note: GC not initialized 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:34:08.114+0000 7f3ce7fff640 20 reqs_thread_entry: start 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace show hook 0x7f3ea801d070 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace history hook 0x7f3ea801d070 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace active hook 0x7f3ea801d070 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:34:08.114+0000 7f3ebb216800 5 asok(0x562f8b251270) register_command sync trace active_short hook 0x7f3ea801d070 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 Filter name: none 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:34:08.114+0000 7f3ce5ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:08.250 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:34:08.114+0000 7f3ebb216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:34:08.114+0000 7f3ebb216800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:34:08.115+0000 7f3ebb216800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:34:08.115+0000 7f3ebb216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:34:08.120+0000 7f3ebb216800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:08.251 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94762201196832 notifier 7604 bl.length()=911 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:34:08.120+0000 7f3d99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:34:08.120+0000 7f3ebb216800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.1 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.252 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.2 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.3 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.4 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.5 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.6 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.7 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.8 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.253 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.9 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.10 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.11 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.12 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.13 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:34:08.126+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:34:08.126+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.254 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:34:08.127+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:34:08.127+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:34:08.128+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:34:08.128+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:34:08.129+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:34:08.129+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.255 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:34:08.130+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:34:08.130+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:34:08.131+0000 7f3ebb216800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:34:08.131+0000 7f3ebb216800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:34:08.134+0000 7f3ebb216800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ebb216800 time 2024-09-14T11:34:08.134188+0000 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ebc38c76a] 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.256 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:34:08.135+0000 7f3ebb216800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f3ebb216800 thread_name:radosgw-admin 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ebb03e6f0] 2024-09-14T11:34:08.257 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ebb08b99c] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ebc38c7c4] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3ebc38c928] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562f898030b1] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x562f89812124] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x562f89812fc4] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ebb029590] 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:34:08.258 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:08.259 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:34:08.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:34:08.261 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:34:08.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:34:08.263 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:08.264 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:08.265 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ce5ffb640 / http_manager 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ce7fff640 / http_manager 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d6d7e2640 / rgw_dt_lg_renew 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d98ff9640 / ms_dispatch 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d99ffb640 / io_context_pool 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3d9a7fc640 / io_context_pool 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da0e01640 / ms_dispatch 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da3606640 / ms_dispatch 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3da4e09640 / io_context_pool 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb61e6640 / msgr-worker-2 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb69e7640 / msgr-worker-1 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb71e8640 / msgr-worker-0 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3eb79e9640 / io_context_pool 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: 7f3ebb216800 / radosgw-admin 2024-09-14T11:34:08.266 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:34:08.267 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:34:08.267 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:08.135802Z_e186c88f-45df-48ab-af52-f02db980ebed/log 2024-09-14T11:34:08.267 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:34:08.267 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:08.268 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.268 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.209+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.211+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.211+0000 7f57f0d2c800 20 realm 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.211+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.212+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.213+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.213+0000 7f57f0d2c800 20 searching for the correct realm 2024-09-14T11:34:08.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.215+0000 7f57ed250640 0 -- 172.21.15.130:0/3712671016 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f57d404c020 msgr2=0x7f57d4077da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.421+0000 7f57ed250640 0 -- 172.21.15.130:0/3712671016 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f57d404c020 msgr2=0x7f57d4077da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.423 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.425+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 zone default found 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 4 Realm: () 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.425 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 zonegroup default 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 started sync module instance, tier type = 2024-09-14T11:34:08.426 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.426+0000 7f57f0d2c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=0 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=1 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=2 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=3 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=4 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=5 2024-09-14T11:34:08.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.435+0000 7f57f0d2c800 20 add_watcher() i=6 2024-09-14T11:34:08.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.436+0000 7f57f0d2c800 20 add_watcher() i=7 2024-09-14T11:34:08.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.436+0000 7f57f0d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.437+0000 7f56a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 5 note: GC not initialized 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f56a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 20 Filter name: none 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f56137fe640 20 reqs_thread_entry: start 2024-09-14T11:34:08.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.438+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.439+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.439+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:08.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.440+0000 7f57f0d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:08.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.442+0000 7f56a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.444+0000 7f57f0d2c800 20 remove_watcher() i=0 2024-09-14T11:34:08.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.444+0000 7f57f0d2c800 2 removed watcher, disabling cache 2024-09-14T11:34:08.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.445+0000 7f57f0d2c800 20 remove_watcher() i=1 2024-09-14T11:34:08.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.447+0000 7f57f0d2c800 20 remove_watcher() i=2 2024-09-14T11:34:08.446 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.449+0000 7f57f0d2c800 20 remove_watcher() i=3 2024-09-14T11:34:08.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.450+0000 7f57f0d2c800 20 remove_watcher() i=4 2024-09-14T11:34:08.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.451+0000 7f57f0d2c800 20 remove_watcher() i=5 2024-09-14T11:34:08.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.451+0000 7f57f0d2c800 20 remove_watcher() i=6 2024-09-14T11:34:08.450 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.452+0000 7f57f0d2c800 20 remove_watcher() i=7 2024-09-14T11:34:08.463 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:08.463 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:08.471 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:34:08.499 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:08.499 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:08.536 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.538+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.539+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.539+0000 7fe9b4baf800 20 realm 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.539+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.540+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.540+0000 7fe9b4baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.540+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.540+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.540+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.538 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.541+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.541+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.541+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:08.539 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.541+0000 7fe9b4baf800 20 searching for the correct realm 2024-09-14T11:34:08.541 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.544+0000 7fe9b2e9a640 0 -- 172.21.15.130:0/2661142805 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe9a8095c00 msgr2=0x7fe9a8064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:08.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.750+0000 7fe9b2e9a640 0 -- 172.21.15.130:0/2661142805 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe9a8095c00 msgr2=0x7fe9a8064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:08.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:08.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.754+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 zone default found 2024-09-14T11:34:08.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 4 Realm: () 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 zonegroup default 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:08.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 started sync module instance, tier type = 2024-09-14T11:34:08.755 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.755+0000 7fe9b4baf800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=0 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=1 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=2 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=3 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=4 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=5 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.764+0000 7fe9b4baf800 20 add_watcher() i=6 2024-09-14T11:34:08.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.765+0000 7fe9b4baf800 20 add_watcher() i=7 2024-09-14T11:34:08.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.765+0000 7fe9b4baf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:08.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:08.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:08.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 5 note: GC not initialized 2024-09-14T11:34:08.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe7e37fe640 20 reqs_thread_entry: start 2024-09-14T11:34:08.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 20 Filter name: none 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe7e17fa640 20 reqs_thread_entry: start 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.767+0000 7fe9b4baf800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 20 rados->read ofs=0 len=0 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:08.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.768+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:08.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:08.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.769+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:08.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.770+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.771+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:08.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:08.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:08.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.772+0000 7fe9b4baf800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:08.772 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.773+0000 7fe868fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:08.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.776+0000 7fe9b4baf800 20 remove_watcher() i=0 2024-09-14T11:34:08.773 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.776+0000 7fe9b4baf800 2 removed watcher, disabling cache 2024-09-14T11:34:08.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.776+0000 7fe9b4baf800 20 remove_watcher() i=1 2024-09-14T11:34:08.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.778+0000 7fe9b4baf800 20 remove_watcher() i=2 2024-09-14T11:34:08.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.779+0000 7fe9b4baf800 20 remove_watcher() i=3 2024-09-14T11:34:08.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.780+0000 7fe9b4baf800 20 remove_watcher() i=4 2024-09-14T11:34:08.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.781+0000 7fe9b4baf800 20 remove_watcher() i=5 2024-09-14T11:34:08.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.781+0000 7fe9b4baf800 20 remove_watcher() i=6 2024-09-14T11:34:08.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:08.782+0000 7fe9b4baf800 20 remove_watcher() i=7 2024-09-14T11:34:38.822 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:38.855 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:38.855 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:38.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.898+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 realm 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.900+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.901+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.901+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.902+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:38.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.902+0000 7f06d1123800 20 searching for the correct realm 2024-09-14T11:34:38.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:38.904+0000 7f06cd60d640 0 -- 172.21.15.130:0/1328740556 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f06b401f060 msgr2=0x7f06b4083a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.111+0000 7f06cd60d640 0 -- 172.21.15.130:0/1328740556 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f06b401f060 msgr2=0x7f06b4083a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.115+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 zone default found 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 4 Realm: () 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 zonegroup default 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.116+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.117+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.117+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.117+0000 7f06d1123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.117+0000 7f06d1123800 20 started sync module instance, tier type = 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.117+0000 7f06d1123800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=0 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=1 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=2 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=3 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=4 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=5 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.127+0000 7f06d1123800 20 add_watcher() i=6 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.128+0000 7f06d1123800 20 add_watcher() i=7 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.128+0000 7f06d1123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f05837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f06d1123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f06d1123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f06d1123800 5 note: GC not initialized 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f05827e4640 20 reqs_thread_entry: start 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f06d1123800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f06d1123800 20 Filter name: none 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.130+0000 7f057b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.131+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.132+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.132+0000 7f06d1123800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.132+0000 7f06d1123800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.132+0000 7f06d1123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.134+0000 7f05837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.136+0000 7f06d1123800 20 remove_watcher() i=0 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.136+0000 7f06d1123800 2 removed watcher, disabling cache 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.137+0000 7f06d1123800 20 remove_watcher() i=1 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.138+0000 7f06d1123800 20 remove_watcher() i=2 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.139+0000 7f06d1123800 20 remove_watcher() i=3 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.140+0000 7f06d1123800 20 remove_watcher() i=4 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.141+0000 7f06d1123800 20 remove_watcher() i=5 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.142+0000 7f06d1123800 20 remove_watcher() i=6 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.143+0000 7f06d1123800 20 remove_watcher() i=7 2024-09-14T11:34:39.156 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:39.156 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:39.177 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:34:39.206 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.206 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.447+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 realm 2024-09-14T11:34:39.447 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.449+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.450+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.448 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.450+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.451+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.449 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.451+0000 7f8e13a13800 20 searching for the correct realm 2024-09-14T11:34:39.452 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.453+0000 7f8e0f949640 0 -- 172.21.15.130:0/990371256 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8df806d040 msgr2=0x7f8df8088940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.456 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.458+0000 7f8e0f949640 0 -- 172.21.15.130:0/990371256 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8cd80878d0 msgr2=0x7f8cd8089d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.461 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.461+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.462 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 zone default found 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 4 Realm: () 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 zonegroup default 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.462+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.463+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.463+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.463+0000 7f8e13a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.463+0000 7f8e13a13800 20 started sync module instance, tier type = 2024-09-14T11:34:39.463 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.463+0000 7f8e13a13800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=0 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=1 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=2 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=3 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=4 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=5 2024-09-14T11:34:39.470 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.471+0000 7f8e13a13800 20 add_watcher() i=6 2024-09-14T11:34:39.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.472+0000 7f8e13a13800 20 add_watcher() i=7 2024-09-14T11:34:39.471 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.472+0000 7f8e13a13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8cc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8e13a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8e13a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8e13a13800 5 note: GC not initialized 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8cc4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8e13a13800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.473 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8e13a13800 20 Filter name: none 2024-09-14T11:34:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.474+0000 7f8c3e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:39.474 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.475 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.475+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.476+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.476+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.476+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:39.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.476+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.477+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.478+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.478+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.478+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:39.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.478+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.478+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:39.478 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.479+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.480+0000 7f8e13a13800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.480+0000 7f8e13a13800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:39.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.481+0000 7f8cc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.483+0000 7f8e13a13800 20 remove_watcher() i=0 2024-09-14T11:34:39.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.483+0000 7f8e13a13800 2 removed watcher, disabling cache 2024-09-14T11:34:39.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.484+0000 7f8e13a13800 20 remove_watcher() i=1 2024-09-14T11:34:39.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.485+0000 7f8e13a13800 20 remove_watcher() i=2 2024-09-14T11:34:39.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.486+0000 7f8e13a13800 20 remove_watcher() i=3 2024-09-14T11:34:39.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.487+0000 7f8e13a13800 20 remove_watcher() i=4 2024-09-14T11:34:39.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.488+0000 7f8e13a13800 20 remove_watcher() i=5 2024-09-14T11:34:39.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.489+0000 7f8e13a13800 20 remove_watcher() i=6 2024-09-14T11:34:39.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.490+0000 7f8e13a13800 20 remove_watcher() i=7 2024-09-14T11:34:39.500 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:39.528 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.528 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.564 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.566+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 realm 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.567 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.568+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.770+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.770+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.771+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.771+0000 7f6c4de63800 20 searching for the correct realm 2024-09-14T11:34:39.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.772+0000 7f6c43153640 0 -- 172.21.15.130:0/1785228867 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f6c3c08a070 msgr2=0x7f6c3c08e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:39.978+0000 7f6c4b954640 0 -- 172.21.15.130:0/1785228867 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f6c44067a40 msgr2=0x7f6c4406aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.182 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.183+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.184+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.183 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.184+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.184+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.184+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 zone default found 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 4 Realm: () 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 zonegroup default 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.184 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.185+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.186+0000 7f6c4de63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.186+0000 7f6c4de63800 20 started sync module instance, tier type = 2024-09-14T11:34:40.185 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.186+0000 7f6c4de63800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=0 2024-09-14T11:34:40.193 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=1 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=2 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=3 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=4 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=5 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.195+0000 7f6c4de63800 20 add_watcher() i=6 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.196+0000 7f6c4de63800 20 add_watcher() i=7 2024-09-14T11:34:40.194 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.196+0000 7f6c4de63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.196 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6b017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6c4de63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6c4de63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.197 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6c4de63800 5 note: GC not initialized 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6a7bfff640 20 reqs_thread_entry: start 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.198+0000 7f6c4de63800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.199+0000 7f6c4de63800 20 Filter name: none 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.199+0000 7f6a79ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:40.198 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.199+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.199+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.199+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.200+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.200+0000 7f6c4de63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.200+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.199 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.200+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.200+0000 7f6c4de63800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.201+0000 7f6c4de63800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.200 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.201+0000 7f6c4de63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.201 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.202+0000 7f6b017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.205+0000 7f6c4de63800 20 remove_watcher() i=0 2024-09-14T11:34:40.203 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.205+0000 7f6c4de63800 2 removed watcher, disabling cache 2024-09-14T11:34:40.204 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.206+0000 7f6c4de63800 20 remove_watcher() i=1 2024-09-14T11:34:40.205 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.207+0000 7f6c4de63800 20 remove_watcher() i=2 2024-09-14T11:34:40.206 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.208+0000 7f6c4de63800 20 remove_watcher() i=3 2024-09-14T11:34:40.207 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.209+0000 7f6c4de63800 20 remove_watcher() i=4 2024-09-14T11:34:40.208 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.210+0000 7f6c4de63800 20 remove_watcher() i=5 2024-09-14T11:34:40.209 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.211+0000 7f6c4de63800 20 remove_watcher() i=6 2024-09-14T11:34:40.210 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.212+0000 7f6c4de63800 20 remove_watcher() i=7 2024-09-14T11:34:40.220 INFO:tasks.workunit.client.0.smithi130.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:34:40.222 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.251 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.287 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.289+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.290+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.290+0000 7f09de532800 20 realm 2024-09-14T11:34:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.290+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.290+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.289 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.290+0000 7f09de532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.291+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.291+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.291+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.292+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.290 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.292+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.293+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.291 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.293+0000 7f09de532800 20 searching for the correct realm 2024-09-14T11:34:40.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.294+0000 7f09d9aaf640 0 -- 172.21.15.130:0/2697499481 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f09cc047050 msgr2=0x7f09cc054400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.299+0000 7f09da2b0640 0 -- 172.21.15.130:0/2697499481 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f09d4079030 msgr2=0x7f09d40af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.505+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.505 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 zone default found 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 4 Realm: () 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.506 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 zonegroup default 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.506+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.507+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.507+0000 7f09de532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.507+0000 7f09de532800 20 started sync module instance, tier type = 2024-09-14T11:34:40.507 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.507+0000 7f09de532800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=0 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=1 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=2 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=3 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=4 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=5 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.516+0000 7f09de532800 20 add_watcher() i=6 2024-09-14T11:34:40.515 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.517+0000 7f09de532800 20 add_watcher() i=7 2024-09-14T11:34:40.516 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.517+0000 7f09de532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f0890fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f09de532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f09de532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f09de532800 5 note: GC not initialized 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f080b7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:40.518 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f09de532800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f09de532800 20 Filter name: none 2024-09-14T11:34:40.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.519+0000 7f08097fa640 20 reqs_thread_entry: start 2024-09-14T11:34:40.519 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.520+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.521+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.521+0000 7f09de532800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.521+0000 7f09de532800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.520 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.521+0000 7f09de532800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.521 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.523+0000 7f0890fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.525+0000 7f09de532800 20 remove_watcher() i=0 2024-09-14T11:34:40.524 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.525+0000 7f09de532800 2 removed watcher, disabling cache 2024-09-14T11:34:40.525 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.527+0000 7f09de532800 20 remove_watcher() i=1 2024-09-14T11:34:40.526 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.528+0000 7f09de532800 20 remove_watcher() i=2 2024-09-14T11:34:40.527 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.529+0000 7f09de532800 20 remove_watcher() i=3 2024-09-14T11:34:40.528 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.530+0000 7f09de532800 20 remove_watcher() i=4 2024-09-14T11:34:40.529 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.530+0000 7f09de532800 20 remove_watcher() i=5 2024-09-14T11:34:40.530 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.531+0000 7f09de532800 20 remove_watcher() i=6 2024-09-14T11:34:40.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.532+0000 7f09de532800 20 remove_watcher() i=7 2024-09-14T11:34:40.541 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.541 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:34:40.541 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:34:40.541 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.542 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:34:40.576 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.576 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.614 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.615+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.615 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 realm 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.616 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.619+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.617 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.619+0000 7ff403f25800 20 searching for the correct realm 2024-09-14T11:34:40.618 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.620+0000 7ff3ffb33640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7ff3ec003b00 msgr2=0x7ff3f8063180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:40.622 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.624+0000 7ff3f7332640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7ff3f007b070 msgr2=0x7ff3f006c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.629 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.630 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 zone default found 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 4 Realm: () 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 zonegroup default 2024-09-14T11:34:40.631 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.632+0000 7ff403f25800 20 started sync module instance, tier type = 2024-09-14T11:34:40.632 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.632+0000 7ff403f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=0 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=1 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=2 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=3 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=4 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=5 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=6 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=7 2024-09-14T11:34:40.640 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.641+0000 7ff403f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.643+0000 7ff2b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.642 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 5 note: GC not initialized 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff2b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 20 Filter name: none 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff22e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.644+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:40.644 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.645 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.645+0000 7ff403f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff403f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff403f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 93847302752528 notifier 8274 bl.length()=911 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.649 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:40.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:40.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:40.650 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:40.655 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff403f25800 time 2024-09-14T11:34:40.658168+0000 2024-09-14T11:34:40.655 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff40558c76a] 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:34:40.656 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7ff403f25800 thread_name:radosgw-admin 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.657+0000 7ff403f25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff403f25800 time 2024-09-14T11:34:40.658168+0000 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff40558c76a] 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.657 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:34:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:34:40.658 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff40423e6f0] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff40428b99c] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff40558c7c4] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.676 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.658+0000 7ff403f25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7ff403f25800 thread_name:radosgw-admin 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff40423e6f0] 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff40428b99c] 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff40558c7c4] 2024-09-14T11:34:40.677 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:34:40.598+0000 7ff403f25800 4 set_mon_vals no callback set 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: shutdown 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 asok(0x555a86f2a270) unregister_commands rotate-key 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.678 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.679 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:34:40.599+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: starting msgr at 2024-09-14T11:34:40.680 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: starting objecter 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests hook 0x555a87178e20 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: setting wanted keys 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: calling monclient init 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.681 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:34:40.599+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:34:40.600+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:34:40.600+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key hook 0x555a8714a1a8 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a8714d6b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a87179920 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x7ff3ec0022f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.682 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.084268s 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a87179920 auth_method 0 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a8714d6b0 auth_method 0 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x7ff3ec0022f0 auth_method 0 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.683 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_done global_id 8265 payload 824 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:34:40.600+0000 7ff3f7332640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.684 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: dump: 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.685 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:34:40.601+0000 7ff2e7fff640 10 monclient: dump: 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.686 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:34:40.601+0000 7ff403f25800 5 monclient: authenticate success, global_id 8265 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:34:40.600+0000 7ff2ede0b640 4 set_mon_vals no callback set 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:34:40.601+0000 7ff403f25800 1 librados: init done 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:34:40.603+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2e8077230 auth_method 0 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:34:40.603+0000 7ff400334640 10 monclient: get_auth_request con 0x555a8716a050 auth_method 0 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:34:40.604+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a87196830 auth_method 0 2024-09-14T11:34:40.687 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:34:40.604+0000 7ff3f7332640 10 monclient: get_auth_request con 0x555a8719aa20 auth_method 0 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:34:40.606+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:34:40.606+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:34:40.606+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.688 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.689 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:34:40.606+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests cmddesc objecter_requests hook 0x555a871a2e00 EEXIST 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.690 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:34:40.607+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:34:40.607+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x555a8719e090 EEXIST 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a871c7120 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a871c7500 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a871c5e30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.691 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.091597s 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a871c5e30 auth_method 0 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871c7120 auth_method 0 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a871c7500 auth_method 0 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.692 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:34:40.607+0000 7ff400334640 1 monclient: found mon.noname-c 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:40.693 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: dump: 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.694 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: dump: 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:34:40.608+0000 7ff403f25800 5 monclient: authenticate success, global_id 7718 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.695 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:34:40.608+0000 7ff400b35640 4 set_mon_vals no callback set 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: get_monmap_and_config 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:34:40.610+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.696 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:34:40.610+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2d8077140 auth_method 0 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.697 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:34:40.610+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.698 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:34:40.611+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:34:40.611+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x7ffcf9b11188 EEXIST 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.699 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a871ed380 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a87218bd0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a8720f450 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.095600s 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a87218bd0 auth_method 0 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a8720f450 auth_method 0 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.700 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871ed380 auth_method 0 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.701 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_done global_id 8271 payload 274 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:34:40.611+0000 7ff400334640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: dump: 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.702 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: dump: 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.703 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 monclient: authenticate success, global_id 8271 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:34:40.612+0000 7ff403f25800 4 set_mon_vals no callback set 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: shutdown 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:34:40.612+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.704 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.705 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: starting msgr at 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: starting objecter 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests cmddesc objecter_requests hook 0x555a871c5560 EEXIST 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: setting wanted keys 2024-09-14T11:34:40.706 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: calling monclient init 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.707 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x555a871dbb28 EEXIST 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a871ed380 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a8720f450 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a87218bd0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.708 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.097774s 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871ed380 auth_method 0 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a8720f450 auth_method 0 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.709 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a87218bd0 auth_method 0 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:34:40.614+0000 7ff3f7332640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: dump: 2024-09-14T11:34:40.710 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.711 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: dump: 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.712 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:34:40.614+0000 7ff403f25800 5 monclient: authenticate success, global_id 8274 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:34:40.614+0000 7ff2deffd640 4 set_mon_vals no callback set 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:34:40.614+0000 7ff403f25800 1 librados: init done 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:34:40.614+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cr dump hook 0x555a87217e48 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:34:40.615+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.713 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:34:40.616+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2c8077230 auth_method 0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:34:40.616+0000 7ff400334640 10 monclient: get_auth_request con 0x555a87237dc0 auth_method 0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 realm 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:34:40.617+0000 7ff403f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:34:40.617+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a8723bfb0 auth_method 0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:34:40.618+0000 7ff3f7332640 10 monclient: get_auth_request con 0x555a8723f860 auth_method 0 2024-09-14T11:34:40.714 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:34:40.619+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:34:40.619+0000 7ff403f25800 20 searching for the correct realm 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:34:40.619+0000 7ff400334640 10 monclient: get_auth_request con 0x555a872445e0 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff3ec003b00 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7ff3ec003b00 msgr2=0x7ff3f8063180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 1 client.8274.objecter ms_handle_reset 0x7ff3ec003b00 session 0x7ff3f809aa10 osd.7 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 10 monclient: _renew_subs 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2c8087930 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:34:40.621+0000 7ff3f7332640 10 monclient: get_auth_request con 0x7ff3f007b070 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:34:40.622+0000 7ff400334640 10 monclient: get_auth_request con 0x7ff3e806cd30 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:34:40.624+0000 7ff3f7332640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7ff3f007b070 msgr2=0x7ff3f006c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:34:40.624+0000 7ff2dd7fa640 1 client.8274.objecter ms_handle_reset 0x7ff3f007b070 session 0x7ff3f0055930 osd.2 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:34:40.624+0000 7ff3f7332640 10 monclient: get_auth_request con 0x7ff3ec003b00 auth_method 0 2024-09-14T11:34:40.715 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:34:40.625+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a86fd3f80 auth_method 0 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 zone default found 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 Realm: () 2024-09-14T11:34:40.716 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:34:40.631+0000 7ff403f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 zonegroup default 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 started sync module instance, tier type = 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=0 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=1 2024-09-14T11:34:40.717 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=2 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=3 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=4 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=5 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=6 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=7 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:34:40.641+0000 7ff403f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.718 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:34:40.643+0000 7ff2b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:34:40.644+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache list hook 0x555a87223040 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache inspect hook 0x555a87223040 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache erase hook 0x555a87223040 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache zap hook 0x555a87223040 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 note: GC not initialized 2024-09-14T11:34:40.719 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:34:40.644+0000 7ff2b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace show hook 0x7ff3ec002ed0 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace history hook 0x7ff3ec002ed0 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace active hook 0x7ff3ec002ed0 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace active_short hook 0x7ff3ec002ed0 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 Filter name: none 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:34:40.644+0000 7ff22e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:34:40.644+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:40.720 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.721 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 93847302752528 notifier 8274 bl.length()=911 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:34:40.657+0000 7ff403f25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff403f25800 time 2024-09-14T11:34:40.658168+0000 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.722 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff40558c76a] 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:34:40.658+0000 7ff403f25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7ff403f25800 thread_name:radosgw-admin 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.723 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff40423e6f0] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff40428b99c] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff40558c7c4] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.724 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:34:40.725 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:34:40.726 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:34:40.727 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:34:40.728 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:40.729 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:34:40.730 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff22e7fc640 / http_manager 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2b4fe1640 / http_manager 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2b5fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2dd7fa640 / ms_dispatch 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2deffd640 / io_context_pool 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2e57fa640 / ms_dispatch 2024-09-14T11:34:40.731 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2e7fff640 / ms_dispatch 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2ede0b640 / io_context_pool 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff3f7332640 / msgr-worker-2 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff3ffb33640 / msgr-worker-1 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff400334640 / msgr-worker-0 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff400b35640 / io_context_pool 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff403f25800 / radosgw-admin 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.151054.log 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:34:40.598+0000 7ff403f25800 4 set_mon_vals no callback set 2024-09-14T11:34:40.732 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: shutdown 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 asok(0x555a86f2a270) unregister_commands rotate-key 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.733 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding auth protocol: cephx 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: crc 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714fc60) adding con mode: secure 2024-09-14T11:34:40.734 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:34:40.599+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: starting msgr at 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: starting objecter 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests hook 0x555a87178e20 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: setting wanted keys 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:34:40.599+0000 7ff403f25800 1 librados: calling monclient init 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:34:40.599+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding auth protocol: cephx 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.735 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: crc 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:34:40.599+0000 7ff403f25800 5 AuthRegistry(0x555a8714a060) adding con mode: secure 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:34:40.599+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:34:40.600+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:34:40.600+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key hook 0x555a8714a1a8 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a8714d6b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a87179920 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x7ff3ec0022f0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.736 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:34:40.600+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.084268s 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a87179920 auth_method 0 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a8714d6b0 auth_method 0 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x7ff3ec0022f0 auth_method 0 2024-09-14T11:34:40.737 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:34:40.600+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:34:40.600+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient(hunting): handle_auth_done global_id 8265 payload 824 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:34:40.600+0000 7ff3f7332640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.738 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:34:40.600+0000 7ff3f7332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: dump: 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.739 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:34:40.600+0000 7ff2e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:34:40.601+0000 7ff2e7fff640 10 monclient: dump: 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.740 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:34:40.601+0000 7ff403f25800 5 monclient: authenticate success, global_id 8265 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:34:40.600+0000 7ff2ede0b640 4 set_mon_vals no callback set 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:34:40.601+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:34:40.601+0000 7ff403f25800 1 librados: init done 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.741 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:34:40.602+0000 7ff2e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:34:40.603+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2e8077230 auth_method 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:34:40.603+0000 7ff400334640 10 monclient: get_auth_request con 0x555a8716a050 auth_method 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:34:40.604+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a87196830 auth_method 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:34:40.604+0000 7ff3f7332640 10 monclient: get_auth_request con 0x555a8719aa20 auth_method 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:34:40.606+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:34:40.606+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:34:40.606+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.742 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding auth protocol: cephx 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.743 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: crc 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 AuthRegistry(0x555a8719f900) adding con mode: secure 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:34:40.606+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:34:40.606+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests cmddesc objecter_requests hook 0x555a871a2e00 EEXIST 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.744 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding auth protocol: cephx 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: crc 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 AuthRegistry(0x555a8719df48) adding con mode: secure 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:34:40.607+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.745 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:34:40.607+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:34:40.607+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x555a8719e090 EEXIST 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a871c7120 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a871c7500 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a871c5e30 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:34:40.607+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.091597s 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a871c5e30 auth_method 0 2024-09-14T11:34:40.746 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871c7120 auth_method 0 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a871c7500 auth_method 0 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.747 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:34:40.607+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:34:40.607+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:34:40.607+0000 7ff400334640 1 monclient: found mon.noname-c 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:34:40.607+0000 7ff400334640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: dump: 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.748 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:40.749 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:34:40.608+0000 7ff2e57fa640 10 monclient: dump: 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:34:40.608+0000 7ff403f25800 5 monclient: authenticate success, global_id 7718 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.750 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:34:40.608+0000 7ff400b35640 4 set_mon_vals no callback set 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:34:40.608+0000 7ff403f25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:34:40.610+0000 7ff2e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: get_monmap_and_config 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:34:40.610+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:34:40.610+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.751 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:34:40.610+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2d8077140 auth_method 0 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding auth protocol: cephx 2024-09-14T11:34:40.752 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: crc 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:34:40.610+0000 7ff403f25800 5 AuthRegistry(0x555a871e6ff0) adding con mode: secure 2024-09-14T11:34:40.753 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:34:40.610+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding auth protocol: cephx 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.754 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: crc 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11040) adding con mode: secure 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:34:40.611+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:34:40.611+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:34:40.611+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x7ffcf9b11188 EEXIST 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a871ed380 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a87218bd0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a8720f450 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.755 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:34:40.611+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.095600s 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a87218bd0 auth_method 0 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a8720f450 auth_method 0 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:34:40.611+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.756 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871ed380 auth_method 0 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:34:40.611+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient(hunting): handle_auth_done global_id 8271 payload 274 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:34:40.611+0000 7ff400334640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:34:40.611+0000 7ff400334640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: dump: 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.757 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:34:40.612+0000 7ff2deffd640 10 monclient: dump: 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.758 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 monclient: authenticate success, global_id 8271 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: get_monmap_and_config success 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:34:40.612+0000 7ff403f25800 4 set_mon_vals no callback set 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: shutdown 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: build_initial_monmap 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:34:40.612+0000 7ff403f25800 1 build_initial for_mkfs: 0 2024-09-14T11:34:40.759 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:34:40.612+0000 7ff403f25800 10 monclient: monmap: 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding auth protocol: cephx 2024-09-14T11:34:40.760 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: crc 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:34:40.612+0000 7ff403f25800 5 AuthRegistry(0x555a8720f970) adding con mode: secure 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.761 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: starting msgr at 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: starting objecter 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command objecter_requests cmddesc objecter_requests hook 0x555a871c5560 EEXIST 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: setting wanted keys 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:34:40.613+0000 7ff403f25800 1 librados: calling monclient init 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: init 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding auth protocol: cephx 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.762 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: crc 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 AuthRegistry(0x555a871db9e0) adding con mode: secure 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:34:40.613+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:34:40.613+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command rotate-key cmddesc rotate-key hook 0x555a871dbb28 EEXIST 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: _reopen_session rank -1 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-c con 0x555a871ed380 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:34:40.763 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-a con 0x555a8720f450 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): picked mon.noname-b con 0x555a87218bd0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): _renew_subs 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:34:40.613+0000 7ff403f25800 10 monclient(hunting): authenticate will time out at 2197.097774s 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request con 0x555a871ed380 auth_method 0 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): get_auth_request con 0x555a8720f450 auth_method 0 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.764 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:34:40.613+0000 7ff3f7332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:34:40.613+0000 7ff3ffb33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): get_auth_request con 0x555a87218bd0 auth_method 0 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:34:40.614+0000 7ff400334640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient(hunting): handle_auth_done global_id 8274 payload 824 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient: _finish_hunting 0 2024-09-14T11:34:40.765 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:34:40.614+0000 7ff3f7332640 1 monclient: found mon.noname-a 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:34:40.614+0000 7ff3f7332640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: dump: 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.766 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:34:40.614+0000 7ff2dd7fa640 10 monclient: dump: 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:34:40.767 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:34:40.614+0000 7ff403f25800 5 monclient: authenticate success, global_id 8274 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:34:40.614+0000 7ff2deffd640 4 set_mon_vals no callback set 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _renew_subs 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:34:40.614+0000 7ff403f25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:34:40.614+0000 7ff403f25800 1 librados: init done 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:34:40.614+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cr dump hook 0x555a87217e48 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:34:40.615+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.768 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:34:40.616+0000 7ff2dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:34:40.616+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2c8077230 auth_method 0 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:34:40.616+0000 7ff400334640 10 monclient: get_auth_request con 0x555a87237dc0 auth_method 0 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 realm 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.769 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:34:40.617+0000 7ff403f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:34:40.617+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:34:40.617+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a8723bfb0 auth_method 0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:34:40.618+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:34:40.618+0000 7ff3f7332640 10 monclient: get_auth_request con 0x555a8723f860 auth_method 0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:34:40.619+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:34:40.619+0000 7ff403f25800 20 searching for the correct realm 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:34:40.619+0000 7ff400334640 10 monclient: get_auth_request con 0x555a872445e0 auth_method 0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff3ec003b00 auth_method 0 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7ff3ec003b00 msgr2=0x7ff3f8063180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 1 client.8274.objecter ms_handle_reset 0x7ff3ec003b00 session 0x7ff3f809aa10 osd.7 2024-09-14T11:34:40.770 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 10 monclient: _renew_subs 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:34:40.620+0000 7ff2dd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:34:40.620+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x7ff2c8087930 auth_method 0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:34:40.621+0000 7ff3f7332640 10 monclient: get_auth_request con 0x7ff3f007b070 auth_method 0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:34:40.622+0000 7ff400334640 10 monclient: get_auth_request con 0x7ff3e806cd30 auth_method 0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:34:40.624+0000 7ff3f7332640 0 -- 172.21.15.130:0/1756252921 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7ff3f007b070 msgr2=0x7ff3f006c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:34:40.624+0000 7ff2dd7fa640 1 client.8274.objecter ms_handle_reset 0x7ff3f007b070 session 0x7ff3f0055930 osd.2 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:34:40.624+0000 7ff3f7332640 10 monclient: get_auth_request con 0x7ff3ec003b00 auth_method 0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:34:40.625+0000 7ff3ffb33640 10 monclient: get_auth_request con 0x555a86fd3f80 auth_method 0 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.771 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:34:40.630+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 zone default found 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 Realm: () 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:34:40.631+0000 7ff403f25800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:34:40.631+0000 7ff403f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 zonegroup default 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.772 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:34:40.631+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 started sync module instance, tier type = 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:34:40.632+0000 7ff403f25800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=0 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=1 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=2 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=3 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=4 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=5 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=6 2024-09-14T11:34:40.773 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:34:40.641+0000 7ff403f25800 20 add_watcher() i=7 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:34:40.641+0000 7ff403f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding auth protocol: cephx 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.774 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:34:40.643+0000 7ff2b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: crc 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:34:40.643+0000 7ff403f25800 5 AuthRegistry(0x7ffcf9b11520) adding con mode: secure 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:34:40.644+0000 7ff403f25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache list hook 0x555a87223040 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache inspect hook 0x555a87223040 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache erase hook 0x555a87223040 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command cache zap hook 0x555a87223040 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 note: GC not initialized 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:34:40.644+0000 7ff2b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace show hook 0x7ff3ec002ed0 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace history hook 0x7ff3ec002ed0 2024-09-14T11:34:40.775 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace active hook 0x7ff3ec002ed0 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:34:40.644+0000 7ff403f25800 5 asok(0x555a86f2a270) register_command sync trace active_short hook 0x7ff3ec002ed0 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 Filter name: none 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:34:40.644+0000 7ff22e7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:34:40.644+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:34:40.644+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:34:40.645+0000 7ff403f25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.776 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:34:40.645+0000 7ff403f25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:34:40.650+0000 7ff403f25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497055 cookie 93847302752528 notifier 8274 bl.length()=911 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:34:40.650+0000 7ff2deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:34:40.777 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:34:40.651+0000 7ff403f25800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:34:40.657+0000 7ff403f25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff403f25800 time 2024-09-14T11:34:40.658168+0000 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff40558c76a] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.778 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:34:40.658+0000 7ff403f25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7ff403f25800 thread_name:radosgw-admin 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff40423e6f0] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff40428b99c] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff40558c7c4] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ff40558c928] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555a8582e0b1] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555a8583df6a] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7ff404229590] 2024-09-14T11:34:40.779 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:40.780 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:34:40.781 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:34:40.782 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:34:40.783 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:34:40.784 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:34:40.785 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff22e7fc640 / http_manager 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2b4fe1640 / http_manager 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2b5fe3640 / rgw_dt_lg_renew 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2dd7fa640 / ms_dispatch 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2deffd640 / io_context_pool 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2e57fa640 / ms_dispatch 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2e7fff640 / ms_dispatch 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff2ede0b640 / io_context_pool 2024-09-14T11:34:40.786 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff3f7332640 / msgr-worker-2 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff3ffb33640 / msgr-worker-1 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff400334640 / msgr-worker-0 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff400b35640 / io_context_pool 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: 7ff403f25800 / radosgw-admin 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:40.659582Z_b08e488f-dadf-4281-a506-60d66e087f20/log 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:34:40.787 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:34:40.788 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.737+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 20 realm 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.739+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.740+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.740+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.740+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.740+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.741+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:40.789 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.741+0000 7f033b60e800 20 searching for the correct realm 2024-09-14T11:34:40.790 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.743+0000 7f033756c640 0 -- 172.21.15.130:0/454083785 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f032c07a920 msgr2=0x7f032c064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:40.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.950+0000 7f033756c640 0 -- 172.21.15.130:0/454083785 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f032c07a920 msgr2=0x7f032c064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:40.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.954+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 zone default found 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 4 Realm: () 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 zonegroup default 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:40.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 started sync module instance, tier type = 2024-09-14T11:34:40.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.955+0000 7f033b60e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=0 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=1 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=2 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=3 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=4 2024-09-14T11:34:40.963 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=5 2024-09-14T11:34:40.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=6 2024-09-14T11:34:40.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 20 add_watcher() i=7 2024-09-14T11:34:40.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.965+0000 7f033b60e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:40.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.967+0000 7f01ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.967+0000 7f033b60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.967+0000 7f033b60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.967+0000 7f033b60e800 5 note: GC not initialized 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f0167fff640 20 reqs_thread_entry: start 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f033b60e800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f033b60e800 20 Filter name: none 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f0165ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:40.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.968+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.969+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:40.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.969+0000 7f033b60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.969+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.969+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:40.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.969+0000 7f033b60e800 20 rados->read ofs=0 len=0 2024-09-14T11:34:40.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.970+0000 7f033b60e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:40.969 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.970+0000 7f033b60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:40.970 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.971+0000 7f01ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:40.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.974+0000 7f033b60e800 20 remove_watcher() i=0 2024-09-14T11:34:40.972 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.974+0000 7f033b60e800 2 removed watcher, disabling cache 2024-09-14T11:34:40.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.975+0000 7f033b60e800 20 remove_watcher() i=1 2024-09-14T11:34:40.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.975+0000 7f033b60e800 20 remove_watcher() i=2 2024-09-14T11:34:40.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.976+0000 7f033b60e800 20 remove_watcher() i=3 2024-09-14T11:34:40.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.977+0000 7f033b60e800 20 remove_watcher() i=4 2024-09-14T11:34:40.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.978+0000 7f033b60e800 20 remove_watcher() i=5 2024-09-14T11:34:40.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.979+0000 7f033b60e800 20 remove_watcher() i=6 2024-09-14T11:34:40.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:40.980+0000 7f033b60e800 20 remove_watcher() i=7 2024-09-14T11:34:40.991 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:34:40.991 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:34:40.999 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:34:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:41.028 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:41.064 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.066+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.066 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.067+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.067+0000 7f78bfb26800 20 realm 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.067+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.068+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.068+0000 7f78bfb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.068+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.068+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.068+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.067 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.069+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.069+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.070+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:41.068 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.070+0000 7f78bfb26800 20 searching for the correct realm 2024-09-14T11:34:41.071 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.072+0000 7f78bbf0a640 0 -- 172.21.15.130:0/607680559 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f78a4063070 msgr2=0x7f78a4063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:41.278 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.279+0000 7f78bbf0a640 0 -- 172.21.15.130:0/607680559 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f78a4063070 msgr2=0x7f78a4063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.282 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.283+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.283 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 zone default found 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 4 Realm: () 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 zonegroup default 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.284+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.285+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.285+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.284 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.285+0000 7f78bfb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:41.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.285+0000 7f78bfb26800 20 started sync module instance, tier type = 2024-09-14T11:34:41.285 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.285+0000 7f78bfb26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:34:41.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=0 2024-09-14T11:34:41.292 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=1 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=2 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=3 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=4 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=5 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.294+0000 7f78bfb26800 20 add_watcher() i=6 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.295+0000 7f78bfb26800 20 add_watcher() i=7 2024-09-14T11:34:41.293 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.295+0000 7f78bfb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:41.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.296+0000 7f7771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:41.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:41.295 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 5 note: GC not initialized 2024-09-14T11:34:41.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f7770fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:41.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:34:41.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 20 Filter name: none 2024-09-14T11:34:41.296 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f76ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:41.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:34:41.297 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.297+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 20 rados->read ofs=0 len=0 2024-09-14T11:34:41.298 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.298+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.299+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.299+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.300+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:41.299 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.300+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.300+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.300+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.301+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.301+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.301+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.301+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:34:41.300 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.302+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:34:41.301 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.303+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:34:41.302 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.304+0000 7f78bfb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:41.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.304+0000 7f78bfb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:34:41.303 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.305+0000 7f7771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:41.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.307+0000 7f78bfb26800 20 remove_watcher() i=0 2024-09-14T11:34:41.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.307+0000 7f78bfb26800 2 removed watcher, disabling cache 2024-09-14T11:34:41.306 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.308+0000 7f78bfb26800 20 remove_watcher() i=1 2024-09-14T11:34:41.308 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.309+0000 7f78bfb26800 20 remove_watcher() i=2 2024-09-14T11:34:41.309 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.310+0000 7f78bfb26800 20 remove_watcher() i=3 2024-09-14T11:34:41.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.311+0000 7f78bfb26800 20 remove_watcher() i=4 2024-09-14T11:34:41.310 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.312+0000 7f78bfb26800 20 remove_watcher() i=5 2024-09-14T11:34:41.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.313+0000 7f78bfb26800 20 remove_watcher() i=6 2024-09-14T11:34:41.312 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:34:41.314+0000 7f78bfb26800 20 remove_watcher() i=7 2024-09-14T11:35:11.355 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:35:11.393 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:11.393 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:11.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.436+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.437+0000 7f6744f32800 20 realm 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.438+0000 7f6744f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.437 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:11.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.440+0000 7f6744f32800 20 searching for the correct realm 2024-09-14T11:35:11.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.442+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:11.648 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.650+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:11.654 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.655 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 zone default found 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 4 Realm: () 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 zonegroup default 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.656 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.658+0000 7f6744f32800 20 started sync module instance, tier type = 2024-09-14T11:35:11.657 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.658+0000 7f6744f32800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:11.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=0 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=1 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=2 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=3 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=4 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=5 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=6 2024-09-14T11:35:11.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.669+0000 7f6744f32800 20 add_watcher() i=7 2024-09-14T11:35:11.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.669+0000 7f6744f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:11.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.671+0000 7f65f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:11.670 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.671+0000 7f6744f32800 5 note: GC not initialized 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f65f5fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f6744f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f6744f32800 20 Filter name: none 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f65677fe640 20 reqs_thread_entry: start 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:11.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.672+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:11.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:11.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:11.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:11.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.673+0000 7f6744f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:11.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.674+0000 7f6744f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6744f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6744f32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94271965560384 notifier 7778 bl.length()=911 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:11.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:11.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:11.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:11.686 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6744f32800 time 2024-09-14T11:35:11.688722+0000 2024-09-14T11:35:11.686 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f674658c76a] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:35:11.687 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f6744f32800 thread_name:radosgw-admin 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.688+0000 7f6744f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6744f32800 time 2024-09-14T11:35:11.688722+0000 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f674658c76a] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.688 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:35:11.689 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:35:11.689 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f674523e6f0] 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f674528b99c] 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f674658c7c4] 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.708 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.689+0000 7f6744f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f6744f32800 thread_name:radosgw-admin 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f674523e6f0] 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f674528b99c] 2024-09-14T11:35:11.709 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f674658c7c4] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:35:11.710 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:35:11.417+0000 7f662ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:35:11.417+0000 7f662ee0d640 10 monclient: dump: 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:35:11.417+0000 7f6744f32800 5 monclient: authenticate success, global_id 7766 2024-09-14T11:35:11.711 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:35:11.417+0000 7f6744f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:35:11.417+0000 7f6744f32800 4 set_mon_vals no callback set 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: shutdown 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 asok(0x55bd66d31270) unregister_commands rotate-key 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:35:11.418+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.712 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.713 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:35:11.418+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:35:11.418+0000 7f6744f32800 1 librados: starting msgr at 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: starting objecter 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests hook 0x55bd66f57d10 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: setting wanted keys 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: calling monclient init 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.714 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.715 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:35:11.419+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:35:11.419+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key hook 0x55bd66f51368 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66ddb1a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd66dfedc0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66e076c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.903755s 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66ddb1a0 auth_method 0 2024-09-14T11:35:11.716 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66dfedc0 auth_method 0 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7769 payload 824 2024-09-14T11:35:11.717 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:35:11.420+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:35:11.420+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd66e076c0 auth_method 0 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: dump: 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.718 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: dump: 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.719 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:35:11.420+0000 7f6744f32800 5 monclient: authenticate success, global_id 7769 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:35:11.420+0000 7f662ee0d640 4 set_mon_vals no callback set 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:35:11.420+0000 7f6744f32800 1 librados: init done 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:35:11.422+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6628077260 auth_method 0 2024-09-14T11:35:11.720 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:35:11.423+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd66f77f20 auth_method 0 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:35:11.423+0000 7f6740bbc640 10 monclient: get_auth_request con 0x55bd66f9ce30 auth_method 0 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:35:11.424+0000 7f67383bb640 10 monclient: get_auth_request con 0x55bd66fa11e0 auth_method 0 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:35:11.426+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.721 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.722 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:35:11.426+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests cmddesc objecter_requests hook 0x55bd66fa95b0 EEXIST 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.723 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:35:11.427+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:35:11.427+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:35:11.427+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x55bd66fa48c0 EEXIST 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66fcd8d0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd66fcdcb0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.724 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66fcc5e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.911442s 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66fcd8d0 auth_method 0 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66fcdcb0 auth_method 0 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.725 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd66fcc5e0 auth_method 0 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.726 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:35:11.427+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: dump: 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.727 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: dump: 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.728 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:35:11.428+0000 7f6744f32800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:35:11.428+0000 7f6741bbe640 4 set_mon_vals no callback set 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: get_monmap_and_config 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:35:11.430+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.729 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.730 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:35:11.430+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6618077140 auth_method 0 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:35:11.430+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.731 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.732 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:35:11.430+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:35:11.431+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:35:11.431+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x7ffc0720f0b8 EEXIST 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd67021ad0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66ff2a20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd6701d370 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.733 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.915318s 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd67021ad0 auth_method 0 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd6701d370 auth_method 0 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.734 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66ff2a20 auth_method 0 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:35:11.431+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: dump: 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.735 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:35:11.431+0000 7f6744f32800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:35:11.431+0000 7f6744f32800 4 set_mon_vals no callback set 2024-09-14T11:35:11.736 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: dump: 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: shutdown 2024-09-14T11:35:11.737 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.738 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:35:11.432+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.739 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 librados: starting msgr at 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 librados: starting objecter 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests cmddesc objecter_requests hook 0x55bd6701d1c0 EEXIST 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:35:11.433+0000 7f6744f32800 1 librados: setting wanted keys 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:35:11.433+0000 7f6744f32800 1 librados: calling monclient init 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.740 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:35:11.433+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:35:11.433+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x55bd66fe22d8 EEXIST 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66ff2a20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.741 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd6701d370 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd67021ad0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.917624s 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66ff2a20 auth_method 0 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd67021ad0 auth_method 0 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.742 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd6701d370 auth_method 0 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-14T11:35:11.743 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:35:11.433+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: dump: 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.744 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: dump: 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.745 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:35:11.434+0000 7f6744f32800 5 monclient: authenticate success, global_id 7778 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:35:11.434+0000 7f6617fff640 4 set_mon_vals no callback set 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:35:11.434+0000 7f6744f32800 1 librados: init done 2024-09-14T11:35:11.746 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:35:11.434+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cr dump hook 0x7f673005e5b8 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:35:11.436+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:35:11.437+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f660c077230 auth_method 0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:35:11.437+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd6703b170 auth_method 0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 realm 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:35:11.438+0000 7f6744f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.747 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:35:11.438+0000 7f6740bbc640 10 monclient: get_auth_request con 0x55bd6703f520 auth_method 0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:35:11.439+0000 7f67383bb640 10 monclient: get_auth_request con 0x55bd67042c40 auth_method 0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:35:11.440+0000 7f6744f32800 20 searching for the correct realm 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:35:11.440+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd67047a20 auth_method 0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:35:11.440+0000 7f6740bbc640 10 monclient: get_auth_request con 0x7f673c00f3d0 auth_method 0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:35:11.441+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6730024020 auth_method 0 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:35:11.442+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:11.748 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:35:11.644+0000 7f67413bd640 10 monclient: get_auth_request con 0x7f672807c070 auth_method 0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:35:11.649+0000 7f6740bbc640 10 monclient: get_auth_request con 0x7f673c031430 auth_method 0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:35:11.650+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:35:11.650+0000 7f66167fc640 1 client.7778.objecter ms_handle_reset 0x7f672807c070 session 0x7f6728005040 osd.4 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:35:11.650+0000 7f66167fc640 10 monclient: _renew_subs 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:35:11.650+0000 7f66167fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:35:11.650+0000 7f67413bd640 10 monclient: get_auth_request con 0x7f660c0878d0 auth_method 0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.749 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 zone default found 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 Realm: () 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:35:11.656+0000 7f6744f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 zonegroup default 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.750 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:35:11.658+0000 7f6744f32800 20 started sync module instance, tier type = 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:35:11.658+0000 7f6744f32800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=0 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=1 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=2 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=3 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=4 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=5 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=6 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:35:11.669+0000 7f6744f32800 20 add_watcher() i=7 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:35:11.669+0000 7f6744f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.751 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.752 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:35:11.671+0000 7f65f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:35:11.671+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache list hook 0x55bd6701ab60 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache inspect hook 0x55bd6701ab60 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache erase hook 0x55bd6701ab60 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache zap hook 0x55bd6701ab60 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 note: GC not initialized 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:35:11.672+0000 7f65f5fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace show hook 0x7f673004c040 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace history hook 0x7f673004c040 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace active hook 0x7f673004c040 2024-09-14T11:35:11.753 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace active_short hook 0x7f673004c040 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 Filter name: none 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:35:11.672+0000 7f65677fe640 20 reqs_thread_entry: start 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:35:11.672+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.754 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:35:11.674+0000 7f6744f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94271965560384 notifier 7778 bl.length()=911 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:11.755 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:35:11.688+0000 7f6744f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6744f32800 time 2024-09-14T11:35:11.688722+0000 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f674658c76a] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.756 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:35:11.689+0000 7f6744f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f6744f32800 thread_name:radosgw-admin 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f674523e6f0] 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f674528b99c] 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f674658c7c4] 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.757 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:11.758 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:11.759 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:35:11.760 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:11.761 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:35:11.762 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:35:11.763 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:35:11.764 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65677fe640 / http_manager 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65f5fe3640 / http_manager 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65f6fe5640 / rgw_dt_lg_renew 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f66167fc640 / ms_dispatch 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6617fff640 / io_context_pool 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f66267fc640 / ms_dispatch 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f662d60a640 / ms_dispatch 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f662ee0d640 / io_context_pool 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f67383bb640 / msgr-worker-2 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6740bbc640 / msgr-worker-1 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f67413bd640 / msgr-worker-0 2024-09-14T11:35:11.765 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6741bbe640 / io_context_pool 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6744f32800 / radosgw-admin 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.152821.log 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:35:11.417+0000 7f662ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:35:11.417+0000 7f662ee0d640 10 monclient: dump: 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.766 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:35:11.417+0000 7f6744f32800 5 monclient: authenticate success, global_id 7766 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:35:11.417+0000 7f6744f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:35:11.417+0000 7f6744f32800 4 set_mon_vals no callback set 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: shutdown 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 asok(0x55bd66d31270) unregister_commands rotate-key 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:35:11.418+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:35:11.418+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.767 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding auth protocol: cephx 2024-09-14T11:35:11.768 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: crc 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:35:11.418+0000 7f6744f32800 5 AuthRegistry(0x55bd66f56f20) adding con mode: secure 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:35:11.418+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:35:11.418+0000 7f6744f32800 1 librados: starting msgr at 2024-09-14T11:35:11.769 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: starting objecter 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests hook 0x55bd66f57d10 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: setting wanted keys 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:35:11.419+0000 7f6744f32800 1 librados: calling monclient init 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding auth protocol: cephx 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.770 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: crc 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 AuthRegistry(0x55bd66f51220) adding con mode: secure 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:35:11.419+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:35:11.419+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:35:11.419+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key hook 0x55bd66f51368 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:11.771 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66ddb1a0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd66dfedc0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66e076c0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:35:11.419+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.903755s 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66ddb1a0 auth_method 0 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.772 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66dfedc0 auth_method 0 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:35:11.419+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:35:11.419+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7769 payload 824 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.773 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:35:11.420+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:35:11.420+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:35:11.420+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd66e076c0 auth_method 0 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: dump: 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.774 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:35:11.420+0000 7f662d60a640 10 monclient: dump: 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.775 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:35:11.420+0000 7f6744f32800 5 monclient: authenticate success, global_id 7769 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:35:11.420+0000 7f662ee0d640 4 set_mon_vals no callback set 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.776 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:35:11.420+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:35:11.420+0000 7f6744f32800 1 librados: init done 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:35:11.422+0000 7f662d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:35:11.422+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6628077260 auth_method 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:35:11.423+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd66f77f20 auth_method 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:35:11.423+0000 7f6740bbc640 10 monclient: get_auth_request con 0x55bd66f9ce30 auth_method 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:35:11.424+0000 7f67383bb640 10 monclient: get_auth_request con 0x55bd66fa11e0 auth_method 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:35:11.426+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.777 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding auth protocol: cephx 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.778 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: crc 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa60f0) adding con mode: secure 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:35:11.426+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests cmddesc objecter_requests hook 0x55bd66fa95b0 EEXIST 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:35:11.426+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.779 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding auth protocol: cephx 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.780 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: crc 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:35:11.426+0000 7f6744f32800 5 AuthRegistry(0x55bd66fa4778) adding con mode: secure 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:35:11.427+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:35:11.427+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:35:11.427+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x55bd66fa48c0 EEXIST 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66fcd8d0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd66fcdcb0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66fcc5e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.781 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:35:11.427+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.911442s 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66fcd8d0 auth_method 0 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66fcdcb0 auth_method 0 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.782 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:35:11.427+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd66fcc5e0 auth_method 0 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:35:11.427+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7772 payload 824 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:35:11.427+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:35:11.427+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.783 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: dump: 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.784 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:35:11.428+0000 7f66267fc640 10 monclient: dump: 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:35:11.428+0000 7f6744f32800 5 monclient: authenticate success, global_id 7772 2024-09-14T11:35:11.785 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:35:11.428+0000 7f6741bbe640 4 set_mon_vals no callback set 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:35:11.428+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:35:11.429+0000 7f66267fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: get_monmap_and_config 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:35:11.430+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.786 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.787 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding auth protocol: cephx 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.788 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: crc 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x55bd66fed4b0) adding con mode: secure 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:35:11.430+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6618077140 auth_method 0 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:35:11.430+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:35:11.430+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding auth protocol: cephx 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.789 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: crc 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:35:11.430+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720ef70) adding con mode: secure 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:35:11.430+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:35:11.431+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:35:11.431+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x7ffc0720f0b8 EEXIST 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd67021ad0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.790 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd66ff2a20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd6701d370 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.915318s 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd67021ad0 auth_method 0 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd6701d370 auth_method 0 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.791 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:35:11.431+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd66ff2a20 auth_method 0 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:35:11.431+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.792 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:35:11.431+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:35:11.431+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: dump: 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.793 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:35:11.431+0000 7f6744f32800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:35:11.431+0000 7f6744f32800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:35:11.431+0000 7f6744f32800 4 set_mon_vals no callback set 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:35:11.431+0000 7f6617fff640 10 monclient: dump: 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.794 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: shutdown 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: build_initial_monmap 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 build_initial for_mkfs: 0 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:35:11.432+0000 7f6744f32800 10 monclient: monmap: 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:11.795 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding auth protocol: cephx 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.796 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: crc 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 AuthRegistry(0x55bd670136a0) adding con mode: secure 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:35:11.432+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 librados: starting msgr at 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:35:11.432+0000 7f6744f32800 1 librados: starting objecter 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:35:11.432+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command objecter_requests cmddesc objecter_requests hook 0x55bd6701d1c0 EEXIST 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:35:11.433+0000 7f6744f32800 1 librados: setting wanted keys 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:35:11.433+0000 7f6744f32800 1 librados: calling monclient init 2024-09-14T11:35:11.797 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: init 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding auth protocol: cephx 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: crc 2024-09-14T11:35:11.798 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 AuthRegistry(0x55bd66fe2190) adding con mode: secure 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:35:11.433+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:35:11.433+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:35:11.433+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command rotate-key cmddesc rotate-key hook 0x55bd66fe22d8 EEXIST 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-c con 0x55bd66ff2a20 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-b con 0x55bd6701d370 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): picked mon.noname-a con 0x55bd67021ad0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:11.799 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:35:11.433+0000 7f6744f32800 10 monclient(hunting): authenticate will time out at 2227.917624s 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): get_auth_request con 0x55bd66ff2a20 auth_method 0 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): get_auth_request con 0x55bd67021ad0 auth_method 0 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): get_auth_request con 0x55bd6701d370 auth_method 0 2024-09-14T11:35:11.800 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:35:11.433+0000 7f67413bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:35:11.433+0000 7f67383bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient: _finish_hunting 0 2024-09-14T11:35:11.801 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:35:11.433+0000 7f6740bbc640 1 monclient: found mon.noname-c 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:35:11.433+0000 7f6740bbc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: dump: 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.802 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: _finish_auth 0 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: _check_auth_tickets 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:35:11.434+0000 7f66167fc640 10 monclient: dump: 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:35:11.434+0000 7f6744f32800 5 monclient: authenticate success, global_id 7778 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:35:11.434+0000 7f6617fff640 4 set_mon_vals no callback set 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _renew_subs 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:35:11.434+0000 7f6744f32800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:35:11.434+0000 7f6744f32800 1 librados: init done 2024-09-14T11:35:11.804 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:35:11.434+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cr dump hook 0x7f673005e5b8 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:35:11.436+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:35:11.436+0000 7f66167fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:35:11.437+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f660c077230 auth_method 0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:35:11.437+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd6703b170 auth_method 0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 realm 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:35:11.437+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:35:11.438+0000 7f6744f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.805 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:35:11.438+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:35:11.438+0000 7f6740bbc640 10 monclient: get_auth_request con 0x55bd6703f520 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:35:11.439+0000 7f67383bb640 10 monclient: get_auth_request con 0x55bd67042c40 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:35:11.439+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:35:11.440+0000 7f6744f32800 20 searching for the correct realm 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:35:11.440+0000 7f67413bd640 10 monclient: get_auth_request con 0x55bd67047a20 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:35:11.440+0000 7f6740bbc640 10 monclient: get_auth_request con 0x7f673c00f3d0 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:35:11.441+0000 7f67383bb640 10 monclient: get_auth_request con 0x7f6730024020 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:35:11.442+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:35:11.644+0000 7f67413bd640 10 monclient: get_auth_request con 0x7f672807c070 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:35:11.649+0000 7f6740bbc640 10 monclient: get_auth_request con 0x7f673c031430 auth_method 0 2024-09-14T11:35:11.806 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:35:11.650+0000 7f67413bd640 0 -- 172.21.15.130:0/227633685 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f672807c070 msgr2=0x7f672808b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:35:11.650+0000 7f66167fc640 1 client.7778.objecter ms_handle_reset 0x7f672807c070 session 0x7f6728005040 osd.4 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:35:11.650+0000 7f66167fc640 10 monclient: _renew_subs 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:35:11.650+0000 7f66167fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:35:11.650+0000 7f67413bd640 10 monclient: get_auth_request con 0x7f660c0878d0 auth_method 0 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:35:11.655+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.807 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 zone default found 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 Realm: () 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:35:11.656+0000 7f6744f32800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:35:11.656+0000 7f6744f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 zonegroup default 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.808 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:35:11.656+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:35:11.657+0000 7f6744f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:35:11.658+0000 7f6744f32800 20 started sync module instance, tier type = 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:35:11.658+0000 7f6744f32800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=0 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=1 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=2 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=3 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=4 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=5 2024-09-14T11:35:11.809 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:35:11.668+0000 7f6744f32800 20 add_watcher() i=6 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:35:11.669+0000 7f6744f32800 20 add_watcher() i=7 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:35:11.669+0000 7f6744f32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding auth protocol: cephx 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.810 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: crc 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 AuthRegistry(0x7ffc0720f450) adding con mode: secure 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:35:11.671+0000 7f65f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:35:11.671+0000 7f6744f32800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:35:11.671+0000 7f6744f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache list hook 0x55bd6701ab60 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache inspect hook 0x55bd6701ab60 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache erase hook 0x55bd6701ab60 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command cache zap hook 0x55bd6701ab60 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:35:11.671+0000 7f6744f32800 5 note: GC not initialized 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:35:11.672+0000 7f65f5fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:11.811 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace show hook 0x7f673004c040 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace history hook 0x7f673004c040 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace active hook 0x7f673004c040 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:35:11.672+0000 7f6744f32800 5 asok(0x55bd66d31270) register_command sync trace active_short hook 0x7f673004c040 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 Filter name: none 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:35:11.672+0000 7f65677fe640 20 reqs_thread_entry: start 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:35:11.672+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:35:11.672+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:11.812 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:35:11.673+0000 7f6744f32800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:35:11.673+0000 7f6744f32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:35:11.674+0000 7f6744f32800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:35:11.683+0000 7f6744f32800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94271965560384 notifier 7778 bl.length()=911 2024-09-14T11:35:11.813 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:35:11.683+0000 7f6617fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:35:11.684+0000 7f6744f32800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:35:11.688+0000 7f6744f32800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6744f32800 time 2024-09-14T11:35:11.688722+0000 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f674658c76a] 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.814 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 4: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 6: main() 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 8: __libc_start_main() 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 9: _start() 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:35:11.689+0000 7f6744f32800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7f6744f32800 thread_name:radosgw-admin 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f674523e6f0] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f674528b99c] 2024-09-14T11:35:11.815 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f674658c7c4] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f674658c928] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bd655dd0b1] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 8: radosgw-admin(+0xd8907c) [0x55bd65af107c] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bd655ecefd] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 10: main() 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f6745229590] 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 12: __libc_start_main() 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 13: _start() 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:35:11.816 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:35:11.817 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:35:11.818 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:11.819 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:35:11.820 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:35:11.821 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:11.824 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:35:11.825 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65677fe640 / http_manager 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65f5fe3640 / http_manager 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f65f6fe5640 / rgw_dt_lg_renew 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f66167fc640 / ms_dispatch 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6617fff640 / io_context_pool 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f66267fc640 / ms_dispatch 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f662d60a640 / ms_dispatch 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f662ee0d640 / io_context_pool 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f67383bb640 / msgr-worker-2 2024-09-14T11:35:11.826 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6740bbc640 / msgr-worker-1 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f67413bd640 / msgr-worker-0 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6741bbe640 / io_context_pool 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: 7f6744f32800 / radosgw-admin 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:11.690543Z_5cc2536d-8028-4755-a446-96598b68a7e9/log 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:35:11.827 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.772+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 20 realm 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.773+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.774+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.774+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.775+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.829 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.775+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.776+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:11.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.776+0000 7fed05123800 20 searching for the correct realm 2024-09-14T11:35:11.830 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.779+0000 7fed0160d640 0 -- 172.21.15.130:0/1887608787 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fece801eb60 msgr2=0x7fece802e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:11.985 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.986+0000 7fed0160d640 0 -- 172.21.15.130:0/1887608787 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fece801eb60 msgr2=0x7fece802e990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.990+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 zone default found 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 4 Realm: () 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:11.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 zonegroup default 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.991+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.992+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.992+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.992+0000 7fed05123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.992+0000 7fed05123800 20 started sync module instance, tier type = 2024-09-14T11:35:11.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:11.992+0000 7fed05123800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=0 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=1 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=2 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=3 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=4 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=5 2024-09-14T11:35:12.001 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.002+0000 7fed05123800 20 add_watcher() i=6 2024-09-14T11:35:12.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.003+0000 7fed05123800 20 add_watcher() i=7 2024-09-14T11:35:12.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.003+0000 7fed05123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:12.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7febb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:12.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7fed05123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:12.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7fed05123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:12.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7fed05123800 5 note: GC not initialized 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7febb67e4640 20 reqs_thread_entry: start 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.005+0000 7fed05123800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 20 Filter name: none 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7febaffff640 20 reqs_thread_entry: start 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:12.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:12.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:12.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:12.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:12.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.006+0000 7fed05123800 20 rados->read ofs=0 len=0 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:35:12.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:35:12.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.007+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:35:12.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.008+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:35:12.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.008+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.008+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.008+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.009+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.010+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:35:12.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.010+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.010+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.010+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:35:12.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:35:12.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:35:12.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.011+0000 7fed05123800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:35:12.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.012+0000 7febb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:12.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.015+0000 7fed05123800 20 remove_watcher() i=0 2024-09-14T11:35:12.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.015+0000 7fed05123800 2 removed watcher, disabling cache 2024-09-14T11:35:12.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.016+0000 7fed05123800 20 remove_watcher() i=1 2024-09-14T11:35:12.015 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.017+0000 7fed05123800 20 remove_watcher() i=2 2024-09-14T11:35:12.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.018+0000 7fed05123800 20 remove_watcher() i=3 2024-09-14T11:35:12.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.019+0000 7fed05123800 20 remove_watcher() i=4 2024-09-14T11:35:12.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.020+0000 7fed05123800 20 remove_watcher() i=5 2024-09-14T11:35:12.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.021+0000 7fed05123800 20 remove_watcher() i=6 2024-09-14T11:35:12.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:12.022+0000 7fed05123800 20 remove_watcher() i=7 2024-09-14T11:35:12.031 INFO:tasks.workunit.client.0.smithi130.stderr: test: duplicated entries can be purged manually 2024-09-14T11:35:42.063 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:42.096 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:42.096 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:42.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.139+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 20 realm 2024-09-14T11:35:42.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.141+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.142+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.142+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.143+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:42.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.143+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.143+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:42.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.143+0000 7fb36550c800 20 searching for the correct realm 2024-09-14T11:35:42.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.146+0000 7fb3637fe640 0 -- 172.21.15.130:0/2957896066 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb34c0ae070 msgr2=0x7fb34c0be170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:42.351 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.352+0000 7fb3637fe640 0 -- 172.21.15.130:0/2957896066 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb34c0ae070 msgr2=0x7fb34c0be170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:42.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.357+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 zone default found 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 4 Realm: () 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 zonegroup default 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.358+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.359+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.359+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.359+0000 7fb36550c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.359+0000 7fb36550c800 20 started sync module instance, tier type = 2024-09-14T11:35:42.359 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.359+0000 7fb36550c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:42.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=0 2024-09-14T11:35:42.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=1 2024-09-14T11:35:42.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=2 2024-09-14T11:35:42.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=3 2024-09-14T11:35:42.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=4 2024-09-14T11:35:42.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=5 2024-09-14T11:35:42.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.369+0000 7fb36550c800 20 add_watcher() i=6 2024-09-14T11:35:42.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.370+0000 7fb36550c800 20 add_watcher() i=7 2024-09-14T11:35:42.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.370+0000 7fb36550c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:42.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.371+0000 7fb2197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 5 note: GC not initialized 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb193fff640 20 reqs_thread_entry: start 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 20 Filter name: none 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb191ffb640 20 reqs_thread_entry: start 2024-09-14T11:35:42.371 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.372+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.373+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:42.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.373+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.373+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.373+0000 7fb36550c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.373+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.374+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.374+0000 7fb36550c800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.374+0000 7fb36550c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:42.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.374+0000 7fb36550c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:42.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.376+0000 7fb2197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:42.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.379+0000 7fb36550c800 20 remove_watcher() i=0 2024-09-14T11:35:42.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.379+0000 7fb36550c800 2 removed watcher, disabling cache 2024-09-14T11:35:42.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.380+0000 7fb36550c800 20 remove_watcher() i=1 2024-09-14T11:35:42.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.381+0000 7fb36550c800 20 remove_watcher() i=2 2024-09-14T11:35:42.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.382+0000 7fb36550c800 20 remove_watcher() i=3 2024-09-14T11:35:42.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.383+0000 7fb36550c800 20 remove_watcher() i=4 2024-09-14T11:35:42.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.384+0000 7fb36550c800 20 remove_watcher() i=5 2024-09-14T11:35:42.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.385+0000 7fb36550c800 20 remove_watcher() i=6 2024-09-14T11:35:42.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.386+0000 7fb36550c800 20 remove_watcher() i=7 2024-09-14T11:35:42.396 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:42.396 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:35:42.396 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:35:42.396 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:42.397 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:35:42.432 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:42.432 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:42.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.470+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 20 realm 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:42.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:42.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:42.672 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:42.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.675+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:42.673 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.675+0000 7fde20b46800 20 searching for the correct realm 2024-09-14T11:35:42.675 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.677+0000 7fde1de36640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fde10086060 msgr2=0x7fde100abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:42.881 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:42.882+0000 7fde1e637640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fde18044950 msgr2=0x7fde18021450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.089 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.089+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.090 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 zone default found 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 4 Realm: () 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 zonegroup default 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.091 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.092 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.092+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.092+0000 7fde20b46800 20 started sync module instance, tier type = 2024-09-14T11:35:43.093 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.092+0000 7fde20b46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=0 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=1 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=2 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=3 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=4 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=5 2024-09-14T11:35:43.101 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=6 2024-09-14T11:35:43.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.103+0000 7fde20b46800 20 add_watcher() i=7 2024-09-14T11:35:43.102 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.103+0000 7fde20b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:43.104 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.105+0000 7fdcd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.105+0000 7fde20b46800 5 note: GC not initialized 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.105+0000 7fdc4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 20 Filter name: none 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fdc4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:43.105 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:43.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.107+0000 7fde20b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:43.108 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.108+0000 7fde20b46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:43.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.115+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.115+0000 7fde20b46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.115+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.115+0000 7fde20b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:43.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94487025026304 notifier 7826 bl.length()=911 2024-09-14T11:35:43.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:43.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:43.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:43.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:43.121 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde20b46800 time 2024-09-14T11:35:43.123756+0000 2024-09-14T11:35:43.121 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde2418c76a] 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:35:43.122 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.123+0000 7fde20b46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde20b46800 time 2024-09-14T11:35:43.123756+0000 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde2418c76a] 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:35:43.123 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.124 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:35:43.124 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:35:43.124 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.124 INFO:tasks.workunit.client.0.smithi130.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:43.124 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fde20b46800 thread_name:radosgw-admin 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde22e3e6f0] 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde22e8b99c] 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde2418c7c4] 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.140 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.124+0000 7fde20b46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fde20b46800 thread_name:radosgw-admin 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.141 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde22e3e6f0] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde22e8b99c] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde2418c7c4] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.142 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:35:42.453+0000 7fde20b46800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:35:42.453+0000 7fde20b46800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:35:42.453+0000 7fde20b46800 4 set_mon_vals no callback set 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: shutdown 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 asok(0x55ef795e2270) unregister_commands rotate-key 2024-09-14T11:35:43.143 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:35:42.454+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.144 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.145 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: starting msgr at 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: starting objecter 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests hook 0x55ef79804020 2024-09-14T11:35:43.146 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: setting wanted keys 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: calling monclient init 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.147 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key hook 0x55ef798025e8 2024-09-14T11:35:43.148 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef7968bf80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef7974b5b0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef79805a70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.939733s 2024-09-14T11:35:43.149 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef79805a70 auth_method 0 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef7974b5b0 auth_method 0 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.150 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:35:42.455+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef7968bf80 auth_method 0 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:35:42.456+0000 7fde1de36640 1 monclient: found mon.noname-a 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.151 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: dump: 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.152 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: dump: 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.153 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:35:42.456+0000 7fde20b46800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:35:42.456+0000 7fdd0c608640 4 set_mon_vals no callback set 2024-09-14T11:35:43.154 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:35:42.456+0000 7fde20b46800 1 librados: init done 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:35:42.458+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fdd04077230 auth_method 0 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:35:42.458+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef7984b780 auth_method 0 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:35:42.459+0000 7fde1e637640 10 monclient: get_auth_request con 0x55ef7984e960 auth_method 0 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:35:42.460+0000 7fde1de36640 10 monclient: get_auth_request con 0x55ef79852d10 auth_method 0 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:35:42.461+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.155 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:35:42.461+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:35:42.461+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.156 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.157 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests cmddesc objecter_requests hook 0x55ef7985b060 EEXIST 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.158 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.159 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x55ef798563f0 EEXIST 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef7987f8d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef79881b20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef7987e190 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.160 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.946878s 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef7987f8d0 auth_method 0 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:35:42.462+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef7987e190 auth_method 0 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.161 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef79881b20 auth_method 0 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:35:42.463+0000 7fde1e637640 1 monclient: found mon.noname-a 2024-09-14T11:35:43.162 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: dump: 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.163 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: dump: 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.164 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:35:42.463+0000 7fde20b46800 5 monclient: authenticate success, global_id 8382 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:35:42.463+0000 7fde1f639640 4 set_mon_vals no callback set 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.165 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:35:42.465+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fdcf8077170 auth_method 0 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: get_monmap_and_config 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:35:42.465+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.166 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.167 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.168 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.169 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x7ffc926be258 EEXIST 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef798d3890 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.170 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef798c41e0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef798cecc0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.950739s 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef798cecc0 auth_method 0 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.171 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef798c41e0 auth_method 0 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef798d3890 auth_method 0 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.172 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 7823 payload 274 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:35:42.467+0000 7fde1de36640 1 monclient: found mon.noname-c 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:43.173 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: dump: 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.174 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: dump: 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.175 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 monclient: authenticate success, global_id 7823 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:35:42.467+0000 7fde20b46800 4 set_mon_vals no callback set 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: shutdown 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:35:42.467+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.176 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.177 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.178 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: starting msgr at 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: starting objecter 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests cmddesc objecter_requests hook 0x55ef798a1db0 EEXIST 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: setting wanted keys 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: calling monclient init 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.179 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.180 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x55ef7989e618 EEXIST 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef798c41e0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef798cecc0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef798d3890 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.952892s 2024-09-14T11:35:43.181 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef798c41e0 auth_method 0 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:35:42.468+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef798cecc0 auth_method 0 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.182 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef798d3890 auth_method 0 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:35:42.469+0000 7fde1de36640 1 monclient: found mon.noname-c 2024-09-14T11:35:43.183 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: dump: 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.184 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: dump: 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.185 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:35:42.469+0000 7fde20b46800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:35:42.469+0000 7fdd01ffb640 4 set_mon_vals no callback set 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.186 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:35:42.469+0000 7fde20b46800 1 librados: init done 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:35:42.469+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cr dump hook 0x55ef798c2748 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:35:42.470+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:35:42.471+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fdce8077230 auth_method 0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:35:42.471+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798ee010 auth_method 0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:35:42.672+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798ee010 auth_method 0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 realm 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.187 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:35:42.672+0000 7fde20b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:35:42.673+0000 7fde1e637640 10 monclient: get_auth_request con 0x55ef798f23c0 auth_method 0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:35:42.674+0000 7fde1de36640 10 monclient: get_auth_request con 0x55ef798f5ab0 auth_method 0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:35:42.675+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:35:42.675+0000 7fde20b46800 20 searching for the correct realm 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:35:42.675+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798fa840 auth_method 0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:35:42.676+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18031410 auth_method 0 2024-09-14T11:35:43.188 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:35:42.676+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fde10086060 auth_method 0 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:35:42.677+0000 7fde1de36640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fde10086060 msgr2=0x7fde100abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:35:42.878+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fde10086060 auth_method 0 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:35:42.878+0000 7fde1ee38640 10 monclient: get_auth_request con 0x7fde14050150 auth_method 0 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:35:42.882+0000 7fde1e637640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fde18044950 msgr2=0x7fde18021450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:35:42.882+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18044950 auth_method 0 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:35:43.083+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18044950 auth_method 0 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:43.189 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 zone default found 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 Realm: () 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:35:43.091+0000 7fde20b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 zonegroup default 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.190 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 started sync module instance, tier type = 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=0 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=1 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=2 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=3 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=4 2024-09-14T11:35:43.191 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=5 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=6 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:35:43.103+0000 7fde20b46800 20 add_watcher() i=7 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:35:43.103+0000 7fde20b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.192 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:35:43.105+0000 7fdcd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:35:43.105+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache list hook 0x55ef798c79c0 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache inspect hook 0x55ef798c79c0 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache erase hook 0x55ef798c79c0 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache zap hook 0x55ef798c79c0 2024-09-14T11:35:43.193 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 note: GC not initialized 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:35:43.105+0000 7fdc4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace show hook 0x7fde140043a0 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace history hook 0x7fde140043a0 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace active hook 0x7fde140043a0 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace active_short hook 0x7fde140043a0 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 Filter name: none 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:35:43.106+0000 7fdc4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:43.194 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:35:43.107+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:35:43.108+0000 7fde20b46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.195 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94487025026304 notifier 7826 bl.length()=911 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:35:43.123+0000 7fde20b46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde20b46800 time 2024-09-14T11:35:43.123756+0000 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.196 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde2418c76a] 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:35:43.124+0000 7fde20b46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fde20b46800 thread_name:radosgw-admin 2024-09-14T11:35:43.197 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde22e3e6f0] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde22e8b99c] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde2418c7c4] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:35:43.198 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:35:43.199 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:43.200 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:35:43.201 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:35:43.202 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:35:43.203 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:43.204 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:35:43.205 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdc4d7fa640 / http_manager 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdc4f7fe640 / http_manager 2024-09-14T11:35:43.206 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdcd4fe1640 / rgw_dt_lg_renew 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdceffff640 / ms_dispatch 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd01ffb640 / io_context_pool 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd03fff640 / ms_dispatch 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd0ae05640 / ms_dispatch 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd0c608640 / io_context_pool 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1de36640 / msgr-worker-2 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1e637640 / msgr-worker-1 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1ee38640 / msgr-worker-0 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1f639640 / io_context_pool 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde20b46800 / radosgw-admin 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/log/ceph/ceph-client.admin.154588.log 2024-09-14T11:35:43.207 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr:--- begin dump of recent events --- 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -499> 2024-09-14T11:35:42.453+0000 7fde20b46800 5 monclient: authenticate success, global_id 8376 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -498> 2024-09-14T11:35:42.453+0000 7fde20b46800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -497> 2024-09-14T11:35:42.453+0000 7fde20b46800 4 set_mon_vals no callback set 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -496> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: shutdown 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -495> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 asok(0x55ef795e2270) unregister_commands rotate-key 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -494> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -493> 2024-09-14T11:35:42.454+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr: -492> 2024-09-14T11:35:42.454+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.208 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -491> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -490> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -489> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding auth protocol: cephx 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -488> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -487> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -486> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.209 INFO:tasks.workunit.client.0.smithi130.stderr: -485> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -484> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -483> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -482> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -481> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -480> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -479> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -478> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: crc 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -477> 2024-09-14T11:35:42.454+0000 7fde20b46800 5 AuthRegistry(0x55ef79808170) adding con mode: secure 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -476> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -475> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: starting msgr at 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -474> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: starting objecter 2024-09-14T11:35:43.210 INFO:tasks.workunit.client.0.smithi130.stderr: -473> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests hook 0x55ef79804020 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -472> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: setting wanted keys 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -471> 2024-09-14T11:35:42.455+0000 7fde20b46800 1 librados: calling monclient init 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -470> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -469> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -468> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -467> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding auth protocol: cephx 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -466> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -465> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -464> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -463> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -462> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.211 INFO:tasks.workunit.client.0.smithi130.stderr: -461> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -460> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -459> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -458> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -457> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -456> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: crc 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -455> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 AuthRegistry(0x55ef798024a0) adding con mode: secure 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -454> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -453> 2024-09-14T11:35:42.455+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -452> 2024-09-14T11:35:42.455+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key hook 0x55ef798025e8 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -451> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.212 INFO:tasks.workunit.client.0.smithi130.stderr: -450> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -449> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef7968bf80 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -448> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef7974b5b0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -447> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef79805a70 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -446> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -445> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -444> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -443> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -442> 2024-09-14T11:35:42.455+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.939733s 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -441> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef79805a70 auth_method 0 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -440> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -439> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -438> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.213 INFO:tasks.workunit.client.0.smithi130.stderr: -437> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef7974b5b0 auth_method 0 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -436> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -435> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -434> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -433> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -432> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -431> 2024-09-14T11:35:42.455+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -430> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -429> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -428> 2024-09-14T11:35:42.455+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -427> 2024-09-14T11:35:42.455+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef7968bf80 auth_method 0 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -426> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.214 INFO:tasks.workunit.client.0.smithi130.stderr: -425> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -424> 2024-09-14T11:35:42.456+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -423> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 8379 payload 824 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -422> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -421> 2024-09-14T11:35:42.456+0000 7fde1de36640 1 monclient: found mon.noname-a 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -420> 2024-09-14T11:35:42.456+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -419> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -418> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr: -417> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: dump: 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.215 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -416> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -415> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -414> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -413> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -412> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr: -411> 2024-09-14T11:35:42.456+0000 7fdd0ae05640 10 monclient: dump: 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.216 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -410> 2024-09-14T11:35:42.456+0000 7fde20b46800 5 monclient: authenticate success, global_id 8379 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -409> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -408> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -407> 2024-09-14T11:35:42.456+0000 7fdd0c608640 4 set_mon_vals no callback set 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -406> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.217 INFO:tasks.workunit.client.0.smithi130.stderr: -405> 2024-09-14T11:35:42.456+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -404> 2024-09-14T11:35:42.456+0000 7fde20b46800 1 librados: init done 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -403> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -402> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -401> 2024-09-14T11:35:42.458+0000 7fdd0ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -400> 2024-09-14T11:35:42.458+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fdd04077230 auth_method 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -399> 2024-09-14T11:35:42.458+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef7984b780 auth_method 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -398> 2024-09-14T11:35:42.459+0000 7fde1e637640 10 monclient: get_auth_request con 0x55ef7984e960 auth_method 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -397> 2024-09-14T11:35:42.460+0000 7fde1de36640 10 monclient: get_auth_request con 0x55ef79852d10 auth_method 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -396> 2024-09-14T11:35:42.461+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -395> 2024-09-14T11:35:42.461+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr: -394> 2024-09-14T11:35:42.461+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.218 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: -393> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: -392> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: -391> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding auth protocol: cephx 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: -390> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.219 INFO:tasks.workunit.client.0.smithi130.stderr: -389> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -388> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -387> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -386> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -385> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -384> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -383> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -382> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -381> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -380> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: crc 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -379> 2024-09-14T11:35:42.461+0000 7fde20b46800 5 AuthRegistry(0x55ef79857bf0) adding con mode: secure 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -378> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -377> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests cmddesc objecter_requests hook 0x55ef7985b060 EEXIST 2024-09-14T11:35:43.220 INFO:tasks.workunit.client.0.smithi130.stderr: -376> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -375> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -374> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -373> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding auth protocol: cephx 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -372> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -371> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -370> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -369> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -368> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -367> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -366> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -365> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -364> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -363> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.221 INFO:tasks.workunit.client.0.smithi130.stderr: -362> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: crc 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -361> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 AuthRegistry(0x55ef798562a8) adding con mode: secure 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -360> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -359> 2024-09-14T11:35:42.462+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -358> 2024-09-14T11:35:42.462+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x55ef798563f0 EEXIST 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -357> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -356> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -355> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef7987f8d0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -354> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef79881b20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -353> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef7987e190 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -352> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -351> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -350> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.222 INFO:tasks.workunit.client.0.smithi130.stderr: -349> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -348> 2024-09-14T11:35:42.462+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.946878s 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -347> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef7987f8d0 auth_method 0 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -346> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -345> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -344> 2024-09-14T11:35:42.462+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -343> 2024-09-14T11:35:42.462+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef7987e190 auth_method 0 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -342> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -341> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -340> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -339> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -338> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -337> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -336> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.223 INFO:tasks.workunit.client.0.smithi130.stderr: -335> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -334> 2024-09-14T11:35:42.463+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -333> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef79881b20 auth_method 0 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -332> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -331> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -330> 2024-09-14T11:35:42.463+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -329> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -328> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -327> 2024-09-14T11:35:42.463+0000 7fde1e637640 1 monclient: found mon.noname-a 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -326> 2024-09-14T11:35:42.463+0000 7fde1e637640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -325> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -324> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr: -323> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: dump: 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.224 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: -322> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: -321> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: -320> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: -319> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.225 INFO:tasks.workunit.client.0.smithi130.stderr: -318> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: -317> 2024-09-14T11:35:42.463+0000 7fdd03fff640 10 monclient: dump: 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: -316> 2024-09-14T11:35:42.463+0000 7fde20b46800 5 monclient: authenticate success, global_id 8382 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: -315> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: -314> 2024-09-14T11:35:42.463+0000 7fde1f639640 4 set_mon_vals no callback set 2024-09-14T11:35:43.226 INFO:tasks.workunit.client.0.smithi130.stderr: -313> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -312> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -311> 2024-09-14T11:35:42.463+0000 7fde20b46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.130:3300/0 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -310> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -309> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -308> 2024-09-14T11:35:42.465+0000 7fdd03fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -307> 2024-09-14T11:35:42.465+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fdcf8077170 auth_method 0 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -306> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: get_monmap_and_config 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -305> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -304> 2024-09-14T11:35:42.465+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr: -303> 2024-09-14T11:35:42.465+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.227 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -302> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -301> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -300> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding auth protocol: cephx 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -299> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -298> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -297> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.228 INFO:tasks.workunit.client.0.smithi130.stderr: -296> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -295> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -294> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -293> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -292> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -291> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -290> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -289> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: crc 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -288> 2024-09-14T11:35:42.465+0000 7fde20b46800 5 AuthRegistry(0x55ef7989f2e0) adding con mode: secure 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -287> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -286> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -285> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -284> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -283> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding auth protocol: cephx 2024-09-14T11:35:43.229 INFO:tasks.workunit.client.0.smithi130.stderr: -282> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -281> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -280> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -279> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -278> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -277> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -276> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -275> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -274> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -273> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -272> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: crc 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -271> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be110) adding con mode: secure 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -270> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -269> 2024-09-14T11:35:42.466+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.230 INFO:tasks.workunit.client.0.smithi130.stderr: -268> 2024-09-14T11:35:42.466+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x7ffc926be258 EEXIST 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -267> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -266> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -265> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef798d3890 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -264> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef798c41e0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -263> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef798cecc0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -262> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -261> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -260> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -259> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -258> 2024-09-14T11:35:42.466+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.950739s 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -257> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef798cecc0 auth_method 0 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -256> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.231 INFO:tasks.workunit.client.0.smithi130.stderr: -255> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -254> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -253> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef798c41e0 auth_method 0 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -252> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -251> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -250> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -249> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef798d3890 auth_method 0 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -248> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -247> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -246> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -245> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -244> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -243> 2024-09-14T11:35:42.466+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -242> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.232 INFO:tasks.workunit.client.0.smithi130.stderr: -241> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -240> 2024-09-14T11:35:42.466+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -239> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -238> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -237> 2024-09-14T11:35:42.466+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -236> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 7823 payload 274 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -235> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -234> 2024-09-14T11:35:42.467+0000 7fde1de36640 1 monclient: found mon.noname-c 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -233> 2024-09-14T11:35:42.467+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -232> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -231> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr: -230> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: dump: 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.233 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -229> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -228> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -227> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -226> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -225> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr: -224> 2024-09-14T11:35:42.467+0000 7fdd01ffb640 10 monclient: dump: 2024-09-14T11:35:43.234 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: -223> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 monclient: authenticate success, global_id 7823 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: -222> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: get_monmap_and_config success 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: -221> 2024-09-14T11:35:42.467+0000 7fde20b46800 4 set_mon_vals no callback set 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: -220> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: shutdown 2024-09-14T11:35:43.235 INFO:tasks.workunit.client.0.smithi130.stderr: -219> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: build_initial_monmap 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr: -218> 2024-09-14T11:35:42.467+0000 7fde20b46800 1 build_initial for_mkfs: 0 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr: -217> 2024-09-14T11:35:42.467+0000 7fde20b46800 10 monclient: monmap: 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 0 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 0.000000 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:created 0.000000 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.noname-a 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.noname-c 2024-09-14T11:35:43.236 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -216> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -215> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -214> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding auth protocol: cephx 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -213> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -212> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -211> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -210> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -209> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -208> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -207> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -206> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -205> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.237 INFO:tasks.workunit.client.0.smithi130.stderr: -204> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -203> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: crc 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -202> 2024-09-14T11:35:42.467+0000 7fde20b46800 5 AuthRegistry(0x55ef798a2df0) adding con mode: secure 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -201> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -200> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: starting msgr at 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -199> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: starting objecter 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -198> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command objecter_requests cmddesc objecter_requests hook 0x55ef798a1db0 EEXIST 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -197> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: setting wanted keys 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -196> 2024-09-14T11:35:42.468+0000 7fde20b46800 1 librados: calling monclient init 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -195> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: init 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -194> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -193> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -192> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding auth protocol: cephx 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -191> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -190> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.238 INFO:tasks.workunit.client.0.smithi130.stderr: -189> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -188> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -187> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -186> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -185> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -184> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -183> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -182> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -181> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: crc 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -180> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 AuthRegistry(0x55ef7989e4d0) adding con mode: secure 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -179> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -178> 2024-09-14T11:35:42.468+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -177> 2024-09-14T11:35:42.468+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command rotate-key cmddesc rotate-key hook 0x55ef7989e618 EEXIST 2024-09-14T11:35:43.239 INFO:tasks.workunit.client.0.smithi130.stderr: -176> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: _reopen_session rank -1 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -175> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -174> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-a con 0x55ef798c41e0 addr [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -173> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-c con 0x55ef798cecc0 addr [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -172> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): picked mon.noname-b con 0x55ef798d3890 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -171> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -170> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -169> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -168> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): _renew_subs 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -167> 2024-09-14T11:35:42.468+0000 7fde20b46800 10 monclient(hunting): authenticate will time out at 2258.952892s 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -166> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): get_auth_request con 0x55ef798c41e0 auth_method 0 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -165> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -164> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -163> 2024-09-14T11:35:42.468+0000 7fde1e637640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.240 INFO:tasks.workunit.client.0.smithi130.stderr: -162> 2024-09-14T11:35:42.468+0000 7fde1de36640 10 monclient(hunting): get_auth_request con 0x55ef798cecc0 auth_method 0 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -161> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -160> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -159> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -158> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -157> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -156> 2024-09-14T11:35:42.469+0000 7fde1e637640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -155> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -154> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -153> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -152> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): get_auth_request con 0x55ef798d3890 auth_method 0 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -151> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -150> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -149> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:43.241 INFO:tasks.workunit.client.0.smithi130.stderr: -148> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -147> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -146> 2024-09-14T11:35:42.469+0000 7fde1ee38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -145> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -144> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient: _finish_hunting 0 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -143> 2024-09-14T11:35:42.469+0000 7fde1de36640 1 monclient: found mon.noname-c 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -142> 2024-09-14T11:35:42.469+0000 7fde1de36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -141> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -140> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr: -139> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: dump: 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.242 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -138> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: _finish_auth 0 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -137> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: _check_auth_tickets 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -136> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -135> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -134> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr: -133> 2024-09-14T11:35:42.469+0000 7fdceffff640 10 monclient: dump: 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:epoch 1 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:fsid 96e8008b-f06f-4b4a-864e-50e587612172 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:last_changed 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.243 INFO:tasks.workunit.client.0.smithi130.stderr:created 2024-09-14T11:09:49.569870+0000 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr:election_strategy: 1 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr:0: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.a 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -132> 2024-09-14T11:35:42.469+0000 7fde20b46800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -131> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -130> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -129> 2024-09-14T11:35:42.469+0000 7fdd01ffb640 4 set_mon_vals no callback set 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -128> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _renew_subs 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -127> 2024-09-14T11:35:42.469+0000 7fde20b46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.130:3301/0 2024-09-14T11:35:43.244 INFO:tasks.workunit.client.0.smithi130.stderr: -126> 2024-09-14T11:35:42.469+0000 7fde20b46800 1 librados: init done 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -125> 2024-09-14T11:35:42.469+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cr dump hook 0x55ef798c2748 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -124> 2024-09-14T11:35:42.470+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -123> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -122> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -121> 2024-09-14T11:35:42.471+0000 7fdceffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.171:6824/2987381339,v1:172.21.15.171:6825/2987381339] 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -120> 2024-09-14T11:35:42.471+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fdce8077230 auth_method 0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -119> 2024-09-14T11:35:42.471+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798ee010 auth_method 0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -118> 2024-09-14T11:35:42.672+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798ee010 auth_method 0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -117> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -116> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 realm 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -115> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -114> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -113> 2024-09-14T11:35:42.672+0000 7fde20b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -112> 2024-09-14T11:35:42.672+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.245 INFO:tasks.workunit.client.0.smithi130.stderr: -111> 2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -110> 2024-09-14T11:35:42.673+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -109> 2024-09-14T11:35:42.673+0000 7fde1e637640 10 monclient: get_auth_request con 0x55ef798f23c0 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -108> 2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -107> 2024-09-14T11:35:42.674+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -106> 2024-09-14T11:35:42.674+0000 7fde1de36640 10 monclient: get_auth_request con 0x55ef798f5ab0 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -105> 2024-09-14T11:35:42.675+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -104> 2024-09-14T11:35:42.675+0000 7fde20b46800 20 searching for the correct realm 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -103> 2024-09-14T11:35:42.675+0000 7fde1ee38640 10 monclient: get_auth_request con 0x55ef798fa840 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -102> 2024-09-14T11:35:42.676+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18031410 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -101> 2024-09-14T11:35:42.676+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fde10086060 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -100> 2024-09-14T11:35:42.677+0000 7fde1de36640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fde10086060 msgr2=0x7fde100abc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -99> 2024-09-14T11:35:42.878+0000 7fde1de36640 10 monclient: get_auth_request con 0x7fde10086060 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -98> 2024-09-14T11:35:42.878+0000 7fde1ee38640 10 monclient: get_auth_request con 0x7fde14050150 auth_method 0 2024-09-14T11:35:43.246 INFO:tasks.workunit.client.0.smithi130.stderr: -97> 2024-09-14T11:35:42.882+0000 7fde1e637640 0 -- 172.21.15.130:0/3971099857 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fde18044950 msgr2=0x7fde18021450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -96> 2024-09-14T11:35:42.882+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18044950 auth_method 0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -95> 2024-09-14T11:35:43.083+0000 7fde1e637640 10 monclient: get_auth_request con 0x7fde18044950 auth_method 0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -94> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -93> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -92> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -91> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -90> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -89> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -88> 2024-09-14T11:35:43.089+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -87> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -86> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -85> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -84> 2024-09-14T11:35:43.090+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.247 INFO:tasks.workunit.client.0.smithi130.stderr: -83> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -82> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 zone default found 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -81> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 Realm: () 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -80> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -79> 2024-09-14T11:35:43.091+0000 7fde20b46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -78> 2024-09-14T11:35:43.091+0000 7fde20b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -77> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 zonegroup default 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -76> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -75> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -74> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -73> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -72> 2024-09-14T11:35:43.091+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -71> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -70> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 started sync module instance, tier type = 2024-09-14T11:35:43.248 INFO:tasks.workunit.client.0.smithi130.stderr: -69> 2024-09-14T11:35:43.092+0000 7fde20b46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -68> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=0 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -67> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=1 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -66> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=2 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -65> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=3 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -64> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=4 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -63> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=5 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -62> 2024-09-14T11:35:43.102+0000 7fde20b46800 20 add_watcher() i=6 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -61> 2024-09-14T11:35:43.103+0000 7fde20b46800 20 add_watcher() i=7 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -60> 2024-09-14T11:35:43.103+0000 7fde20b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -59> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -58> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -57> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding auth protocol: cephx 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -56> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.249 INFO:tasks.workunit.client.0.smithi130.stderr: -55> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -54> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -53> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -52> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -51> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -50> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -49> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -48> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -47> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -46> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: crc 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -45> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 AuthRegistry(0x7ffc926be5f0) adding con mode: secure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -44> 2024-09-14T11:35:43.105+0000 7fdcd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -43> 2024-09-14T11:35:43.105+0000 7fde20b46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -42> 2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -41> 2024-09-14T11:35:43.105+0000 7fde20b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:43.250 INFO:tasks.workunit.client.0.smithi130.stderr: -40> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache list hook 0x55ef798c79c0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -39> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache inspect hook 0x55ef798c79c0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -38> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache erase hook 0x55ef798c79c0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -37> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command cache zap hook 0x55ef798c79c0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -36> 2024-09-14T11:35:43.105+0000 7fde20b46800 5 note: GC not initialized 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -35> 2024-09-14T11:35:43.105+0000 7fdc4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -34> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace show hook 0x7fde140043a0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -33> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace history hook 0x7fde140043a0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -32> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace active hook 0x7fde140043a0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -31> 2024-09-14T11:35:43.106+0000 7fde20b46800 5 asok(0x55ef795e2270) register_command sync trace active_short hook 0x7fde140043a0 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -30> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -29> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 Filter name: none 2024-09-14T11:35:43.251 INFO:tasks.workunit.client.0.smithi130.stderr: -28> 2024-09-14T11:35:43.106+0000 7fdc4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -27> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -26> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -25> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -24> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -23> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -22> 2024-09-14T11:35:43.106+0000 7fde20b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -21> 2024-09-14T11:35:43.106+0000 7fde20b46800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -20> 2024-09-14T11:35:43.107+0000 7fde20b46800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -19> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -18> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -17> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -16> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -15> 2024-09-14T11:35:43.107+0000 7fde20b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:43.252 INFO:tasks.workunit.client.0.smithi130.stderr: -14> 2024-09-14T11:35:43.108+0000 7fde20b46800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -13> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -12> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -11> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -10> 2024-09-14T11:35:43.115+0000 7fde20b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -9> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94487025026304 notifier 7826 bl.length()=911 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -8> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -7> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -6> 2024-09-14T11:35:43.116+0000 7fdd01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -5> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -4> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -3> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -2> 2024-09-14T11:35:43.116+0000 7fde20b46800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr: -1> 2024-09-14T11:35:43.123+0000 7fde20b46800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde20b46800 time 2024-09-14T11:35:43.123756+0000 2024-09-14T11:35:43.253 INFO:tasks.workunit.client.0.smithi130.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde2418c76a] 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 5: main() 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 7: __libc_start_main() 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 8: _start() 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 0> 2024-09-14T11:35:43.124+0000 7fde20b46800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: in thread 7fde20b46800 thread_name:radosgw-admin 2024-09-14T11:35:43.254 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde22e3e6f0] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde22e8b99c] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 3: raise() 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 4: abort() 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde2418c7c4] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fde2418c928] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef786bf0b1] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef786cef6a] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 9: main() 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fde22e29590] 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 11: __libc_start_main() 2024-09-14T11:35:43.255 INFO:tasks.workunit.client.0.smithi130.stderr: 12: _start() 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr:--- logging levels --- 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 none 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 lockdep 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 context 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 crush 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_locker 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:43.256 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 buffer 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 timer 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 filer 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 striper 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 1 objecter 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rados 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 journaler 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objectcacher 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 client 2024-09-14T11:35:43.257 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 osd 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 optracker 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 objclass 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 filestore 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 journal 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 ms 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mon 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 0/10 monc 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 paxos 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 tp 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 auth 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 crypto 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 finisher 2024-09-14T11:35:43.258 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 reserver 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 perfcounter 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_access 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 20/20 rgw_notification 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 javaclient 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 asok 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 1 throttle 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 0 refs 2024-09-14T11:35:43.259 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 compressor 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluestore 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 bluefs 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 3 bdev 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 kstore 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 4/ 5 rocksdb 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 fuse 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 2/ 5 mgr 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mgrc 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 dpdk 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 eventtrace 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 prioritycache 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 test 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:43.260 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_t 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:43.261 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_device 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 alienstore 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 mclock 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 cyanstore 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 memstore 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 1/ 5 trace 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdc4d7fa640 / http_manager 2024-09-14T11:35:43.262 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdc4f7fe640 / http_manager 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdcd4fe1640 / rgw_dt_lg_renew 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdceffff640 / ms_dispatch 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd01ffb640 / io_context_pool 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd03fff640 / ms_dispatch 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd0ae05640 / ms_dispatch 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fdd0c608640 / io_context_pool 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1de36640 / msgr-worker-2 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1e637640 / msgr-worker-1 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1ee38640 / msgr-worker-0 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde1f639640 / io_context_pool 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: 7fde20b46800 / radosgw-admin 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: max_recent 500 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: max_new 1000 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:43.125222Z_1b6ccd3c-6528-452f-8eae-bdba841c60c7/log 2024-09-14T11:35:43.263 INFO:tasks.workunit.client.0.smithi130.stderr:--- end dump of recent events --- 2024-09-14T11:35:43.264 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.203+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 realm 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.265 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.205+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.206+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.206+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.207+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.207+0000 7f7708d39800 20 searching for the correct realm 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.209+0000 7f77041c6640 0 -- 172.21.15.130:0/4222245517 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f76f4024070 msgr2=0x7f76f40651e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.266 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.213+0000 7f77049c7640 0 -- 172.21.15.130:0/4222245517 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f76fc073bb0 msgr2=0x7f76fc0643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.418 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.419+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.419 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 zone default found 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 4 Realm: () 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 zonegroup default 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.420+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.420 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.421+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.421+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.421+0000 7f7708d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.421+0000 7f7708d39800 20 started sync module instance, tier type = 2024-09-14T11:35:43.421 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.421+0000 7f7708d39800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=0 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=1 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=2 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=3 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=4 2024-09-14T11:35:43.429 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=5 2024-09-14T11:35:43.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.430+0000 7f7708d39800 20 add_watcher() i=6 2024-09-14T11:35:43.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.431+0000 7f7708d39800 20 add_watcher() i=7 2024-09-14T11:35:43.430 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.431+0000 7f7708d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:43.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.433+0000 7f75bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.433+0000 7f7708d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:43.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.433+0000 7f7708d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:43.432 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.433+0000 7f7708d39800 5 note: GC not initialized 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f75b9fe3640 20 reqs_thread_entry: start 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f7708d39800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f7708d39800 20 Filter name: none 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f752b7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.433 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.434+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.435+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.435+0000 7f7708d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:43.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.435+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.434 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.435+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.435+0000 7f7708d39800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.436+0000 7f7708d39800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.435 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.436+0000 7f7708d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:43.436 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.437+0000 7f75bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.440+0000 7f7708d39800 20 remove_watcher() i=0 2024-09-14T11:35:43.438 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.440+0000 7f7708d39800 2 removed watcher, disabling cache 2024-09-14T11:35:43.439 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.441+0000 7f7708d39800 20 remove_watcher() i=1 2024-09-14T11:35:43.440 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.442+0000 7f7708d39800 20 remove_watcher() i=2 2024-09-14T11:35:43.441 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.443+0000 7f7708d39800 20 remove_watcher() i=3 2024-09-14T11:35:43.442 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.444+0000 7f7708d39800 20 remove_watcher() i=4 2024-09-14T11:35:43.443 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.445+0000 7f7708d39800 20 remove_watcher() i=5 2024-09-14T11:35:43.444 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.446+0000 7f7708d39800 20 remove_watcher() i=6 2024-09-14T11:35:43.445 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.447+0000 7f7708d39800 20 remove_watcher() i=7 2024-09-14T11:35:43.458 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:43.458 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:35:43.467 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:35:43.495 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:43.495 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:43.531 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.533+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 realm 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.534 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.535+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.536+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.536+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.537+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:43.535 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.537+0000 7f446bb26800 20 searching for the correct realm 2024-09-14T11:35:43.537 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.539+0000 7f44680d7640 0 -- 172.21.15.130:0/2632961828 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4450043060 msgr2=0x7f445006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:43.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.746+0000 7f44680d7640 0 -- 172.21.15.130:0/2632961828 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4450043060 msgr2=0x7f445006c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:43.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:43.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:43.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:35:43.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:43.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:43.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:35:43.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.750+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:43.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 zone default found 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 4 Realm: () 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 zonegroup default 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.751+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.752 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:43.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 started sync module instance, tier type = 2024-09-14T11:35:43.753 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.752+0000 7f446bb26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=0 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=1 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=2 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=3 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=4 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=5 2024-09-14T11:35:43.761 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.762+0000 7f446bb26800 20 add_watcher() i=6 2024-09-14T11:35:43.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.763+0000 7f446bb26800 20 add_watcher() i=7 2024-09-14T11:35:43.762 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.763+0000 7f446bb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:43.763 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f431dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f446bb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:43.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f446bb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:43.764 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f446bb26800 5 note: GC not initialized 2024-09-14T11:35:43.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f431cfe1640 20 reqs_thread_entry: start 2024-09-14T11:35:43.765 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f446bb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.765+0000 7f446bb26800 20 Filter name: none 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f42967fc640 20 reqs_thread_entry: start 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 20 rados->read ofs=0 len=0 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:35:43.766 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.766+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.767+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:35:43.767 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.767+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.767+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.767+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.768+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.768+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.768+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:35:43.768 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.768+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:35:43.769 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.769+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.770+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.770+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.770+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.770+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.771+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.771+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:35:43.770 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.771+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:35:43.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.771+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:35:43.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.772+0000 7f446bb26800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:35:43.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.772+0000 7f446bb26800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:35:43.771 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.773+0000 7f431dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:43.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.775+0000 7f446bb26800 20 remove_watcher() i=0 2024-09-14T11:35:43.774 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.775+0000 7f446bb26800 2 removed watcher, disabling cache 2024-09-14T11:35:43.775 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.776+0000 7f446bb26800 20 remove_watcher() i=1 2024-09-14T11:35:43.776 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.778+0000 7f446bb26800 20 remove_watcher() i=2 2024-09-14T11:35:43.777 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.779+0000 7f446bb26800 20 remove_watcher() i=3 2024-09-14T11:35:43.778 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.780+0000 7f446bb26800 20 remove_watcher() i=4 2024-09-14T11:35:43.779 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.781+0000 7f446bb26800 20 remove_watcher() i=5 2024-09-14T11:35:43.780 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.782+0000 7f446bb26800 20 remove_watcher() i=6 2024-09-14T11:35:43.781 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:35:43.783+0000 7f446bb26800 20 remove_watcher() i=7 2024-09-14T11:36:13.819 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:36:13.851 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:13.851 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:13.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.894+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:13.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:13.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 realm 2024-09-14T11:36:13.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:13.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:13.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:13.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:13.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.896+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:13.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.897+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:13.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.897+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:13.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.897+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:13.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.898+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:13.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.898+0000 7fb219325800 20 searching for the correct realm 2024-09-14T11:36:13.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:13.901+0000 7fb215734640 0 -- 172.21.15.130:0/2115976809 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb1fc040030 msgr2=0x7fb1fc06b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.107 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.108+0000 7fb215734640 0 -- 172.21.15.130:0/2115976809 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb1fc040030 msgr2=0x7fb1fc06b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:14.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:14.113 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.113+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:14.114 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 zone default found 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 4 Realm: () 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 zonegroup default 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.114+0000 7fb219325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.115 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.115+0000 7fb219325800 20 started sync module instance, tier type = 2024-09-14T11:36:14.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.115+0000 7fb219325800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=0 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=1 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=2 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=3 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=4 2024-09-14T11:36:14.123 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=5 2024-09-14T11:36:14.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.124+0000 7fb219325800 20 add_watcher() i=6 2024-09-14T11:36:14.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.125+0000 7fb219325800 20 add_watcher() i=7 2024-09-14T11:36:14.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.125+0000 7fb219325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.127+0000 7fb0cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.127+0000 7fb219325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.127+0000 7fb219325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.127+0000 7fb219325800 5 note: GC not initialized 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb0ca7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb219325800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb219325800 20 Filter name: none 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb0c3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb219325800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:14.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.128+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:14.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.129+0000 7fb219325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:36:14.132 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.133+0000 7fb0cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.136+0000 7fb219325800 20 remove_watcher() i=0 2024-09-14T11:36:14.134 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.136+0000 7fb219325800 2 removed watcher, disabling cache 2024-09-14T11:36:14.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.137+0000 7fb219325800 20 remove_watcher() i=1 2024-09-14T11:36:14.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.138+0000 7fb219325800 20 remove_watcher() i=2 2024-09-14T11:36:14.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.139+0000 7fb219325800 20 remove_watcher() i=3 2024-09-14T11:36:14.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.140+0000 7fb219325800 20 remove_watcher() i=4 2024-09-14T11:36:14.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.141+0000 7fb219325800 20 remove_watcher() i=5 2024-09-14T11:36:14.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.142+0000 7fb219325800 20 remove_watcher() i=6 2024-09-14T11:36:14.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.143+0000 7fb219325800 20 remove_watcher() i=7 2024-09-14T11:36:14.154 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:36:14.183 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:14.183 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:14.219 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.221+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 realm 2024-09-14T11:36:14.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.221 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:14.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.222 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.222+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.223+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.223+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.224+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:14.223 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.224+0000 7f459cab9800 20 searching for the correct realm 2024-09-14T11:36:14.226 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.227+0000 7f459a5a3640 0 -- 172.21.15.130:0/1369796874 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f4594034410 msgr2=0x7f4594034850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:14.230 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.231+0000 7f4599da2640 0 -- 172.21.15.130:0/1369796874 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x5624eb455b30 msgr2=0x5624eb457f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:14.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.235+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 zone default found 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 4 Realm: () 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 zonegroup default 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.236+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.237+0000 7f459cab9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.237+0000 7f459cab9800 20 started sync module instance, tier type = 2024-09-14T11:36:14.238 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.237+0000 7f459cab9800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:14.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=0 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=1 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=2 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=3 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=4 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=5 2024-09-14T11:36:14.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.246+0000 7f459cab9800 20 add_watcher() i=6 2024-09-14T11:36:14.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.247+0000 7f459cab9800 20 add_watcher() i=7 2024-09-14T11:36:14.246 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.247+0000 7f459cab9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:14.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.248+0000 7f4450fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 5 note: GC not initialized 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f43cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 20 Filter name: none 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f43c97fa640 20 reqs_thread_entry: start 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:14.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.249+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:14.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.250+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:14.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.251+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.252+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.252+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.252+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.252+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:14.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.253+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.254+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.254+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.254+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.254+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.255+0000 7f459cab9800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:14.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.255+0000 7f459cab9800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:14.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.256+0000 7f4450fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.256 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.258+0000 7f459cab9800 20 remove_watcher() i=0 2024-09-14T11:36:14.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.258+0000 7f459cab9800 2 removed watcher, disabling cache 2024-09-14T11:36:14.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.259+0000 7f459cab9800 20 remove_watcher() i=1 2024-09-14T11:36:14.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.260+0000 7f459cab9800 20 remove_watcher() i=2 2024-09-14T11:36:14.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.261+0000 7f459cab9800 20 remove_watcher() i=3 2024-09-14T11:36:14.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.262+0000 7f459cab9800 20 remove_watcher() i=4 2024-09-14T11:36:14.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.263+0000 7f459cab9800 20 remove_watcher() i=5 2024-09-14T11:36:14.262 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.264+0000 7f459cab9800 20 remove_watcher() i=6 2024-09-14T11:36:14.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.265+0000 7f459cab9800 20 remove_watcher() i=7 2024-09-14T11:36:14.275 INFO:tasks.workunit.client.0.smithi130.stderr:check reshard logrecord successfully 2024-09-14T11:36:14.275 INFO:tasks.workunit.client.0.smithi130.stderr: test: reshard versioned bucket 2024-09-14T11:36:14.276 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:14.304 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:14.304 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:14.341 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.342+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 realm 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.344+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.345+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.345+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.346+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:14.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.346+0000 7f5939b36800 20 searching for the correct realm 2024-09-14T11:36:14.347 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.348+0000 7f59360b8640 0 -- 172.21.15.130:0/3109796527 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f592c0763f0 msgr2=0x7f592c076810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.553 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.555+0000 7f59360b8640 0 -- 172.21.15.130:0/3109796527 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f592c0763f0 msgr2=0x7f592c076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:14.558 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.559 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.559+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:14.560 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 zone default found 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 4 Realm: () 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 zonegroup default 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.560+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.561 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.561+0000 7f5939b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.561+0000 7f5939b36800 20 started sync module instance, tier type = 2024-09-14T11:36:14.562 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.561+0000 7f5939b36800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=0 2024-09-14T11:36:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=1 2024-09-14T11:36:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=2 2024-09-14T11:36:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=3 2024-09-14T11:36:14.569 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=4 2024-09-14T11:36:14.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=5 2024-09-14T11:36:14.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.570+0000 7f5939b36800 20 add_watcher() i=6 2024-09-14T11:36:14.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.571+0000 7f5939b36800 20 add_watcher() i=7 2024-09-14T11:36:14.570 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.571+0000 7f5939b36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:14.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.573+0000 7f57e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:14.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:14.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 5 note: GC not initialized 2024-09-14T11:36:14.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f57e67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:14.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:14.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 20 Filter name: none 2024-09-14T11:36:14.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5757fff640 20 reqs_thread_entry: start 2024-09-14T11:36:14.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.574+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.575+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.575+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.575 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:14.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.576+0000 7f5939b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:14.576 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.578+0000 7f57e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.580+0000 7f5939b36800 20 remove_watcher() i=0 2024-09-14T11:36:14.579 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.580+0000 7f5939b36800 2 removed watcher, disabling cache 2024-09-14T11:36:14.580 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.581+0000 7f5939b36800 20 remove_watcher() i=1 2024-09-14T11:36:14.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.582+0000 7f5939b36800 20 remove_watcher() i=2 2024-09-14T11:36:14.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.583+0000 7f5939b36800 20 remove_watcher() i=3 2024-09-14T11:36:14.583 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.584+0000 7f5939b36800 20 remove_watcher() i=4 2024-09-14T11:36:14.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.585+0000 7f5939b36800 20 remove_watcher() i=5 2024-09-14T11:36:14.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.586+0000 7f5939b36800 20 remove_watcher() i=6 2024-09-14T11:36:14.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.587+0000 7f5939b36800 20 remove_watcher() i=7 2024-09-14T11:36:14.596 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:14.596 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:36:14.596 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: myver id: a588039c-1457-497f-adbd-8890a12279b7.4508.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:36:14.597 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:14.598 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:36:14.629 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:14.629 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:14.666 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.667+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.668+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.667 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.668+0000 7fafa1610800 20 realm 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.668+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.669+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.669+0000 7fafa1610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.669+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.669+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.669+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.670+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.670+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.670+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:14.669 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.670+0000 7fafa1610800 20 searching for the correct realm 2024-09-14T11:36:14.671 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.673+0000 7faf9d5e1640 0 -- 172.21.15.130:0/2045448107 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7faf840b4070 msgr2=0x7faf840a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.880+0000 7faf9d5e1640 0 -- 172.21.15.130:0/2045448107 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7faf840b4070 msgr2=0x7faf840a5d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:14.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:14.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.884+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.885+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.885+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.885+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:14.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.885+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 zone default found 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 4 Realm: () 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 zonegroup default 2024-09-14T11:36:14.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.886+0000 7fafa1610800 20 started sync module instance, tier type = 2024-09-14T11:36:14.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.887+0000 7fafa1610800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:14.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=0 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=1 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=2 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=3 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=4 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=5 2024-09-14T11:36:14.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.896+0000 7fafa1610800 20 add_watcher() i=6 2024-09-14T11:36:14.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.897+0000 7fafa1610800 20 add_watcher() i=7 2024-09-14T11:36:14.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.897+0000 7fafa1610800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.898+0000 7fae52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 5 note: GC not initialized 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fae51fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:14.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 20 Filter name: none 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fadc37fe640 20 reqs_thread_entry: start 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.899+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : miss 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 20 rados->read ofs=0 len=0 2024-09-14T11:36:14.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:14.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 adding default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:14.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.900+0000 7fafa1610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:14.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fae73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94426051713232 notifier 7931 bl.length()=905 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fae73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fae73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fae73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:14.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.906+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:14.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:14.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.911+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.0 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.912+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1 2024-09-14T11:36:14.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.912+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.913+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.913+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.4 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.914+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.5 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.914+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.6 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.915+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.7 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.915+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.8 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.916+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.9 2024-09-14T11:36:14.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.916+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.10 2024-09-14T11:36:14.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.917+0000 7fafa1610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:14.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.917+0000 7fafa1610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:14.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fafa1610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fafa1610800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fafa1610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fafa1610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fae737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94426051713232 notifier 7931 bl.length()=905 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fae737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fae737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.918+0000 7fae737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.919+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.919+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.919+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:14.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.919+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:14.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.921+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.0 2024-09-14T11:36:14.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.921+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1 2024-09-14T11:36:14.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.922+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2 2024-09-14T11:36:14.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.922+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3 2024-09-14T11:36:14.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.923+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.4 2024-09-14T11:36:14.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.923+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.5 2024-09-14T11:36:14.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.923+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.6 2024-09-14T11:36:14.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.924+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.7 2024-09-14T11:36:14.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.924+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.8 2024-09-14T11:36:14.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.924+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.9 2024-09-14T11:36:14.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.925+0000 7fafa1610800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.10 2024-09-14T11:36:14.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.925+0000 7fafa1610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:14.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.925+0000 7fafa1610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fae737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94426051713232 notifier 7931 bl.length()=873 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fae737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fae737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:14.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fae737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:14.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:14.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:14.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:14.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.927+0000 7fafa1610800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:14.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.929+0000 7fafa1610800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:14.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.931+0000 7fae52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:14.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.933+0000 7fafa1610800 20 remove_watcher() i=0 2024-09-14T11:36:14.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.934+0000 7fafa1610800 2 removed watcher, disabling cache 2024-09-14T11:36:14.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.935+0000 7fafa1610800 20 remove_watcher() i=1 2024-09-14T11:36:14.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.936+0000 7fafa1610800 20 remove_watcher() i=2 2024-09-14T11:36:14.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.937+0000 7fafa1610800 20 remove_watcher() i=3 2024-09-14T11:36:14.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.938+0000 7fafa1610800 20 remove_watcher() i=4 2024-09-14T11:36:14.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.939+0000 7fafa1610800 20 remove_watcher() i=5 2024-09-14T11:36:14.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.940+0000 7fafa1610800 20 remove_watcher() i=6 2024-09-14T11:36:14.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:14.941+0000 7fafa1610800 20 remove_watcher() i=7 2024-09-14T11:36:14.952 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:14.980 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:14.980 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:15.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.018+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 20 realm 2024-09-14T11:36:15.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:15.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.020+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.021+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.021+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.021+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.021+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.022+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:15.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.022+0000 7f62bd736800 20 searching for the correct realm 2024-09-14T11:36:15.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.024+0000 7f62b9cb8640 0 -- 172.21.15.130:0/4263314548 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f62a406b020 msgr2=0x7f62a40a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.229 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.230+0000 7f62b9cb8640 0 -- 172.21.15.130:0/4263314548 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f62a406b020 msgr2=0x7f62a40a73c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.234+0000 7f62bd736800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.235 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 zone default found 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 4 Realm: () 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 zonegroup default 2024-09-14T11:36:15.236 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.235+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 started sync module instance, tier type = 2024-09-14T11:36:15.237 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.236+0000 7f62bd736800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=0 2024-09-14T11:36:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=1 2024-09-14T11:36:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=2 2024-09-14T11:36:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=3 2024-09-14T11:36:15.244 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=4 2024-09-14T11:36:15.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=5 2024-09-14T11:36:15.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=6 2024-09-14T11:36:15.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 20 add_watcher() i=7 2024-09-14T11:36:15.245 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.246+0000 7f62bd736800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:15.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.248+0000 7f616f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:15.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:15.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 5 note: GC not initialized 2024-09-14T11:36:15.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f616e7e4640 20 reqs_thread_entry: start 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 20 Filter name: none 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f60dffff640 20 reqs_thread_entry: start 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.249+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:15.249 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:15.250 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.250+0000 7f62bd736800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.251+0000 7f62bd736800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:15.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.251+0000 7f62bd736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:15.251 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.252+0000 7f616f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.254+0000 7f62bd736800 20 remove_watcher() i=0 2024-09-14T11:36:15.253 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.254+0000 7f62bd736800 2 removed watcher, disabling cache 2024-09-14T11:36:15.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.256+0000 7f62bd736800 20 remove_watcher() i=1 2024-09-14T11:36:15.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.257+0000 7f62bd736800 20 remove_watcher() i=2 2024-09-14T11:36:15.257 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.258+0000 7f62bd736800 20 remove_watcher() i=3 2024-09-14T11:36:15.258 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.259+0000 7f62bd736800 20 remove_watcher() i=4 2024-09-14T11:36:15.259 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.260+0000 7f62bd736800 20 remove_watcher() i=5 2024-09-14T11:36:15.260 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.261+0000 7f62bd736800 20 remove_watcher() i=6 2024-09-14T11:36:15.261 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.262+0000 7f62bd736800 20 remove_watcher() i=7 2024-09-14T11:36:15.271 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:15.271 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:36:15.271 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: myver id: a588039c-1457-497f-adbd-8890a12279b7.4508.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:36:15.271 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:15.273 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:15.273 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:15.277 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:15.277 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:15.318 INFO:tasks.workunit.client.0.smithi130.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:36:15.320 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:15.321 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:15.367 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:15.368 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:15.412 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:36:15.440 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:15.440 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:15.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.478+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 realm 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.479 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.480+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.481+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.481+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.482+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:15.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.482+0000 7ff221b28800 20 searching for the correct realm 2024-09-14T11:36:15.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.484+0000 7ff21e04c640 0 -- 172.21.15.130:0/2961351444 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff214018070 msgr2=0x7ff214062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.690 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.691+0000 7ff21e04c640 0 -- 172.21.15.130:0/2961351444 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff214018070 msgr2=0x7ff214062a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:15.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.695 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.695+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 zone default found 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 4 Realm: () 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:15.696 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 zonegroup default 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.696+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 started sync module instance, tier type = 2024-09-14T11:36:15.697 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.697+0000 7ff221b28800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=0 2024-09-14T11:36:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=1 2024-09-14T11:36:15.705 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=2 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=3 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=4 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=5 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=6 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 20 add_watcher() i=7 2024-09-14T11:36:15.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.707+0000 7ff221b28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.709+0000 7ff0cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 5 note: GC not initialized 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff0ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:15.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 20 Filter name: none 2024-09-14T11:36:15.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff03ffff640 20 reqs_thread_entry: start 2024-09-14T11:36:15.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.710+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.711+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.711+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.711+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.711+0000 7ff221b28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.711+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.712+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:15.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.712+0000 7ff221b28800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.712+0000 7ff221b28800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:15.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.712+0000 7ff221b28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:15.713 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.714+0000 7ff0cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.716+0000 7ff221b28800 20 remove_watcher() i=0 2024-09-14T11:36:15.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.716+0000 7ff221b28800 2 removed watcher, disabling cache 2024-09-14T11:36:15.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.717+0000 7ff221b28800 20 remove_watcher() i=1 2024-09-14T11:36:15.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.719+0000 7ff221b28800 20 remove_watcher() i=2 2024-09-14T11:36:15.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.720+0000 7ff221b28800 20 remove_watcher() i=3 2024-09-14T11:36:15.719 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.721+0000 7ff221b28800 20 remove_watcher() i=4 2024-09-14T11:36:15.720 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.722+0000 7ff221b28800 20 remove_watcher() i=5 2024-09-14T11:36:15.721 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.722+0000 7ff221b28800 20 remove_watcher() i=6 2024-09-14T11:36:15.722 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.723+0000 7ff221b28800 20 remove_watcher() i=7 2024-09-14T11:36:15.732 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:36:15.732 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: a-bucket id: a588039c-1457-497f-adbd-8890a12279b7.4508.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:36:15.732 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:15.734 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:36:15.762 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:15.762 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:15.798 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.800+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 realm 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.801 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:15.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.802+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.803+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:15.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.803+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:15.802 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.803+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:15.803 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.803+0000 7f408ff42800 20 searching for the correct realm 2024-09-14T11:36:15.804 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:15.806+0000 7f408c487640 0 -- 172.21.15.130:0/1955378773 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f407406b030 msgr2=0x7f40740a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.012 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.013+0000 7f408c487640 0 -- 172.21.15.130:0/1955378773 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f407406b030 msgr2=0x7f40740a4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.017+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 zone default found 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 4 Realm: () 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 zonegroup default 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.018+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.019+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.019+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.019+0000 7f408ff42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.019+0000 7f408ff42800 20 started sync module instance, tier type = 2024-09-14T11:36:16.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.019+0000 7f408ff42800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:16.026 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=0 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=1 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=2 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=3 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=4 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=5 2024-09-14T11:36:16.027 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.028+0000 7f408ff42800 20 add_watcher() i=6 2024-09-14T11:36:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.029+0000 7f408ff42800 20 add_watcher() i=7 2024-09-14T11:36:16.028 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.029+0000 7f408ff42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:16.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.030+0000 7f3f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 5 note: GC not initialized 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f3f40fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 20 Filter name: none 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f3eba7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.031+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.032+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:16.031 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.032+0000 7f408ff42800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.032+0000 7f408ff42800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:16.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.032+0000 7f408ff42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:16.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.033+0000 7f3f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.035+0000 7f408ff42800 20 remove_watcher() i=0 2024-09-14T11:36:16.033 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.035+0000 7f408ff42800 2 removed watcher, disabling cache 2024-09-14T11:36:16.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.036+0000 7f408ff42800 20 remove_watcher() i=1 2024-09-14T11:36:16.035 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.037+0000 7f408ff42800 20 remove_watcher() i=2 2024-09-14T11:36:16.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.038+0000 7f408ff42800 20 remove_watcher() i=3 2024-09-14T11:36:16.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.039+0000 7f408ff42800 20 remove_watcher() i=4 2024-09-14T11:36:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.040+0000 7f408ff42800 20 remove_watcher() i=5 2024-09-14T11:36:16.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.041+0000 7f408ff42800 20 remove_watcher() i=6 2024-09-14T11:36:16.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.042+0000 7f408ff42800 20 remove_watcher() i=7 2024-09-14T11:36:16.052 INFO:tasks.workunit.client.0.smithi130.stderr:rados -p default.rgw.buckets.index setomapval .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:36:16.078 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:16.078 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:16.094 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:36:16.123 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:16.123 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:16.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.160+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 realm 2024-09-14T11:36:16.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.161 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:16.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.162+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.162 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.163+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.163+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.164+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:16.163 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.164+0000 7f046f010800 20 searching for the correct realm 2024-09-14T11:36:16.165 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.166+0000 7f046afbd640 0 -- 172.21.15.130:0/1553056377 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f045403fb20 msgr2=0x7f0454037920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.372+0000 7f046afbd640 0 -- 172.21.15.130:0/1553056377 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f045403fb20 msgr2=0x7f0454037920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:16.374 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.375 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 zone default found 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 4 Realm: () 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 zonegroup default 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.376+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 started sync module instance, tier type = 2024-09-14T11:36:16.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.377+0000 7f046f010800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:16.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=0 2024-09-14T11:36:16.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=1 2024-09-14T11:36:16.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=2 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=3 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=4 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=5 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.386+0000 7f046f010800 20 add_watcher() i=6 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.387+0000 7f046f010800 20 add_watcher() i=7 2024-09-14T11:36:16.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.387+0000 7f046f010800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:16.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.389+0000 7f0320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.389+0000 7f046f010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.389+0000 7f046f010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.389+0000 7f046f010800 5 note: GC not initialized 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f029b7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f046f010800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f046f010800 20 Filter name: none 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f02997fa640 20 reqs_thread_entry: start 2024-09-14T11:36:16.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:16.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.390+0000 7f046f010800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:16.390 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 INFO: main: starting shard=0 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.391+0000 7f046f010800 20 INFO: main: starting shard=1 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 INFO: main: starting shard=2 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 INFO: main: starting shard=3 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.392+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 INFO: main: starting shard=4 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 INFO: main: starting shard=5 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.393+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.394+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.394+0000 7f046f010800 20 INFO: main: starting shard=6 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.394+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.394+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 INFO: main: starting shard=7 2024-09-14T11:36:16.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 INFO: main: starting shard=8 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.395+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 INFO: main: starting shard=9 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 INFO: main: starting shard=10 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.396+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 INFO: main: starting shard=11 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 INFO: main: starting shard=12 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:16.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.397+0000 7f046f010800 20 INFO: main: done 2024-09-14T11:36:16.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.398+0000 7f0320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.400+0000 7f046f010800 20 remove_watcher() i=0 2024-09-14T11:36:16.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.400+0000 7f046f010800 2 removed watcher, disabling cache 2024-09-14T11:36:16.400 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.401+0000 7f046f010800 20 remove_watcher() i=1 2024-09-14T11:36:16.401 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.402+0000 7f046f010800 20 remove_watcher() i=2 2024-09-14T11:36:16.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.403+0000 7f046f010800 20 remove_watcher() i=3 2024-09-14T11:36:16.403 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.404+0000 7f046f010800 20 remove_watcher() i=4 2024-09-14T11:36:16.404 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.405+0000 7f046f010800 20 remove_watcher() i=5 2024-09-14T11:36:16.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.406+0000 7f046f010800 20 remove_watcher() i=6 2024-09-14T11:36:16.406 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.407+0000 7f046f010800 20 remove_watcher() i=7 2024-09-14T11:36:16.418 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:36:16.450 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:16.450 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:16.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.488+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.489+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.489+0000 7f287bd24800 20 realm 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.489+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.490+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.490+0000 7f287bd24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.490+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.490+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.490+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.491+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.491+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.491+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:16.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.491+0000 7f287bd24800 20 searching for the correct realm 2024-09-14T11:36:16.694 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.695+0000 7f28781d3640 0 -- 172.21.15.130:0/3785225689 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2860084040 msgr2=0x7f286006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.901+0000 7f28781d3640 0 -- 172.21.15.130:0/3785225689 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f2860084040 msgr2=0x7f286006c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.905+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 zone default found 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 4 Realm: () 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:16.906 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 zonegroup default 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.906+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.907+0000 7f287bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.907+0000 7f287bd24800 20 started sync module instance, tier type = 2024-09-14T11:36:16.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.907+0000 7f287bd24800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:16.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=0 2024-09-14T11:36:16.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=1 2024-09-14T11:36:16.915 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=2 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=3 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=4 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.916+0000 7f287bd24800 20 add_watcher() i=5 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.917+0000 7f287bd24800 20 add_watcher() i=6 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.917+0000 7f287bd24800 20 add_watcher() i=7 2024-09-14T11:36:16.916 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.917+0000 7f287bd24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:16.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.919+0000 7f272dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.919+0000 7f287bd24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:16.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.919+0000 7f287bd24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.919+0000 7f287bd24800 5 note: GC not initialized 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f272cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f287bd24800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f287bd24800 20 Filter name: none 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f26a67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f287bd24800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:36:16.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.920+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : miss 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 20 rados->read ofs=0 len=0 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.920 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:16.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.921 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.921+0000 7f287bd24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:36:16.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.924+0000 7f287bd24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.924+0000 7f287bd24800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.924+0000 7f287bd24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.924+0000 7f287bd24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f27567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94824775927680 notifier 8024 bl.length()=911 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f27567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f27567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f27567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:36:16.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.925+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:36:16.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:36:16.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:36:16.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:36:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.930+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.931+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.930 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.931+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.932+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.932+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.932+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.932+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.933+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.931 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.933+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.933+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.933+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.934+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.934+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.934+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.934+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.935+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.933 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.935+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.935+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.935+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:16.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.936+0000 7f287bd24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:36:16.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f287bd24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.936 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f287bd24800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f287bd24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f287bd24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:36:16.937 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f2756ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94824775927680 notifier 8024 bl.length()=911 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f2756ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f2756ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.938+0000 7f2756ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.939+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.939+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.939+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:36:16.938 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.939+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:36:16.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.941+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.941+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.0 2024-09-14T11:36:16.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.941+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.941+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.1 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.942+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.942+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.2 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.942+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.942+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.3 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.4 2024-09-14T11:36:16.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.5 2024-09-14T11:36:16.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.943+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.6 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.7 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.8 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.944+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.9 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.10 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.11 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.944 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.945+0000 7f287bd24800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.2.12 2024-09-14T11:36:16.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.946+0000 7f287bd24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:16.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.946+0000 7f287bd24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 2024-09-14T11:36:16.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f287bd24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f287bd24800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f287bd24800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f287bd24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18, ofs0, ns] 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f27567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94824775927680 notifier 8024 bl.length()=879 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f27567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 info.flags=0x17 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f27567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.18 to cache LRU end 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.947+0000 7f27567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:16.946 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.948+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_sources= new_sources= 2024-09-14T11:36:16.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.948+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential sources added=[] removed=[] 2024-09-14T11:36:16.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.948+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): orig_dests= new_dests= 2024-09-14T11:36:16.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.948+0000 7f287bd24800 20 handle_bi_update(): bucket=:a-bucket[a588039c-1457-497f-adbd-8890a12279b7.4508.18]): potential dests added=[] removed=[] 2024-09-14T11:36:16.949 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.951+0000 7f287bd24800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:36:16.951 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.953+0000 7f272dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:16.953 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.955+0000 7f287bd24800 20 remove_watcher() i=0 2024-09-14T11:36:16.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.955+0000 7f287bd24800 2 removed watcher, disabling cache 2024-09-14T11:36:16.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.956+0000 7f287bd24800 20 remove_watcher() i=1 2024-09-14T11:36:16.955 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.957+0000 7f287bd24800 20 remove_watcher() i=2 2024-09-14T11:36:16.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.958+0000 7f287bd24800 20 remove_watcher() i=3 2024-09-14T11:36:16.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.959+0000 7f287bd24800 20 remove_watcher() i=4 2024-09-14T11:36:16.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.960+0000 7f287bd24800 20 remove_watcher() i=5 2024-09-14T11:36:16.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.961+0000 7f287bd24800 20 remove_watcher() i=6 2024-09-14T11:36:16.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:16.962+0000 7f287bd24800 20 remove_watcher() i=7 2024-09-14T11:36:16.973 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:36:17.000 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:17.001 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:17.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.039+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.040+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.040+0000 7f609ac2f800 20 realm 2024-09-14T11:36:17.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.040+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.041+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.041+0000 7f609ac2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.041+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.041+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.041+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.042+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.042+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.042+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:17.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.042+0000 7f609ac2f800 20 searching for the correct realm 2024-09-14T11:36:17.043 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.044+0000 7f6098f21640 0 -- 172.21.15.130:0/785029765 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f608006bbb0 msgr2=0x7f6080067100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.248 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.249+0000 7f6098f21640 0 -- 172.21.15.130:0/785029765 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f608006bbb0 msgr2=0x7f6080067100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.252 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.253+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 zone default found 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 4 Realm: () 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:17.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 zonegroup default 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.254+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.255+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.255+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.255+0000 7f609ac2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.255+0000 7f609ac2f800 20 started sync module instance, tier type = 2024-09-14T11:36:17.255 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.255+0000 7f609ac2f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=0 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=1 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=2 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=3 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=4 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=5 2024-09-14T11:36:17.263 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.264+0000 7f609ac2f800 20 add_watcher() i=6 2024-09-14T11:36:17.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.265+0000 7f609ac2f800 20 add_watcher() i=7 2024-09-14T11:36:17.264 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.265+0000 7f609ac2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f5f4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f609ac2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f609ac2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f609ac2f800 5 note: GC not initialized 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f5f4dfdb640 20 reqs_thread_entry: start 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.267+0000 7f609ac2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.268+0000 7f609ac2f800 20 Filter name: none 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.268+0000 7f5ebf7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.268+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.268+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:36:17.267 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.268+0000 7f609ac2f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:36:17.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:17.268 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 INFO: main: starting shard=0 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.18.3.0 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.269+0000 7f609ac2f800 20 INFO: main: done 2024-09-14T11:36:17.269 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.270+0000 7f5f4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.270 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.272+0000 7f609ac2f800 20 remove_watcher() i=0 2024-09-14T11:36:17.271 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.272+0000 7f609ac2f800 2 removed watcher, disabling cache 2024-09-14T11:36:17.272 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.273+0000 7f609ac2f800 20 remove_watcher() i=1 2024-09-14T11:36:17.273 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.274+0000 7f609ac2f800 20 remove_watcher() i=2 2024-09-14T11:36:17.274 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.275+0000 7f609ac2f800 20 remove_watcher() i=3 2024-09-14T11:36:17.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.276+0000 7f609ac2f800 20 remove_watcher() i=4 2024-09-14T11:36:17.275 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.277+0000 7f609ac2f800 20 remove_watcher() i=5 2024-09-14T11:36:17.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.278+0000 7f609ac2f800 20 remove_watcher() i=6 2024-09-14T11:36:17.277 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.279+0000 7f609ac2f800 20 remove_watcher() i=7 2024-09-14T11:36:17.288 INFO:tasks.workunit.client.0.smithi130.stderr: test: PUT succeeds during reshard 2024-09-14T11:36:17.289 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:17.318 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:17.318 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:17.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.355+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.357+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.357+0000 7fb9e840f800 20 realm 2024-09-14T11:36:17.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.357+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.356 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.357+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.358+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.359+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:17.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.359+0000 7fb9e840f800 20 searching for the correct realm 2024-09-14T11:36:17.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.361+0000 7fb9e4323640 0 -- 172.21.15.130:0/325980117 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb9cc0ab490 msgr2=0x7fb9cc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:17.566 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.567+0000 7fb9e4323640 0 -- 172.21.15.130:0/325980117 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb9cc0ab490 msgr2=0x7fb9cc070a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:17.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:17.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:17.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:17.571 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.571+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 zone default found 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 4 Realm: () 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:17.572 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 zonegroup default 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.572+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.573+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.573+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.573+0000 7fb9e840f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.573 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.573+0000 7fb9e840f800 20 started sync module instance, tier type = 2024-09-14T11:36:17.574 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.573+0000 7fb9e840f800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=0 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=1 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=2 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=3 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=4 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=5 2024-09-14T11:36:17.581 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.582+0000 7fb9e840f800 20 add_watcher() i=6 2024-09-14T11:36:17.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.583+0000 7fb9e840f800 20 add_watcher() i=7 2024-09-14T11:36:17.582 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.583+0000 7fb9e840f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:17.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.585+0000 7fb899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.585+0000 7fb9e840f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:17.584 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.585+0000 7fb9e840f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.585+0000 7fb9e840f800 5 note: GC not initialized 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.585+0000 7fb898fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb9e840f800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb9e840f800 20 Filter name: none 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb8127fc640 20 reqs_thread_entry: start 2024-09-14T11:36:17.585 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.586+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:17.586 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:17.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:17.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.587+0000 7fb9e840f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:17.587 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.589+0000 7fb899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.591+0000 7fb9e840f800 20 remove_watcher() i=0 2024-09-14T11:36:17.590 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.591+0000 7fb9e840f800 2 removed watcher, disabling cache 2024-09-14T11:36:17.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.592+0000 7fb9e840f800 20 remove_watcher() i=1 2024-09-14T11:36:17.592 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.593+0000 7fb9e840f800 20 remove_watcher() i=2 2024-09-14T11:36:17.593 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.594+0000 7fb9e840f800 20 remove_watcher() i=3 2024-09-14T11:36:17.594 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.595+0000 7fb9e840f800 20 remove_watcher() i=4 2024-09-14T11:36:17.595 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.596+0000 7fb9e840f800 20 remove_watcher() i=5 2024-09-14T11:36:17.596 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.597+0000 7fb9e840f800 20 remove_watcher() i=6 2024-09-14T11:36:17.597 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.598+0000 7fb9e840f800 20 remove_watcher() i=7 2024-09-14T11:36:17.607 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:17.607 INFO:tasks.workunit.client.0.smithi130.stderr:BUCKET_STATS: 2024-09-14T11:36:17.607 INFO:tasks.workunit.client.0.smithi130.stderr:bucket: myver id: a588039c-1457-497f-adbd-8890a12279b7.4508.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:36:17.607 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:17.609 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:36:17.641 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:17.641 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:17.680 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.681+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.681 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 realm 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.683+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.682 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.684+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.684+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.685+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:17.683 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.685+0000 7fc329e20800 20 searching for the correct realm 2024-09-14T11:36:17.685 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.687+0000 7fc328112640 0 -- 172.21.15.130:0/1158992992 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc31c065040 msgr2=0x7fc31c04db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.893+0000 7fc328112640 0 -- 172.21.15.130:0/1158992992 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc31c065040 msgr2=0x7fc31c04db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:17.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:17.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:17.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:17.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:17.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:17.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:17.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.897+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 zone default found 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 4 Realm: () 2024-09-14T11:36:17.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 zonegroup default 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.898+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 started sync module instance, tier type = 2024-09-14T11:36:17.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.899+0000 7fc329e20800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:17.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=0 2024-09-14T11:36:17.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=1 2024-09-14T11:36:17.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=2 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=3 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=4 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=5 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.908+0000 7fc329e20800 20 add_watcher() i=6 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.909+0000 7fc329e20800 20 add_watcher() i=7 2024-09-14T11:36:17.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.909+0000 7fc329e20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:17.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.911+0000 7fc1ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:17.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.911+0000 7fc329e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.911+0000 7fc329e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.911+0000 7fc329e20800 5 note: GC not initialized 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc1dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 20 Filter name: none 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc1567fc640 20 reqs_thread_entry: start 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:17.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:17.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:17.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:17.912 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : miss 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.912+0000 7fc329e20800 20 rados->read ofs=0 len=0 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 10 adding default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.913 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.913+0000 7fc329e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc329e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc329e20800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc329e20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc329e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc206ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94055587023584 notifier 8649 bl.length()=905 2024-09-14T11:36:17.917 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc206ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc206ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.918+0000 7fc206ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.919+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.919+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.919+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:17.918 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.919+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:17.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:17.923+0000 7fc329e20800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:18.613 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:18.627 INFO:tasks.workunit.client.0.smithi130.stderr:put object successful 2024-09-14T11:36:22.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:22.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:22.922 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:22.923 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:22.924 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:22.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:22.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.924+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:22.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.925+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:22.925 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.925+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.926+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.926+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.927+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.927+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.927+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.927+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:22.926 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.928+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:22.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.928+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:22.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.928+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:22.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.928+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:22.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.929+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:22.927 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.929+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:22.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.929+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:22.928 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.929+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:22.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.930+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:22.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.930+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:22.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.931+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:22.929 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.931+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:22.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.933+0000 7fc329e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:22.932 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.933+0000 7fc329e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc329e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc329e20800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc329e20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc329e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc206ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94055587023584 notifier 8649 bl.length()=905 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc206ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc206ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:22.934 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.935+0000 7fc206ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:22.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.936+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:22.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.936+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:22.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.936+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:22.935 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.936+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.0 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.1 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:22.939 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.940+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.2 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.941+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.941+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.3 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.941+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.941+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.4 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:22.940 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.5 2024-09-14T11:36:22.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:22.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.6 2024-09-14T11:36:22.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:22.941 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.942+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.7 2024-09-14T11:36:22.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.943+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:22.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.943+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.8 2024-09-14T11:36:22.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.943+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:22.942 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.943+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.9 2024-09-14T11:36:22.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.944+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:22.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.944+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.10 2024-09-14T11:36:22.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.944+0000 7fc329e20800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:22.943 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.944+0000 7fc329e20800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.1.11 2024-09-14T11:36:22.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.947+0000 7fc329e20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:22.945 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.947+0000 7fc329e20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:22.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.948+0000 7fc329e20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:22.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.948+0000 7fc329e20800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:22.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.948+0000 7fc329e20800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:22.947 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.948+0000 7fc329e20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc206ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94055587023584 notifier 8649 bl.length()=873 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc206ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc206ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc206ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:22.948 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.949+0000 7fc329e20800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:22.952 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.953+0000 7fc329e20800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:36:22.954 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.955+0000 7fc1ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:22.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.958+0000 7fc329e20800 20 remove_watcher() i=0 2024-09-14T11:36:22.956 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.958+0000 7fc329e20800 2 removed watcher, disabling cache 2024-09-14T11:36:22.958 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.959+0000 7fc329e20800 20 remove_watcher() i=1 2024-09-14T11:36:22.959 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.960+0000 7fc329e20800 20 remove_watcher() i=2 2024-09-14T11:36:22.960 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.962+0000 7fc329e20800 20 remove_watcher() i=3 2024-09-14T11:36:22.961 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.963+0000 7fc329e20800 20 remove_watcher() i=4 2024-09-14T11:36:22.962 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.964+0000 7fc329e20800 20 remove_watcher() i=5 2024-09-14T11:36:22.964 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.965+0000 7fc329e20800 20 remove_watcher() i=6 2024-09-14T11:36:22.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:22.966+0000 7fc329e20800 20 remove_watcher() i=7 2024-09-14T11:36:23.633 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:36:23.633 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:36:23.637 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.637 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.643 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.643 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.686 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.686 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.702 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.702 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.706 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.706 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.720 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.721 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.725 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.737 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:23.738 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:23.742 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:36:24.142 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:36:25.529 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:25.529 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:25.581 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:25.582 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:36:25.617 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:25.617 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:25.659 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.660+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 20 realm 2024-09-14T11:36:25.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.660 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:25.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.661+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.662+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.662+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.663+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:25.661 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.663+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.663+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:25.662 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.663+0000 7fd2c3320800 20 searching for the correct realm 2024-09-14T11:36:25.664 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.666+0000 7fd2b6867640 0 -- 172.21.15.130:0/40159119 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd2b0062070 msgr2=0x7fd2b00a4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:25.668 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.670+0000 7fd2bf068640 0 -- 172.21.15.130:0/40159119 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd2b80433e0 msgr2=0x7fd2b8043840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.876+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:25.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 zone default found 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 4 Realm: () 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 zonegroup default 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.877+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.878+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.878+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.878+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.878+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.879+0000 7fd2c3320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:25.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.879+0000 7fd2c3320800 20 started sync module instance, tier type = 2024-09-14T11:36:25.878 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.879+0000 7fd2c3320800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:25.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=0 2024-09-14T11:36:25.887 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=1 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=2 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=3 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=4 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=5 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.889+0000 7fd2c3320800 20 add_watcher() i=6 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.890+0000 7fd2c3320800 20 add_watcher() i=7 2024-09-14T11:36:25.888 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.890+0000 7fd2c3320800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd175fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd2c3320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd2c3320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd2c3320800 5 note: GC not initialized 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd174fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd2c3320800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:25.891 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.892+0000 7fd2c3320800 20 Filter name: none 2024-09-14T11:36:25.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.893+0000 7fd0ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:25.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.893+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.892 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.893+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.893+0000 7fd2c3320800 20 rados->read ofs=0 len=0 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 20 INFO: main: starting shard=0 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:25.893 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.894+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 INFO: main: starting shard=1 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 INFO: main: starting shard=2 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:25.894 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.895+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:25.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 INFO: main: starting shard=3 2024-09-14T11:36:25.895 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 INFO: main: starting shard=4 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.896+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 INFO: main: starting shard=5 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:25.896 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:25.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:25.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 INFO: main: starting shard=6 2024-09-14T11:36:25.897 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.897+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 INFO: main: starting shard=7 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 INFO: main: starting shard=8 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.898+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.899+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.899+0000 7fd2c3320800 20 INFO: main: starting shard=9 2024-09-14T11:36:25.898 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.899+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:25.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.899+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:25.899 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 INFO: main: starting shard=10 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 INFO: main: starting shard=11 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.900+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 20 INFO: main: starting shard=12 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:25.900 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:25.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:25.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.901+0000 7fd2c3320800 20 INFO: main: done 2024-09-14T11:36:25.901 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.902+0000 7fd175fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:25.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.904+0000 7fd2c3320800 20 remove_watcher() i=0 2024-09-14T11:36:25.903 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.904+0000 7fd2c3320800 2 removed watcher, disabling cache 2024-09-14T11:36:25.904 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.906+0000 7fd2c3320800 20 remove_watcher() i=1 2024-09-14T11:36:25.905 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.907+0000 7fd2c3320800 20 remove_watcher() i=2 2024-09-14T11:36:25.907 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.908+0000 7fd2c3320800 20 remove_watcher() i=3 2024-09-14T11:36:25.908 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.909+0000 7fd2c3320800 20 remove_watcher() i=4 2024-09-14T11:36:25.909 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.910+0000 7fd2c3320800 20 remove_watcher() i=5 2024-09-14T11:36:25.910 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.911+0000 7fd2c3320800 20 remove_watcher() i=6 2024-09-14T11:36:25.911 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:25.912+0000 7fd2c3320800 20 remove_watcher() i=7 2024-09-14T11:36:25.924 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:25.925 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:25.928 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:25.928 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:25.977 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:25.978 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:36:26.008 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:26.009 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:26.047 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.048+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 20 realm 2024-09-14T11:36:26.049 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:26.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.050+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.051+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.050 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.051+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.051+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:26.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.051+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.052+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:26.051 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.052+0000 7ffbc5a63800 20 searching for the correct realm 2024-09-14T11:36:26.254 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.255+0000 7ffbc3d55640 0 -- 172.21.15.130:0/3931341387 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffbb80a7040 msgr2=0x7ffbb8045a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:26.460 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.462+0000 7ffbc3d55640 0 -- 172.21.15.130:0/3931341387 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ffbb80a7040 msgr2=0x7ffbb8045a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:26.467 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.466+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 zone default found 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 4 Realm: () 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 zonegroup default 2024-09-14T11:36:26.468 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.467+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.468+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.468+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.468+0000 7ffbc5a63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.468+0000 7ffbc5a63800 20 started sync module instance, tier type = 2024-09-14T11:36:26.469 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.468+0000 7ffbc5a63800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:26.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=0 2024-09-14T11:36:26.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=1 2024-09-14T11:36:26.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=2 2024-09-14T11:36:26.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=3 2024-09-14T11:36:26.476 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=4 2024-09-14T11:36:26.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=5 2024-09-14T11:36:26.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=6 2024-09-14T11:36:26.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 20 add_watcher() i=7 2024-09-14T11:36:26.477 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.478+0000 7ffbc5a63800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:26.480 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.481+0000 7ffa79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 5 note: GC not initialized 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffa78fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 20 Filter name: none 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ff9f27fc640 20 reqs_thread_entry: start 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.482+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.481 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:26.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:26.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:26.482 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 INFO: main: starting shard=0 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.483+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 INFO: main: starting shard=1 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:26.483 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 INFO: main: starting shard=2 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.484+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 INFO: main: starting shard=3 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 INFO: main: starting shard=4 2024-09-14T11:36:26.484 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.485+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 INFO: main: starting shard=5 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.485 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 INFO: main: starting shard=6 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.486+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.487+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.487+0000 7ffbc5a63800 20 INFO: main: starting shard=7 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.487+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:26.486 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.487+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:26.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 INFO: main: starting shard=8 2024-09-14T11:36:26.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:26.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:26.487 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 INFO: main: starting shard=9 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.488+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 INFO: main: starting shard=10 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:26.488 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 INFO: main: starting shard=11 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.489+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.490+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.490+0000 7ffbc5a63800 20 INFO: main: starting shard=12 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.490+0000 7ffbc5a63800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.490+0000 7ffbc5a63800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.491+0000 7ffbc5a63800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.489 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.491+0000 7ffbc5a63800 20 INFO: main: done 2024-09-14T11:36:26.490 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.491+0000 7ffa79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:26.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.494+0000 7ffbc5a63800 20 remove_watcher() i=0 2024-09-14T11:36:26.492 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.494+0000 7ffbc5a63800 2 removed watcher, disabling cache 2024-09-14T11:36:26.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.495+0000 7ffbc5a63800 20 remove_watcher() i=1 2024-09-14T11:36:26.494 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.496+0000 7ffbc5a63800 20 remove_watcher() i=2 2024-09-14T11:36:26.495 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.497+0000 7ffbc5a63800 20 remove_watcher() i=3 2024-09-14T11:36:26.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.498+0000 7ffbc5a63800 20 remove_watcher() i=4 2024-09-14T11:36:26.497 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.499+0000 7ffbc5a63800 20 remove_watcher() i=5 2024-09-14T11:36:26.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.500+0000 7ffbc5a63800 20 remove_watcher() i=6 2024-09-14T11:36:26.499 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.501+0000 7ffbc5a63800 20 remove_watcher() i=7 2024-09-14T11:36:26.512 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:26.512 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:26.516 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:26.516 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:26.564 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:36:26.566 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:36:26.598 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:26.598 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:26.635 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.636+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 realm 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.637 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.638+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.639+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:26.638 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.639+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.640+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:26.639 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.640+0000 7fab53925800 20 searching for the correct realm 2024-09-14T11:36:26.641 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.643+0000 7fab4fd34640 0 -- 172.21.15.130:0/3322409312 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fab38036060 msgr2=0x7fab38067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:26.849 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.850+0000 7fab4fd34640 0 -- 172.21.15.130:0/3322409312 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fab38036060 msgr2=0x7fab38067db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.853 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.854+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 zone default found 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 4 Realm: () 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 zonegroup default 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.855 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.855+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.856+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.856+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.856+0000 7fab53925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.856+0000 7fab53925800 20 started sync module instance, tier type = 2024-09-14T11:36:26.856 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.856+0000 7fab53925800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:26.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=0 2024-09-14T11:36:26.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=1 2024-09-14T11:36:26.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=2 2024-09-14T11:36:26.864 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=3 2024-09-14T11:36:26.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=4 2024-09-14T11:36:26.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=5 2024-09-14T11:36:26.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.866+0000 7fab53925800 20 add_watcher() i=6 2024-09-14T11:36:26.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.867+0000 7fab53925800 20 add_watcher() i=7 2024-09-14T11:36:26.865 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.867+0000 7fab53925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.868+0000 7faa05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 5 note: GC not initialized 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7faa04fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 Filter name: none 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fa97e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.868 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:26.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.869+0000 7fab53925800 20 rados->read ofs=0 len=0 2024-09-14T11:36:26.869 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 20 INFO: main: starting shard=0 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.870+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 INFO: main: starting shard=1 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:26.870 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 INFO: main: starting shard=2 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.871+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 INFO: main: starting shard=3 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:26.871 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 INFO: main: starting shard=4 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.872+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.872 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 INFO: main: starting shard=5 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 INFO: main: starting shard=6 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.873+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 INFO: main: starting shard=7 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:26.873 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 INFO: main: starting shard=8 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.874+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.875+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.875+0000 7fab53925800 20 INFO: main: starting shard=9 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.875+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:26.874 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.875+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:26.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.876+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.876+0000 7fab53925800 20 INFO: main: starting shard=10 2024-09-14T11:36:26.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.876+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:26.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.876+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:26.875 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 INFO: main: starting shard=11 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 INFO: main: starting shard=12 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.877+0000 7fab53925800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:36:26.876 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.878+0000 7fab53925800 20 INFO: main: done 2024-09-14T11:36:26.877 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.878+0000 7faa05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:26.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.881+0000 7fab53925800 20 remove_watcher() i=0 2024-09-14T11:36:26.879 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.881+0000 7fab53925800 2 removed watcher, disabling cache 2024-09-14T11:36:26.880 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.882+0000 7fab53925800 20 remove_watcher() i=1 2024-09-14T11:36:26.882 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.883+0000 7fab53925800 20 remove_watcher() i=2 2024-09-14T11:36:26.883 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.884+0000 7fab53925800 20 remove_watcher() i=3 2024-09-14T11:36:26.884 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.885+0000 7fab53925800 20 remove_watcher() i=4 2024-09-14T11:36:26.885 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.886+0000 7fab53925800 20 remove_watcher() i=5 2024-09-14T11:36:26.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.887+0000 7fab53925800 20 remove_watcher() i=6 2024-09-14T11:36:26.886 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:26.888+0000 7fab53925800 20 remove_watcher() i=7 2024-09-14T11:36:26.899 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:26.899 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:26.904 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:36:27.297 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:36:27.686 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:36:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:27.754 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.756+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.757+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.757+0000 7fe935939800 20 realm 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.757+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.758+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.758+0000 7fe935939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.758+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.757 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.758+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.758+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.758 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.759+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:27.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.759+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.759+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:27.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.760+0000 7fe935939800 20 searching for the correct realm 2024-09-14T11:36:27.759 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.761+0000 7fe931625640 0 -- 172.21.15.130:0/864840900 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7fe92c070040 msgr2=0x7fe92c070420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:27.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.967+0000 7fe928e24640 0 -- 172.21.15.130:0/864840900 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fe924040060 msgr2=0x7fe924068340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:27.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:27.973 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.973+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.974 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 zone default found 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 4 Realm: () 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 zonegroup default 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.975 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.974+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.975+0000 7fe935939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.975+0000 7fe935939800 20 started sync module instance, tier type = 2024-09-14T11:36:27.976 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.975+0000 7fe935939800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:27.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=0 2024-09-14T11:36:27.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=1 2024-09-14T11:36:27.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=2 2024-09-14T11:36:27.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=3 2024-09-14T11:36:27.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=4 2024-09-14T11:36:27.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=5 2024-09-14T11:36:27.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.984+0000 7fe935939800 20 add_watcher() i=6 2024-09-14T11:36:27.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.985+0000 7fe935939800 20 add_watcher() i=7 2024-09-14T11:36:27.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.985+0000 7fe935939800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.987+0000 7fe7e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.987+0000 7fe935939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:27.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.987+0000 7fe935939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.987+0000 7fe935939800 5 note: GC not initialized 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.987+0000 7fe7e6fe5640 20 reqs_thread_entry: start 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 20 Filter name: none 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe7e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:27.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:27.988 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : miss 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.988+0000 7fe935939800 20 rados->read ofs=0 len=0 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 10 adding default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:27.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.989+0000 7fe935939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe814ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94365127614736 notifier 8736 bl.length()=905 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe814ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:27.996 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe814ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe814ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:27.997 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:27.997+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:28.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.0 2024-09-14T11:36:28.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.0 2024-09-14T11:36:28.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.1 2024-09-14T11:36:28.002 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.1 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.2 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.2 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.3 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.3 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.4 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.4 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.5 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.5 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.6 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.6 2024-09-14T11:36:28.003 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.7 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.7 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.8 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.8 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.10 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.10 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.11 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.11 2024-09-14T11:36:28.004 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.12 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.12 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.13 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.13 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.14 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.14 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.15 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.15 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.16 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.16 2024-09-14T11:36:28.005 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:28.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:28.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:28.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.003+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:28.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.004+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:28.006 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.004+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:28.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.004+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:28.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.004+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:28.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.005+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:28.007 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.005+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.006+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.006+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.006+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.006+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.007+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.007+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.007+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.007+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.008+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:28.008 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.008+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:28.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.009+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:28.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.009+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:28.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.009+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:28.009 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.009+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:28.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.010+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:28.010 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.010+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:28.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.012+0000 7fe935939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:28.011 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.012+0000 7fe935939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe803fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 94365127614736 notifier 8736 bl.length()=905 2024-09-14T11:36:28.013 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe803fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe803fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe803fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:28.014 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.014+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:28.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.017+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:28.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.017+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.0 2024-09-14T11:36:28.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:28.016 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.1 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.2 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.018+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.3 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:28.017 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.4 2024-09-14T11:36:28.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:28.018 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.5 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.019+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.6 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.7 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:28.019 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.8 2024-09-14T11:36:28.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:28.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.020+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.9 2024-09-14T11:36:28.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.021+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:28.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.021+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.10 2024-09-14T11:36:28.020 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.021+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:28.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.021+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.11 2024-09-14T11:36:28.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.022+0000 7fe935939800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:28.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.022+0000 7fe935939800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.2.12 2024-09-14T11:36:28.021 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.022+0000 7fe935939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:28.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.022+0000 7fe935939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:28.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.023+0000 7fe935939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:28.022 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.023+0000 7fe935939800 10 moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.023+0000 7fe935939800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.023+0000 7fe935939800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19, ofs0, ns] 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe814ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 94365127614736 notifier 8736 bl.length()=873 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe814ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe814ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe814ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_sources= new_sources= 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential sources added=[] removed=[] 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): orig_dests= new_dests= 2024-09-14T11:36:28.023 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.024+0000 7fe935939800 20 handle_bi_update(): bucket=:myver[a588039c-1457-497f-adbd-8890a12279b7.4508.19]): potential dests added=[] removed=[] 2024-09-14T11:36:28.030 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.031+0000 7fe935939800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:36:28.032 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.033+0000 7fe7e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:28.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.035+0000 7fe935939800 20 remove_watcher() i=0 2024-09-14T11:36:28.034 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.035+0000 7fe935939800 2 removed watcher, disabling cache 2024-09-14T11:36:28.036 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.037+0000 7fe935939800 20 remove_watcher() i=1 2024-09-14T11:36:28.037 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.038+0000 7fe935939800 20 remove_watcher() i=2 2024-09-14T11:36:28.038 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.039+0000 7fe935939800 20 remove_watcher() i=3 2024-09-14T11:36:28.039 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.040+0000 7fe935939800 20 remove_watcher() i=4 2024-09-14T11:36:28.040 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.041+0000 7fe935939800 20 remove_watcher() i=5 2024-09-14T11:36:28.041 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.042+0000 7fe935939800 20 remove_watcher() i=6 2024-09-14T11:36:28.042 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.043+0000 7fe935939800 20 remove_watcher() i=7 2024-09-14T11:36:28.053 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:36:28.089 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:28.089 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:28.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.127+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 realm 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.129+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.130+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:28.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.130+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.131+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:28.130 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.131+0000 7f979f22b800 20 searching for the correct realm 2024-09-14T11:36:28.131 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.133+0000 7f979d516640 0 -- 172.21.15.130:0/249374090 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f978800a460 msgr2=0x7f978800a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:28.337 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.339+0000 7f979d516640 0 -- 172.21.15.130:0/249374090 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f978800a460 msgr2=0x7f978800a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:28.343 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.344 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.343+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 zone default found 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 4 Realm: () 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 zonegroup default 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.345 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 started sync module instance, tier type = 2024-09-14T11:36:28.346 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.344+0000 7f979f22b800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=0 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=1 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=2 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=3 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=4 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=5 2024-09-14T11:36:28.353 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.354+0000 7f979f22b800 20 add_watcher() i=6 2024-09-14T11:36:28.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.355+0000 7f979f22b800 20 add_watcher() i=7 2024-09-14T11:36:28.354 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.355+0000 7f979f22b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f9652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f979f22b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f979f22b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f979f22b800 5 note: GC not initialized 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f9651fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f979f22b800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:28.357 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.357+0000 7f979f22b800 20 Filter name: none 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f95c37fe640 20 reqs_thread_entry: start 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 : miss 2024-09-14T11:36:28.358 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.358+0000 7f979f22b800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 info.flags=0x17 2024-09-14T11:36:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 adding default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 to cache LRU end 2024-09-14T11:36:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:28.360 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:a588039c-1457-497f-adbd-8890a12279b7.4508.19 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.0 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.0 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.1 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.359+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.1 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.360+0000 7f979f22b800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:36:28.361 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.360+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.2 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.360+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.2 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.3 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.3 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.4 2024-09-14T11:36:28.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.361+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.4 2024-09-14T11:36:28.363 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.5 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.5 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.6 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.362+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.6 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.363+0000 7f979f22b800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.363+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.7 2024-09-14T11:36:28.364 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.363+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.7 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.8 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.8 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.364+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.365+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.10 2024-09-14T11:36:28.365 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.365+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.10 2024-09-14T11:36:28.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:36:28.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.11 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.11 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.12 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.366+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.12 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.13 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.13 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.14 2024-09-14T11:36:28.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.367+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.14 2024-09-14T11:36:28.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:36:28.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.15 2024-09-14T11:36:28.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.15 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 10 bucket_obj is .dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.16 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.368+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.16 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.369+0000 7f979f22b800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.369+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.369+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:x state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.370+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to 04ncnwpjcab54yfmljer8qvmdpnh6ncq 2024-09-14T11:36:28.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.370+0000 7f979f22b800 20 get_obj_state_impl: setting s->olh_tag to moh2jt735m6f4aiko0oi4ou4738tkazg 2024-09-14T11:36:28.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.370+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=moh2jt735m6f4aiko0oi4ou4738tkazg 2024-09-14T11:36:28.370 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.371+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.373+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.373+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:36:28.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.373+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=3 key=x[k3OZlyUUt.pgvarSiIZPZcslmOdlqWi] 2024-09-14T11:36:28.372 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.373+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:k3OZlyUUt.pgvarSiIZPZcslmOdlqWi_x state=0x563c7a31fc08 s->prefetch_data=0 2024-09-14T11:36:28.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.374+0000 7f979f22b800 10 manifest: total_size = 9 2024-09-14T11:36:28.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.374+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.1795797586540768286 2024-09-14T11:36:28.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.374+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:k3OZlyUUt.pgvarSiIZPZcslmOdlqWi_x state=0x563c7a31fc08 s->prefetch_data=0 2024-09-14T11:36:28.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.374+0000 7f979f22b800 20 prepare_atomic_modification: state is not atomic. state=0x563c7a31fc08 2024-09-14T11:36:28.373 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.374+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.376 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.378+0000 7f9673fff640 20 handle_completion(): completion ok for obj=x[k3OZlyUUt.pgvarSiIZPZcslmOdlqWi] 2024-09-14T11:36:28.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.378+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:x state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.377 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.378+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=moh2jt735m6f4aiko0oi4ou4738tkazg 2024-09-14T11:36:28.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.381+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.382+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.382+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.381 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.383+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:y state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.383+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to ym1mck5u1ntb54t7k3e6tbf851t5t1uj 2024-09-14T11:36:28.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.383+0000 7f979f22b800 20 get_obj_state_impl: setting s->olh_tag to 79zqy99wfht2yopxt6r8asqmufefwq5o 2024-09-14T11:36:28.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.383+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=79zqy99wfht2yopxt6r8asqmufefwq5o 2024-09-14T11:36:28.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.384+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:36:28.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=3 key=y[oNmuSgR9wUTIiElXYYZ9FtOz7iCznZP] 2024-09-14T11:36:28.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:oNmuSgR9wUTIiElXYYZ9FtOz7iCznZP_y state=0x563c7a31fc08 s->prefetch_data=0 2024-09-14T11:36:28.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 10 manifest: total_size = 9 2024-09-14T11:36:28.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.15863655050484787236 2024-09-14T11:36:28.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:oNmuSgR9wUTIiElXYYZ9FtOz7iCznZP_y state=0x563c7a31fc08 s->prefetch_data=0 2024-09-14T11:36:28.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 prepare_atomic_modification: state is not atomic. state=0x563c7a31fc08 2024-09-14T11:36:28.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.386+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.390+0000 7f9673fff640 20 handle_completion(): completion ok for obj=y[oNmuSgR9wUTIiElXYYZ9FtOz7iCznZP] 2024-09-14T11:36:28.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.390+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:y state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.390+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=79zqy99wfht2yopxt6r8asqmufefwq5o 2024-09-14T11:36:28.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.393+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.394+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.395+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.395+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:z state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.396+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to rto477267goh932l4zabigfsp7ktfd9p 2024-09-14T11:36:28.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.396+0000 7f979f22b800 20 get_obj_state_impl: setting s->olh_tag to 7he7ezig734072gx0l3qe206d3gh7g87 2024-09-14T11:36:28.394 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.396+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7he7ezig734072gx0l3qe206d3gh7g87 2024-09-14T11:36:28.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.397+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.398+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 olh_log_entry: epoch=2 op=3 key=z[WKD9aedzXwu.26XEHlZWq5ewJP1aMU5] 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:WKD9aedzXwu.26XEHlZWq5ewJP1aMU5_z state=0x563c7a328628 s->prefetch_data=0 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 10 manifest: total_size = 12 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 get_obj_state: setting s->obj_tag to a588039c-1457-497f-adbd-8890a12279b7.4508.16983737887091925030 2024-09-14T11:36:28.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:_:WKD9aedzXwu.26XEHlZWq5ewJP1aMU5_z state=0x563c7a328628 s->prefetch_data=0 2024-09-14T11:36:28.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 prepare_atomic_modification: state is not atomic. state=0x563c7a328628 2024-09-14T11:36:28.399 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.399+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.403+0000 7f96737fe640 20 handle_completion(): completion ok for obj=z[WKD9aedzXwu.26XEHlZWq5ewJP1aMU5] 2024-09-14T11:36:28.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.403+0000 7f979f22b800 20 get_obj_state: octx=0x563c7a016300 obj=myver:z state=0x563c7a2dd438 s->prefetch_data=0 2024-09-14T11:36:28.402 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.403+0000 7f979f22b800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7he7ezig734072gx0l3qe206d3gh7g87 2024-09-14T11:36:28.405 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.406+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.407+0000 7f979f22b800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.19.3.9 2024-09-14T11:36:28.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.407+0000 7f979f22b800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:36:28.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.407+0000 7f979f22b800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:36:28.407 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.408+0000 7f9652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:28.410 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.411+0000 7f979f22b800 20 remove_watcher() i=0 2024-09-14T11:36:28.412 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.411+0000 7f979f22b800 2 removed watcher, disabling cache 2024-09-14T11:36:28.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.412+0000 7f979f22b800 20 remove_watcher() i=1 2024-09-14T11:36:28.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.413+0000 7f979f22b800 20 remove_watcher() i=2 2024-09-14T11:36:28.413 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.414+0000 7f979f22b800 20 remove_watcher() i=3 2024-09-14T11:36:28.414 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.415+0000 7f979f22b800 20 remove_watcher() i=4 2024-09-14T11:36:28.415 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.417+0000 7f979f22b800 20 remove_watcher() i=5 2024-09-14T11:36:28.416 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.418+0000 7f979f22b800 20 remove_watcher() i=6 2024-09-14T11:36:28.417 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.419+0000 7f979f22b800 20 remove_watcher() i=7 2024-09-14T11:36:28.430 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:28.430 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:28.435 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:28.435 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:28.478 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:36:28.507 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:28.507 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:28.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.748+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 realm 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.749 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.750+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.751+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:28.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.751+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.752+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:28.750 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.752+0000 7ff27d214800 20 searching for the correct realm 2024-09-14T11:36:28.751 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.752+0000 7ff2788cb640 0 -- 172.21.15.130:0/1328634057 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x55ef41cb83c0 msgr2=0x7ff274067450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:28.957 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.958+0000 7ff2700ca640 0 -- 172.21.15.130:0/1328634057 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7ff26804f030 msgr2=0x7ff26801a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:28.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:28.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:28.965 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.966 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 zone default found 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 4 Realm: () 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 zonegroup default 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.965+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.967 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:28.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 started sync module instance, tier type = 2024-09-14T11:36:28.968 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.966+0000 7ff27d214800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:28.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=0 2024-09-14T11:36:28.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=1 2024-09-14T11:36:28.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=2 2024-09-14T11:36:28.977 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=3 2024-09-14T11:36:28.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=4 2024-09-14T11:36:28.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=5 2024-09-14T11:36:28.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.978+0000 7ff27d214800 20 add_watcher() i=6 2024-09-14T11:36:28.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.979+0000 7ff27d214800 20 add_watcher() i=7 2024-09-14T11:36:28.978 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.979+0000 7ff27d214800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.981+0000 7ff12efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.981+0000 7ff27d214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.981+0000 7ff27d214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.981+0000 7ff27d214800 5 note: GC not initialized 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.981+0000 7ff12dfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff27d214800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:28.981 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff27d214800 20 Filter name: none 2024-09-14T11:36:28.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff09f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:28.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:28.982 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.982+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:28.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:28.983 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:28.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 rados->read ofs=0 len=0 2024-09-14T11:36:28.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:28.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.983+0000 7ff27d214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:28.984 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.985+0000 7ff12efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:28.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.987+0000 7ff27d214800 20 remove_watcher() i=0 2024-09-14T11:36:28.986 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.987+0000 7ff27d214800 2 removed watcher, disabling cache 2024-09-14T11:36:28.987 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.988+0000 7ff27d214800 20 remove_watcher() i=1 2024-09-14T11:36:28.989 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.990+0000 7ff27d214800 20 remove_watcher() i=2 2024-09-14T11:36:28.990 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.991+0000 7ff27d214800 20 remove_watcher() i=3 2024-09-14T11:36:28.991 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.992+0000 7ff27d214800 20 remove_watcher() i=4 2024-09-14T11:36:28.992 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.993+0000 7ff27d214800 20 remove_watcher() i=5 2024-09-14T11:36:28.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.994+0000 7ff27d214800 20 remove_watcher() i=6 2024-09-14T11:36:28.993 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:36:28.995+0000 7ff27d214800 20 remove_watcher() i=7 2024-09-14T11:36:29.004 INFO:tasks.workunit.client.0.smithi130.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:36:29.004 INFO:tasks.workunit.client.0.smithi130.stderr:Deleting bucket a-bucket 2024-09-14T11:36:29.006 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:29.006 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:29.010 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:29.010 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:29.023 INFO:tasks.workunit.client.0.smithi130.stderr:Deleting bucket myver 2024-09-14T11:36:29.024 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:29.024 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:29.069 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:36:29.069 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:36:29.108 INFO:tasks.workunit.client.0.smithi130.stderr:Completed resharding tests 2024-09-14T11:36:29.108 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:36:29.108 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:36:29.108 INFO:tasks.workunit.client.0.smithi130.stdout:connected to https://localhost:443 2024-09-14T11:36:29.188 INFO:tasks.workunit.client.0.smithi130.stderr:+ deactivate 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ export PATH 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ hash -r 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:36:29.189 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:36:29.190 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:36:29.190 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset -f deactivate 2024-09-14T11:36:29.190 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo OK. 2024-09-14T11:36:29.191 INFO:tasks.workunit.client.0.smithi130.stdout:OK. 2024-09-14T11:36:29.192 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:36:29.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:36:29.270 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:36:29.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:36:29.680 DEBUG:teuthology.parallel:result is None 2024-09-14T11:36:29.680 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:29.725 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:29.725 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:36:29.794 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:36:29.794 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:36:29.810 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:36:29.810 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:36:29.810 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:36:29.810 DEBUG:teuthology.orchestra.run.smithi130:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:36:29.863 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:36:34.066 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:36:34.066 DEBUG:teuthology.orchestra.run.smithi130:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:36:35.951 INFO:teuthology.orchestra.run.smithi130.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:36:36.521 INFO:teuthology.orchestra.run.smithi130.stdout:Last metadata expiration check: 0:28:48 ago on Sat 14 Sep 2024 11:07:48 AM UTC. 2024-09-14T11:36:36.663 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:36:36.664 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout:Install 5 Packages 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:36.665 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 46 M 2024-09-14T11:36:36.666 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 166 M 2024-09-14T11:36:36.666 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-09-14T11:36:37.290 INFO:teuthology.orchestra.run.smithi130.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.1 MB/s | 426 kB 00:00 2024-09-14T11:36:37.451 INFO:teuthology.orchestra.run.smithi130.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 6.6 MB/s | 3.5 MB 00:00 2024-09-14T11:36:37.559 INFO:teuthology.orchestra.run.smithi130.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 15 MB/s | 9.3 MB 00:00 2024-09-14T11:36:37.584 INFO:teuthology.orchestra.run.smithi130.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 194 kB/s | 26 kB 00:00 2024-09-14T11:36:38.335 INFO:teuthology.orchestra.run.smithi130.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 31 MB/s | 32 MB 00:01 2024-09-14T11:36:38.335 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:36:38.335 INFO:teuthology.orchestra.run.smithi130.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-14T11:36:38.759 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-09-14T11:36:38.779 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-09-14T11:36:38.779 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-09-14T11:36:39.259 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-09-14T11:36:39.259 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-09-14T11:36:39.792 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:36:39.939 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-09-14T11:36:40.127 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:36:40.735 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:36:40.779 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:36:41.018 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:36:41.046 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:36:41.275 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:36:41.317 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:36:41.325 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:36:41.334 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:36:41.403 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:36:44.418 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:36:44.418 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:36:44.418 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:36:44.419 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:36:44.419 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:44.834 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-09-14T11:36:45.260 INFO:teuthology.orchestra.run.smithi130.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:36:45.340 INFO:teuthology.orchestra.run.smithi130.stderr:--2024-09-14 11:36:45-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:36:45.461 INFO:teuthology.orchestra.run.smithi130.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-14T11:36:45.475 INFO:teuthology.orchestra.run.smithi130.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-14T11:36:45.571 INFO:teuthology.orchestra.run.smithi130.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:36:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:36:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:--2024-09-14 11:36:45-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:36:45.572 INFO:teuthology.orchestra.run.smithi130.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-14T11:36:45.581 INFO:teuthology.orchestra.run.smithi130.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-14T11:36:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:36:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113638Z&X-Amz-Expires=300&X-Amz-Signature=e7fe995cf9437d6fc59d164b4ba00d8a0cee34710ba6954c1fc9f2111547bfcb&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:36:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:--2024-09-14 11:36:45-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T113638Z&X-Amz-Expires=300&X-Amz-Signature=e7fe995cf9437d6fc59d164b4ba00d8a0cee34710ba6954c1fc9f2111547bfcb&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:36:45.669 INFO:teuthology.orchestra.run.smithi130.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.108.133, ... 2024-09-14T11:36:45.682 INFO:teuthology.orchestra.run.smithi130.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-14T11:36:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:36:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:36:45.754 INFO:teuthology.orchestra.run.smithi130.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:36:45.754 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:36:45.769 INFO:teuthology.orchestra.run.smithi130.stderr: 0K .......... .......... .......... .......... .......... 0% 3.27M 28s 2024-09-14T11:36:45.782 INFO:teuthology.orchestra.run.smithi130.stderr: 50K .......... .......... .......... .......... .......... 0% 3.70M 26s 2024-09-14T11:36:45.790 INFO:teuthology.orchestra.run.smithi130.stderr: 100K .......... .......... .......... .......... .......... 0% 5.47M 23s 2024-09-14T11:36:45.793 INFO:teuthology.orchestra.run.smithi130.stderr: 150K .......... .......... .......... .......... .......... 0% 17.6M 18s 2024-09-14T11:36:45.795 INFO:teuthology.orchestra.run.smithi130.stderr: 200K .......... .......... .......... .......... .......... 0% 25.1M 15s 2024-09-14T11:36:45.803 INFO:teuthology.orchestra.run.smithi130.stderr: 250K .......... .......... .......... .......... .......... 0% 21.9M 14s 2024-09-14T11:36:45.804 INFO:teuthology.orchestra.run.smithi130.stderr: 300K .......... .......... .......... .......... .......... 0% 7.91M 13s 2024-09-14T11:36:45.806 INFO:teuthology.orchestra.run.smithi130.stderr: 350K .......... .......... .......... .......... .......... 0% 26.9M 12s 2024-09-14T11:36:45.808 INFO:teuthology.orchestra.run.smithi130.stderr: 400K .......... .......... .......... .......... .......... 0% 33.6M 11s 2024-09-14T11:36:45.808 INFO:teuthology.orchestra.run.smithi130.stderr: 450K .......... .......... .......... .......... .......... 0% 81.0M 10s 2024-09-14T11:36:45.809 INFO:teuthology.orchestra.run.smithi130.stderr: 500K .......... .......... .......... .......... .......... 0% 55.3M 9s 2024-09-14T11:36:45.810 INFO:teuthology.orchestra.run.smithi130.stderr: 550K .......... .......... .......... .......... .......... 0% 34.8M 9s 2024-09-14T11:36:45.815 INFO:teuthology.orchestra.run.smithi130.stderr: 600K .......... .......... .......... .......... .......... 0% 9.65M 9s 2024-09-14T11:36:45.816 INFO:teuthology.orchestra.run.smithi130.stderr: 650K .......... .......... .......... .......... .......... 0% 42.6M 8s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 700K .......... .......... .......... .......... .......... 0% 43.3M 8s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 750K .......... .......... .......... .......... .......... 0% 72.5M 7s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 800K .......... .......... .......... .......... .......... 0% 103M 7s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 850K .......... .......... .......... .......... .......... 0% 58.3M 7s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 900K .......... .......... .......... .......... .......... 1% 187M 6s 2024-09-14T11:36:45.825 INFO:teuthology.orchestra.run.smithi130.stderr: 950K .......... .......... .......... .......... .......... 1% 94.8M 6s 2024-09-14T11:36:45.826 INFO:teuthology.orchestra.run.smithi130.stderr: 1000K .......... .......... .......... .......... .......... 1% 75.7M 6s 2024-09-14T11:36:45.826 INFO:teuthology.orchestra.run.smithi130.stderr: 1050K .......... .......... .......... .......... .......... 1% 73.2M 6s 2024-09-14T11:36:45.826 INFO:teuthology.orchestra.run.smithi130.stderr: 1100K .......... .......... .......... .......... .......... 1% 65.4M 5s 2024-09-14T11:36:45.826 INFO:teuthology.orchestra.run.smithi130.stderr: 1150K .......... .......... .......... .......... .......... 1% 388M 5s 2024-09-14T11:36:45.826 INFO:teuthology.orchestra.run.smithi130.stderr: 1200K .......... .......... .......... .......... .......... 1% 103M 5s 2024-09-14T11:36:45.828 INFO:teuthology.orchestra.run.smithi130.stderr: 1250K .......... .......... .......... .......... .......... 1% 10.6M 5s 2024-09-14T11:36:45.828 INFO:teuthology.orchestra.run.smithi130.stderr: 1300K .......... .......... .......... .......... .......... 1% 241M 5s 2024-09-14T11:36:45.828 INFO:teuthology.orchestra.run.smithi130.stderr: 1350K .......... .......... .......... .......... .......... 1% 421M 5s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1400K .......... .......... .......... .......... .......... 1% 28.8M 5s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1450K .......... .......... .......... .......... .......... 1% 236M 5s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1500K .......... .......... .......... .......... .......... 1% 76.5M 5s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1550K .......... .......... .......... .......... .......... 1% 195M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1600K .......... .......... .......... .......... .......... 1% 436M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1650K .......... .......... .......... .......... .......... 1% 102M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1700K .......... .......... .......... .......... .......... 1% 121M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1750K .......... .......... .......... .......... .......... 1% 145M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1800K .......... .......... .......... .......... .......... 1% 116M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1850K .......... .......... .......... .......... .......... 2% 431M 4s 2024-09-14T11:36:47.065 INFO:teuthology.orchestra.run.smithi130.stderr: 1900K .......... .......... .......... .......... .......... 2% 142M 4s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 1950K .......... .......... .......... .......... .......... 2% 137M 4s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2000K .......... .......... .......... .......... .......... 2% 141M 4s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2050K .......... .......... .......... .......... .......... 2% 365M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2100K .......... .......... .......... .......... .......... 2% 122M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2150K .......... .......... .......... .......... .......... 2% 198M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2200K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2250K .......... .......... .......... .......... .......... 2% 164M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2300K .......... .......... .......... .......... .......... 2% 436M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2350K .......... .......... .......... .......... .......... 2% 149M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2400K .......... .......... .......... .......... .......... 2% 190M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2450K .......... .......... .......... .......... .......... 2% 96.8M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2500K .......... .......... .......... .......... .......... 2% 185M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2550K .......... .......... .......... .......... .......... 2% 14.1M 3s 2024-09-14T11:36:47.066 INFO:teuthology.orchestra.run.smithi130.stderr: 2600K .......... .......... .......... .......... .......... 2% 438M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2650K .......... .......... .......... .......... .......... 2% 383M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2700K .......... .......... .......... .......... .......... 2% 232M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2750K .......... .......... .......... .......... .......... 3% 396M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2800K .......... .......... .......... .......... .......... 3% 38.0M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2850K .......... .......... .......... .......... .......... 3% 429M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2900K .......... .......... .......... .......... .......... 3% 275M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 2950K .......... .......... .......... .......... .......... 3% 186M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3000K .......... .......... .......... .......... .......... 3% 294M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3050K .......... .......... .......... .......... .......... 3% 223M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3100K .......... .......... .......... .......... .......... 3% 321M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3150K .......... .......... .......... .......... .......... 3% 293M 3s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3200K .......... .......... .......... .......... .......... 3% 213M 2s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3250K .......... .......... .......... .......... .......... 3% 446M 2s 2024-09-14T11:36:47.067 INFO:teuthology.orchestra.run.smithi130.stderr: 3300K .......... .......... .......... .......... .......... 3% 246M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3350K .......... .......... .......... .......... .......... 3% 180M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3400K .......... .......... .......... .......... .......... 3% 314M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3450K .......... .......... .......... .......... .......... 3% 377M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3500K .......... .......... .......... .......... .......... 3% 228M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3550K .......... .......... .......... .......... .......... 3% 250M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3600K .......... .......... .......... .......... .......... 3% 362M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3650K .......... .......... .......... .......... .......... 3% 386M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3700K .......... .......... .......... .......... .......... 4% 308M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3750K .......... .......... .......... .......... .......... 4% 335M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3800K .......... .......... .......... .......... .......... 4% 310M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3850K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3900K .......... .......... .......... .......... .......... 4% 203M 2s 2024-09-14T11:36:47.068 INFO:teuthology.orchestra.run.smithi130.stderr: 3950K .......... .......... .......... .......... .......... 4% 435M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4000K .......... .......... .......... .......... .......... 4% 460M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4050K .......... .......... .......... .......... .......... 4% 255M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4100K .......... .......... .......... .......... .......... 4% 475M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4150K .......... .......... .......... .......... .......... 4% 326M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4200K .......... .......... .......... .......... .......... 4% 345M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4250K .......... .......... .......... .......... .......... 4% 262M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4300K .......... .......... .......... .......... .......... 4% 309M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4350K .......... .......... .......... .......... .......... 4% 382M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4400K .......... .......... .......... .......... .......... 4% 487M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4450K .......... .......... .......... .......... .......... 4% 411M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4500K .......... .......... .......... .......... .......... 4% 311M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4550K .......... .......... .......... .......... .......... 4% 388M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4600K .......... .......... .......... .......... .......... 5% 272M 2s 2024-09-14T11:36:47.069 INFO:teuthology.orchestra.run.smithi130.stderr: 4650K .......... .......... .......... .......... .......... 5% 368M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4700K .......... .......... .......... .......... .......... 5% 431M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4750K .......... .......... .......... .......... .......... 5% 336M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4800K .......... .......... .......... .......... .......... 5% 442M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4850K .......... .......... .......... .......... .......... 5% 471M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4900K .......... .......... .......... .......... .......... 5% 481M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 4950K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5000K .......... .......... .......... .......... .......... 5% 338M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5050K .......... .......... .......... .......... .......... 5% 15.8M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5100K .......... .......... .......... .......... .......... 5% 243M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5150K .......... .......... .......... .......... .......... 5% 454M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5200K .......... .......... .......... .......... .......... 5% 433M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5250K .......... .......... .......... .......... .......... 5% 381M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5300K .......... .......... .......... .......... .......... 5% 302M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5350K .......... .......... .......... .......... .......... 5% 430M 2s 2024-09-14T11:36:47.070 INFO:teuthology.orchestra.run.smithi130.stderr: 5400K .......... .......... .......... .......... .......... 5% 426M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5450K .......... .......... .......... .......... .......... 5% 360M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5500K .......... .......... .......... .......... .......... 5% 458M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5550K .......... .......... .......... .......... .......... 6% 472M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5600K .......... .......... .......... .......... .......... 6% 47.5M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5650K .......... .......... .......... .......... .......... 6% 350M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5700K .......... .......... .......... .......... .......... 6% 442M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5750K .......... .......... .......... .......... .......... 6% 439M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5800K .......... .......... .......... .......... .......... 6% 362M 2s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5850K .......... .......... .......... .......... .......... 6% 352M 1s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5900K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 5950K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 6000K .......... .......... .......... .......... .......... 6% 362M 1s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 6050K .......... .......... .......... .......... .......... 6% 433M 1s 2024-09-14T11:36:47.071 INFO:teuthology.orchestra.run.smithi130.stderr: 6100K .......... .......... .......... .......... .......... 6% 384M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6150K .......... .......... .......... .......... .......... 6% 368M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6200K .......... .......... .......... .......... .......... 6% 421M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6250K .......... .......... .......... .......... .......... 6% 456M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6300K .......... .......... .......... .......... .......... 6% 372M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6350K .......... .......... .......... .......... .......... 6% 444M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6400K .......... .......... .......... .......... .......... 6% 438M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6450K .......... .......... .......... .......... .......... 6% 450M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6500K .......... .......... .......... .......... .......... 7% 402M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6550K .......... .......... .......... .......... .......... 7% 440M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6600K .......... .......... .......... .......... .......... 7% 441M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6650K .......... .......... .......... .......... .......... 7% 217M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6700K .......... .......... .......... .......... .......... 7% 362M 1s 2024-09-14T11:36:47.072 INFO:teuthology.orchestra.run.smithi130.stderr: 6750K .......... .......... .......... .......... .......... 7% 467M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 6800K .......... .......... .......... .......... .......... 7% 97.2M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 6850K .......... .......... .......... .......... .......... 7% 348M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 6900K .......... .......... .......... .......... .......... 7% 444M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 6950K .......... .......... .......... .......... .......... 7% 451M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7000K .......... .......... .......... .......... .......... 7% 77.5M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7050K .......... .......... .......... .......... .......... 7% 421M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7100K .......... .......... .......... .......... .......... 7% 340M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7150K .......... .......... .......... .......... .......... 7% 439M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7200K .......... .......... .......... .......... .......... 7% 442M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7250K .......... .......... .......... .......... .......... 7% 431M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7300K .......... .......... .......... .......... .......... 7% 397M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7350K .......... .......... .......... .......... .......... 7% 439M 1s 2024-09-14T11:36:47.073 INFO:teuthology.orchestra.run.smithi130.stderr: 7400K .......... .......... .......... .......... .......... 8% 429M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7450K .......... .......... .......... .......... .......... 8% 407M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7500K .......... .......... .......... .......... .......... 8% 374M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7550K .......... .......... .......... .......... .......... 8% 450M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7600K .......... .......... .......... .......... .......... 8% 429M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7650K .......... .......... .......... .......... .......... 8% 446M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7700K .......... .......... .......... .......... .......... 8% 456M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7750K .......... .......... .......... .......... .......... 8% 380M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7800K .......... .......... .......... .......... .......... 8% 222M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7850K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7900K .......... .......... .......... .......... .......... 8% 436M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 7950K .......... .......... .......... .......... .......... 8% 397M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 8000K .......... .......... .......... .......... .......... 8% 466M 1s 2024-09-14T11:36:47.074 INFO:teuthology.orchestra.run.smithi130.stderr: 8050K .......... .......... .......... .......... .......... 8% 448M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8100K .......... .......... .......... .......... .......... 8% 459M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8150K .......... .......... .......... .......... .......... 8% 17.8M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8200K .......... .......... .......... .......... .......... 8% 63.1M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8250K .......... .......... .......... .......... .......... 8% 383M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8300K .......... .......... .......... .......... .......... 8% 447M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8350K .......... .......... .......... .......... .......... 9% 458M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8400K .......... .......... .......... .......... .......... 9% 421M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8450K .......... .......... .......... .......... .......... 9% 448M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8500K .......... .......... .......... .......... .......... 9% 466M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8550K .......... .......... .......... .......... .......... 9% 45.6M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8600K .......... .......... .......... .......... .......... 9% 376M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8650K .......... .......... .......... .......... .......... 9% 450M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8700K .......... .......... .......... .......... .......... 9% 451M 1s 2024-09-14T11:36:47.075 INFO:teuthology.orchestra.run.smithi130.stderr: 8750K .......... .......... .......... .......... .......... 9% 395M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 8800K .......... .......... .......... .......... .......... 9% 441M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 8850K .......... .......... .......... .......... .......... 9% 453M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 8900K .......... .......... .......... .......... .......... 9% 403M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 8950K .......... .......... .......... .......... .......... 9% 442M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9000K .......... .......... .......... .......... .......... 9% 307M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9050K .......... .......... .......... .......... .......... 9% 456M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9100K .......... .......... .......... .......... .......... 9% 433M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9150K .......... .......... .......... .......... .......... 9% 390M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9200K .......... .......... .......... .......... .......... 9% 480M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9250K .......... .......... .......... .......... .......... 10% 397M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9300K .......... .......... .......... .......... .......... 10% 406M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9350K .......... .......... .......... .......... .......... 10% 449M 1s 2024-09-14T11:36:47.076 INFO:teuthology.orchestra.run.smithi130.stderr: 9400K .......... .......... .......... .......... .......... 10% 367M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9450K .......... .......... .......... .......... .......... 10% 427M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9500K .......... .......... .......... .......... .......... 10% 324M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9550K .......... .......... .......... .......... .......... 10% 466M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9600K .......... .......... .......... .......... .......... 10% 457M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9650K .......... .......... .......... .......... .......... 10% 460M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9700K .......... .......... .......... .......... .......... 10% 421M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9750K .......... .......... .......... .......... .......... 10% 458M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9800K .......... .......... .......... .......... .......... 10% 404M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9850K .......... .......... .......... .......... .......... 10% 131M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9900K .......... .......... .......... .......... .......... 10% 289M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 9950K .......... .......... .......... .......... .......... 10% 72.8M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 10000K .......... .......... .......... .......... .......... 10% 342M 1s 2024-09-14T11:36:47.077 INFO:teuthology.orchestra.run.smithi130.stderr: 10050K .......... .......... .......... .......... .......... 10% 452M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10100K .......... .......... .......... .......... .......... 10% 97.8M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10150K .......... .......... .......... .......... .......... 10% 341M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10200K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10250K .......... .......... .......... .......... .......... 11% 404M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10300K .......... .......... .......... .......... .......... 11% 374M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10350K .......... .......... .......... .......... .......... 11% 449M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10400K .......... .......... .......... .......... .......... 11% 445M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10450K .......... .......... .......... .......... .......... 11% 456M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10500K .......... .......... .......... .......... .......... 11% 393M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10550K .......... .......... .......... .......... .......... 11% 371M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10600K .......... .......... .......... .......... .......... 11% 441M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10650K .......... .......... .......... .......... .......... 11% 441M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10700K .......... .......... .......... .......... .......... 11% 335M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10750K .......... .......... .......... .......... .......... 11% 459M 1s 2024-09-14T11:36:47.078 INFO:teuthology.orchestra.run.smithi130.stderr: 10800K .......... .......... .......... .......... .......... 11% 456M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 10850K .......... .......... .......... .......... .......... 11% 434M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 10900K .......... .......... .......... .......... .......... 11% 416M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 10950K .......... .......... .......... .......... .......... 11% 446M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11000K .......... .......... .......... .......... .......... 11% 373M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11050K .......... .......... .......... .......... .......... 11% 457M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11100K .......... .......... .......... .......... .......... 12% 86.5M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11150K .......... .......... .......... .......... .......... 12% 412M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11200K .......... .......... .......... .......... .......... 12% 433M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11250K .......... .......... .......... .......... .......... 12% 18.1M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11300K .......... .......... .......... .......... .......... 12% 207M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11350K .......... .......... .......... .......... .......... 12% 355M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11400K .......... .......... .......... .......... .......... 12% 359M 1s 2024-09-14T11:36:47.079 INFO:teuthology.orchestra.run.smithi130.stderr: 11450K .......... .......... .......... .......... .......... 12% 393M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11500K .......... .......... .......... .......... .......... 12% 377M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11550K .......... .......... .......... .......... .......... 12% 55.2M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11600K .......... .......... .......... .......... .......... 12% 426M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11650K .......... .......... .......... .......... .......... 12% 446M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11700K .......... .......... .......... .......... .......... 12% 180M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11750K .......... .......... .......... .......... .......... 12% 155M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11800K .......... .......... .......... .......... .......... 12% 241M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11850K .......... .......... .......... .......... .......... 12% 443M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11900K .......... .......... .......... .......... .......... 12% 374M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 11950K .......... .......... .......... .......... .......... 12% 421M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 12000K .......... .......... .......... .......... .......... 12% 448M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 12050K .......... .......... .......... .......... .......... 13% 453M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 12100K .......... .......... .......... .......... .......... 13% 330M 1s 2024-09-14T11:36:47.080 INFO:teuthology.orchestra.run.smithi130.stderr: 12150K .......... .......... .......... .......... .......... 13% 436M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12200K .......... .......... .......... .......... .......... 13% 385M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12250K .......... .......... .......... .......... .......... 13% 441M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12300K .......... .......... .......... .......... .......... 13% 389M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12350K .......... .......... .......... .......... .......... 13% 469M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12400K .......... .......... .......... .......... .......... 13% 450M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12450K .......... .......... .......... .......... .......... 13% 460M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12500K .......... .......... .......... .......... .......... 13% 344M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12550K .......... .......... .......... .......... .......... 13% 439M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12600K .......... .......... .......... .......... .......... 13% 428M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12650K .......... .......... .......... .......... .......... 13% 386M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12700K .......... .......... .......... .......... .......... 13% 383M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12750K .......... .......... .......... .......... .......... 13% 430M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12800K .......... .......... .......... .......... .......... 13% 467M 1s 2024-09-14T11:36:47.081 INFO:teuthology.orchestra.run.smithi130.stderr: 12850K .......... .......... .......... .......... .......... 13% 444M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 12900K .......... .......... .......... .......... .......... 13% 409M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 12950K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13000K .......... .......... .......... .......... .......... 14% 444M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13050K .......... .......... .......... .......... .......... 14% 77.0M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13100K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13150K .......... .......... .......... .......... .......... 14% 103M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13200K .......... .......... .......... .......... .......... 14% 428M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13250K .......... .......... .......... .......... .......... 14% 464M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13300K .......... .......... .......... .......... .......... 14% 101M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13350K .......... .......... .......... .......... .......... 14% 436M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13400K .......... .......... .......... .......... .......... 14% 406M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13450K .......... .......... .......... .......... .......... 14% 469M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13500K .......... .......... .......... .......... .......... 14% 386M 1s 2024-09-14T11:36:47.082 INFO:teuthology.orchestra.run.smithi130.stderr: 13550K .......... .......... .......... .......... .......... 14% 458M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13600K .......... .......... .......... .......... .......... 14% 474M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13650K .......... .......... .......... .......... .......... 14% 471M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13700K .......... .......... .......... .......... .......... 14% 347M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13750K .......... .......... .......... .......... .......... 14% 451M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13800K .......... .......... .......... .......... .......... 14% 416M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13850K .......... .......... .......... .......... .......... 14% 391M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13900K .......... .......... .......... .......... .......... 15% 393M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 13950K .......... .......... .......... .......... .......... 15% 469M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14000K .......... .......... .......... .......... .......... 15% 466M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14050K .......... .......... .......... .......... .......... 15% 148M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14100K .......... .......... .......... .......... .......... 15% 377M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14150K .......... .......... .......... .......... .......... 15% 439M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14200K .......... .......... .......... .......... .......... 15% 436M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14250K .......... .......... .......... .......... .......... 15% 436M 1s 2024-09-14T11:36:47.083 INFO:teuthology.orchestra.run.smithi130.stderr: 14300K .......... .......... .......... .......... .......... 15% 36.3M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14350K .......... .......... .......... .......... .......... 15% 45.0M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14400K .......... .......... .......... .......... .......... 15% 162M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14450K .......... .......... .......... .......... .......... 15% 109M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14500K .......... .......... .......... .......... .......... 15% 372M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14550K .......... .......... .......... .......... .......... 15% 71.4M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14600K .......... .......... .......... .......... .......... 15% 329M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14650K .......... .......... .......... .......... .......... 15% 466M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14700K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14750K .......... .......... .......... .......... .......... 15% 346M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14800K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14850K .......... .......... .......... .......... .......... 16% 451M 1s 2024-09-14T11:36:47.084 INFO:teuthology.orchestra.run.smithi130.stderr: 14900K .......... .......... .......... .......... .......... 16% 70.5M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 14950K .......... .......... .......... .......... .......... 16% 443M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15000K .......... .......... .......... .......... .......... 16% 393M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15050K .......... .......... .......... .......... .......... 16% 444M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15100K .......... .......... .......... .......... .......... 16% 412M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15150K .......... .......... .......... .......... .......... 16% 452M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15200K .......... .......... .......... .......... .......... 16% 458M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15250K .......... .......... .......... .......... .......... 16% 448M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15300K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15350K .......... .......... .......... .......... .......... 16% 384M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15400K .......... .......... .......... .......... .......... 16% 378M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15450K .......... .......... .......... .......... .......... 16% 444M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15500K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15550K .......... .......... .......... .......... .......... 16% 437M 1s 2024-09-14T11:36:47.085 INFO:teuthology.orchestra.run.smithi130.stderr: 15600K .......... .......... .......... .......... .......... 16% 453M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15650K .......... .......... .......... .......... .......... 16% 429M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15700K .......... .......... .......... .......... .......... 16% 344M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15750K .......... .......... .......... .......... .......... 17% 427M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15800K .......... .......... .......... .......... .......... 17% 383M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15850K .......... .......... .......... .......... .......... 17% 472M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15900K .......... .......... .......... .......... .......... 17% 422M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 15950K .......... .......... .......... .......... .......... 17% 466M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16000K .......... .......... .......... .......... .......... 17% 115M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16050K .......... .......... .......... .......... .......... 17% 308M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16100K .......... .......... .......... .......... .......... 17% 382M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16150K .......... .......... .......... .......... .......... 17% 453M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16200K .......... .......... .......... .......... .......... 17% 459M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16250K .......... .......... .......... .......... .......... 17% 169M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16300K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-14T11:36:47.086 INFO:teuthology.orchestra.run.smithi130.stderr: 16350K .......... .......... .......... .......... .......... 17% 116M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16400K .......... .......... .......... .......... .......... 17% 462M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16450K .......... .......... .......... .......... .......... 17% 454M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16500K .......... .......... .......... .......... .......... 17% 362M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16550K .......... .......... .......... .......... .......... 17% 326M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16600K .......... .......... .......... .......... .......... 17% 369M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16650K .......... .......... .......... .......... .......... 17% 181M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16700K .......... .......... .......... .......... .......... 18% 374M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16750K .......... .......... .......... .......... .......... 18% 467M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16800K .......... .......... .......... .......... .......... 18% 440M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16850K .......... .......... .......... .......... .......... 18% 473M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16900K .......... .......... .......... .......... .......... 18% 129M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 16950K .......... .......... .......... .......... .......... 18% 447M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 17000K .......... .......... .......... .......... .......... 18% 403M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 17050K .......... .......... .......... .......... .......... 18% 459M 1s 2024-09-14T11:36:47.087 INFO:teuthology.orchestra.run.smithi130.stderr: 17100K .......... .......... .......... .......... .......... 18% 400M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17150K .......... .......... .......... .......... .......... 18% 448M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17200K .......... .......... .......... .......... .......... 18% 460M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17250K .......... .......... .......... .......... .......... 18% 453M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17300K .......... .......... .......... .......... .......... 18% 320M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17350K .......... .......... .......... .......... .......... 18% 50.2M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17400K .......... .......... .......... .......... .......... 18% 41.8M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17450K .......... .......... .......... .......... .......... 18% 278M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17500K .......... .......... .......... .......... .......... 18% 63.1M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17550K .......... .......... .......... .......... .......... 18% 437M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17600K .......... .......... .......... .......... .......... 18% 111M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17650K .......... .......... .......... .......... .......... 19% 205M 1s 2024-09-14T11:36:47.088 INFO:teuthology.orchestra.run.smithi130.stderr: 17700K .......... .......... .......... .......... .......... 19% 348M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 17750K .......... .......... .......... .......... .......... 19% 432M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 17800K .......... .......... .......... .......... .......... 19% 388M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 17850K .......... .......... .......... .......... .......... 19% 154M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 17900K .......... .......... .......... .......... .......... 19% 59.3M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 17950K .......... .......... .......... .......... .......... 19% 324M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18000K .......... .......... .......... .......... .......... 19% 409M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18050K .......... .......... .......... .......... .......... 19% 415M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18100K .......... .......... .......... .......... .......... 19% 324M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18150K .......... .......... .......... .......... .......... 19% 434M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18200K .......... .......... .......... .......... .......... 19% 360M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18250K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18300K .......... .......... .......... .......... .......... 19% 407M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18350K .......... .......... .......... .......... .......... 19% 410M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18400K .......... .......... .......... .......... .......... 19% 452M 1s 2024-09-14T11:36:47.089 INFO:teuthology.orchestra.run.smithi130.stderr: 18450K .......... .......... .......... .......... .......... 19% 464M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18500K .......... .......... .......... .......... .......... 19% 384M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18550K .......... .......... .......... .......... .......... 20% 401M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18600K .......... .......... .......... .......... .......... 20% 405M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18650K .......... .......... .......... .......... .......... 20% 377M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18700K .......... .......... .......... .......... .......... 20% 465M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18750K .......... .......... .......... .......... .......... 20% 409M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18800K .......... .......... .......... .......... .......... 20% 453M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18850K .......... .......... .......... .......... .......... 20% 474M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18900K .......... .......... .......... .......... .......... 20% 463M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 18950K .......... .......... .......... .......... .......... 20% 99.8M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 19000K .......... .......... .......... .......... .......... 20% 448M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 19050K .......... .......... .......... .......... .......... 20% 248M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 19100K .......... .......... .......... .......... .......... 20% 398M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 19150K .......... .......... .......... .......... .......... 20% 465M 1s 2024-09-14T11:36:47.090 INFO:teuthology.orchestra.run.smithi130.stderr: 19200K .......... .......... .......... .......... .......... 20% 337M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19250K .......... .......... .......... .......... .......... 20% 438M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19300K .......... .......... .......... .......... .......... 20% 392M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19350K .......... .......... .......... .......... .......... 20% 436M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19400K .......... .......... .......... .......... .......... 20% 164M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19450K .......... .......... .......... .......... .......... 20% 157M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19500K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19550K .......... .......... .......... .......... .......... 21% 460M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19600K .......... .......... .......... .......... .......... 21% 407M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19650K .......... .......... .......... .......... .......... 21% 468M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19700K .......... .......... .......... .......... .......... 21% 402M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19750K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19800K .......... .......... .......... .......... .......... 21% 448M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19850K .......... .......... .......... .......... .......... 21% 345M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19900K .......... .......... .......... .......... .......... 21% 128M 1s 2024-09-14T11:36:47.091 INFO:teuthology.orchestra.run.smithi130.stderr: 19950K .......... .......... .......... .......... .......... 21% 439M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20000K .......... .......... .......... .......... .......... 21% 460M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20050K .......... .......... .......... .......... .......... 21% 250M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20100K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20150K .......... .......... .......... .......... .......... 21% 433M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20200K .......... .......... .......... .......... .......... 21% 434M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20250K .......... .......... .......... .......... .......... 21% 401M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20300K .......... .......... .......... .......... .......... 21% 479M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20350K .......... .......... .......... .......... .......... 21% 65.0M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20400K .......... .......... .......... .......... .......... 22% 425M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20450K .......... .......... .......... .......... .......... 22% 44.3M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20500K .......... .......... .......... .......... .......... 22% 372M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20550K .......... .......... .......... .......... .......... 22% 57.1M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20600K .......... .......... .......... .......... .......... 22% 421M 1s 2024-09-14T11:36:47.092 INFO:teuthology.orchestra.run.smithi130.stderr: 20650K .......... .......... .......... .......... .......... 22% 106M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20700K .......... .......... .......... .......... .......... 22% 274M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20750K .......... .......... .......... .......... .......... 22% 454M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20800K .......... .......... .......... .......... .......... 22% 103M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20850K .......... .......... .......... .......... .......... 22% 335M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20900K .......... .......... .......... .......... .......... 22% 329M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 20950K .......... .......... .......... .......... .......... 22% 439M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21000K .......... .......... .......... .......... .......... 22% 41.1M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21050K .......... .......... .......... .......... .......... 22% 359M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21100K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21150K .......... .......... .......... .......... .......... 22% 431M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21200K .......... .......... .......... .......... .......... 22% 452M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21250K .......... .......... .......... .......... .......... 22% 353M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21300K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21350K .......... .......... .......... .......... .......... 23% 386M 1s 2024-09-14T11:36:47.093 INFO:teuthology.orchestra.run.smithi130.stderr: 21400K .......... .......... .......... .......... .......... 23% 444M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21450K .......... .......... .......... .......... .......... 23% 441M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21500K .......... .......... .......... .......... .......... 23% 371M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21550K .......... .......... .......... .......... .......... 23% 459M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21600K .......... .......... .......... .......... .......... 23% 457M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21650K .......... .......... .......... .......... .......... 23% 367M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21700K .......... .......... .......... .......... .......... 23% 385M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21750K .......... .......... .......... .......... .......... 23% 380M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21800K .......... .......... .......... .......... .......... 23% 457M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21850K .......... .......... .......... .......... .......... 23% 470M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21900K .......... .......... .......... .......... .......... 23% 391M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 21950K .......... .......... .......... .......... .......... 23% 437M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 22000K .......... .......... .......... .......... .......... 23% 465M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 22050K .......... .......... .......... .......... .......... 23% 459M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 22100K .......... .......... .......... .......... .......... 23% 125M 1s 2024-09-14T11:36:47.094 INFO:teuthology.orchestra.run.smithi130.stderr: 22150K .......... .......... .......... .......... .......... 23% 271M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22200K .......... .......... .......... .......... .......... 23% 449M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22250K .......... .......... .......... .......... .......... 24% 467M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22300K .......... .......... .......... .......... .......... 24% 380M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22350K .......... .......... .......... .......... .......... 24% 453M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22400K .......... .......... .......... .......... .......... 24% 371M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22450K .......... .......... .......... .......... .......... 24% 453M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22500K .......... .......... .......... .......... .......... 24% 148M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22550K .......... .......... .......... .......... .......... 24% 319M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22600K .......... .......... .......... .......... .......... 24% 458M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22650K .......... .......... .......... .......... .......... 24% 463M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22700K .......... .......... .......... .......... .......... 24% 316M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22750K .......... .......... .......... .......... .......... 24% 407M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22800K .......... .......... .......... .......... .......... 24% 247M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22850K .......... .......... .......... .......... .......... 24% 442M 1s 2024-09-14T11:36:47.095 INFO:teuthology.orchestra.run.smithi130.stderr: 22900K .......... .......... .......... .......... .......... 24% 426M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 22950K .......... .......... .......... .......... .......... 24% 160M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23000K .......... .......... .......... .......... .......... 24% 205M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23050K .......... .......... .......... .......... .......... 24% 443M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23100K .......... .......... .......... .......... .......... 24% 341M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23150K .......... .......... .......... .......... .......... 24% 116M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23200K .......... .......... .......... .......... .......... 25% 377M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23250K .......... .......... .......... .......... .......... 25% 376M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23300K .......... .......... .......... .......... .......... 25% 387M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23350K .......... .......... .......... .......... .......... 25% 134M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23400K .......... .......... .......... .......... .......... 25% 452M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23450K .......... .......... .......... .......... .......... 25% 472M 1s 2024-09-14T11:36:47.096 INFO:teuthology.orchestra.run.smithi130.stderr: 23500K .......... .......... .......... .......... .......... 25% 53.1M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23550K .......... .......... .......... .......... .......... 25% 457M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23600K .......... .......... .......... .......... .......... 25% 58.1M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23650K .......... .......... .......... .......... .......... 25% 134M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23700K .......... .......... .......... .......... .......... 25% 220M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23750K .......... .......... .......... .......... .......... 25% 462M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23800K .......... .......... .......... .......... .......... 25% 149M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23850K .......... .......... .......... .......... .......... 25% 141M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23900K .......... .......... .......... .......... .......... 25% 118M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 23950K .......... .......... .......... .......... .......... 25% 285M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24000K .......... .......... .......... .......... .......... 25% 486M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24050K .......... .......... .......... .......... .......... 25% 47.0M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24100K .......... .......... .......... .......... .......... 25% 106M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24150K .......... .......... .......... .......... .......... 26% 428M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24200K .......... .......... .......... .......... .......... 26% 465M 1s 2024-09-14T11:36:47.097 INFO:teuthology.orchestra.run.smithi130.stderr: 24250K .......... .......... .......... .......... .......... 26% 410M 1s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24300K .......... .......... .......... .......... .......... 26% 440M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24350K .......... .......... .......... .......... .......... 26% 460M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24400K .......... .......... .......... .......... .......... 26% 477M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24450K .......... .......... .......... .......... .......... 26% 235M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24500K .......... .......... .......... .......... .......... 26% 311M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24550K .......... .......... .......... .......... .......... 26% 397M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24600K .......... .......... .......... .......... .......... 26% 430M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24650K .......... .......... .......... .......... .......... 26% 426M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24700K .......... .......... .......... .......... .......... 26% 465M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24750K .......... .......... .......... .......... .......... 26% 397M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24800K .......... .......... .......... .......... .......... 26% 450M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24850K .......... .......... .......... .......... .......... 26% 384M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24900K .......... .......... .......... .......... .......... 26% 435M 0s 2024-09-14T11:36:47.098 INFO:teuthology.orchestra.run.smithi130.stderr: 24950K .......... .......... .......... .......... .......... 26% 338M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25000K .......... .......... .......... .......... .......... 26% 453M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25050K .......... .......... .......... .......... .......... 27% 458M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25100K .......... .......... .......... .......... .......... 27% 477M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25150K .......... .......... .......... .......... .......... 27% 430M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25200K .......... .......... .......... .......... .......... 27% 294M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25250K .......... .......... .......... .......... .......... 27% 377M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25300K .......... .......... .......... .......... .......... 27% 428M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25350K .......... .......... .......... .......... .......... 27% 337M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25400K .......... .......... .......... .......... .......... 27% 427M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25450K .......... .......... .......... .......... .......... 27% 471M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25500K .......... .......... .......... .......... .......... 27% 133M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25550K .......... .......... .......... .......... .......... 27% 253M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25600K .......... .......... .......... .......... .......... 27% 167M 0s 2024-09-14T11:36:47.099 INFO:teuthology.orchestra.run.smithi130.stderr: 25650K .......... .......... .......... .......... .......... 27% 269M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25700K .......... .......... .......... .......... .......... 27% 440M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25750K .......... .......... .......... .......... .......... 27% 474M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25800K .......... .......... .......... .......... .......... 27% 418M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25850K .......... .......... .......... .......... .......... 27% 455M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25900K .......... .......... .......... .......... .......... 27% 276M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 25950K .......... .......... .......... .......... .......... 27% 446M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26000K .......... .......... .......... .......... .......... 28% 443M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26050K .......... .......... .......... .......... .......... 28% 284M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26100K .......... .......... .......... .......... .......... 28% 384M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26150K .......... .......... .......... .......... .......... 28% 141M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26200K .......... .......... .......... .......... .......... 28% 426M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26250K .......... .......... .......... .......... .......... 28% 440M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26300K .......... .......... .......... .......... .......... 28% 125M 0s 2024-09-14T11:36:47.100 INFO:teuthology.orchestra.run.smithi130.stderr: 26350K .......... .......... .......... .......... .......... 28% 422M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26400K .......... .......... .......... .......... .......... 28% 441M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26450K .......... .......... .......... .......... .......... 28% 163M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26500K .......... .......... .......... .......... .......... 28% 253M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26550K .......... .......... .......... .......... .......... 28% 82.0M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26600K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26650K .......... .......... .......... .......... .......... 28% 51.4M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26700K .......... .......... .......... .......... .......... 28% 221M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26750K .......... .......... .......... .......... .......... 28% 168M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26800K .......... .......... .......... .......... .......... 28% 433M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26850K .......... .......... .......... .......... .......... 28% 401M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26900K .......... .......... .......... .......... .......... 29% 74.7M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 26950K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 27000K .......... .......... .......... .......... .......... 29% 333M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 27050K .......... .......... .......... .......... .......... 29% 198M 0s 2024-09-14T11:36:47.101 INFO:teuthology.orchestra.run.smithi130.stderr: 27100K .......... .......... .......... .......... .......... 29% 56.4M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27150K .......... .......... .......... .......... .......... 29% 72.8M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27200K .......... .......... .......... .......... .......... 29% 204M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27250K .......... .......... .......... .......... .......... 29% 181M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27300K .......... .......... .......... .......... .......... 29% 346M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27350K .......... .......... .......... .......... .......... 29% 316M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27400K .......... .......... .......... .......... .......... 29% 435M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27450K .......... .......... .......... .......... .......... 29% 389M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27500K .......... .......... .......... .......... .......... 29% 423M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27550K .......... .......... .......... .......... .......... 29% 422M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27600K .......... .......... .......... .......... .......... 29% 387M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27650K .......... .......... .......... .......... .......... 29% 385M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27700K .......... .......... .......... .......... .......... 29% 389M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27750K .......... .......... .......... .......... .......... 29% 451M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27800K .......... .......... .......... .......... .......... 29% 459M 0s 2024-09-14T11:36:47.102 INFO:teuthology.orchestra.run.smithi130.stderr: 27850K .......... .......... .......... .......... .......... 30% 396M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 27900K .......... .......... .......... .......... .......... 30% 440M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 27950K .......... .......... .......... .......... .......... 30% 402M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28000K .......... .......... .......... .......... .......... 30% 431M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28050K .......... .......... .......... .......... .......... 30% 422M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28100K .......... .......... .......... .......... .......... 30% 327M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28150K .......... .......... .......... .......... .......... 30% 416M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28200K .......... .......... .......... .......... .......... 30% 402M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28250K .......... .......... .......... .......... .......... 30% 461M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28300K .......... .......... .......... .......... .......... 30% 403M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28350K .......... .......... .......... .......... .......... 30% 276M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28400K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28450K .......... .......... .......... .......... .......... 30% 383M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28500K .......... .......... .......... .......... .......... 30% 453M 0s 2024-09-14T11:36:47.103 INFO:teuthology.orchestra.run.smithi130.stderr: 28550K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28600K .......... .......... .......... .......... .......... 30% 208M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28650K .......... .......... .......... .......... .......... 30% 441M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28700K .......... .......... .......... .......... .......... 30% 417M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28750K .......... .......... .......... .......... .......... 31% 197M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28800K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28850K .......... .......... .......... .......... .......... 31% 378M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28900K .......... .......... .......... .......... .......... 31% 475M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 28950K .......... .......... .......... .......... .......... 31% 422M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29000K .......... .......... .......... .......... .......... 31% 307M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29050K .......... .......... .......... .......... .......... 31% 437M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29100K .......... .......... .......... .......... .......... 31% 299M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29150K .......... .......... .......... .......... .......... 31% 290M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29200K .......... .......... .......... .......... .......... 31% 437M 0s 2024-09-14T11:36:47.104 INFO:teuthology.orchestra.run.smithi130.stderr: 29250K .......... .......... .......... .......... .......... 31% 131M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29300K .......... .......... .......... .......... .......... 31% 447M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29350K .......... .......... .......... .......... .......... 31% 103M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29400K .......... .......... .......... .......... .......... 31% 444M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29450K .......... .......... .......... .......... .......... 31% 429M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29500K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29550K .......... .......... .......... .......... .......... 31% 102M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29600K .......... .......... .......... .......... .......... 31% 218M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29650K .......... .......... .......... .......... .......... 31% 453M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29700K .......... .......... .......... .......... .......... 32% 52.3M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29750K .......... .......... .......... .......... .......... 32% 404M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29800K .......... .......... .......... .......... .......... 32% 434M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29850K .......... .......... .......... .......... .......... 32% 175M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29900K .......... .......... .......... .......... .......... 32% 224M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 29950K .......... .......... .......... .......... .......... 32% 90.9M 0s 2024-09-14T11:36:47.105 INFO:teuthology.orchestra.run.smithi130.stderr: 30000K .......... .......... .......... .......... .......... 32% 148M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30050K .......... .......... .......... .......... .......... 32% 404M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30100K .......... .......... .......... .......... .......... 32% 254M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30150K .......... .......... .......... .......... .......... 32% 65.3M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30200K .......... .......... .......... .......... .......... 32% 65.5M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30250K .......... .......... .......... .......... .......... 32% 208M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30300K .......... .......... .......... .......... .......... 32% 336M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30350K .......... .......... .......... .......... .......... 32% 145M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30400K .......... .......... .......... .......... .......... 32% 444M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30450K .......... .......... .......... .......... .......... 32% 123M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30500K .......... .......... .......... .......... .......... 32% 425M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30550K .......... .......... .......... .......... .......... 32% 408M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30600K .......... .......... .......... .......... .......... 32% 153M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30650K .......... .......... .......... .......... .......... 33% 436M 0s 2024-09-14T11:36:47.106 INFO:teuthology.orchestra.run.smithi130.stderr: 30700K .......... .......... .......... .......... .......... 33% 428M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 30750K .......... .......... .......... .......... .......... 33% 393M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 30800K .......... .......... .......... .......... .......... 33% 429M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 30850K .......... .......... .......... .......... .......... 33% 458M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 30900K .......... .......... .......... .......... .......... 33% 461M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 30950K .......... .......... .......... .......... .......... 33% 410M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31000K .......... .......... .......... .......... .......... 33% 441M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31050K .......... .......... .......... .......... .......... 33% 452M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31100K .......... .......... .......... .......... .......... 33% 460M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31150K .......... .......... .......... .......... .......... 33% 375M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31200K .......... .......... .......... .......... .......... 33% 142M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31250K .......... .......... .......... .......... .......... 33% 434M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31300K .......... .......... .......... .......... .......... 33% 444M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31350K .......... .......... .......... .......... .......... 33% 404M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31400K .......... .......... .......... .......... .......... 33% 451M 0s 2024-09-14T11:36:47.107 INFO:teuthology.orchestra.run.smithi130.stderr: 31450K .......... .......... .......... .......... .......... 33% 438M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31500K .......... .......... .......... .......... .......... 33% 368M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31550K .......... .......... .......... .......... .......... 34% 339M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31600K .......... .......... .......... .......... .......... 34% 419M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31650K .......... .......... .......... .......... .......... 34% 442M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31700K .......... .......... .......... .......... .......... 34% 370M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31750K .......... .......... .......... .......... .......... 34% 442M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31800K .......... .......... .......... .......... .......... 34% 441M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31850K .......... .......... .......... .......... .......... 34% 454M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31900K .......... .......... .......... .......... .......... 34% 456M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 31950K .......... .......... .......... .......... .......... 34% 385M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 32000K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 32050K .......... .......... .......... .......... .......... 34% 415M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 32100K .......... .......... .......... .......... .......... 34% 439M 0s 2024-09-14T11:36:47.108 INFO:teuthology.orchestra.run.smithi130.stderr: 32150K .......... .......... .......... .......... .......... 34% 449M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32200K .......... .......... .......... .......... .......... 34% 270M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32250K .......... .......... .......... .......... .......... 34% 115M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32300K .......... .......... .......... .......... .......... 34% 430M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32350K .......... .......... .......... .......... .......... 34% 173M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32400K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32450K .......... .......... .......... .......... .......... 34% 443M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32500K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32550K .......... .......... .......... .......... .......... 35% 381M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32600K .......... .......... .......... .......... .......... 35% 168M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32650K .......... .......... .......... .......... .......... 35% 355M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32700K .......... .......... .......... .......... .......... 35% 41.2M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32750K .......... .......... .......... .......... .......... 35% 429M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32800K .......... .......... .......... .......... .......... 35% 225M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32850K .......... .......... .......... .......... .......... 35% 407M 0s 2024-09-14T11:36:47.109 INFO:teuthology.orchestra.run.smithi130.stderr: 32900K .......... .......... .......... .......... .......... 35% 361M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 32950K .......... .......... .......... .......... .......... 35% 310M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33000K .......... .......... .......... .......... .......... 35% 67.8M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33050K .......... .......... .......... .......... .......... 35% 190M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33100K .......... .......... .......... .......... .......... 35% 391M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33150K .......... .......... .......... .......... .......... 35% 401M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33200K .......... .......... .......... .......... .......... 35% 49.6M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33250K .......... .......... .......... .......... .......... 35% 81.5M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33300K .......... .......... .......... .......... .......... 35% 340M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33350K .......... .......... .......... .......... .......... 35% 440M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33400K .......... .......... .......... .......... .......... 36% 128M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33450K .......... .......... .......... .......... .......... 36% 424M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33500K .......... .......... .......... .......... .......... 36% 78.3M 0s 2024-09-14T11:36:47.110 INFO:teuthology.orchestra.run.smithi130.stderr: 33550K .......... .......... .......... .......... .......... 36% 434M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33600K .......... .......... .......... .......... .......... 36% 447M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33650K .......... .......... .......... .......... .......... 36% 231M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33700K .......... .......... .......... .......... .......... 36% 204M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33750K .......... .......... .......... .......... .......... 36% 334M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33800K .......... .......... .......... .......... .......... 36% 423M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33850K .......... .......... .......... .......... .......... 36% 407M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33900K .......... .......... .......... .......... .......... 36% 443M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 33950K .......... .......... .......... .......... .......... 36% 390M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34000K .......... .......... .......... .......... .......... 36% 419M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34050K .......... .......... .......... .......... .......... 36% 432M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34100K .......... .......... .......... .......... .......... 36% 451M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34150K .......... .......... .......... .......... .......... 36% 205M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34200K .......... .......... .......... .......... .......... 36% 208M 0s 2024-09-14T11:36:47.111 INFO:teuthology.orchestra.run.smithi130.stderr: 34250K .......... .......... .......... .......... .......... 36% 429M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34300K .......... .......... .......... .......... .......... 36% 421M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34350K .......... .......... .......... .......... .......... 37% 441M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34400K .......... .......... .......... .......... .......... 37% 430M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34450K .......... .......... .......... .......... .......... 37% 381M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34500K .......... .......... .......... .......... .......... 37% 443M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34550K .......... .......... .......... .......... .......... 37% 449M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34600K .......... .......... .......... .......... .......... 37% 445M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34650K .......... .......... .......... .......... .......... 37% 407M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34700K .......... .......... .......... .......... .......... 37% 439M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34750K .......... .......... .......... .......... .......... 37% 452M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34800K .......... .......... .......... .......... .......... 37% 455M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34850K .......... .......... .......... .......... .......... 37% 355M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34900K .......... .......... .......... .......... .......... 37% 424M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 34950K .......... .......... .......... .......... .......... 37% 450M 0s 2024-09-14T11:36:47.112 INFO:teuthology.orchestra.run.smithi130.stderr: 35000K .......... .......... .......... .......... .......... 37% 449M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35050K .......... .......... .......... .......... .......... 37% 398M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35100K .......... .......... .......... .......... .......... 37% 397M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35150K .......... .......... .......... .......... .......... 37% 407M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35200K .......... .......... .......... .......... .......... 37% 436M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35250K .......... .......... .......... .......... .......... 37% 432M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35300K .......... .......... .......... .......... .......... 38% 279M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35350K .......... .......... .......... .......... .......... 38% 113M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35400K .......... .......... .......... .......... .......... 38% 251M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35450K .......... .......... .......... .......... .......... 38% 455M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35500K .......... .......... .......... .......... .......... 38% 174M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35550K .......... .......... .......... .......... .......... 38% 439M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35600K .......... .......... .......... .......... .......... 38% 307M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35650K .......... .......... .......... .......... .......... 38% 434M 0s 2024-09-14T11:36:47.113 INFO:teuthology.orchestra.run.smithi130.stderr: 35700K .......... .......... .......... .......... .......... 38% 360M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 35750K .......... .......... .......... .......... .......... 38% 51.1M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 35800K .......... .......... .......... .......... .......... 38% 89.5M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 35850K .......... .......... .......... .......... .......... 38% 438M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 35900K .......... .......... .......... .......... .......... 38% 433M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 35950K .......... .......... .......... .......... .......... 38% 458M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36000K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36050K .......... .......... .......... .......... .......... 38% 86.9M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36100K .......... .......... .......... .......... .......... 38% 223M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36150K .......... .......... .......... .......... .......... 38% 261M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36200K .......... .......... .......... .......... .......... 39% 228M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36250K .......... .......... .......... .......... .......... 39% 54.0M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36300K .......... .......... .......... .......... .......... 39% 95.2M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36350K .......... .......... .......... .......... .......... 39% 306M 0s 2024-09-14T11:36:47.114 INFO:teuthology.orchestra.run.smithi130.stderr: 36400K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36450K .......... .......... .......... .......... .......... 39% 148M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36500K .......... .......... .......... .......... .......... 39% 205M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36550K .......... .......... .......... .......... .......... 39% 76.3M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36600K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36650K .......... .......... .......... .......... .......... 39% 321M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36700K .......... .......... .......... .......... .......... 39% 459M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36750K .......... .......... .......... .......... .......... 39% 399M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36800K .......... .......... .......... .......... .......... 39% 177M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36850K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36900K .......... .......... .......... .......... .......... 39% 390M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 36950K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 37000K .......... .......... .......... .......... .......... 39% 396M 0s 2024-09-14T11:36:47.115 INFO:teuthology.orchestra.run.smithi130.stderr: 37050K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37100K .......... .......... .......... .......... .......... 39% 416M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37150K .......... .......... .......... .......... .......... 40% 179M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37200K .......... .......... .......... .......... .......... 40% 386M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37250K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37300K .......... .......... .......... .......... .......... 40% 347M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37350K .......... .......... .......... .......... .......... 40% 329M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37400K .......... .......... .......... .......... .......... 40% 377M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37450K .......... .......... .......... .......... .......... 40% 414M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37500K .......... .......... .......... .......... .......... 40% 340M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37550K .......... .......... .......... .......... .......... 40% 418M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37600K .......... .......... .......... .......... .......... 40% 423M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37650K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37700K .......... .......... .......... .......... .......... 40% 365M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37750K .......... .......... .......... .......... .......... 40% 391M 0s 2024-09-14T11:36:47.116 INFO:teuthology.orchestra.run.smithi130.stderr: 37800K .......... .......... .......... .......... .......... 40% 397M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 37850K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 37900K .......... .......... .......... .......... .......... 40% 403M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 37950K .......... .......... .......... .......... .......... 40% 390M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38000K .......... .......... .......... .......... .......... 40% 338M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38050K .......... .......... .......... .......... .......... 41% 388M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38100K .......... .......... .......... .......... .......... 41% 414M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38150K .......... .......... .......... .......... .......... 41% 353M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38200K .......... .......... .......... .......... .......... 41% 403M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38250K .......... .......... .......... .......... .......... 41% 432M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38300K .......... .......... .......... .......... .......... 41% 459M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38350K .......... .......... .......... .......... .......... 41% 417M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38400K .......... .......... .......... .......... .......... 41% 217M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38450K .......... .......... .......... .......... .......... 41% 111M 0s 2024-09-14T11:36:47.117 INFO:teuthology.orchestra.run.smithi130.stderr: 38500K .......... .......... .......... .......... .......... 41% 425M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38550K .......... .......... .......... .......... .......... 41% 446M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38600K .......... .......... .......... .......... .......... 41% 320M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38650K .......... .......... .......... .......... .......... 41% 356M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38700K .......... .......... .......... .......... .......... 41% 432M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38750K .......... .......... .......... .......... .......... 41% 460M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38800K .......... .......... .......... .......... .......... 41% 65.7M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38850K .......... .......... .......... .......... .......... 41% 62.6M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38900K .......... .......... .......... .......... .......... 41% 304M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 38950K .......... .......... .......... .......... .......... 41% 395M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39000K .......... .......... .......... .......... .......... 42% 422M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39050K .......... .......... .......... .......... .......... 42% 409M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39100K .......... .......... .......... .......... .......... 42% 130M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39150K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39200K .......... .......... .......... .......... .......... 42% 417M 0s 2024-09-14T11:36:47.118 INFO:teuthology.orchestra.run.smithi130.stderr: 39250K .......... .......... .......... .......... .......... 42% 408M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39300K .......... .......... .......... .......... .......... 42% 42.5M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39350K .......... .......... .......... .......... .......... 42% 165M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39400K .......... .......... .......... .......... .......... 42% 424M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39450K .......... .......... .......... .......... .......... 42% 153M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39500K .......... .......... .......... .......... .......... 42% 228M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39550K .......... .......... .......... .......... .......... 42% 128M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39600K .......... .......... .......... .......... .......... 42% 96.2M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39650K .......... .......... .......... .......... .......... 42% 320M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39700K .......... .......... .......... .......... .......... 42% 139M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39750K .......... .......... .......... .......... .......... 42% 445M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39800K .......... .......... .......... .......... .......... 42% 359M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39850K .......... .......... .......... .......... .......... 42% 104M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39900K .......... .......... .......... .......... .......... 43% 408M 0s 2024-09-14T11:36:47.119 INFO:teuthology.orchestra.run.smithi130.stderr: 39950K .......... .......... .......... .......... .......... 43% 427M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40000K .......... .......... .......... .......... .......... 43% 385M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40050K .......... .......... .......... .......... .......... 43% 432M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40100K .......... .......... .......... .......... .......... 43% 423M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40150K .......... .......... .......... .......... .......... 43% 323M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40200K .......... .......... .......... .......... .......... 43% 164M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40250K .......... .......... .......... .......... .......... 43% 422M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40300K .......... .......... .......... .......... .......... 43% 433M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40350K .......... .......... .......... .......... .......... 43% 442M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40400K .......... .......... .......... .......... .......... 43% 444M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40450K .......... .......... .......... .......... .......... 43% 370M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40500K .......... .......... .......... .......... .......... 43% 426M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40550K .......... .......... .......... .......... .......... 43% 440M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40600K .......... .......... .......... .......... .......... 43% 458M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40650K .......... .......... .......... .......... .......... 43% 408M 0s 2024-09-14T11:36:47.120 INFO:teuthology.orchestra.run.smithi130.stderr: 40700K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 40750K .......... .......... .......... .......... .......... 43% 438M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 40800K .......... .......... .......... .......... .......... 43% 443M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 40850K .......... .......... .......... .......... .......... 44% 379M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 40900K .......... .......... .......... .......... .......... 44% 478M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 40950K .......... .......... .......... .......... .......... 44% 415M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41000K .......... .......... .......... .......... .......... 44% 430M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41050K .......... .......... .......... .......... .......... 44% 430M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41100K .......... .......... .......... .......... .......... 44% 374M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41150K .......... .......... .......... .......... .......... 44% 358M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41200K .......... .......... .......... .......... .......... 44% 226M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41250K .......... .......... .......... .......... .......... 44% 381M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41300K .......... .......... .......... .......... .......... 44% 294M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41350K .......... .......... .......... .......... .......... 44% 366M 0s 2024-09-14T11:36:47.121 INFO:teuthology.orchestra.run.smithi130.stderr: 41400K .......... .......... .......... .......... .......... 44% 331M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41450K .......... .......... .......... .......... .......... 44% 421M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41500K .......... .......... .......... .......... .......... 44% 228M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41550K .......... .......... .......... .......... .......... 44% 451M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41600K .......... .......... .......... .......... .......... 44% 157M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41650K .......... .......... .......... .......... .......... 44% 313M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41700K .......... .......... .......... .......... .......... 44% 445M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41750K .......... .......... .......... .......... .......... 44% 458M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41800K .......... .......... .......... .......... .......... 45% 70.8M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41850K .......... .......... .......... .......... .......... 45% 436M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41900K .......... .......... .......... .......... .......... 45% 67.7M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 41950K .......... .......... .......... .......... .......... 45% 179M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 42000K .......... .......... .......... .......... .......... 45% 413M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 42050K .......... .......... .......... .......... .......... 45% 442M 0s 2024-09-14T11:36:47.122 INFO:teuthology.orchestra.run.smithi130.stderr: 42100K .......... .......... .......... .......... .......... 45% 161M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42150K .......... .......... .......... .......... .......... 45% 302M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42200K .......... .......... .......... .......... .......... 45% 390M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42250K .......... .......... .......... .......... .......... 45% 442M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42300K .......... .......... .......... .......... .......... 45% 312M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42350K .......... .......... .......... .......... .......... 45% 48.1M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42400K .......... .......... .......... .......... .......... 45% 152M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42450K .......... .......... .......... .......... .......... 45% 416M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42500K .......... .......... .......... .......... .......... 45% 189M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42550K .......... .......... .......... .......... .......... 45% 242M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42600K .......... .......... .......... .......... .......... 45% 99.3M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42650K .......... .......... .......... .......... .......... 45% 91.0M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42700K .......... .......... .......... .......... .......... 46% 409M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42750K .......... .......... .......... .......... .......... 46% 165M 0s 2024-09-14T11:36:47.123 INFO:teuthology.orchestra.run.smithi130.stderr: 42800K .......... .......... .......... .......... .......... 46% 167M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 42850K .......... .......... .......... .......... .......... 46% 278M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 42900K .......... .......... .......... .......... .......... 46% 444M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 42950K .......... .......... .......... .......... .......... 46% 121M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43000K .......... .......... .......... .......... .......... 46% 126M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43050K .......... .......... .......... .......... .......... 46% 386M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43100K .......... .......... .......... .......... .......... 46% 420M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43150K .......... .......... .......... .......... .......... 46% 440M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43200K .......... .......... .......... .......... .......... 46% 452M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43250K .......... .......... .......... .......... .......... 46% 159M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43300K .......... .......... .......... .......... .......... 46% 190M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43350K .......... .......... .......... .......... .......... 46% 431M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43400K .......... .......... .......... .......... .......... 46% 451M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43450K .......... .......... .......... .......... .......... 46% 406M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43500K .......... .......... .......... .......... .......... 46% 436M 0s 2024-09-14T11:36:47.124 INFO:teuthology.orchestra.run.smithi130.stderr: 43550K .......... .......... .......... .......... .......... 46% 445M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43600K .......... .......... .......... .......... .......... 46% 445M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43650K .......... .......... .......... .......... .......... 47% 369M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43700K .......... .......... .......... .......... .......... 47% 436M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43750K .......... .......... .......... .......... .......... 47% 441M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43800K .......... .......... .......... .......... .......... 47% 371M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43850K .......... .......... .......... .......... .......... 47% 450M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43900K .......... .......... .......... .......... .......... 47% 439M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 43950K .......... .......... .......... .......... .......... 47% 444M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44000K .......... .......... .......... .......... .......... 47% 398M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44050K .......... .......... .......... .......... .......... 47% 447M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44100K .......... .......... .......... .......... .......... 47% 439M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44150K .......... .......... .......... .......... .......... 47% 403M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44200K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-14T11:36:47.125 INFO:teuthology.orchestra.run.smithi130.stderr: 44250K .......... .......... .......... .......... .......... 47% 467M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44300K .......... .......... .......... .......... .......... 47% 398M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44350K .......... .......... .......... .......... .......... 47% 452M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44400K .......... .......... .......... .......... .......... 47% 445M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44450K .......... .......... .......... .......... .......... 47% 252M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44500K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44550K .......... .......... .......... .......... .......... 48% 437M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44600K .......... .......... .......... .......... .......... 48% 441M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44650K .......... .......... .......... .......... .......... 48% 195M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44700K .......... .......... .......... .......... .......... 48% 390M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44750K .......... .......... .......... .......... .......... 48% 447M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44800K .......... .......... .......... .......... .......... 48% 435M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44850K .......... .......... .......... .......... .......... 48% 73.7M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44900K .......... .......... .......... .......... .......... 48% 439M 0s 2024-09-14T11:36:47.126 INFO:teuthology.orchestra.run.smithi130.stderr: 44950K .......... .......... .......... .......... .......... 48% 65.6M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45000K .......... .......... .......... .......... .......... 48% 262M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45050K .......... .......... .......... .......... .......... 48% 163M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45100K .......... .......... .......... .......... .......... 48% 436M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45150K .......... .......... .......... .......... .......... 48% 426M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45200K .......... .......... .......... .......... .......... 48% 201M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45250K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45300K .......... .......... .......... .......... .......... 48% 446M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45350K .......... .......... .......... .......... .......... 48% 438M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45400K .......... .......... .......... .......... .......... 48% 50.1M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45450K .......... .......... .......... .......... .......... 48% 295M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45500K .......... .......... .......... .......... .......... 49% 208M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45550K .......... .......... .......... .......... .......... 49% 164M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45600K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-14T11:36:47.127 INFO:teuthology.orchestra.run.smithi130.stderr: 45650K .......... .......... .......... .......... .......... 49% 68.0M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45700K .......... .......... .......... .......... .......... 49% 348M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45750K .......... .......... .......... .......... .......... 49% 98.5M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45800K .......... .......... .......... .......... .......... 49% 411M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45850K .......... .......... .......... .......... .......... 49% 94.0M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45900K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 45950K .......... .......... .......... .......... .......... 49% 449M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46000K .......... .......... .......... .......... .......... 49% 143M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46050K .......... .......... .......... .......... .......... 49% 117M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46100K .......... .......... .......... .......... .......... 49% 409M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46150K .......... .......... .......... .......... .......... 49% 401M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46200K .......... .......... .......... .......... .......... 49% 357M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46250K .......... .......... .......... .......... .......... 49% 400M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46300K .......... .......... .......... .......... .......... 49% 429M 0s 2024-09-14T11:36:47.128 INFO:teuthology.orchestra.run.smithi130.stderr: 46350K .......... .......... .......... .......... .......... 49% 188M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46400K .......... .......... .......... .......... .......... 49% 383M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46450K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46500K .......... .......... .......... .......... .......... 50% 406M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46550K .......... .......... .......... .......... .......... 50% 170M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46600K .......... .......... .......... .......... .......... 50% 356M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46650K .......... .......... .......... .......... .......... 50% 414M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46700K .......... .......... .......... .......... .......... 50% 427M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46750K .......... .......... .......... .......... .......... 50% 453M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46800K .......... .......... .......... .......... .......... 50% 327M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46850K .......... .......... .......... .......... .......... 50% 376M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46900K .......... .......... .......... .......... .......... 50% 445M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 46950K .......... .......... .......... .......... .......... 50% 401M 0s 2024-09-14T11:36:47.129 INFO:teuthology.orchestra.run.smithi130.stderr: 47000K .......... .......... .......... .......... .......... 50% 447M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47050K .......... .......... .......... .......... .......... 50% 432M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47100K .......... .......... .......... .......... .......... 50% 425M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47150K .......... .......... .......... .......... .......... 50% 369M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47200K .......... .......... .......... .......... .......... 50% 435M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47250K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47300K .......... .......... .......... .......... .......... 50% 494M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47350K .......... .......... .......... .......... .......... 51% 363M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47400K .......... .......... .......... .......... .......... 51% 436M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47450K .......... .......... .......... .......... .......... 51% 456M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47500K .......... .......... .......... .......... .......... 51% 448M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47550K .......... .......... .......... .......... .......... 51% 387M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47600K .......... .......... .......... .......... .......... 51% 455M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47650K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47700K .......... .......... .......... .......... .......... 51% 421M 0s 2024-09-14T11:36:47.130 INFO:teuthology.orchestra.run.smithi130.stderr: 47750K .......... .......... .......... .......... .......... 51% 358M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 47800K .......... .......... .......... .......... .......... 51% 435M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 47850K .......... .......... .......... .......... .......... 51% 450M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 47900K .......... .......... .......... .......... .......... 51% 87.7M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 47950K .......... .......... .......... .......... .......... 51% 65.3M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48000K .......... .......... .......... .......... .......... 51% 410M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48050K .......... .......... .......... .......... .......... 51% 434M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48100K .......... .......... .......... .......... .......... 51% 109M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48150K .......... .......... .......... .......... .......... 51% 436M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48200K .......... .......... .......... .......... .......... 51% 448M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48250K .......... .......... .......... .......... .......... 51% 370M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48300K .......... .......... .......... .......... .......... 52% 447M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48350K .......... .......... .......... .......... .......... 52% 198M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48400K .......... .......... .......... .......... .......... 52% 52.2M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48450K .......... .......... .......... .......... .......... 52% 407M 0s 2024-09-14T11:36:47.131 INFO:teuthology.orchestra.run.smithi130.stderr: 48500K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48550K .......... .......... .......... .......... .......... 52% 350M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48600K .......... .......... .......... .......... .......... 52% 156M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48650K .......... .......... .......... .......... .......... 52% 358M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48700K .......... .......... .......... .......... .......... 52% 66.3M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48750K .......... .......... .......... .......... .......... 52% 109M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48800K .......... .......... .......... .......... .......... 52% 148M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48850K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48900K .......... .......... .......... .......... .......... 52% 74.9M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 48950K .......... .......... .......... .......... .......... 52% 364M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 49000K .......... .......... .......... .......... .......... 52% 172M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 49050K .......... .......... .......... .......... .......... 52% 426M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 49100K .......... .......... .......... .......... .......... 52% 277M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 49150K .......... .......... .......... .......... .......... 52% 157M 0s 2024-09-14T11:36:47.132 INFO:teuthology.orchestra.run.smithi130.stderr: 49200K .......... .......... .......... .......... .......... 53% 376M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49250K .......... .......... .......... .......... .......... 53% 433M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49300K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49350K .......... .......... .......... .......... .......... 53% 170M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49400K .......... .......... .......... .......... .......... 53% 270M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49450K .......... .......... .......... .......... .......... 53% 394M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49500K .......... .......... .......... .......... .......... 53% 428M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49550K .......... .......... .......... .......... .......... 53% 445M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49600K .......... .......... .......... .......... .......... 53% 387M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49650K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49700K .......... .......... .......... .......... .......... 53% 241M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49750K .......... .......... .......... .......... .......... 53% 428M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49800K .......... .......... .......... .......... .......... 53% 350M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49850K .......... .......... .......... .......... .......... 53% 438M 0s 2024-09-14T11:36:47.133 INFO:teuthology.orchestra.run.smithi130.stderr: 49900K .......... .......... .......... .......... .......... 53% 129M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 49950K .......... .......... .......... .......... .......... 53% 335M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50000K .......... .......... .......... .......... .......... 53% 426M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50050K .......... .......... .......... .......... .......... 53% 445M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50100K .......... .......... .......... .......... .......... 53% 397M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50150K .......... .......... .......... .......... .......... 54% 385M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50200K .......... .......... .......... .......... .......... 54% 439M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50250K .......... .......... .......... .......... .......... 54% 456M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50300K .......... .......... .......... .......... .......... 54% 445M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50350K .......... .......... .......... .......... .......... 54% 397M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50400K .......... .......... .......... .......... .......... 54% 379M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50450K .......... .......... .......... .......... .......... 54% 430M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50500K .......... .......... .......... .......... .......... 54% 442M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50550K .......... .......... .......... .......... .......... 54% 417M 0s 2024-09-14T11:36:47.134 INFO:teuthology.orchestra.run.smithi130.stderr: 50600K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50650K .......... .......... .......... .......... .......... 54% 435M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50700K .......... .......... .......... .......... .......... 54% 430M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50750K .......... .......... .......... .......... .......... 54% 391M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50800K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50850K .......... .......... .......... .......... .......... 54% 201M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50900K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 50950K .......... .......... .......... .......... .......... 54% 429M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51000K .......... .......... .......... .......... .......... 54% 78.5M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51050K .......... .......... .......... .......... .......... 55% 219M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51100K .......... .......... .......... .......... .......... 55% 418M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51150K .......... .......... .......... .......... .......... 55% 163M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51200K .......... .......... .......... .......... .......... 55% 158M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51250K .......... .......... .......... .......... .......... 55% 460M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51300K .......... .......... .......... .......... .......... 55% 348M 0s 2024-09-14T11:36:47.135 INFO:teuthology.orchestra.run.smithi130.stderr: 51350K .......... .......... .......... .......... .......... 55% 360M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51400K .......... .......... .......... .......... .......... 55% 416M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51450K .......... .......... .......... .......... .......... 55% 73.0M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51500K .......... .......... .......... .......... .......... 55% 109M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51550K .......... .......... .......... .......... .......... 55% 305M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51600K .......... .......... .......... .......... .......... 55% 435M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51650K .......... .......... .......... .......... .......... 55% 210M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51700K .......... .......... .......... .......... .......... 55% 259M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51750K .......... .......... .......... .......... .......... 55% 57.9M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51800K .......... .......... .......... .......... .......... 55% 263M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51850K .......... .......... .......... .......... .......... 55% 163M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51900K .......... .......... .......... .......... .......... 55% 216M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 51950K .......... .......... .......... .......... .......... 55% 67.8M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 52000K .......... .......... .......... .......... .......... 56% 124M 0s 2024-09-14T11:36:47.136 INFO:teuthology.orchestra.run.smithi130.stderr: 52050K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52100K .......... .......... .......... .......... .......... 56% 395M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52150K .......... .......... .......... .......... .......... 56% 427M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52200K .......... .......... .......... .......... .......... 56% 102M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52250K .......... .......... .......... .......... .......... 56% 265M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52300K .......... .......... .......... .......... .......... 56% 355M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52350K .......... .......... .......... .......... .......... 56% 438M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52400K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52450K .......... .......... .......... .......... .......... 56% 425M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52500K .......... .......... .......... .......... .......... 56% 399M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52550K .......... .......... .......... .......... .......... 56% 349M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52600K .......... .......... .......... .......... .......... 56% 434M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52650K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-14T11:36:47.137 INFO:teuthology.orchestra.run.smithi130.stderr: 52700K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 52750K .......... .......... .......... .......... .......... 56% 395M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 52800K .......... .......... .......... .......... .......... 56% 444M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 52850K .......... .......... .......... .......... .......... 56% 377M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 52900K .......... .......... .......... .......... .......... 56% 125M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 52950K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53000K .......... .......... .......... .......... .......... 57% 446M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53050K .......... .......... .......... .......... .......... 57% 211M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53100K .......... .......... .......... .......... .......... 57% 451M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53150K .......... .......... .......... .......... .......... 57% 421M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53200K .......... .......... .......... .......... .......... 57% 365M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53250K .......... .......... .......... .......... .......... 57% 234M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53300K .......... .......... .......... .......... .......... 57% 352M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53350K .......... .......... .......... .......... .......... 57% 424M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53400K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-14T11:36:47.138 INFO:teuthology.orchestra.run.smithi130.stderr: 53450K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53500K .......... .......... .......... .......... .......... 57% 303M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53550K .......... .......... .......... .......... .......... 57% 434M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53600K .......... .......... .......... .......... .......... 57% 373M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53650K .......... .......... .......... .......... .......... 57% 433M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53700K .......... .......... .......... .......... .......... 57% 422M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53750K .......... .......... .......... .......... .......... 57% 272M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53800K .......... .......... .......... .......... .......... 57% 221M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53850K .......... .......... .......... .......... .......... 58% 255M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53900K .......... .......... .......... .......... .......... 58% 281M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 53950K .......... .......... .......... .......... .......... 58% 291M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 54000K .......... .......... .......... .......... .......... 58% 246M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 54050K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 54100K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 54150K .......... .......... .......... .......... .......... 58% 302M 0s 2024-09-14T11:36:47.139 INFO:teuthology.orchestra.run.smithi130.stderr: 54200K .......... .......... .......... .......... .......... 58% 272M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54250K .......... .......... .......... .......... .......... 58% 177M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54300K .......... .......... .......... .......... .......... 58% 265M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54350K .......... .......... .......... .......... .......... 58% 314M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54400K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54450K .......... .......... .......... .......... .......... 58% 245M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54500K .......... .......... .......... .......... .......... 58% 88.4M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54550K .......... .......... .......... .......... .......... 58% 152M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54600K .......... .......... .......... .......... .......... 58% 310M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54650K .......... .......... .......... .......... .......... 58% 231M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54700K .......... .......... .......... .......... .......... 58% 203M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54750K .......... .......... .......... .......... .......... 58% 233M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54800K .......... .......... .......... .......... .......... 59% 59.6M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54850K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-14T11:36:47.140 INFO:teuthology.orchestra.run.smithi130.stderr: 54900K .......... .......... .......... .......... .......... 59% 200M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 54950K .......... .......... .......... .......... .......... 59% 303M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55000K .......... .......... .......... .......... .......... 59% 66.0M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55050K .......... .......... .......... .......... .......... 59% 435M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55100K .......... .......... .......... .......... .......... 59% 100M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55150K .......... .......... .......... .......... .......... 59% 356M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55200K .......... .......... .......... .......... .......... 59% 82.9M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55250K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55300K .......... .......... .......... .......... .......... 59% 426M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55350K .......... .......... .......... .......... .......... 59% 240M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55400K .......... .......... .......... .......... .......... 59% 440M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55450K .......... .......... .......... .......... .......... 59% 313M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55500K .......... .......... .......... .......... .......... 59% 267M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55550K .......... .......... .......... .......... .......... 59% 444M 0s 2024-09-14T11:36:47.141 INFO:teuthology.orchestra.run.smithi130.stderr: 55600K .......... .......... .......... .......... .......... 59% 381M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55650K .......... .......... .......... .......... .......... 59% 428M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55700K .......... .......... .......... .......... .......... 60% 422M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55750K .......... .......... .......... .......... .......... 60% 306M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55800K .......... .......... .......... .......... .......... 60% 372M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55850K .......... .......... .......... .......... .......... 60% 326M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55900K .......... .......... .......... .......... .......... 60% 430M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 55950K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56000K .......... .......... .......... .......... .......... 60% 317M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56050K .......... .......... .......... .......... .......... 60% 438M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56100K .......... .......... .......... .......... .......... 60% 149M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56150K .......... .......... .......... .......... .......... 60% 442M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56200K .......... .......... .......... .......... .......... 60% 456M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56250K .......... .......... .......... .......... .......... 60% 450M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56300K .......... .......... .......... .......... .......... 60% 380M 0s 2024-09-14T11:36:47.142 INFO:teuthology.orchestra.run.smithi130.stderr: 56350K .......... .......... .......... .......... .......... 60% 265M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56400K .......... .......... .......... .......... .......... 60% 425M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56450K .......... .......... .......... .......... .......... 60% 450M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56500K .......... .......... .......... .......... .......... 60% 172M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56550K .......... .......... .......... .......... .......... 60% 436M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56600K .......... .......... .......... .......... .......... 60% 428M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56650K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56700K .......... .......... .......... .......... .......... 61% 459M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56750K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56800K .......... .......... .......... .......... .......... 61% 454M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56850K .......... .......... .......... .......... .......... 61% 255M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56900K .......... .......... .......... .......... .......... 61% 395M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 56950K .......... .......... .......... .......... .......... 61% 398M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 57000K .......... .......... .......... .......... .......... 61% 445M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 57050K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-14T11:36:47.143 INFO:teuthology.orchestra.run.smithi130.stderr: 57100K .......... .......... .......... .......... .......... 61% 80.1M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57150K .......... .......... .......... .......... .......... 61% 300M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57200K .......... .......... .......... .......... .......... 61% 441M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57250K .......... .......... .......... .......... .......... 61% 431M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57300K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57350K .......... .......... .......... .......... .......... 61% 136M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57400K .......... .......... .......... .......... .......... 61% 312M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57450K .......... .......... .......... .......... .......... 61% 385M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57500K .......... .......... .......... .......... .......... 61% 417M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57550K .......... .......... .......... .......... .......... 62% 99.4M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57600K .......... .......... .......... .......... .......... 62% 105M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57650K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57700K .......... .......... .......... .......... .......... 62% 297M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57750K .......... .......... .......... .......... .......... 62% 443M 0s 2024-09-14T11:36:47.144 INFO:teuthology.orchestra.run.smithi130.stderr: 57800K .......... .......... .......... .......... .......... 62% 172M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 57850K .......... .......... .......... .......... .......... 62% 68.5M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 57900K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 57950K .......... .......... .......... .......... .......... 62% 138M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58000K .......... .......... .......... .......... .......... 62% 361M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58050K .......... .......... .......... .......... .......... 62% 62.7M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58100K .......... .......... .......... .......... .......... 62% 293M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58150K .......... .......... .......... .......... .......... 62% 215M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58200K .......... .......... .......... .......... .......... 62% 182M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58250K .......... .......... .......... .......... .......... 62% 62.6M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58300K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58350K .......... .......... .......... .......... .......... 62% 436M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58400K .......... .......... .......... .......... .......... 62% 362M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58450K .......... .......... .......... .......... .......... 62% 371M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58500K .......... .......... .......... .......... .......... 63% 432M 0s 2024-09-14T11:36:47.145 INFO:teuthology.orchestra.run.smithi130.stderr: 58550K .......... .......... .......... .......... .......... 63% 226M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58600K .......... .......... .......... .......... .......... 63% 207M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58650K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58700K .......... .......... .......... .......... .......... 63% 441M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58750K .......... .......... .......... .......... .......... 63% 388M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58800K .......... .......... .......... .......... .......... 63% 440M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58850K .......... .......... .......... .......... .......... 63% 427M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58900K .......... .......... .......... .......... .......... 63% 441M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 58950K .......... .......... .......... .......... .......... 63% 425M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59000K .......... .......... .......... .......... .......... 63% 378M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59050K .......... .......... .......... .......... .......... 63% 456M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59100K .......... .......... .......... .......... .......... 63% 146M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59150K .......... .......... .......... .......... .......... 63% 444M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59200K .......... .......... .......... .......... .......... 63% 379M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59250K .......... .......... .......... .......... .......... 63% 193M 0s 2024-09-14T11:36:47.146 INFO:teuthology.orchestra.run.smithi130.stderr: 59300K .......... .......... .......... .......... .......... 63% 208M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59350K .......... .......... .......... .......... .......... 63% 446M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59400K .......... .......... .......... .......... .......... 63% 439M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59450K .......... .......... .......... .......... .......... 64% 420M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59500K .......... .......... .......... .......... .......... 64% 450M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59550K .......... .......... .......... .......... .......... 64% 314M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59600K .......... .......... .......... .......... .......... 64% 436M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59650K .......... .......... .......... .......... .......... 64% 369M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59700K .......... .......... .......... .......... .......... 64% 436M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59750K .......... .......... .......... .......... .......... 64% 461M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59800K .......... .......... .......... .......... .......... 64% 453M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59850K .......... .......... .......... .......... .......... 64% 397M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59900K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 59950K .......... .......... .......... .......... .......... 64% 372M 0s 2024-09-14T11:36:47.147 INFO:teuthology.orchestra.run.smithi130.stderr: 60000K .......... .......... .......... .......... .......... 64% 429M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60050K .......... .......... .......... .......... .......... 64% 459M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60100K .......... .......... .......... .......... .......... 64% 445M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60150K .......... .......... .......... .......... .......... 64% 46.3M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60200K .......... .......... .......... .......... .......... 64% 378M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60250K .......... .......... .......... .......... .......... 64% 444M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60300K .......... .......... .......... .......... .......... 64% 432M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60350K .......... .......... .......... .......... .......... 65% 380M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60400K .......... .......... .......... .......... .......... 65% 174M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60450K .......... .......... .......... .......... .......... 65% 418M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60500K .......... .......... .......... .......... .......... 65% 449M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60550K .......... .......... .......... .......... .......... 65% 191M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60600K .......... .......... .......... .......... .......... 65% 267M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60650K .......... .......... .......... .......... .......... 65% 95.9M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60700K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-14T11:36:47.148 INFO:teuthology.orchestra.run.smithi130.stderr: 60750K .......... .......... .......... .......... .......... 65% 436M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 60800K .......... .......... .......... .......... .......... 65% 396M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 60850K .......... .......... .......... .......... .......... 65% 294M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 60900K .......... .......... .......... .......... .......... 65% 440M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 60950K .......... .......... .......... .......... .......... 65% 56.9M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61000K .......... .......... .......... .......... .......... 65% 142M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61050K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61100K .......... .......... .......... .......... .......... 65% 76.1M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61150K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61200K .......... .......... .......... .......... .......... 65% 211M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61250K .......... .......... .......... .......... .......... 65% 125M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61300K .......... .......... .......... .......... .......... 66% 38.9M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61350K .......... .......... .......... .......... .......... 66% 152M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61400K .......... .......... .......... .......... .......... 66% 427M 0s 2024-09-14T11:36:47.149 INFO:teuthology.orchestra.run.smithi130.stderr: 61450K .......... .......... .......... .......... .......... 66% 483M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61500K .......... .......... .......... .......... .......... 66% 426M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61550K .......... .......... .......... .......... .......... 66% 379M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61600K .......... .......... .......... .......... .......... 66% 446M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61650K .......... .......... .......... .......... .......... 66% 426M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61700K .......... .......... .......... .......... .......... 66% 425M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61750K .......... .......... .......... .......... .......... 66% 397M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61800K .......... .......... .......... .......... .......... 66% 436M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61850K .......... .......... .......... .......... .......... 66% 466M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61900K .......... .......... .......... .......... .......... 66% 449M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 61950K .......... .......... .......... .......... .......... 66% 380M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 62000K .......... .......... .......... .......... .......... 66% 457M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 62050K .......... .......... .......... .......... .......... 66% 262M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 62100K .......... .......... .......... .......... .......... 66% 457M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 62150K .......... .......... .......... .......... .......... 66% 391M 0s 2024-09-14T11:36:47.150 INFO:teuthology.orchestra.run.smithi130.stderr: 62200K .......... .......... .......... .......... .......... 67% 433M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62250K .......... .......... .......... .......... .......... 67% 453M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62300K .......... .......... .......... .......... .......... 67% 453M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62350K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62400K .......... .......... .......... .......... .......... 67% 211M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62450K .......... .......... .......... .......... .......... 67% 431M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62500K .......... .......... .......... .......... .......... 67% 440M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62550K .......... .......... .......... .......... .......... 67% 405M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62600K .......... .......... .......... .......... .......... 67% 449M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62650K .......... .......... .......... .......... .......... 67% 414M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62700K .......... .......... .......... .......... .......... 67% 424M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62750K .......... .......... .......... .......... .......... 67% 395M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62800K .......... .......... .......... .......... .......... 67% 231M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62850K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-14T11:36:47.151 INFO:teuthology.orchestra.run.smithi130.stderr: 62900K .......... .......... .......... .......... .......... 67% 340M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 62950K .......... .......... .......... .......... .......... 67% 434M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63000K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63050K .......... .......... .......... .......... .......... 67% 429M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63100K .......... .......... .......... .......... .......... 67% 447M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63150K .......... .......... .......... .......... .......... 68% 61.2M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63200K .......... .......... .......... .......... .......... 68% 424M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63250K .......... .......... .......... .......... .......... 68% 278M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63300K .......... .......... .......... .......... .......... 68% 408M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63350K .......... .......... .......... .......... .......... 68% 446M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63400K .......... .......... .......... .......... .......... 68% 144M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63450K .......... .......... .......... .......... .......... 68% 301M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63500K .......... .......... .......... .......... .......... 68% 240M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63550K .......... .......... .......... .......... .......... 68% 424M 0s 2024-09-14T11:36:47.152 INFO:teuthology.orchestra.run.smithi130.stderr: 63600K .......... .......... .......... .......... .......... 68% 419M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63650K .......... .......... .......... .......... .......... 68% 86.7M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63700K .......... .......... .......... .......... .......... 68% 381M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63750K .......... .......... .......... .......... .......... 68% 242M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63800K .......... .......... .......... .......... .......... 68% 271M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63850K .......... .......... .......... .......... .......... 68% 432M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63900K .......... .......... .......... .......... .......... 68% 398M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 63950K .......... .......... .......... .......... .......... 68% 400M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64000K .......... .......... .......... .......... .......... 68% 63.0M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64050K .......... .......... .......... .......... .......... 68% 437M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64100K .......... .......... .......... .......... .......... 69% 110M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64150K .......... .......... .......... .......... .......... 69% 67.0M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64200K .......... .......... .......... .......... .......... 69% 290M 0s 2024-09-14T11:36:47.153 INFO:teuthology.orchestra.run.smithi130.stderr: 64250K .......... .......... .......... .......... .......... 69% 436M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64300K .......... .......... .......... .......... .......... 69% 93.7M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64350K .......... .......... .......... .......... .......... 69% 53.6M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64400K .......... .......... .......... .......... .......... 69% 96.0M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64450K .......... .......... .......... .......... .......... 69% 260M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64500K .......... .......... .......... .......... .......... 69% 404M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64550K .......... .......... .......... .......... .......... 69% 403M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64600K .......... .......... .......... .......... .......... 69% 447M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64650K .......... .......... .......... .......... .......... 69% 446M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64700K .......... .......... .......... .......... .......... 69% 451M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64750K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64800K .......... .......... .......... .......... .......... 69% 454M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64850K .......... .......... .......... .......... .......... 69% 464M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64900K .......... .......... .......... .......... .......... 69% 466M 0s 2024-09-14T11:36:47.154 INFO:teuthology.orchestra.run.smithi130.stderr: 64950K .......... .......... .......... .......... .......... 69% 167M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65000K .......... .......... .......... .......... .......... 70% 424M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65050K .......... .......... .......... .......... .......... 70% 360M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65100K .......... .......... .......... .......... .......... 70% 440M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65150K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65200K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65250K .......... .......... .......... .......... .......... 70% 268M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65300K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65350K .......... .......... .......... .......... .......... 70% 427M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65400K .......... .......... .......... .......... .......... 70% 441M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65450K .......... .......... .......... .......... .......... 70% 362M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65500K .......... .......... .......... .......... .......... 70% 426M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65550K .......... .......... .......... .......... .......... 70% 448M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65600K .......... .......... .......... .......... .......... 70% 453M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65650K .......... .......... .......... .......... .......... 70% 387M 0s 2024-09-14T11:36:47.155 INFO:teuthology.orchestra.run.smithi130.stderr: 65700K .......... .......... .......... .......... .......... 70% 119M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 65750K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 65800K .......... .......... .......... .......... .......... 70% 424M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 65850K .......... .......... .......... .......... .......... 70% 446M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 65900K .......... .......... .......... .......... .......... 70% 446M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 65950K .......... .......... .......... .......... .......... 71% 363M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66000K .......... .......... .......... .......... .......... 71% 440M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66050K .......... .......... .......... .......... .......... 71% 460M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66100K .......... .......... .......... .......... .......... 71% 449M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66150K .......... .......... .......... .......... .......... 71% 49.4M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66200K .......... .......... .......... .......... .......... 71% 411M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66250K .......... .......... .......... .......... .......... 71% 438M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66300K .......... .......... .......... .......... .......... 71% 407M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66350K .......... .......... .......... .......... .......... 71% 439M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66400K .......... .......... .......... .......... .......... 71% 362M 0s 2024-09-14T11:36:47.156 INFO:teuthology.orchestra.run.smithi130.stderr: 66450K .......... .......... .......... .......... .......... 71% 402M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66500K .......... .......... .......... .......... .......... 71% 446M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66550K .......... .......... .......... .......... .......... 71% 446M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66600K .......... .......... .......... .......... .......... 71% 346M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66650K .......... .......... .......... .......... .......... 71% 122M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66700K .......... .......... .......... .......... .......... 71% 350M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66750K .......... .......... .......... .......... .......... 71% 428M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66800K .......... .......... .......... .......... .......... 71% 188M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66850K .......... .......... .......... .......... .......... 72% 115M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66900K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 66950K .......... .......... .......... .......... .......... 72% 414M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 67000K .......... .......... .......... .......... .......... 72% 447M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 67050K .......... .......... .......... .......... .......... 72% 425M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 67100K .......... .......... .......... .......... .......... 72% 168M 0s 2024-09-14T11:36:47.157 INFO:teuthology.orchestra.run.smithi130.stderr: 67150K .......... .......... .......... .......... .......... 72% 126M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67200K .......... .......... .......... .......... .......... 72% 258M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67250K .......... .......... .......... .......... .......... 72% 51.6M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67300K .......... .......... .......... .......... .......... 72% 77.8M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67350K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67400K .......... .......... .......... .......... .......... 72% 96.2M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67450K .......... .......... .......... .......... .......... 72% 225M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67500K .......... .......... .......... .......... .......... 72% 88.2M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67550K .......... .......... .......... .......... .......... 72% 175M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67600K .......... .......... .......... .......... .......... 72% 304M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67650K .......... .......... .......... .......... .......... 72% 155M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67700K .......... .......... .......... .......... .......... 72% 244M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67750K .......... .......... .......... .......... .......... 72% 435M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67800K .......... .......... .......... .......... .......... 73% 433M 0s 2024-09-14T11:36:47.158 INFO:teuthology.orchestra.run.smithi130.stderr: 67850K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 67900K .......... .......... .......... .......... .......... 73% 392M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 67950K .......... .......... .......... .......... .......... 73% 446M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68000K .......... .......... .......... .......... .......... 73% 435M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68050K .......... .......... .......... .......... .......... 73% 439M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68100K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68150K .......... .......... .......... .......... .......... 73% 436M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68200K .......... .......... .......... .......... .......... 73% 451M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68250K .......... .......... .......... .......... .......... 73% 327M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68300K .......... .......... .......... .......... .......... 73% 307M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68350K .......... .......... .......... .......... .......... 73% 365M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68400K .......... .......... .......... .......... .......... 73% 444M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68450K .......... .......... .......... .......... .......... 73% 439M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68500K .......... .......... .......... .......... .......... 73% 432M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68550K .......... .......... .......... .......... .......... 73% 435M 0s 2024-09-14T11:36:47.159 INFO:teuthology.orchestra.run.smithi130.stderr: 68600K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68650K .......... .......... .......... .......... .......... 73% 441M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68700K .......... .......... .......... .......... .......... 74% 178M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68750K .......... .......... .......... .......... .......... 74% 417M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68800K .......... .......... .......... .......... .......... 74% 388M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68850K .......... .......... .......... .......... .......... 74% 428M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68900K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 68950K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69000K .......... .......... .......... .......... .......... 74% 400M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69050K .......... .......... .......... .......... .......... 74% 412M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69100K .......... .......... .......... .......... .......... 74% 451M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69150K .......... .......... .......... .......... .......... 74% 49.2M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69200K .......... .......... .......... .......... .......... 74% 448M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69250K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69300K .......... .......... .......... .......... .......... 74% 457M 0s 2024-09-14T11:36:47.160 INFO:teuthology.orchestra.run.smithi130.stderr: 69350K .......... .......... .......... .......... .......... 74% 471M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69400K .......... .......... .......... .......... .......... 74% 451M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69450K .......... .......... .......... .......... .......... 74% 404M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69500K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69550K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69600K .......... .......... .......... .......... .......... 74% 443M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69650K .......... .......... .......... .......... .......... 75% 446M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69700K .......... .......... .......... .......... .......... 75% 395M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69750K .......... .......... .......... .......... .......... 75% 307M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69800K .......... .......... .......... .......... .......... 75% 337M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69850K .......... .......... .......... .......... .......... 75% 241M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69900K .......... .......... .......... .......... .......... 75% 122M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 69950K .......... .......... .......... .......... .......... 75% 212M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 70000K .......... .......... .......... .......... .......... 75% 242M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 70050K .......... .......... .......... .......... .......... 75% 391M 0s 2024-09-14T11:36:47.161 INFO:teuthology.orchestra.run.smithi130.stderr: 70100K .......... .......... .......... .......... .......... 75% 206M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70150K .......... .......... .......... .......... .......... 75% 426M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70200K .......... .......... .......... .......... .......... 75% 217M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70250K .......... .......... .......... .......... .......... 75% 443M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70300K .......... .......... .......... .......... .......... 75% 46.9M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70350K .......... .......... .......... .......... .......... 75% 69.9M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70400K .......... .......... .......... .......... .......... 75% 241M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70450K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70500K .......... .......... .......... .......... .......... 75% 86.4M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70550K .......... .......... .......... .......... .......... 75% 96.2M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70600K .......... .......... .......... .......... .......... 76% 80.8M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70650K .......... .......... .......... .......... .......... 76% 364M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70700K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70750K .......... .......... .......... .......... .......... 76% 334M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70800K .......... .......... .......... .......... .......... 76% 265M 0s 2024-09-14T11:36:47.162 INFO:teuthology.orchestra.run.smithi130.stderr: 70850K .......... .......... .......... .......... .......... 76% 442M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 70900K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 70950K .......... .......... .......... .......... .......... 76% 407M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71000K .......... .......... .......... .......... .......... 76% 254M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71050K .......... .......... .......... .......... .......... 76% 433M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71100K .......... .......... .......... .......... .......... 76% 447M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71150K .......... .......... .......... .......... .......... 76% 401M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71200K .......... .......... .......... .......... .......... 76% 451M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71250K .......... .......... .......... .......... .......... 76% 375M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71300K .......... .......... .......... .......... .......... 76% 436M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71350K .......... .......... .......... .......... .......... 76% 401M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71400K .......... .......... .......... .......... .......... 76% 428M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71450K .......... .......... .......... .......... .......... 76% 441M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71500K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71550K .......... .......... .......... .......... .......... 77% 431M 0s 2024-09-14T11:36:47.163 INFO:teuthology.orchestra.run.smithi130.stderr: 71600K .......... .......... .......... .......... .......... 77% 440M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71650K .......... .......... .......... .......... .......... 77% 340M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71700K .......... .......... .......... .......... .......... 77% 214M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71750K .......... .......... .......... .......... .......... 77% 431M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71800K .......... .......... .......... .......... .......... 77% 425M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71850K .......... .......... .......... .......... .......... 77% 289M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71900K .......... .......... .......... .......... .......... 77% 225M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 71950K .......... .......... .......... .......... .......... 77% 421M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72000K .......... .......... .......... .......... .......... 77% 312M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72050K .......... .......... .......... .......... .......... 77% 383M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72100K .......... .......... .......... .......... .......... 77% 396M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72150K .......... .......... .......... .......... .......... 77% 50.2M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72200K .......... .......... .......... .......... .......... 77% 416M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72250K .......... .......... .......... .......... .......... 77% 444M 0s 2024-09-14T11:36:47.164 INFO:teuthology.orchestra.run.smithi130.stderr: 72300K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72350K .......... .......... .......... .......... .......... 77% 430M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72400K .......... .......... .......... .......... .......... 77% 437M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72450K .......... .......... .......... .......... .......... 78% 440M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72500K .......... .......... .......... .......... .......... 78% 395M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72550K .......... .......... .......... .......... .......... 78% 422M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72600K .......... .......... .......... .......... .......... 78% 426M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72650K .......... .......... .......... .......... .......... 78% 407M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72700K .......... .......... .......... .......... .......... 78% 357M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72750K .......... .......... .......... .......... .......... 78% 429M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72800K .......... .......... .......... .......... .......... 78% 442M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72850K .......... .......... .......... .......... .......... 78% 436M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72900K .......... .......... .......... .......... .......... 78% 398M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 72950K .......... .......... .......... .......... .......... 78% 153M 0s 2024-09-14T11:36:47.165 INFO:teuthology.orchestra.run.smithi130.stderr: 73000K .......... .......... .......... .......... .......... 78% 122M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73050K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73100K .......... .......... .......... .......... .......... 78% 303M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73150K .......... .......... .......... .......... .......... 78% 406M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73200K .......... .......... .......... .......... .......... 78% 143M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73250K .......... .......... .......... .......... .......... 78% 436M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73300K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73350K .......... .......... .......... .......... .......... 79% 56.7M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73400K .......... .......... .......... .......... .......... 79% 59.0M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73450K .......... .......... .......... .......... .......... 79% 258M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73500K .......... .......... .......... .......... .......... 79% 276M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73550K .......... .......... .......... .......... .......... 79% 83.6M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73600K .......... .......... .......... .......... .......... 79% 91.1M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73650K .......... .......... .......... .......... .......... 79% 55.5M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73700K .......... .......... .......... .......... .......... 79% 344M 0s 2024-09-14T11:36:47.166 INFO:teuthology.orchestra.run.smithi130.stderr: 73750K .......... .......... .......... .......... .......... 79% 424M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 73800K .......... .......... .......... .......... .......... 79% 376M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 73850K .......... .......... .......... .......... .......... 79% 426M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 73900K .......... .......... .......... .......... .......... 79% 424M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 73950K .......... .......... .......... .......... .......... 79% 448M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74000K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74050K .......... .......... .......... .......... .......... 79% 435M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74100K .......... .......... .......... .......... .......... 79% 448M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74150K .......... .......... .......... .......... .......... 79% 446M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74200K .......... .......... .......... .......... .......... 79% 386M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74250K .......... .......... .......... .......... .......... 79% 336M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74300K .......... .......... .......... .......... .......... 80% 429M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74350K .......... .......... .......... .......... .......... 80% 419M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74400K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74450K .......... .......... .......... .......... .......... 80% 432M 0s 2024-09-14T11:36:47.167 INFO:teuthology.orchestra.run.smithi130.stderr: 74500K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74550K .......... .......... .......... .......... .......... 80% 441M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74600K .......... .......... .......... .......... .......... 80% 428M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74650K .......... .......... .......... .......... .......... 80% 211M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74700K .......... .......... .......... .......... .......... 80% 384M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74750K .......... .......... .......... .......... .......... 80% 402M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74800K .......... .......... .......... .......... .......... 80% 452M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74850K .......... .......... .......... .......... .......... 80% 429M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74900K .......... .......... .......... .......... .......... 80% 281M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 74950K .......... .......... .......... .......... .......... 80% 238M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 75000K .......... .......... .......... .......... .......... 80% 385M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 75050K .......... .......... .......... .......... .......... 80% 435M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 75100K .......... .......... .......... .......... .......... 80% 57.0M 0s 2024-09-14T11:36:47.168 INFO:teuthology.orchestra.run.smithi130.stderr: 75150K .......... .......... .......... .......... .......... 80% 402M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75200K .......... .......... .......... .......... .......... 81% 389M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75250K .......... .......... .......... .......... .......... 81% 279M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75300K .......... .......... .......... .......... .......... 81% 295M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75350K .......... .......... .......... .......... .......... 81% 439M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75400K .......... .......... .......... .......... .......... 81% 426M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75450K .......... .......... .......... .......... .......... 81% 405M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75500K .......... .......... .......... .......... .......... 81% 389M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75550K .......... .......... .......... .......... .......... 81% 436M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75600K .......... .......... .......... .......... .......... 81% 443M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75650K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75700K .......... .......... .......... .......... .......... 81% 186M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75750K .......... .......... .......... .......... .......... 81% 420M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75800K .......... .......... .......... .......... .......... 81% 419M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75850K .......... .......... .......... .......... .......... 81% 384M 0s 2024-09-14T11:36:47.169 INFO:teuthology.orchestra.run.smithi130.stderr: 75900K .......... .......... .......... .......... .......... 81% 356M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 75950K .......... .......... .......... .......... .......... 81% 449M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76000K .......... .......... .......... .......... .......... 81% 215M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76050K .......... .......... .......... .......... .......... 81% 307M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76100K .......... .......... .......... .......... .......... 81% 388M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76150K .......... .......... .......... .......... .......... 82% 310M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76200K .......... .......... .......... .......... .......... 82% 221M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76250K .......... .......... .......... .......... .......... 82% 150M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76300K .......... .......... .......... .......... .......... 82% 453M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76350K .......... .......... .......... .......... .......... 82% 252M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76400K .......... .......... .......... .......... .......... 82% 72.3M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76450K .......... .......... .......... .......... .......... 82% 64.7M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76500K .......... .......... .......... .......... .......... 82% 141M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76550K .......... .......... .......... .......... .......... 82% 281M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76600K .......... .......... .......... .......... .......... 82% 93.6M 0s 2024-09-14T11:36:47.170 INFO:teuthology.orchestra.run.smithi130.stderr: 76650K .......... .......... .......... .......... .......... 82% 79.8M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76700K .......... .......... .......... .......... .......... 82% 61.6M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76750K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76800K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76850K .......... .......... .......... .......... .......... 82% 376M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76900K .......... .......... .......... .......... .......... 82% 170M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 76950K .......... .......... .......... .......... .......... 82% 248M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77000K .......... .......... .......... .......... .......... 82% 357M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77050K .......... .......... .......... .......... .......... 82% 444M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77100K .......... .......... .......... .......... .......... 83% 445M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77150K .......... .......... .......... .......... .......... 83% 422M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77200K .......... .......... .......... .......... .......... 83% 391M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77250K .......... .......... .......... .......... .......... 83% 460M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77300K .......... .......... .......... .......... .......... 83% 450M 0s 2024-09-14T11:36:47.171 INFO:teuthology.orchestra.run.smithi130.stderr: 77350K .......... .......... .......... .......... .......... 83% 385M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77400K .......... .......... .......... .......... .......... 83% 435M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77450K .......... .......... .......... .......... .......... 83% 408M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77500K .......... .......... .......... .......... .......... 83% 388M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77550K .......... .......... .......... .......... .......... 83% 438M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77600K .......... .......... .......... .......... .......... 83% 452M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77650K .......... .......... .......... .......... .......... 83% 442M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77700K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77750K .......... .......... .......... .......... .......... 83% 455M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77800K .......... .......... .......... .......... .......... 83% 451M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77850K .......... .......... .......... .......... .......... 83% 442M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77900K .......... .......... .......... .......... .......... 83% 137M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 77950K .......... .......... .......... .......... .......... 83% 421M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 78000K .......... .......... .......... .......... .......... 84% 447M 0s 2024-09-14T11:36:47.172 INFO:teuthology.orchestra.run.smithi130.stderr: 78050K .......... .......... .......... .......... .......... 84% 454M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78100K .......... .......... .......... .......... .......... 84% 390M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78150K .......... .......... .......... .......... .......... 84% 69.2M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78200K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78250K .......... .......... .......... .......... .......... 84% 198M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78300K .......... .......... .......... .......... .......... 84% 407M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78350K .......... .......... .......... .......... .......... 84% 166M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78400K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78450K .......... .......... .......... .......... .......... 84% 406M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78500K .......... .......... .......... .......... .......... 84% 443M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78550K .......... .......... .......... .......... .......... 84% 244M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78600K .......... .......... .......... .......... .......... 84% 371M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78650K .......... .......... .......... .......... .......... 84% 455M 0s 2024-09-14T11:36:47.173 INFO:teuthology.orchestra.run.smithi130.stderr: 78700K .......... .......... .......... .......... .......... 84% 259M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 78750K .......... .......... .......... .......... .......... 84% 432M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 78800K .......... .......... .......... .......... .......... 84% 206M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 78850K .......... .......... .......... .......... .......... 84% 411M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 78900K .......... .......... .......... .......... .......... 84% 388M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 78950K .......... .......... .......... .......... .......... 85% 416M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79000K .......... .......... .......... .......... .......... 85% 438M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79050K .......... .......... .......... .......... .......... 85% 429M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79100K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79150K .......... .......... .......... .......... .......... 85% 444M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79200K .......... .......... .......... .......... .......... 85% 435M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79250K .......... .......... .......... .......... .......... 85% 439M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79300K .......... .......... .......... .......... .......... 85% 218M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79350K .......... .......... .......... .......... .......... 85% 287M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79400K .......... .......... .......... .......... .......... 85% 435M 0s 2024-09-14T11:36:47.174 INFO:teuthology.orchestra.run.smithi130.stderr: 79450K .......... .......... .......... .......... .......... 85% 56.6M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79500K .......... .......... .......... .......... .......... 85% 82.7M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79550K .......... .......... .......... .......... .......... 85% 128M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79600K .......... .......... .......... .......... .......... 85% 444M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79650K .......... .......... .......... .......... .......... 85% 108M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79700K .......... .......... .......... .......... .......... 85% 82.6M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79750K .......... .......... .......... .......... .......... 85% 54.4M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79800K .......... .......... .......... .......... .......... 85% 249M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79850K .......... .......... .......... .......... .......... 86% 295M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79900K .......... .......... .......... .......... .......... 86% 196M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 79950K .......... .......... .......... .......... .......... 86% 323M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 80000K .......... .......... .......... .......... .......... 86% 101M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 80050K .......... .......... .......... .......... .......... 86% 241M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 80100K .......... .......... .......... .......... .......... 86% 415M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 80150K .......... .......... .......... .......... .......... 86% 365M 0s 2024-09-14T11:36:47.175 INFO:teuthology.orchestra.run.smithi130.stderr: 80200K .......... .......... .......... .......... .......... 86% 445M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80250K .......... .......... .......... .......... .......... 86% 424M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80300K .......... .......... .......... .......... .......... 86% 431M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80350K .......... .......... .......... .......... .......... 86% 411M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80400K .......... .......... .......... .......... .......... 86% 434M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80450K .......... .......... .......... .......... .......... 86% 439M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80500K .......... .......... .......... .......... .......... 86% 439M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80550K .......... .......... .......... .......... .......... 86% 363M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80600K .......... .......... .......... .......... .......... 86% 454M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80650K .......... .......... .......... .......... .......... 86% 399M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80700K .......... .......... .......... .......... .......... 86% 436M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80750K .......... .......... .......... .......... .......... 86% 447M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80800K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80850K .......... .......... .......... .......... .......... 87% 453M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80900K .......... .......... .......... .......... .......... 87% 451M 0s 2024-09-14T11:36:47.176 INFO:teuthology.orchestra.run.smithi130.stderr: 80950K .......... .......... .......... .......... .......... 87% 273M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81000K .......... .......... .......... .......... .......... 87% 392M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81050K .......... .......... .......... .......... .......... 87% 430M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81100K .......... .......... .......... .......... .......... 87% 378M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81150K .......... .......... .......... .......... .......... 87% 435M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81200K .......... .......... .......... .......... .......... 87% 72.3M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81250K .......... .......... .......... .......... .......... 87% 399M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81300K .......... .......... .......... .......... .......... 87% 388M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81350K .......... .......... .......... .......... .......... 87% 318M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81400K .......... .......... .......... .......... .......... 87% 95.3M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81450K .......... .......... .......... .......... .......... 87% 441M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81500K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81550K .......... .......... .......... .......... .......... 87% 434M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81600K .......... .......... .......... .......... .......... 87% 438M 0s 2024-09-14T11:36:47.177 INFO:teuthology.orchestra.run.smithi130.stderr: 81650K .......... .......... .......... .......... .......... 87% 441M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81700K .......... .......... .......... .......... .......... 87% 395M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81750K .......... .......... .......... .......... .......... 88% 151M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81800K .......... .......... .......... .......... .......... 88% 449M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81850K .......... .......... .......... .......... .......... 88% 422M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81900K .......... .......... .......... .......... .......... 88% 476M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 81950K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82000K .......... .......... .......... .......... .......... 88% 442M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82050K .......... .......... .......... .......... .......... 88% 310M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82100K .......... .......... .......... .......... .......... 88% 238M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82150K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82200K .......... .......... .......... .......... .......... 88% 420M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82250K .......... .......... .......... .......... .......... 88% 387M 0s 2024-09-14T11:36:47.178 INFO:teuthology.orchestra.run.smithi130.stderr: 82300K .......... .......... .......... .......... .......... 88% 450M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82350K .......... .......... .......... .......... .......... 88% 439M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82400K .......... .......... .......... .......... .......... 88% 428M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82450K .......... .......... .......... .......... .......... 88% 373M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82500K .......... .......... .......... .......... .......... 88% 74.1M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82550K .......... .......... .......... .......... .......... 88% 88.9M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82600K .......... .......... .......... .......... .......... 88% 290M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82650K .......... .......... .......... .......... .......... 89% 126M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82700K .......... .......... .......... .......... .......... 89% 134M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82750K .......... .......... .......... .......... .......... 89% 69.8M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82800K .......... .......... .......... .......... .......... 89% 56.7M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82850K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82900K .......... .......... .......... .......... .......... 89% 138M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 82950K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-14T11:36:47.179 INFO:teuthology.orchestra.run.smithi130.stderr: 83000K .......... .......... .......... .......... .......... 89% 165M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83050K .......... .......... .......... .......... .......... 89% 428M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83100K .......... .......... .......... .......... .......... 89% 74.1M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83150K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83200K .......... .......... .......... .......... .......... 89% 439M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83250K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83300K .......... .......... .......... .......... .......... 89% 118M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83350K .......... .......... .......... .......... .......... 89% 198M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83400K .......... .......... .......... .......... .......... 89% 437M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83450K .......... .......... .......... .......... .......... 89% 435M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83500K .......... .......... .......... .......... .......... 89% 434M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83550K .......... .......... .......... .......... .......... 89% 371M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83600K .......... .......... .......... .......... .......... 90% 449M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83650K .......... .......... .......... .......... .......... 90% 445M 0s 2024-09-14T11:36:47.180 INFO:teuthology.orchestra.run.smithi130.stderr: 83700K .......... .......... .......... .......... .......... 90% 449M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 83750K .......... .......... .......... .......... .......... 90% 333M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 83800K .......... .......... .......... .......... .......... 90% 448M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 83850K .......... .......... .......... .......... .......... 90% 439M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 83900K .......... .......... .......... .......... .......... 90% 433M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 83950K .......... .......... .......... .......... .......... 90% 368M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84000K .......... .......... .......... .......... .......... 90% 451M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84050K .......... .......... .......... .......... .......... 90% 456M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84100K .......... .......... .......... .......... .......... 90% 452M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84150K .......... .......... .......... .......... .......... 90% 407M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84200K .......... .......... .......... .......... .......... 90% 193M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84250K .......... .......... .......... .......... .......... 90% 437M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84300K .......... .......... .......... .......... .......... 90% 437M 0s 2024-09-14T11:36:47.181 INFO:teuthology.orchestra.run.smithi130.stderr: 84350K .......... .......... .......... .......... .......... 90% 371M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84400K .......... .......... .......... .......... .......... 90% 228M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84450K .......... .......... .......... .......... .......... 90% 52.9M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84500K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84550K .......... .......... .......... .......... .......... 91% 370M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84600K .......... .......... .......... .......... .......... 91% 419M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84650K .......... .......... .......... .......... .......... 91% 428M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84700K .......... .......... .......... .......... .......... 91% 424M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84750K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84800K .......... .......... .......... .......... .......... 91% 422M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84850K .......... .......... .......... .......... .......... 91% 430M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84900K .......... .......... .......... .......... .......... 91% 425M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 84950K .......... .......... .......... .......... .......... 91% 374M 0s 2024-09-14T11:36:47.182 INFO:teuthology.orchestra.run.smithi130.stderr: 85000K .......... .......... .......... .......... .......... 91% 426M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85050K .......... .......... .......... .......... .......... 91% 406M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85100K .......... .......... .......... .......... .......... 91% 436M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85150K .......... .......... .......... .......... .......... 91% 380M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85200K .......... .......... .......... .......... .......... 91% 438M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85250K .......... .......... .......... .......... .......... 91% 433M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85300K .......... .......... .......... .......... .......... 91% 437M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85350K .......... .......... .......... .......... .......... 91% 377M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85400K .......... .......... .......... .......... .......... 91% 98.1M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85450K .......... .......... .......... .......... .......... 92% 368M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85500K .......... .......... .......... .......... .......... 92% 427M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85550K .......... .......... .......... .......... .......... 92% 362M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85600K .......... .......... .......... .......... .......... 92% 75.5M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85650K .......... .......... .......... .......... .......... 92% 373M 0s 2024-09-14T11:36:47.183 INFO:teuthology.orchestra.run.smithi130.stderr: 85700K .......... .......... .......... .......... .......... 92% 72.1M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 85750K .......... .......... .......... .......... .......... 92% 322M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 85800K .......... .......... .......... .......... .......... 92% 113M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 85850K .......... .......... .......... .......... .......... 92% 60.0M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 85900K .......... .......... .......... .......... .......... 92% 275M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 85950K .......... .......... .......... .......... .......... 92% 217M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86000K .......... .......... .......... .......... .......... 92% 187M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86050K .......... .......... .......... .......... .......... 92% 126M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86100K .......... .......... .......... .......... .......... 92% 425M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86150K .......... .......... .......... .......... .......... 92% 69.3M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86200K .......... .......... .......... .......... .......... 92% 438M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86250K .......... .......... .......... .......... .......... 92% 444M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86300K .......... .......... .......... .......... .......... 92% 442M 0s 2024-09-14T11:36:47.184 INFO:teuthology.orchestra.run.smithi130.stderr: 86350K .......... .......... .......... .......... .......... 93% 412M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86400K .......... .......... .......... .......... .......... 93% 113M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86450K .......... .......... .......... .......... .......... 93% 228M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86500K .......... .......... .......... .......... .......... 93% 202M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86550K .......... .......... .......... .......... .......... 93% 173M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86600K .......... .......... .......... .......... .......... 93% 447M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86650K .......... .......... .......... .......... .......... 93% 362M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86700K .......... .......... .......... .......... .......... 93% 428M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86750K .......... .......... .......... .......... .......... 93% 440M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86800K .......... .......... .......... .......... .......... 93% 439M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86850K .......... .......... .......... .......... .......... 93% 394M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86900K .......... .......... .......... .......... .......... 93% 452M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 86950K .......... .......... .......... .......... .......... 93% 448M 0s 2024-09-14T11:36:47.185 INFO:teuthology.orchestra.run.smithi130.stderr: 87000K .......... .......... .......... .......... .......... 93% 417M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87050K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87100K .......... .......... .......... .......... .......... 93% 473M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87150K .......... .......... .......... .......... .......... 93% 390M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87200K .......... .......... .......... .......... .......... 93% 431M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87250K .......... .......... .......... .......... .......... 93% 447M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87300K .......... .......... .......... .......... .......... 94% 436M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87350K .......... .......... .......... .......... .......... 94% 372M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87400K .......... .......... .......... .......... .......... 94% 428M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87450K .......... .......... .......... .......... .......... 94% 438M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87500K .......... .......... .......... .......... .......... 94% 64.6M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87550K .......... .......... .......... .......... .......... 94% 218M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87600K .......... .......... .......... .......... .......... 94% 83.8M 0s 2024-09-14T11:36:47.186 INFO:teuthology.orchestra.run.smithi130.stderr: 87650K .......... .......... .......... .......... .......... 94% 444M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87700K .......... .......... .......... .......... .......... 94% 346M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87750K .......... .......... .......... .......... .......... 94% 405M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87800K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87850K .......... .......... .......... .......... .......... 94% 440M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87900K .......... .......... .......... .......... .......... 94% 433M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 87950K .......... .......... .......... .......... .......... 94% 437M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88000K .......... .......... .......... .......... .......... 94% 257M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88050K .......... .......... .......... .......... .......... 94% 454M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88100K .......... .......... .......... .......... .......... 94% 425M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88150K .......... .......... .......... .......... .......... 94% 428M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88200K .......... .......... .......... .......... .......... 94% 400M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88250K .......... .......... .......... .......... .......... 95% 452M 0s 2024-09-14T11:36:47.187 INFO:teuthology.orchestra.run.smithi130.stderr: 88300K .......... .......... .......... .......... .......... 95% 452M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88350K .......... .......... .......... .......... .......... 95% 325M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88400K .......... .......... .......... .......... .......... 95% 302M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88450K .......... .......... .......... .......... .......... 95% 485M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88500K .......... .......... .......... .......... .......... 95% 401M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88550K .......... .......... .......... .......... .......... 95% 334M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88600K .......... .......... .......... .......... .......... 95% 432M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88650K .......... .......... .......... .......... .......... 95% 446M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88700K .......... .......... .......... .......... .......... 95% 88.4M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88750K .......... .......... .......... .......... .......... 95% 90.4M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88800K .......... .......... .......... .......... .......... 95% 239M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88850K .......... .......... .......... .......... .......... 95% 97.9M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88900K .......... .......... .......... .......... .......... 95% 78.3M 0s 2024-09-14T11:36:47.188 INFO:teuthology.orchestra.run.smithi130.stderr: 88950K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89000K .......... .......... .......... .......... .......... 95% 106M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89050K .......... .......... .......... .......... .......... 95% 315M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89100K .......... .......... .......... .......... .......... 95% 101M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89150K .......... .......... .......... .......... .......... 96% 290M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89200K .......... .......... .......... .......... .......... 96% 127M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89250K .......... .......... .......... .......... .......... 96% 82.5M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89300K .......... .......... .......... .......... .......... 96% 418M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89350K .......... .......... .......... .......... .......... 96% 286M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89400K .......... .......... .......... .......... .......... 96% 426M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89450K .......... .......... .......... .......... .......... 96% 457M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89500K .......... .......... .......... .......... .......... 96% 101M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89550K .......... .......... .......... .......... .......... 96% 396M 0s 2024-09-14T11:36:47.189 INFO:teuthology.orchestra.run.smithi130.stderr: 89600K .......... .......... .......... .......... .......... 96% 493M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89650K .......... .......... .......... .......... .......... 96% 257M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89700K .......... .......... .......... .......... .......... 96% 99.8M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89750K .......... .......... .......... .......... .......... 96% 421M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89800K .......... .......... .......... .......... .......... 96% 437M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89850K .......... .......... .......... .......... .......... 96% 385M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89900K .......... .......... .......... .......... .......... 96% 464M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 89950K .......... .......... .......... .......... .......... 96% 438M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90000K .......... .......... .......... .......... .......... 96% 435M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90050K .......... .......... .......... .......... .......... 96% 368M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90100K .......... .......... .......... .......... .......... 97% 448M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90150K .......... .......... .......... .......... .......... 97% 394M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90200K .......... .......... .......... .......... .......... 97% 435M 0s 2024-09-14T11:36:47.190 INFO:teuthology.orchestra.run.smithi130.stderr: 90250K .......... .......... .......... .......... .......... 97% 399M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90300K .......... .......... .......... .......... .......... 97% 437M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90350K .......... .......... .......... .......... .......... 97% 365M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90400K .......... .......... .......... .......... .......... 97% 447M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90450K .......... .......... .......... .......... .......... 97% 440M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90500K .......... .......... .......... .......... .......... 97% 404M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90550K .......... .......... .......... .......... .......... 97% 439M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90600K .......... .......... .......... .......... .......... 97% 98.1M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90650K .......... .......... .......... .......... .......... 97% 76.6M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90700K .......... .......... .......... .......... .......... 97% 360M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90750K .......... .......... .......... .......... .......... 97% 399M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90800K .......... .......... .......... .......... .......... 97% 300M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90850K .......... .......... .......... .......... .......... 97% 429M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90900K .......... .......... .......... .......... .......... 97% 383M 0s 2024-09-14T11:36:47.191 INFO:teuthology.orchestra.run.smithi130.stderr: 90950K .......... .......... .......... .......... .......... 97% 485M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91000K .......... .......... .......... .......... .......... 98% 349M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91050K .......... .......... .......... .......... .......... 98% 440M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91100K .......... .......... .......... .......... .......... 98% 444M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91150K .......... .......... .......... .......... .......... 98% 444M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91200K .......... .......... .......... .......... .......... 98% 406M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91250K .......... .......... .......... .......... .......... 98% 317M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91300K .......... .......... .......... .......... .......... 98% 239M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91350K .......... .......... .......... .......... .......... 98% 243M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91400K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91450K .......... .......... .......... .......... .......... 98% 440M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91500K .......... .......... .......... .......... .......... 98% 435M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91550K .......... .......... .......... .......... .......... 98% 462M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91600K .......... .......... .......... .......... .......... 98% 466M 0s 2024-09-14T11:36:47.192 INFO:teuthology.orchestra.run.smithi130.stderr: 91650K .......... .......... .......... .......... .......... 98% 175M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91700K .......... .......... .......... .......... .......... 98% 419M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91750K .......... .......... .......... .......... .......... 98% 444M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91800K .......... .......... .......... .......... .......... 98% 103M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91850K .......... .......... .......... .......... .......... 98% 133M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91900K .......... .......... .......... .......... .......... 98% 125M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 91950K .......... .......... .......... .......... .......... 99% 314M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92000K .......... .......... .......... .......... .......... 99% 61.8M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92050K .......... .......... .......... .......... .......... 99% 239M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92100K .......... .......... .......... .......... .......... 99% 106M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92150K .......... .......... .......... .......... .......... 99% 221M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92200K .......... .......... .......... .......... .......... 99% 404M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92250K .......... .......... .......... .......... .......... 99% 93.3M 0s 2024-09-14T11:36:47.193 INFO:teuthology.orchestra.run.smithi130.stderr: 92300K .......... .......... .......... .......... .......... 99% 99.5M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92350K .......... .......... .......... .......... .......... 99% 233M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92400K .......... .......... .......... .......... .......... 99% 184M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92450K .......... .......... .......... .......... .......... 99% 440M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92500K .......... .......... .......... .......... .......... 99% 429M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92550K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92600K .......... .......... .......... .......... .......... 99% 119M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92650K .......... .......... .......... .......... .......... 99% 291M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92700K .......... .......... .......... .......... .......... 99% 445M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92750K .......... .......... .......... .......... .......... 99% 146M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92800K .......... .......... .......... .......... .......... 99% 146M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92850K .......... .......... .......... .......... .......... 99% 308M 0s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:36:47.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14 11:36:46 (198 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:36:47.195 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:36:47.227 INFO:teuthology.orchestra.run.smithi130.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:36:47.228 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:36:47.229 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:36:47.230 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:36:47.231 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:36:47.232 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:36:47.233 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:36:47.234 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:36:47.235 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:36:47.236 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:36:47.237 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:36:47.238 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:36:47.239 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:36:47.240 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:36:47.241 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:36:47.242 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:36:47.243 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:36:47.244 INFO:teuthology.orchestra.run.smithi130.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout:Here are the highlights of this release: 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Advanced control of transitive versions 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Support for optional features and dependencies 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Rules to tweak published metadata 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Support for Java 13 2024-09-14T11:36:47.299 INFO:teuthology.orchestra.run.smithi130.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: - New Zinc compiler for Scala 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: - VS2019 support 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:------------------------------------------------------------ 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:Gradle 6.0.1 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:------------------------------------------------------------ 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:36:47.300 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout:Kotlin: 1.3.50 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout:Groovy: 2.5.8 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:36:47.301 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.303 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:36:47.303 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:36:47.303 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:36:47.303 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:36:47.303 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:36:47.303 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:36:47.556 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:36:47.556 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:36:47.556 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'YGXDHOGCZWUVABNEHGNE', 'access_secret': '1zbtptKj1PkR7gnwdHiASQCMMd2v2KYRkpZ1M1Ca0+Y+IxByYD6k/w==', 'region': 'mexico', 'endpoint': 'smithi130.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi130.front.sepia.ceph.com'} 2024-09-14T11:36:47.556 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:36:47.556 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'YGXDHOGCZWUVABNEHGNE', '--secret', '1zbtptKj1PkR7gnwdHiASQCMMd2v2KYRkpZ1M1Ca0+Y+IxByYD6k/w==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:36:47.557 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key YGXDHOGCZWUVABNEHGNE --secret 1zbtptKj1PkR7gnwdHiASQCMMd2v2KYRkpZ1M1Ca0+Y+IxByYD6k/w== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:36:47.621 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:47.621 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:47.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.656+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.656 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 realm 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.658+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.659+0000 7f85d1f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:47.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.659+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.660+0000 7f85d1f40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:47.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.660+0000 7f85d1f40800 20 searching for the correct realm 2024-09-14T11:36:47.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.662+0000 7f85ce4c1640 0 -- 172.21.15.130:0/2015744611 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f85c406b020 msgr2=0x7f85c40a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:47.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.868+0000 7f85ce4c1640 0 -- 172.21.15.130:0/2015744611 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f85c406b020 msgr2=0x7f85c40a4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:47.871 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.872+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 zone default found 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 4 Realm: () 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:47.873 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 zonegroup default 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.873+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 started sync module instance, tier type = 2024-09-14T11:36:47.874 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.874+0000 7f85d1f40800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=0 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=1 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=2 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=3 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=4 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=5 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.884+0000 7f85d1f40800 20 add_watcher() i=6 2024-09-14T11:36:47.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.885+0000 7f85d1f40800 20 add_watcher() i=7 2024-09-14T11:36:47.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.885+0000 7f85d1f40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f847f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 5 note: GC not initialized 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f847e7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 20 Filter name: none 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f83effff640 20 reqs_thread_entry: start 2024-09-14T11:36:47.886 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:36:47.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.887+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache get: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE : miss 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 20 rados->read ofs=0 len=0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE info.flags=0x0 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 adding default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE to cache LRU end 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache get: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE : hit (negative entry) 2024-09-14T11:36:47.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.888+0000 7f85d1f40800 10 cache get: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE : hit (negative entry) 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f85d1f40800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f85d1f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f84b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94231739371824 notifier 8793 bl.length()=670 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f84b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:36:47.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.890+0000 7f84b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.891+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.891+0000 7f85d1f40800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.891+0000 7f85d1f40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.892+0000 7f84b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94231739369696 notifier 8793 bl.length()=200 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.892+0000 7f84b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:36:47.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.892+0000 7f84b17fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f85d1f40800 10 cache put: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE info.flags=0x7 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f85d1f40800 10 moving default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE to cache LRU end 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f85d1f40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:YGXDHOGCZWUVABNEHGNE, ofs0, ns] 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f84b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94231739379808 notifier 8793 bl.length()=189 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f84b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE info.flags=0x7 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.893+0000 7f84b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YGXDHOGCZWUVABNEHGNE to cache LRU end 2024-09-14T11:36:47.892 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "tester.client.0", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "tester.client.0", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "YGXDHOGCZWUVABNEHGNE", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "1zbtptKj1PkR7gnwdHiASQCMMd2v2KYRkpZ1M1Ca0+Y+IxByYD6k/w==", 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:36:47.893 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:36:47.889869Z" 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:36:47.894 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:36:47.889857Z", 2024-09-14T11:36:47.895 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.895+0000 7f847f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.897+0000 7f85d1f40800 20 remove_watcher() i=0 2024-09-14T11:36:47.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.897+0000 7f85d1f40800 2 removed watcher, disabling cache 2024-09-14T11:36:47.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.898+0000 7f85d1f40800 20 remove_watcher() i=1 2024-09-14T11:36:47.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.899+0000 7f85d1f40800 20 remove_watcher() i=2 2024-09-14T11:36:47.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.901+0000 7f85d1f40800 20 remove_watcher() i=3 2024-09-14T11:36:47.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.902+0000 7f85d1f40800 20 remove_watcher() i=4 2024-09-14T11:36:47.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.903+0000 7f85d1f40800 20 remove_watcher() i=5 2024-09-14T11:36:47.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.904+0000 7f85d1f40800 20 remove_watcher() i=6 2024-09-14T11:36:47.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:47.905+0000 7f85d1f40800 20 remove_watcher() i=7 2024-09-14T11:36:47.915 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:36:47.915 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:36:47.945 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:36:47.945 DEBUG:teuthology.orchestra.run.smithi130:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:36:48.013 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:36:48.106 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.106 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.144+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 realm 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.146+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.147+0000 7f5f3a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.147+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.148+0000 7f5f3a923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.148+0000 7f5f3a923800 20 searching for the correct realm 2024-09-14T11:36:48.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.149+0000 7f5f3660c640 0 -- 172.21.15.130:0/3991021924 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f5f24003b20 msgr2=0x7f5f30016910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.153+0000 7f5f2de0b640 0 -- 172.21.15.130:0/3991021924 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f5f240023b0 msgr2=0x7f5f28093aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 zone default found 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 4 Realm: () 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 zonegroup default 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.159+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 started sync module instance, tier type = 2024-09-14T11:36:48.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.160+0000 7f5f3a923800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=0 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=1 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=2 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=3 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=4 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=5 2024-09-14T11:36:48.168 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.169+0000 7f5f3a923800 20 add_watcher() i=6 2024-09-14T11:36:48.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.170+0000 7f5f3a923800 20 add_watcher() i=7 2024-09-14T11:36:48.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.170+0000 7f5f3a923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.172+0000 7f5ded7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.172+0000 7f5f3a923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.172+0000 7f5f3a923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.207+0000 7f5de77fe640 20 reqs_thread_entry: start 2024-09-14T11:36:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.207+0000 7f5f3a923800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.207+0000 7f5f3a923800 20 Filter name: none 2024-09-14T11:36:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.207+0000 7f5de57fa640 20 reqs_thread_entry: start 2024-09-14T11:36:48.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.207+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:36:48.207 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.209+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.209+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17803982733261994910', time=2024-09-14T13:27:56.009036+0000, chain.objs.size()=4 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.1 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.2 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.3 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.10__multipart_foo.2~pQcs4ZhW0dHc-ZcVrtSnbK6Fr8T0eIZ.4 2024-09-14T11:36:48.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_DeizgXvJ6v8zwR78-aNJoq6qcLLjlCO', time=2024-09-14T13:27:56.046475+0000, chain.objs.size()=2 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.o313R4e9yRfTpIxZICQeq5z6AnLce-u_0 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.o313R4e9yRfTpIxZICQeq5z6AnLce-u_1 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9832184751681929952', time=2024-09-14T13:27:56.064968+0000, chain.objs.size()=2 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_0 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_1 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_Vs3vDZKu6PRySTTrujQnEJMungUVKQ1', time=2024-09-14T13:27:56.095780+0000, chain.objs.size()=2 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.au6EzfvimOVqheZaFmeNd9TL164Y9_z_1 2024-09-14T11:36:48.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.210+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.au6EzfvimOVqheZaFmeNd9TL164Y9_z_2 2024-09-14T11:36:48.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.214+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.217+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:36:48.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.218+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.218+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.219+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.219+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_Az7Uvghjmo5gkJKejfqfMbWfjAiOam_', time=2024-09-14T13:27:56.068792+0000, chain.objs.size()=1 2024-09-14T11:36:48.217 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.219+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.duGToRX4mBzLV-0YDjn-E0bXVkCPbH1_0 2024-09-14T11:36:48.218 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.220+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.222+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:36:48.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.223+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.224+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.224+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.225+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:36:48.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.226+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8323340511491998542', time=2024-09-14T13:27:56.128729+0000, chain.objs.size()=5 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1_1 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2 2024-09-14T11:36:48.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2_1 2024-09-14T11:36:48.227 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.227+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.3 2024-09-14T11:36:48.227 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.229+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.229 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.231+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:36:48.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.232+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.233+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.231 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.233+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.233 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.234+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:36:48.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.235+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.234 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.236+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.236+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.236+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7623194926665877657', time=2024-09-14T13:27:56.193050+0000, chain.objs.size()=3 2024-09-14T11:36:48.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.236+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_0 2024-09-14T11:36:48.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.237+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_1 2024-09-14T11:36:48.235 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.237+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.On2JrBPZsXApa6clcI9Eol33-pw7WBK_2 2024-09-14T11:36:48.237 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.239+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.241+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:36:48.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.242+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7561130587305046999', time=2024-09-14T13:27:56.160929+0000, chain.objs.size()=3 2024-09-14T11:36:48.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.1 2024-09-14T11:36:48.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.2 2024-09-14T11:36:48.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.243+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-STANDARD.2~DcnEXonIAkdSS5n83Rk5mSiTmbpzs7_.3 2024-09-14T11:36:48.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.245+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.246 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.248+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:36:48.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10186100763519683980', time=2024-09-14T13:27:56.120414+0000, chain.objs.size()=5 2024-09-14T11:36:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1 2024-09-14T11:36:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.1_1 2024-09-14T11:36:48.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2 2024-09-14T11:36:48.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.2_1 2024-09-14T11:36:48.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.249+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-LUKEWARM.2~VXJiP1SHx3vMjP_sqNnIN3BK34AzRoI.3 2024-09-14T11:36:48.251 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.252+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.254 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.255+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:36:48.255 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.257+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6609037090344355037', time=2024-09-14T13:27:56.111915+0000, chain.objs.size()=5 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1_1 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2_1 2024-09-14T11:36:48.257 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.258+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.3 2024-09-14T11:36:48.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.260+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.263+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:36:48.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.264+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.264+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.265+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.265+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_hFh7yolTfPCTJu_LnBkIxyRUzcqbDGh', time=2024-09-14T13:27:56.042351+0000, chain.objs.size()=2 2024-09-14T11:36:48.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.265+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.hQ8VvKVmnZQO4uIOd0ifHuo9_PsYpmE_0 2024-09-14T11:36:48.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.265+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.hQ8VvKVmnZQO4uIOd0ifHuo9_PsYpmE_1 2024-09-14T11:36:48.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.267+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.269+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:36:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.270+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.270+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.271+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.271+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14012103814512270143', time=2024-09-14T13:27:56.184522+0000, chain.objs.size()=3 2024-09-14T11:36:48.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.271+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_0 2024-09-14T11:36:48.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.271+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_1 2024-09-14T11:36:48.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.271+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.nnk58I20GHu3F5mKfCAGKX0Tq3vnHIX_2 2024-09-14T11:36:48.271 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.273+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.273 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.275+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:36:48.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.276+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.276+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.277+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.277+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3130798413733992043', time=2024-09-14T13:27:56.072802+0000, chain.objs.size()=2 2024-09-14T11:36:48.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.277+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_0 2024-09-14T11:36:48.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.277+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_1 2024-09-14T11:36:48.277 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.278+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.281+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:36:48.280 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.282+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.282+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6721268573605664635', time=2024-09-14T13:27:55.942998+0000, chain.objs.size()=7 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.1 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.1_1 2024-09-14T11:36:48.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.2 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.2_1 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.3 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__shadow_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.3_1 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.12__multipart_foo.2~Zb3JDg4PoetLFz8SHyBdQ-OlXWNlaQT.4 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14067117076655289081', time=2024-09-14T13:27:56.099947+0000, chain.objs.size()=5 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1_1 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2_1 2024-09-14T11:36:48.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.283+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.3 2024-09-14T11:36:48.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.288+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.289 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.290+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:36:48.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.292+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.292+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.292+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.293+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:36:48.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.295+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.295+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.296+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.296+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_GSLv2I0Uob_mfWPfb4nZwcujpWTOeFr', time=2024-09-14T13:27:56.107741+0000, chain.objs.size()=3 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.296+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_0 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.296+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_1 2024-09-14T11:36:48.294 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.296+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.Pe8OB1FygUlrtJQPa1-JZkN6daMfGHb_2 2024-09-14T11:36:48.296 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.298+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.298 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.300+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:36:48.299 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.301+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.302+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.302+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.302+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15392047456026118229', time=2024-09-14T13:27:56.057697+0000, chain.objs.size()=2 2024-09-14T11:36:48.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.302+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_0 2024-09-14T11:36:48.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.302+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.UKI9VFjwaGRpDnFQ3HVxbnPDaNuL5qu_1 2024-09-14T11:36:48.302 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.304+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.306+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:36:48.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.307+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10107936100009112501', time=2024-09-14T13:27:56.165207+0000, chain.objs.size()=5 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.1 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.1_1 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.2 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.2_1 2024-09-14T11:36:48.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.308+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-LUKEWARM.2~YnwW4_2MDxQQoTuM0PpMu0SczeGS48L.3 2024-09-14T11:36:48.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.310+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.312+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:36:48.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.313+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.314+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.314+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.315+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:36:48.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_NFdVpq9vZaYnWef5sD4yA4fYDbrJvJ0', time=2024-09-14T13:27:56.132636+0000, chain.objs.size()=3 2024-09-14T11:36:48.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_0 2024-09-14T11:36:48.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_1 2024-09-14T11:36:48.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.317+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.FK7Ja6uLPaFRmPfyOLDoCQfiG7xhtaa_2 2024-09-14T11:36:48.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.320+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.322+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:36:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.323+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.323+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.323+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.324+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:36:48.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2040968818327926524', time=2024-09-14T13:27:55.984888+0000, chain.objs.size()=4 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.1 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.2 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.3 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.11__multipart_foo.2~lZD3_cCxr3T7hTRwjicSTpZyLPxIQ4n.4 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10267730985951509029', time=2024-09-14T13:27:56.124471+0000, chain.objs.size()=5 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.1_1 2024-09-14T11:36:48.326 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.2_1 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-STANDARD.2~aj4FRopdebpIjp4zyVkKcgQTJhrrkTL.3 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8459172432023098428', time=2024-09-14T13:27:56.136559+0000, chain.objs.size()=5 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.326+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.327+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.1_1 2024-09-14T11:36:48.327 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.327+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2 2024-09-14T11:36:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.330+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.2_1 2024-09-14T11:36:48.329 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.330+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.17__multipart_foo-FROZEN.2~aiuDCoHCd3MkUg3nDuvCk16z804mfmQ.3 2024-09-14T11:36:48.331 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.333+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.333 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.335+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:36:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.336+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.335 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.337+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.337+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.338+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:36:48.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.339+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7003922205286755087', time=2024-09-14T13:27:56.038337+0000, chain.objs.size()=2 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_0 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.XxysASi7RldmMKl7fWhGqOXu4nF9zTY_1 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8216771819420567536', time=2024-09-14T13:27:56.188979+0000, chain.objs.size()=2 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.XA7hoBeioC2Xe7HJNW5EZpcezEToPAu_1 2024-09-14T11:36:48.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.340+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.14__shadow_.XA7hoBeioC2Xe7HJNW5EZpcezEToPAu_2 2024-09-14T11:36:48.341 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.342+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.345+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:36:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.346+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.347+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.347+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.348+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:36:48.347 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.349+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.349+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.350+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.350+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_2tU3Hsa3aP06K8D6EzSfq00pZJKBVzN', time=2024-09-14T13:27:56.030194+0000, chain.objs.size()=1 2024-09-14T11:36:48.348 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.350+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.kOQJvnqLncBu7vf-huOdS749C2jnUgs_0 2024-09-14T11:36:48.349 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.351+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.353+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:36:48.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_XHU1GNLPtsnJ3gU6DICZZjhjMXHmb3O', time=2024-09-14T13:27:56.091668+0000, chain.objs.size()=3 2024-09-14T11:36:48.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_0 2024-09-14T11:36:48.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_1 2024-09-14T11:36:48.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.354+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.2EQQ2RJrQSci47Ng272OAg3zkI_rzrl_2 2024-09-14T11:36:48.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.357+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.359+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:36:48.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.18298258356801202082', time=2024-09-14T13:27:55.962497+0000, chain.objs.size()=4 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.1 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.2 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.3 2024-09-14T11:36:48.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.13__multipart_foo.2~QpqYa2Wh2VuL69z-nLG9XMhk2XkiVho.4 2024-09-14T11:36:48.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_U-OL4qzDI4V0J6ZJHZX9oRcmCxZ0vwd', time=2024-09-14T13:27:56.034184+0000, chain.objs.size()=1 2024-09-14T11:36:48.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.361+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.bxVQ05_UMjQZoKx6BtxUB9FANi6VBwF_1 2024-09-14T11:36:48.362 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.363+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.366+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:36:48.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.367+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.367+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.368+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.369+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:36:48.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.370+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.371+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.371+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.372+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:36:48.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.373+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.373+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.374+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:36:48.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.374+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_6mqFDuL8MQ3pOqfled51hTmQxJ-H8mH', time=2024-09-14T13:27:56.103748+0000, chain.objs.size()=3 2024-09-14T11:36:48.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.374+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_0 2024-09-14T11:36:48.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.374+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_1 2024-09-14T11:36:48.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.374+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.H4vr8rd68cfHq8-ghGeVfRntLiP6lIs_2 2024-09-14T11:36:48.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.376+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.378+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:36:48.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.379+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.379+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.380+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.381+0000 7f5f3a923800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:36:48.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.382+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:36:48.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_E2zE6IqbQHV0XU4EWxN60AT5Wg5dB-d', time=2024-09-14T13:27:56.053726+0000, chain.objs.size()=1 2024-09-14T11:36:48.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.16__shadow_.l87GYvTiBRHlYEGONvTTiJmQ3rMgaCZ_1 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='_6LrTxOkGgOHXMjAIqN2W3SY3skEe8PK', time=2024-09-14T13:27:56.116361+0000, chain.objs.size()=2 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.-PkFJ4mNyVeJu-gkpGc4EB-G1kCSIxb_1 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.17__shadow_.-PkFJ4mNyVeJu-gkpGc4EB-G1kCSIxb_2 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3512108729484560922', time=2024-09-14T13:27:56.156966+0000, chain.objs.size()=5 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.1 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.1_1 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.2 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.15__shadow_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.2_1 2024-09-14T11:36:48.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.383+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.15__multipart_foo-FROZEN.2~6TvhXNb-djlHePZzHMDnO6-ofL_FbxW.3 2024-09-14T11:36:48.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.386+0000 7f5f3a923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:36:48.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.390+0000 7f5ded7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.392+0000 7f5f3a923800 20 remove_watcher() i=0 2024-09-14T11:36:48.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.392+0000 7f5f3a923800 2 removed watcher, disabling cache 2024-09-14T11:36:48.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.393+0000 7f5f3a923800 20 remove_watcher() i=1 2024-09-14T11:36:48.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.393+0000 7f5f3a923800 20 remove_watcher() i=2 2024-09-14T11:36:48.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.394+0000 7f5f3a923800 20 remove_watcher() i=3 2024-09-14T11:36:48.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.395+0000 7f5f3a923800 20 remove_watcher() i=4 2024-09-14T11:36:48.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.396+0000 7f5f3a923800 20 remove_watcher() i=5 2024-09-14T11:36:48.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.397+0000 7f5f3a923800 20 remove_watcher() i=6 2024-09-14T11:36:48.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.398+0000 7f5f3a923800 20 remove_watcher() i=7 2024-09-14T11:36:48.408 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:36:48.459 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.459 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.496+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 realm 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.498+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.499+0000 7f097cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.499+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.500+0000 7f097cb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.500+0000 7f097cb23800 20 searching for the correct realm 2024-09-14T11:36:48.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.502+0000 7f097900d640 0 -- 172.21.15.130:0/1463193862 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0960013030 msgr2=0x7f096001e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.710+0000 7f097900d640 0 -- 172.21.15.130:0/1463193862 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0960013030 msgr2=0x7f096001e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.713+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 zone default found 2024-09-14T11:36:48.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 4 Realm: () 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 zonegroup default 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.714+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.715+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.715+0000 7f097cb23800 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.715+0000 7f097cb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.715+0000 7f097cb23800 20 started sync module instance, tier type = 2024-09-14T11:36:48.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.715+0000 7f097cb23800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=0 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=1 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=2 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=3 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=4 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=5 2024-09-14T11:36:48.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.724+0000 7f097cb23800 20 add_watcher() i=6 2024-09-14T11:36:48.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.725+0000 7f097cb23800 20 add_watcher() i=7 2024-09-14T11:36:48.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.725+0000 7f097cb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.727+0000 7f082efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.727+0000 7f097cb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.727+0000 7f097cb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.759+0000 7f082dfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.760+0000 7f097cb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:36:48.758 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.760+0000 7f097cb23800 20 Filter name: none 2024-09-14T11:36:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.760+0000 7f079f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:48.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.760+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:36:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.761+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.762+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.762+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.763+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:36:48.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.764+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.765+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.765+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.766+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:36:48.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.767+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.766 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.767+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.766 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.768+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.767 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.769+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:36:48.768 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.770+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.769 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.770+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.769 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.771+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.770 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.772+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:36:48.771 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.773+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.772 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.774+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.772 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.774+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.775+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:36:48.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.776+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.776+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.777+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.777+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:36:48.777 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.779+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.780+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.780+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.781+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:36:48.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.782+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.781 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.783+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.781 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.783+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.782 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.784+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:36:48.783 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.785+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.785+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.786+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.787+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:36:48.786 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.788+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.788+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.788+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.789+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:36:48.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.791+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.791+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.791+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.792+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:36:48.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.794+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.794+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.795+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.794 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.795+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:36:48.795 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.797+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.797+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.798+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.797 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.799+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:36:48.798 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.800+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.798 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.800+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.800+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.801+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:36:48.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.802+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.803+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.803+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.804+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:36:48.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.805+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.806+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.806+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.807+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:36:48.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.808+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.809+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.809+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.810+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:36:48.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.811+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.812+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.810 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.812+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.813+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:36:48.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.814+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.815+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.815+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.816+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:36:48.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.817+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.818+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.818+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.819+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:36:48.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.820+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.820+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.820+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.822+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:36:48.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.823+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.823+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.824+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.823 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.825+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:36:48.824 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.826+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.826+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.825 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.828+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.826 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.828+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:36:48.828 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.829+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.828 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.829+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.828 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.829+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.829 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.830+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:36:48.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.832+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.832+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.831 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.832+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.834+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:36:48.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.835+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.835+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.835+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.835 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.836+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:36:48.836 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.838+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.837 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.838+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.837 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.839+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.840+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:36:48.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.841+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.841+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.842+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.844+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:36:48.842 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.844+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.844+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.843 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.844+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.844 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.845+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:36:48.845 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.847+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.846 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.847+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.846 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.847+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.847 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.849+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:36:48.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.850+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.851+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.851+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.852+0000 7f097cb23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:36:48.851 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.853+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.854+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:36:48.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.854+0000 7f097cb23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:36:48.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.857+0000 7f082efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.858+0000 7f097cb23800 20 remove_watcher() i=0 2024-09-14T11:36:48.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.858+0000 7f097cb23800 2 removed watcher, disabling cache 2024-09-14T11:36:48.857 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.859+0000 7f097cb23800 20 remove_watcher() i=1 2024-09-14T11:36:48.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.860+0000 7f097cb23800 20 remove_watcher() i=2 2024-09-14T11:36:48.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.861+0000 7f097cb23800 20 remove_watcher() i=3 2024-09-14T11:36:48.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.862+0000 7f097cb23800 20 remove_watcher() i=4 2024-09-14T11:36:48.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.863+0000 7f097cb23800 20 remove_watcher() i=5 2024-09-14T11:36:48.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.864+0000 7f097cb23800 20 remove_watcher() i=6 2024-09-14T11:36:48.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:36:48.864+0000 7f097cb23800 20 remove_watcher() i=7 2024-09-14T11:36:48.873 DEBUG:teuthology.orchestra.run.smithi130:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:36:49.369 INFO:teuthology.orchestra.run.smithi130.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:36:52.970 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:37:10.968 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileJava 2024-09-14T11:37:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processResources 2024-09-14T11:37:10.969 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :classes 2024-09-14T11:37:11.668 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:11.668 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileTestJava 2024-09-14T11:37:11.669 INFO:teuthology.orchestra.run.smithi130.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:37:11.669 INFO:teuthology.orchestra.run.smithi130.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:37:11.670 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:11.670 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:37:11.670 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :testClasses 2024-09-14T11:37:17.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:17.469 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :test 2024-09-14T11:37:17.469 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:17.469 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:37:18.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:18.068 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:37:18.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:18.368 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:37:18.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:18.369 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:37:18.568 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:18.568 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:37:19.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.268 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:37:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:37:19.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:37:19.568 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.568 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:37:19.568 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.568 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:37:19.768 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:19.768 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:37:20.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:20.168 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:37:20.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:20.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:37:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:20.668 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:37:20.668 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14 11:37:20,624 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:37:24.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:24.869 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:37:25.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:25.268 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:37:25.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:25.268 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:37:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:25.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:37:25.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:25.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:37:25.768 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:25.768 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:37:26.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:26.168 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:37:26.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:26.368 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:37:26.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:26.368 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:37:26.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:26.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:37:28.768 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:28.768 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:37:28.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:28.968 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:37:29.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:29.368 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:37:29.568 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:29.568 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:37:29.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:29.868 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:37:30.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:30.068 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:37:36.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:36.268 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:37:36.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:36.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:37:37.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:37.369 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:37:37.568 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:37.568 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:37:37.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:37.968 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:37:38.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.168 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:37:38.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.468 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:37:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.768 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:37:38.768 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.768 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:37:38.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.968 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:37:38.968 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:38.969 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:37:39.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.268 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:37:39.269 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.269 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:37:39.468 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.469 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:37:39.469 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.469 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:37:39.668 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.669 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:37:39.669 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.669 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:37:39.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.868 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:37:39.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:39.868 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:37:40.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:40.068 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:37:40.168 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:40.168 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:37:40.368 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:40.368 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:37:40.868 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:40.868 INFO:teuthology.orchestra.run.smithi130.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:37:41.068 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:41.068 INFO:teuthology.orchestra.run.smithi130.stdout:---------------------------------------------------------------------- 2024-09-14T11:37:41.068 INFO:teuthology.orchestra.run.smithi130.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:37:41.068 INFO:teuthology.orchestra.run.smithi130.stdout:---------------------------------------------------------------------- 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout:BUILD SUCCESSFUL in 52s 2024-09-14T11:37:41.129 INFO:teuthology.orchestra.run.smithi130.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:37:41.447 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:41.500 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:41.500 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:41.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.538+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 realm 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.539 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.540+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.541+0000 7f74ecb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:41.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.541+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.542+0000 7f74ecb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:41.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.542+0000 7f74ecb46800 20 searching for the correct realm 2024-09-14T11:37:41.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.544+0000 7f74eae38640 0 -- 172.21.15.130:0/112083810 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f74e009b280 msgr2=0x7f74e0008710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:41.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.750+0000 7f74eae38640 0 -- 172.21.15.130:0/112083810 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f74e009b280 msgr2=0x7f74e0008710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.753 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.754 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.754+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 zone default found 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 4 Realm: () 2024-09-14T11:37:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 zonegroup default 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.755+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.756+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.756+0000 7f74ecb46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.756+0000 7f74ecb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.756+0000 7f74ecb46800 20 started sync module instance, tier type = 2024-09-14T11:37:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.756+0000 7f74ecb46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:41.763 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=0 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=1 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=2 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=3 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=4 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=5 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.765+0000 7f74ecb46800 20 add_watcher() i=6 2024-09-14T11:37:41.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.766+0000 7f74ecb46800 20 add_watcher() i=7 2024-09-14T11:37:41.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.766+0000 7f74ecb46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:41.766 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.767+0000 7f73a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:41.766 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.768+0000 7f74ecb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:41.766 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.768+0000 7f74ecb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:41.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.801+0000 7f731b7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:41.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.801+0000 7f74ecb46800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:41.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.801+0000 7f74ecb46800 20 Filter name: none 2024-09-14T11:37:41.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.801+0000 7f73197fa640 20 reqs_thread_entry: start 2024-09-14T11:37:41.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.801+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:41.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.803+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.803+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.803+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.804+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:41.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.805+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.806+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.806+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.807+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:41.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.808+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1625524895562531226', time=2024-09-14T13:37:29.434717+0000, chain.objs.size()=9 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.1 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.1_1 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.2 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.2_1 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.3 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.3_1 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.4 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.4_1 2024-09-14T11:37:41.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.809+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file2.mpg.2~myFJq9s21yylgmeHn4g8t_ct1fhtalD.5 2024-09-14T11:37:41.812 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.814+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.816+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:41.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.818+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.818+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8954767359580704268', time=2024-09-14T13:37:28.820044+0000, chain.objs.size()=9 2024-09-14T11:37:41.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__multipart_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.1 2024-09-14T11:37:41.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__shadow_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.1_1 2024-09-14T11:37:41.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__multipart_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.2 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__shadow_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.2_1 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__multipart_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.3 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__shadow_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.3_1 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__multipart_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.4 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__shadow_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.4_1 2024-09-14T11:37:41.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.819+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.53__multipart_key1.2~fc2lKldWTynMKq9GlRHH-hUh8aKMK7h.5 2024-09-14T11:37:41.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.823+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.824 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.826+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:41.825 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.827+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.827+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.826 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.828+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.827 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.829+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:41.828 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.830+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.829 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.830+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.829 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.831+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.832+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.833+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.833+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='2~n90ywSRemhBKQSD384TI1nkMugXC33g', time=2024-09-14T13:37:29.950230+0000, chain.objs.size()=5 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.55__multipart_key1.2~n90ywSRemhBKQSD384TI1nkMugXC33g.7 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.55__shadow_key1.2~n90ywSRemhBKQSD384TI1nkMugXC33g.7_1 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.55__multipart_key1.2~n90ywSRemhBKQSD384TI1nkMugXC33g.10 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.55__shadow_key1.2~n90ywSRemhBKQSD384TI1nkMugXC33g.10_1 2024-09-14T11:37:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.834+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.55__multipart_key1.2~n90ywSRemhBKQSD384TI1nkMugXC33g.13 2024-09-14T11:37:41.835 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.836+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.837 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.839+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:41.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.840+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11975613374301794637', time=2024-09-14T13:37:24.802184+0000, chain.objs.size()=7 2024-09-14T11:37:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.1 2024-09-14T11:37:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.1_1 2024-09-14T11:37:41.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.1_2 2024-09-14T11:37:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.2 2024-09-14T11:37:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.2_1 2024-09-14T11:37:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.2_2 2024-09-14T11:37:41.841 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.841+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IU7YN356kDQYE0x8STt3_jbg_B5VYQ6.3 2024-09-14T11:37:41.843 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.845+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.846 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.847+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:41.847 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.848+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9051100768137452938', time=2024-09-14T13:37:24.942972+0000, chain.objs.size()=7 2024-09-14T11:37:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.1 2024-09-14T11:37:41.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.1_1 2024-09-14T11:37:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.1_2 2024-09-14T11:37:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.2 2024-09-14T11:37:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.2_1 2024-09-14T11:37:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.2_2 2024-09-14T11:37:41.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.849+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~IE8bDhyBxpHZdxuhNnT8f0xIXM9EO_g.3 2024-09-14T11:37:41.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.853+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.856+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:41.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.857+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.857+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.858+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.857 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.858+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:41.858 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.860+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.860+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5889423872740464964', time=2024-09-14T13:37:29.423602+0000, chain.objs.size()=9 2024-09-14T11:37:41.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.1 2024-09-14T11:37:41.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.1_1 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.2 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.2_1 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.3 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.3_1 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.4 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__shadow_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.4_1 2024-09-14T11:37:41.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.861+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.54__multipart_file.mpg.2~GK07YTh8OHkDAaD2-gxssdQ2GeeQecJ.5 2024-09-14T11:37:41.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.865+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.867+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:41.867 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.869+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.869+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.868 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15414070315840528898', time=2024-09-14T13:37:37.994149+0000, chain.objs.size()=9 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__multipart_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.1 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__shadow_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.1_1 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__multipart_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.2 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__shadow_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.2_1 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__multipart_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.3 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__shadow_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.3_1 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__multipart_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.4 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__shadow_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.4_1 2024-09-14T11:37:41.869 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.870+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.58__multipart_key1.2~9eAXVyO6U8OjLj6cg_gXQp_OAD_C22b.5 2024-09-14T11:37:41.872 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.874+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.875 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.877+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:41.876 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.878+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.877 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.878+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:37:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5', time=2024-09-14T13:37:18.049515+0000, chain.objs.size()=9 2024-09-14T11:37:41.878 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__multipart_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__shadow_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.1_1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__multipart_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.2 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__shadow_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.2_1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__multipart_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.3 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__shadow_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.3_1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__multipart_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.4 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__shadow_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.4_1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.41__multipart_key1.2~wFLLyWzYDdsCHH9KFkwPi8asq7zVTa5.5 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14559323169040325682', time=2024-09-14T13:37:37.375861+0000, chain.objs.size()=9 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__multipart_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.1 2024-09-14T11:37:41.879 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__shadow_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.1_1 2024-09-14T11:37:41.880 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.879+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__multipart_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.2 2024-09-14T11:37:41.882 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.884+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__shadow_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.2_1 2024-09-14T11:37:41.883 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.884+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__multipart_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.3 2024-09-14T11:37:41.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.884+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__shadow_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.3_1 2024-09-14T11:37:41.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__multipart_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.4 2024-09-14T11:37:41.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__shadow_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.4_1 2024-09-14T11:37:41.884 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.57__multipart_key1.2~SNsWhr76C8OhL-eXIbuezcV2V1lFmwU.5 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3174196193821118321', time=2024-09-14T13:37:40.905577+0000, chain.objs.size()=21 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.1 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.1_1 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.2 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.885+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.2_1 2024-09-14T11:37:41.885 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.887+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.3 2024-09-14T11:37:41.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.889+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.3_1 2024-09-14T11:37:41.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.890+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.4 2024-09-14T11:37:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.4_1 2024-09-14T11:37:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.5 2024-09-14T11:37:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.5_1 2024-09-14T11:37:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.6 2024-09-14T11:37:41.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.6_1 2024-09-14T11:37:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.7 2024-09-14T11:37:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.7_1 2024-09-14T11:37:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.891+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.8 2024-09-14T11:37:41.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.892+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.8_1 2024-09-14T11:37:41.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.893+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.9 2024-09-14T11:37:41.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.893+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.9_1 2024-09-14T11:37:41.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.897+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.10 2024-09-14T11:37:41.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.897+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__shadow_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.10_1 2024-09-14T11:37:41.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.897+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.67__multipart_key1.2~UKEOdPLhuu93zyEJ6M9LUy4rPXDQJql.11 2024-09-14T11:37:41.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.901+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.903+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.904+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10499228856866011596', time=2024-09-14T13:37:20.212020+0000, chain.objs.size()=9 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.1 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.1_1 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.2 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.2_1 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.3 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.3_1 2024-09-14T11:37:41.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.4 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.4_1 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.5 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14817230495864845976', time=2024-09-14T13:37:33.358506+0000, chain.objs.size()=21 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.1 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.1_1 2024-09-14T11:37:41.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.905+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.2 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.2_1 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.3 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.3_1 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.4 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.4_1 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.5 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.5_1 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.6 2024-09-14T11:37:41.909 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.6_1 2024-09-14T11:37:41.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.7 2024-09-14T11:37:41.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.910+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.7_1 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.914+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.8 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.914+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.8_1 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.914+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.9 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.914+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.9_1 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.914+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.10 2024-09-14T11:37:41.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.915+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.10_1 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.915+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Ff3PMyBkDT5SEtub_57KZxDdKg4yUEg.11 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.915+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1215846463901178339', time=2024-09-14T13:37:33.876738+0000, chain.objs.size()=19 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.915+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.1 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.915+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.1_1 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.916+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.2 2024-09-14T11:37:41.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.916+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.2_1 2024-09-14T11:37:41.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.918+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.3 2024-09-14T11:37:41.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.920+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.3_1 2024-09-14T11:37:41.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.920+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.4 2024-09-14T11:37:41.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.920+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.4_1 2024-09-14T11:37:41.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.920+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.5 2024-09-14T11:37:41.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.920+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.5_1 2024-09-14T11:37:41.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.922+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.6 2024-09-14T11:37:41.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.922+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.6_1 2024-09-14T11:37:41.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.924+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.7 2024-09-14T11:37:41.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.924+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.7_1 2024-09-14T11:37:41.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.924+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.8 2024-09-14T11:37:41.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.924+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.8_1 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.924+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.9 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.925+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.9_1 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.925+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~nOWU6paNbA2M2lAlI5teFgoPKcy7kYB.10 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.925+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5401359389599323569', time=2024-09-14T13:37:36.279899+0000, chain.objs.size()=16 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.925+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.1 2024-09-14T11:37:41.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.926+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.1_1 2024-09-14T11:37:41.926 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.927+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.1_2 2024-09-14T11:37:41.926 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.927+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.2 2024-09-14T11:37:41.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.930+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.2_1 2024-09-14T11:37:41.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.930+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.2_2 2024-09-14T11:37:41.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.930+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.3 2024-09-14T11:37:41.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.930+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.3_1 2024-09-14T11:37:41.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.931+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.3_2 2024-09-14T11:37:41.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.931+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.4 2024-09-14T11:37:41.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.931+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.4_1 2024-09-14T11:37:41.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.933+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.4_2 2024-09-14T11:37:41.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.933+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.5 2024-09-14T11:37:41.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.933+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.5_1 2024-09-14T11:37:41.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.933+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.5_2 2024-09-14T11:37:41.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.934+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~BkLYpAlOAdPBt4qb82xWeLminHFVsLo.6 2024-09-14T11:37:41.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.939+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.942+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:41.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.943+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.944+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.944+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.945+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:41.944 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.946+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.946+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12052246601551719655', time=2024-09-14T13:37:36.139404+0000, chain.objs.size()=16 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.1 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.1_1 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.1_2 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.2 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.2_1 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.2_2 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.3 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.3_1 2024-09-14T11:37:41.946 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.3_2 2024-09-14T11:37:41.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.4 2024-09-14T11:37:41.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.4_1 2024-09-14T11:37:41.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.947+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.4_2 2024-09-14T11:37:41.948 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.950+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.5 2024-09-14T11:37:41.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.951+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.5_1 2024-09-14T11:37:41.950 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.951+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.5_2 2024-09-14T11:37:41.950 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.951+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~Rz_yZUEE7oQerj6Zxl6nHBc4Dl1FYUV.6 2024-09-14T11:37:41.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.955+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.958+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:41.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.959+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:37:41.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6000310561153015590', time=2024-09-14T13:37:19.320548+0000, chain.objs.size()=9 2024-09-14T11:37:41.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__multipart_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.1 2024-09-14T11:37:41.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__shadow_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.1_1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__multipart_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.2 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__shadow_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.2_1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__multipart_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.3 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__shadow_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.3_1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__multipart_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.4 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__shadow_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.4_1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.43__multipart_key1.2~MoHmIMmSSrJggcPjSQO3BAViHFEqWqh.5 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2817653428149101129', time=2024-09-14T13:37:22.989878+0000, chain.objs.size()=9 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.1_1 2024-09-14T11:37:41.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.960+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.2 2024-09-14T11:37:41.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.964+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.2_1 2024-09-14T11:37:41.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.965+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.3 2024-09-14T11:37:41.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.965+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.3_1 2024-09-14T11:37:41.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.965+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.4 2024-09-14T11:37:41.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.4_1 2024-09-14T11:37:41.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~fkI6I5antd-uEu_i4DqvRUEZlsnQViZ.5 2024-09-14T11:37:41.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.13033473349507145866', time=2024-09-14T13:37:25.063807+0000, chain.objs.size()=5 2024-09-14T11:37:41.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.47__shadow_.LcyAGA0I5xROfx7pNFfqFUYGTKaON9N_1 2024-09-14T11:37:41.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.47__shadow_.LcyAGA0I5xROfx7pNFfqFUYGTKaON9N_2 2024-09-14T11:37:41.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.966+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.47__shadow_.LcyAGA0I5xROfx7pNFfqFUYGTKaON9N_3 2024-09-14T11:37:41.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.968+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.47__shadow_.LcyAGA0I5xROfx7pNFfqFUYGTKaON9N_4 2024-09-14T11:37:41.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.968+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.47__shadow_.LcyAGA0I5xROfx7pNFfqFUYGTKaON9N_5 2024-09-14T11:37:41.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.968+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14519816685544292930', time=2024-09-14T13:37:26.171099+0000, chain.objs.size()=9 2024-09-14T11:37:41.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.968+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__multipart_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.1 2024-09-14T11:37:41.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.972+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__shadow_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.1_1 2024-09-14T11:37:41.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.972+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__multipart_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.2 2024-09-14T11:37:41.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.972+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__shadow_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.2_1 2024-09-14T11:37:41.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.972+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__multipart_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.3 2024-09-14T11:37:41.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.972+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__shadow_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.3_1 2024-09-14T11:37:41.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.973+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__multipart_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.4 2024-09-14T11:37:41.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.973+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__shadow_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.4_1 2024-09-14T11:37:41.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.974+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.52__multipart_key1.2~J5fUkVH2_UxWvkIguBX7iXwTRW6Wx98.5 2024-09-14T11:37:41.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.978+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.980+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:41.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.982+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9484184416392415696', time=2024-09-14T13:37:34.396493+0000, chain.objs.size()=16 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.1 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.1_1 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.1_2 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.2 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.2_1 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.2_2 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.3 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.3_1 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.3_2 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.4 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.4_1 2024-09-14T11:37:41.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.983+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.4_2 2024-09-14T11:37:41.985 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.987+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.5 2024-09-14T11:37:41.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.988+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.5_1 2024-09-14T11:37:41.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.988+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.5_2 2024-09-14T11:37:41.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.988+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~GQXQAQTYt9m-M7FS8OFXgalnWDQlume.6 2024-09-14T11:37:41.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.992+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:41.993 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.994+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:41.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:41.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:41.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6756769429733986594', time=2024-09-14T13:37:20.333662+0000, chain.objs.size()=9 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.1 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.1_1 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.2 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.2_1 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.3 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.3_1 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.4 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.996+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__shadow_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.4_1 2024-09-14T11:37:41.996 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:41.997+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.45__multipart_key1.2~es1yhrmYQWPGVhzRCWZaCAJSP-kofee.5 2024-09-14T11:37:41.999 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.001+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.003+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:42.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.004+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1863723562748439424', time=2024-09-14T13:37:31.495823+0000, chain.objs.size()=21 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.1_1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.2 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.2_1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.3 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.3_1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.4 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.4_1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.5 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.5_1 2024-09-14T11:37:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.6 2024-09-14T11:37:42.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.005+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.6_1 2024-09-14T11:37:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.008+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.7 2024-09-14T11:37:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.009+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.7_1 2024-09-14T11:37:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.8 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.8_1 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.9 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.9_1 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.10 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__shadow_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.10_1 2024-09-14T11:37:42.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.010+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.56__multipart_key1.2~ZT9sA6wuHvO38w6m-1Gaqp3TcYhhKUw.11 2024-09-14T11:37:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.016+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:42.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.018+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:42.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.019+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.020+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.020+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.021+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:42.020 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.022+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.022+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17478591119533008318', time=2024-09-14T13:37:21.885737+0000, chain.objs.size()=9 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.1 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.1_1 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.2 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.2_1 2024-09-14T11:37:42.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.3 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.3_1 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.4 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.4_1 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~MWDPYs48KU-YC4sBk3fwB3ZhuMVUT3I.5 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs', time=2024-09-14T13:37:38.643701+0000, chain.objs.size()=92 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.1 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.2 2024-09-14T11:37:42.023 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.023+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.3 2024-09-14T11:37:42.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.026+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.4 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.5 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.6 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.7 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.8 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.9 2024-09-14T11:37:42.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.027+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.10 2024-09-14T11:37:42.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.029+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.11 2024-09-14T11:37:42.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.029+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.12 2024-09-14T11:37:42.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.029+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.13 2024-09-14T11:37:42.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.029+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.14 2024-09-14T11:37:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.032+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.15 2024-09-14T11:37:42.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.032+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.16 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.17 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.18 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.19 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.20 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.21 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.22 2024-09-14T11:37:42.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.033+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.23 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.24 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.25 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.26 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.27 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.28 2024-09-14T11:37:42.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.29 2024-09-14T11:37:42.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.037+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.30 2024-09-14T11:37:42.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.039+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.31 2024-09-14T11:37:42.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.039+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.32 2024-09-14T11:37:42.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.039+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.33 2024-09-14T11:37:42.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.039+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.34 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.35 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.36 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.37 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.38 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.39 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.40 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.41 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.42 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.43 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.44 2024-09-14T11:37:42.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.044+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.45 2024-09-14T11:37:42.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.047+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.46 2024-09-14T11:37:42.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.048+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.47 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.48 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.49 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.50 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.51 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.52 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.53 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.54 2024-09-14T11:37:42.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.55 2024-09-14T11:37:42.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.56 2024-09-14T11:37:42.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.049+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.57 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.58 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.59 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.60 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.61 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.62 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.63 2024-09-14T11:37:42.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.054+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.64 2024-09-14T11:37:42.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.056+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.65 2024-09-14T11:37:42.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.056+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.66 2024-09-14T11:37:42.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.056+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.67 2024-09-14T11:37:42.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.056+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.68 2024-09-14T11:37:42.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.058+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.69 2024-09-14T11:37:42.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.059+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.70 2024-09-14T11:37:42.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.059+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.71 2024-09-14T11:37:42.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.059+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.72 2024-09-14T11:37:42.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.059+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.73 2024-09-14T11:37:42.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.061+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.74 2024-09-14T11:37:42.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.061+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.75 2024-09-14T11:37:42.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.061+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.76 2024-09-14T11:37:42.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.061+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.77 2024-09-14T11:37:42.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.062+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.78 2024-09-14T11:37:42.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.062+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.79 2024-09-14T11:37:42.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.062+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.80 2024-09-14T11:37:42.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.063+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.81 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.82 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.83 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.84 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.85 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.86 2024-09-14T11:37:42.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.066+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.87 2024-09-14T11:37:42.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.067+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.88 2024-09-14T11:37:42.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.067+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.89 2024-09-14T11:37:42.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.067+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.90 2024-09-14T11:37:42.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.068+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.91 2024-09-14T11:37:42.067 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.068+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.59__multipart_key1.2~Dx-edLv8eFUqIlGJ2ULMcUlDSrsO-Xs.92 2024-09-14T11:37:42.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.074+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:42.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.076+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:42.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.077+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.078+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.078+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.077 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.079+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:42.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.080+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.080+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.081+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.082+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:42.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.083+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.083+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.083+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.084+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:42.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.085+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1049256852165062413', time=2024-09-14T13:37:23.418147+0000, chain.objs.size()=9 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.1 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.1_1 2024-09-14T11:37:42.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.2 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.2_1 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.3 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.3_1 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.4 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.4_1 2024-09-14T11:37:42.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.086+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~7aP3m-aLWfH9n9AFEOiZLCVJrMg-PhY.5 2024-09-14T11:37:42.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.091+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:42.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.093+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:42.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15681961299256635806', time=2024-09-14T13:37:24.369414+0000, chain.objs.size()=7 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.1 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.1_1 2024-09-14T11:37:42.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.1_2 2024-09-14T11:37:42.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.2 2024-09-14T11:37:42.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.2_1 2024-09-14T11:37:42.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__shadow_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.2_2 2024-09-14T11:37:42.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.095+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.48__multipart_key1.2~pcklIBxWYzlDXUKSas_S2z43Vd1ZYrx.3 2024-09-14T11:37:42.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.098+0000 7f74ecb46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:42.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.102+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:42.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.103+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.103+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.104+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.105+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:42.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.106+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.106+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.106+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.108+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:42.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.109+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.109+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.110+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.111+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:42.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.112+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.112+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.112+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.113+0000 7f74ecb46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:42.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.115+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.115+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.115+0000 7f74ecb46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.117+0000 7f73a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:42.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.119+0000 7f74ecb46800 20 remove_watcher() i=0 2024-09-14T11:37:42.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.119+0000 7f74ecb46800 2 removed watcher, disabling cache 2024-09-14T11:37:42.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.120+0000 7f74ecb46800 20 remove_watcher() i=1 2024-09-14T11:37:42.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.121+0000 7f74ecb46800 20 remove_watcher() i=2 2024-09-14T11:37:42.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.122+0000 7f74ecb46800 20 remove_watcher() i=3 2024-09-14T11:37:42.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.123+0000 7f74ecb46800 20 remove_watcher() i=4 2024-09-14T11:37:42.122 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.124+0000 7f74ecb46800 20 remove_watcher() i=5 2024-09-14T11:37:42.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.125+0000 7f74ecb46800 20 remove_watcher() i=6 2024-09-14T11:37:42.124 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.126+0000 7f74ecb46800 20 remove_watcher() i=7 2024-09-14T11:37:42.136 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:42.187 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:42.187 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:42.223 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.225+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 realm 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.226+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.227+0000 7f24abe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:42.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.227+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.228+0000 7f24abe87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:42.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.228+0000 7f24abe87800 20 searching for the correct realm 2024-09-14T11:37:42.228 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.230+0000 7f24aa179640 0 -- 172.21.15.130:0/4149932214 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f24a0058bd0 msgr2=0x7f24a0071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:42.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.436+0000 7f24aa179640 0 -- 172.21.15.130:0/4149932214 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f24a0058bd0 msgr2=0x7f24a0071400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.440+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 zone default found 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 4 Realm: () 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 zonegroup default 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.441+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.442+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.442+0000 7f24abe87800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.442+0000 7f24abe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.442+0000 7f24abe87800 20 started sync module instance, tier type = 2024-09-14T11:37:42.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.442+0000 7f24abe87800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=0 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=1 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=2 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=3 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=4 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=5 2024-09-14T11:37:42.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.451+0000 7f24abe87800 20 add_watcher() i=6 2024-09-14T11:37:42.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.452+0000 7f24abe87800 20 add_watcher() i=7 2024-09-14T11:37:42.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.452+0000 7f24abe87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:42.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.454+0000 7f235bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:42.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.455+0000 7f24abe87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:42.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.455+0000 7f24abe87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.490+0000 7f235affd640 20 reqs_thread_entry: start 2024-09-14T11:37:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.490+0000 7f24abe87800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.490+0000 7f24abe87800 20 Filter name: none 2024-09-14T11:37:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.490+0000 7f2358ff9640 20 reqs_thread_entry: start 2024-09-14T11:37:42.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.490+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:42.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.492+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.492+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.493+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.494+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.495+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.496+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.496+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.497+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:42.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.498+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.499+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.499+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.500+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:42.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.501+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.501+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.502+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.503+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:42.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.504+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.504+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.505+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.506+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:42.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.507+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.508+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.508+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.509+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:42.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.511+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.511+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.512+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.513+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:42.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.514+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.514+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.514+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.515+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.517+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.517+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.517+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.518+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.520+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.520+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.520+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.521+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.523+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.523+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.524+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.525+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.526+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.526+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.526+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.527+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.529+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.529+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.529+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.530+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:42.530 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.532+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.532+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.533+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.534+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.535+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.536+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.534 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.536+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.535 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.537+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:42.536 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.538+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.538+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.539+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.540+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:42.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.541+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.542+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.542+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.543+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:42.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.544+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.544+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.545+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.545+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:42.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.547+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.546 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.547+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.546 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.548+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.549+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:42.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.550+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.550+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.551+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.550 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.553+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:42.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.553+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.552 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.553+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.552 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.553+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.554+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.556+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.556+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.556+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.558+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:42.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.559+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.559+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.560+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.561+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.562+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.562+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.562+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.563+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.565+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.565+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.565+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.566+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.567+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.568+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.568+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.569+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.570+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.571+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.571+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.572+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:42.572 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.574+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.572 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.574+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.574+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.575+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:42.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.576+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.577+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.577+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.578+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:42.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.580+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.580+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.580+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.581+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:42.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.582+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.583+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.583+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.584+0000 7f24abe87800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.585+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.585+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.586+0000 7f24abe87800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.587+0000 7f235bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:42.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.590+0000 7f24abe87800 20 remove_watcher() i=0 2024-09-14T11:37:42.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.590+0000 7f24abe87800 2 removed watcher, disabling cache 2024-09-14T11:37:42.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.590+0000 7f24abe87800 20 remove_watcher() i=1 2024-09-14T11:37:42.590 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.591+0000 7f24abe87800 20 remove_watcher() i=2 2024-09-14T11:37:42.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.592+0000 7f24abe87800 20 remove_watcher() i=3 2024-09-14T11:37:42.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.593+0000 7f24abe87800 20 remove_watcher() i=4 2024-09-14T11:37:42.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.594+0000 7f24abe87800 20 remove_watcher() i=5 2024-09-14T11:37:42.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.595+0000 7f24abe87800 20 remove_watcher() i=6 2024-09-14T11:37:42.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.596+0000 7f24abe87800 20 remove_watcher() i=7 2024-09-14T11:37:42.606 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:42.658 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:42.658 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:42.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.697+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.698+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.698+0000 7fc18aa1d800 20 realm 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.698+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.699+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.699+0000 7fc18aa1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.699+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.699+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.699+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.700+0000 7fc18aa1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:42.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.700+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.700+0000 7fc18aa1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:42.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.700+0000 7fc18aa1d800 20 searching for the correct realm 2024-09-14T11:37:42.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.702+0000 7fc1869ec640 0 -- 172.21.15.130:0/1135478882 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc170095c10 msgr2=0x7fc170064950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:42.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.908+0000 7fc1869ec640 0 -- 172.21.15.130:0/1135478882 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc170095c10 msgr2=0x7fc170064950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:42.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:42.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.912+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 zone default found 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 4 Realm: () 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 zonegroup default 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.913+0000 7fc18aa1d800 20 rados->read ofs=0 len=0 2024-09-14T11:37:42.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.914+0000 7fc18aa1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:42.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.914+0000 7fc18aa1d800 20 started sync module instance, tier type = 2024-09-14T11:37:42.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.914+0000 7fc18aa1d800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=0 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=1 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=2 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=3 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=4 2024-09-14T11:37:42.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=5 2024-09-14T11:37:42.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.922+0000 7fc18aa1d800 20 add_watcher() i=6 2024-09-14T11:37:42.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.923+0000 7fc18aa1d800 20 add_watcher() i=7 2024-09-14T11:37:42.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.923+0000 7fc18aa1d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:42.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.925+0000 7fc03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:42.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.925+0000 7fc18aa1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:42.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.925+0000 7fc18aa1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:42.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.958+0000 7fbfb77fe640 20 reqs_thread_entry: start 2024-09-14T11:37:42.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.958+0000 7fc18aa1d800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:42.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.958+0000 7fc18aa1d800 20 Filter name: none 2024-09-14T11:37:42.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.958+0000 7fbfb57fa640 20 reqs_thread_entry: start 2024-09-14T11:37:42.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.958+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:42.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.959+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.960+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.960+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.961+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:42.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.963+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.963+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.963+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.964+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:42.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.965+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.966+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.966+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.967+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:42.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.969+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.969+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.970+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.971+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:42.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.972+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.973+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.973+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.974+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:42.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.975+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.975+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.976+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.977+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:42.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.979+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.979+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.979+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.981+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:42.980 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.982+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.982+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.983+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.984+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:42.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.985+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.984 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.985+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.984 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.986+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.985 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.987+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:42.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.988+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.989+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.989+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.990+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:42.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.991+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.992+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.992+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.993+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:42.993 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.995+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.996+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.994 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.996+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.995 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.997+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.998+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.999+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:42.997 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:42.999+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:42.998 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.000+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:43.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.001+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.002+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.002+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.003+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.004+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.004+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.005+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.004 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.005+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:43.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.007+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.007+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.007+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.008+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:43.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.010+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.010+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.009 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.010+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.010 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.011+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:43.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.013+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.011 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.013+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.013+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.014+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:43.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.016+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.016+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.015 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.016+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.016 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.017+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:43.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.019+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.019+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.018 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.020+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.019 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.021+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:43.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.022+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.023+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.021 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.023+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.022 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.024+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:43.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.025+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.026+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.024 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.026+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.027+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:43.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.028+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.029+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.029+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.030+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.031+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.031+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.032+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.033+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:43.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.034+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.034+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.035+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.035+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.037+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.037+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.038+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.038+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:43.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.040+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.040+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.041+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.041+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.043+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.043+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.043+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.044+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:43.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.045+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.046+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.046+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.047+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:43.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.048+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.048+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.049+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.050+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:43.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.051+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.051+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.052+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.052+0000 7fc18aa1d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:43.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.054+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.055+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.055+0000 7fc18aa1d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.057+0000 7fc03cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:43.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.059+0000 7fc18aa1d800 20 remove_watcher() i=0 2024-09-14T11:37:43.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.059+0000 7fc18aa1d800 2 removed watcher, disabling cache 2024-09-14T11:37:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.060+0000 7fc18aa1d800 20 remove_watcher() i=1 2024-09-14T11:37:43.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.061+0000 7fc18aa1d800 20 remove_watcher() i=2 2024-09-14T11:37:43.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.062+0000 7fc18aa1d800 20 remove_watcher() i=3 2024-09-14T11:37:43.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.063+0000 7fc18aa1d800 20 remove_watcher() i=4 2024-09-14T11:37:43.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.064+0000 7fc18aa1d800 20 remove_watcher() i=5 2024-09-14T11:37:43.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.065+0000 7fc18aa1d800 20 remove_watcher() i=6 2024-09-14T11:37:43.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.066+0000 7fc18aa1d800 20 remove_watcher() i=7 2024-09-14T11:37:43.075 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:43.126 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:43.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.165+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 realm 2024-09-14T11:37:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.165 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.166+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.167+0000 7fe008f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:43.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.167+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.168+0000 7fe008f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:43.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.168+0000 7fe008f23800 20 searching for the correct realm 2024-09-14T11:37:43.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.170+0000 7fe00540d640 0 -- 172.21.15.130:0/2040242529 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdfec01a040 msgr2=0x7fdfec040410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:43.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.376+0000 7fe00540d640 0 -- 172.21.15.130:0/2040242529 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fdfec01a040 msgr2=0x7fdfec040410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:43.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:43.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:43.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.380+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:43.381 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 zone default found 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 4 Realm: () 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 zonegroup default 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.381+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.382+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.382+0000 7fe008f23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:43.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.382+0000 7fe008f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:43.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.382+0000 7fe008f23800 20 started sync module instance, tier type = 2024-09-14T11:37:43.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.382+0000 7fe008f23800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=0 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=1 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=2 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=3 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=4 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=5 2024-09-14T11:37:43.390 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.391+0000 7fe008f23800 20 add_watcher() i=6 2024-09-14T11:37:43.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.392+0000 7fe008f23800 20 add_watcher() i=7 2024-09-14T11:37:43.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.392+0000 7fe008f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:43.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.393+0000 7fdebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:43.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.394+0000 7fe008f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:43.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.394+0000 7fe008f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:43.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.429+0000 7fdeba7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:43.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.429+0000 7fe008f23800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:43.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.429+0000 7fe008f23800 20 Filter name: none 2024-09-14T11:37:43.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.429+0000 7fdeb3fff640 20 reqs_thread_entry: start 2024-09-14T11:37:43.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.429+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:43.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.430+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.431+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.431+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.432+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:43.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.434+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.434+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.434+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.435+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:43.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.437+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.437+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.437+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.438+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:43.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.439+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.440+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.440+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.441+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:43.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.442+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.443+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.443+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.444+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:43.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.445+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.446+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.446+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.447+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:43.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.448+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.449+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.449+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.450+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:43.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.452+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.452+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.452+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.454+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:43.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.455+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.455+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.455+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.456+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:43.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.458+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.458+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.458+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.460+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:43.459 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.461+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.461+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.461+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.462+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:43.462 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.464+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.464+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.465+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.466+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:43.465 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.467+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.467+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.468+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.469+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:43.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.470+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.470+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.470+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.471+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:43.471 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.473+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.473+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.473+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.474+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:43.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.475+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.476+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.476+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.477+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:43.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.478+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.478+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.479+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.480+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:43.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.481+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.480 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.481+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.480 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.482+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.483+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:43.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.484+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.484+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.485+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.485+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:43.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.487+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.487+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.487+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.488+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.489+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.490+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.490+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.491+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.492+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.493+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.493+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.494+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:43.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.495+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.496+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.496+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.497+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:43.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.498+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.498+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.499+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.499+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:43.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.501+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.501+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.502+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.502+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:43.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.504+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.504+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.504+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.505+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:43.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.507+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.507+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.507+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.508+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:43.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.510+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.510+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.510+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.511+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:43.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.513+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.513+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.513+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.514+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:43.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.515+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.516+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.516+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.517+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:43.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.518+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.519+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.519+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.520+0000 7fe008f23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:43.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.521+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.522+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:43.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.522+0000 7fe008f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:43.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.524+0000 7fdebb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:43.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.526+0000 7fe008f23800 20 remove_watcher() i=0 2024-09-14T11:37:43.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.526+0000 7fe008f23800 2 removed watcher, disabling cache 2024-09-14T11:37:43.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.527+0000 7fe008f23800 20 remove_watcher() i=1 2024-09-14T11:37:43.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.528+0000 7fe008f23800 20 remove_watcher() i=2 2024-09-14T11:37:43.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.529+0000 7fe008f23800 20 remove_watcher() i=3 2024-09-14T11:37:43.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.530+0000 7fe008f23800 20 remove_watcher() i=4 2024-09-14T11:37:43.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.531+0000 7fe008f23800 20 remove_watcher() i=5 2024-09-14T11:37:43.530 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.532+0000 7fe008f23800 20 remove_watcher() i=6 2024-09-14T11:37:43.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:43.533+0000 7fe008f23800 20 remove_watcher() i=7 2024-09-14T11:37:43.542 DEBUG:teuthology.orchestra.run.smithi130:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:37:44.146 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :clean 2024-09-14T11:37:44.944 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileJava 2024-09-14T11:37:44.944 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processResources 2024-09-14T11:37:44.944 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :classes 2024-09-14T11:37:45.444 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:45.445 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileTestJava 2024-09-14T11:37:45.445 INFO:teuthology.orchestra.run.smithi130.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:37:45.445 INFO:teuthology.orchestra.run.smithi130.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:37:45.446 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:45.446 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:37:45.446 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :testClasses 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :test 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14 11:37:46,706 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.446 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.447 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:37:47.644 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.644 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:37:47.744 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.744 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:37:47.844 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.844 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:37:47.944 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:47.944 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:37:48.144 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.144 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:37:48.144 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.144 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:37:48.244 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.244 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:37:48.344 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.344 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:37:48.644 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.644 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:37:48.744 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.744 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:37:48.944 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.944 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:37:48.945 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:48.945 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:37:49.045 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:49.045 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------- 2024-09-14T11:37:49.045 INFO:teuthology.orchestra.run.smithi130.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:37:49.045 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------- 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:BUILD SUCCESSFUL in 5s 2024-09-14T11:37:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:5 actionable tasks: 5 executed 2024-09-14T11:37:49.051 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:49.102 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:49.103 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:49.139 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.142+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.141 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 realm 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.144+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.145+0000 7eff9110c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:49.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.145+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.146+0000 7eff9110c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:49.143 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.146+0000 7eff9110c800 20 searching for the correct realm 2024-09-14T11:37:49.145 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.148+0000 7eff87fff640 0 -- 172.21.15.130:0/4134720699 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7eff800cebd0 msgr2=0x7eff800aeaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:49.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.152+0000 7eff8ebfd640 0 -- 172.21.15.130:0/4134720699 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7eff88022070 msgr2=0x7eff8806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:49.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.359+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:49.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:49.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 zone default found 2024-09-14T11:37:49.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 4 Realm: () 2024-09-14T11:37:49.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 zonegroup default 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.360+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 started sync module instance, tier type = 2024-09-14T11:37:49.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.361+0000 7eff9110c800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:49.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=0 2024-09-14T11:37:49.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=1 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=2 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=3 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=4 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=5 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.371+0000 7eff9110c800 20 add_watcher() i=6 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.372+0000 7eff9110c800 20 add_watcher() i=7 2024-09-14T11:37:49.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.372+0000 7eff9110c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:49.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.374+0000 7efe457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:49.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.374+0000 7eff9110c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:49.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.374+0000 7eff9110c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.412+0000 7efdbffff640 20 reqs_thread_entry: start 2024-09-14T11:37:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.412+0000 7eff9110c800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.412+0000 7eff9110c800 20 Filter name: none 2024-09-14T11:37:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.412+0000 7efdbdffb640 20 reqs_thread_entry: start 2024-09-14T11:37:49.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.412+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:49.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.414+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.414+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.412 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.414+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.416+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:49.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.417+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.417+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.418+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.419+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:49.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.420+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.421+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.421+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.422+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:49.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.423+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.423+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.424+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.424+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:49.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.426+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.426+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.426+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.427+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:49.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.429+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.429+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.430+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.431+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:49.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.432+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.432+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.433+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.434+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:49.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.435+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.436+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.436+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.437+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:49.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.438+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.438+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.439+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.440+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:49.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.441+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.442+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.442+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.443+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:49.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.444+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.445+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.445+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.446+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:49.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.448+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.448+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.448+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.450+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:49.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.452+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.452+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.452+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.453+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:49.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.455+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.455+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.456+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.457+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:49.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.458+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.459+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.459+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.460+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:49.459 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.462+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.463+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.463+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.464+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:49.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.465+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.466+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.466+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.467+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:49.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.469+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.469+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.469+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.470+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:49.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.472+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.472+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.472+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.471 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.473+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:49.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.475+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.475+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.475+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.476+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:49.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.478+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.478+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.478+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.477 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.479+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:49.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.481+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.481+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.482+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.480 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.483+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:49.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.484+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.484+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.485+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.486+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:49.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.487+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.488+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.488+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.489+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:49.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.490+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.490+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.490+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.491+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:49.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.493+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.493+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.493+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.494+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:49.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.496+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.496+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.496+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.497+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:49.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.499+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.499+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.500+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.500+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:49.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.502+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.502+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.503+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.504+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.505+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.506+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.506+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.507+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:49.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.508+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.509+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.509+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.510+0000 7eff9110c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:49.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.511+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.512+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.512+0000 7eff9110c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.514+0000 7efe457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:49.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.516+0000 7eff9110c800 20 remove_watcher() i=0 2024-09-14T11:37:49.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.516+0000 7eff9110c800 2 removed watcher, disabling cache 2024-09-14T11:37:49.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.518+0000 7eff9110c800 20 remove_watcher() i=1 2024-09-14T11:37:49.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.518+0000 7eff9110c800 20 remove_watcher() i=2 2024-09-14T11:37:49.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.519+0000 7eff9110c800 20 remove_watcher() i=3 2024-09-14T11:37:49.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.521+0000 7eff9110c800 20 remove_watcher() i=4 2024-09-14T11:37:49.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.522+0000 7eff9110c800 20 remove_watcher() i=5 2024-09-14T11:37:49.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.523+0000 7eff9110c800 20 remove_watcher() i=6 2024-09-14T11:37:49.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.524+0000 7eff9110c800 20 remove_watcher() i=7 2024-09-14T11:37:49.532 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:49.583 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:49.583 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:49.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.624+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 realm 2024-09-14T11:37:49.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.626+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.627+0000 7f139233e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:49.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.627+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.627+0000 7f139233e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:49.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.627+0000 7f139233e800 20 searching for the correct realm 2024-09-14T11:37:49.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.628+0000 7f138e0c0640 0 -- 172.21.15.130:0/3039314956 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x564a37f2b8b0 msgr2=0x7f1388064b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:49.830 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.833+0000 7f138d8bf640 0 -- 172.21.15.130:0/3039314956 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f13800d5040 msgr2=0x7f13800bc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:49.838 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.839+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 zone default found 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 4 Realm: () 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:49.839 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 zonegroup default 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.840+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.841+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.841+0000 7f139233e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.841+0000 7f139233e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.841+0000 7f139233e800 20 started sync module instance, tier type = 2024-09-14T11:37:49.840 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.841+0000 7f139233e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=0 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=1 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=2 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=3 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=4 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=5 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.850+0000 7f139233e800 20 add_watcher() i=6 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.851+0000 7f139233e800 20 add_watcher() i=7 2024-09-14T11:37:49.848 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.851+0000 7f139233e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:49.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.852+0000 7f1244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:49.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.853+0000 7f139233e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:49.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.853+0000 7f139233e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:49.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.889+0000 7f11bf7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:49.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.889+0000 7f139233e800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:49.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.889+0000 7f139233e800 20 Filter name: none 2024-09-14T11:37:49.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.889+0000 7f11bd7fa640 20 reqs_thread_entry: start 2024-09-14T11:37:49.887 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.889+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:49.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.890+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.888 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.891+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.891+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.889 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.892+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:49.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.893+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.894+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.891 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.894+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.895+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:49.893 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.896+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.896+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.894 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.897+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.895 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.898+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:49.896 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.899+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.899+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.899+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.900+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:49.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.902+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.902+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.900 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.902+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.901 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.903+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.905+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.905+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.903 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.905+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.906+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:49.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.908+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.908+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.908+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.909+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:49.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.910+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.911+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.911+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.910 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.912+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:49.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.913+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.914+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.914+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.915+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:49.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.917+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.917+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.915 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.917+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.916 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.918+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:49.917 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.920+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.920+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.918 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.920+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.921+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:49.920 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.923+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.923+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.921 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.923+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.924+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:49.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.926+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.926+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.924 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.926+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.925 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.927+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:49.926 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.928+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.926 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.929+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.929+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.930+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:49.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.931+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.932+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.932+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.933+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:49.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.934+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.935+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.935+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.936+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:49.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.937+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.938+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.938+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.939+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:49.938 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.940+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.938 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.941+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.938 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.941+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.939 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.942+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:49.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.944+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.944+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.944+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.943 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.945+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:49.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.948+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.948+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.948+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.947 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.949+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:49.948 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.950+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.948 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.951+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.949 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.951+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.950 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.952+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:49.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.953+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.951 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.954+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.952 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.954+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.953 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.955+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:49.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.956+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.957+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.954 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.957+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.955 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.958+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:49.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.959+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.960+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.958 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.960+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.961+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:49.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.963+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.963+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.961 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.963+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.962 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.964+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:49.963 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.966+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.966+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.964 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.967+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.965 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.967+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:49.966 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.969+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.969+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.967 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.970+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.968 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.971+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:49.969 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.972+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.973+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.970 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.973+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.971 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.974+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:49.972 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.975+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.975+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.973 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.975+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.974 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.976+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:49.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.978+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.975 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.978+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.978+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.977 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.980+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:49.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.981+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.981+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.982+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.980 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.982+0000 7f139233e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:49.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.984+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.984+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:49.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.984+0000 7f139233e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:49.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.986+0000 7f1244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:49.986 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.988+0000 7f139233e800 20 remove_watcher() i=0 2024-09-14T11:37:49.986 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.988+0000 7f139233e800 2 removed watcher, disabling cache 2024-09-14T11:37:49.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.989+0000 7f139233e800 20 remove_watcher() i=1 2024-09-14T11:37:49.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.990+0000 7f139233e800 20 remove_watcher() i=2 2024-09-14T11:37:49.989 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.991+0000 7f139233e800 20 remove_watcher() i=3 2024-09-14T11:37:49.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.992+0000 7f139233e800 20 remove_watcher() i=4 2024-09-14T11:37:49.991 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.993+0000 7f139233e800 20 remove_watcher() i=5 2024-09-14T11:37:49.992 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.994+0000 7f139233e800 20 remove_watcher() i=6 2024-09-14T11:37:49.993 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:49.995+0000 7f139233e800 20 remove_watcher() i=7 2024-09-14T11:37:50.003 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:50.056 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:50.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.094+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 realm 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.096+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.097+0000 7f1931214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:50.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.097+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.098+0000 7f1931214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:50.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.098+0000 7f1931214800 20 searching for the correct realm 2024-09-14T11:37:50.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.100+0000 7f192d0cc640 0 -- 172.21.15.130:0/127594024 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f192002f060 msgr2=0x7f1920072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:50.303 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.305+0000 7f192d0cc640 0 -- 172.21.15.130:0/127594024 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f192002f060 msgr2=0x7f1920072770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:50.307 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.309+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:50.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 zone default found 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 4 Realm: () 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 zonegroup default 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.309 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.310+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.311+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.311+0000 7f1931214800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.311+0000 7f1931214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.311+0000 7f1931214800 20 started sync module instance, tier type = 2024-09-14T11:37:50.310 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.311+0000 7f1931214800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=0 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=1 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=2 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=3 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=4 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=5 2024-09-14T11:37:50.317 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.319+0000 7f1931214800 20 add_watcher() i=6 2024-09-14T11:37:50.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.320+0000 7f1931214800 20 add_watcher() i=7 2024-09-14T11:37:50.318 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.320+0000 7f1931214800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:50.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.322+0000 7f17e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:50.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.322+0000 7f1931214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:50.320 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.322+0000 7f1931214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.356+0000 7f17e27e4640 20 reqs_thread_entry: start 2024-09-14T11:37:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.356+0000 7f1931214800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.356+0000 7f1931214800 20 Filter name: none 2024-09-14T11:37:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.356+0000 7f17dbfff640 20 reqs_thread_entry: start 2024-09-14T11:37:50.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.356+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:50.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.357+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.358+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.358+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.356 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.359+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:50.357 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.360+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.360+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.361+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.359 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.362+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:50.360 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.363+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.364+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.364+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.362 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.365+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:50.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.366+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.367+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.367+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.368+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:50.366 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.369+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.370+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.370+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.371+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.372+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.373+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.373+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.374+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:50.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.376+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.376+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.376+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.377+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.379+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.379+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.379+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.380+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.381+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.382+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.379 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.382+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.383+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.384+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.385+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.385+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.386+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:50.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.387+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.387+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.388+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.389+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:50.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.390+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.391+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.391+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.389 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.392+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.393+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.394+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.394+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.396+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.397+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.397+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.398+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.399+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:50.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.400+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.401+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.401+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.402+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.403+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.404+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.404+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.405+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:50.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.406+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.407+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.404 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.407+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.408+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:50.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.410+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.410+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.410+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.411+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:50.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.412+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.413+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.413+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.411 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.414+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:50.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.415+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.416+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.416+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.417+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.418+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.419+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.419+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.420+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.421+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.422+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.422+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.423+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:50.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.424+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.424+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.425+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.426+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:50.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.427+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.427+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.428+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.429+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:50.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.430+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.431+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.431+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.432+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:50.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.433+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.434+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.434+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.435+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:50.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.436+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.436+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.436+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.437+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:50.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.438+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.439+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.439+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.440+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:50.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.441+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.442+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.442+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.443+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:50.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.444+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.444+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.445+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.446+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:50.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.447+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.447+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.447+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.448+0000 7f1931214800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:50.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.449+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.450+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:50.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.450+0000 7f1931214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:50.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.452+0000 7f17e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:50.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.454+0000 7f1931214800 20 remove_watcher() i=0 2024-09-14T11:37:50.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.454+0000 7f1931214800 2 removed watcher, disabling cache 2024-09-14T11:37:50.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.455+0000 7f1931214800 20 remove_watcher() i=1 2024-09-14T11:37:50.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.456+0000 7f1931214800 20 remove_watcher() i=2 2024-09-14T11:37:50.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.457+0000 7f1931214800 20 remove_watcher() i=3 2024-09-14T11:37:50.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.458+0000 7f1931214800 20 remove_watcher() i=4 2024-09-14T11:37:50.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.459+0000 7f1931214800 20 remove_watcher() i=5 2024-09-14T11:37:50.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.460+0000 7f1931214800 20 remove_watcher() i=6 2024-09-14T11:37:50.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.461+0000 7f1931214800 20 remove_watcher() i=7 2024-09-14T11:37:50.469 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:37:50.520 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:50.521 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:50.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.559+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 realm 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.761 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.762+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.762 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.763+0000 7fee0bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:50.762 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.763+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.762 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.764+0000 7fee0bf46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:50.762 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.764+0000 7fee0bf46800 20 searching for the correct realm 2024-09-14T11:37:50.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.766+0000 7fee01236640 0 -- 172.21.15.130:0/37563616 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fedfc076030 msgr2=0x7fedfc07ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:50.768 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.770+0000 7fee09a37640 0 -- 172.21.15.130:0/37563616 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fee04070420 msgr2=0x7fee04070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.976 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.977+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 zone default found 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 4 Realm: () 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 zonegroup default 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.978+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.978 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:50.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:50.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 started sync module instance, tier type = 2024-09-14T11:37:50.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.979+0000 7fee0bf46800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:37:50.986 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=0 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=1 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=2 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=3 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=4 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=5 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.988+0000 7fee0bf46800 20 add_watcher() i=6 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.989+0000 7fee0bf46800 20 add_watcher() i=7 2024-09-14T11:37:50.987 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.989+0000 7fee0bf46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:50.989 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.991+0000 7fecbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:50.989 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.991+0000 7fee0bf46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:50.990 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:50.991+0000 7fee0bf46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:51.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.026+0000 7fecba7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:51.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.026+0000 7fee0bf46800 20 init_complete bucket index max shards: 11 2024-09-14T11:37:51.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.026+0000 7fee0bf46800 20 Filter name: none 2024-09-14T11:37:51.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.026+0000 7fec2bfff640 20 reqs_thread_entry: start 2024-09-14T11:37:51.025 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.026+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:51.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.027+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.026 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.028+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.028+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.027 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.029+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:51.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.030+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.031+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.029 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.031+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.032+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:51.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.033+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.034+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.034+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.035+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:51.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.036+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.037+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.037+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.036 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.038+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:51.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.039+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.039+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.038 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.040+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.039 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.041+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:51.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.042+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.042+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.043+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.043+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:51.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.045+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.043 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.045+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.044 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.045+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.045 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.046+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:51.046 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.048+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.048+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.047 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.049+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.050+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:51.049 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.051+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.051+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.050 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.052+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.051 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.053+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:51.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.054+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.055+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.055+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.056+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:51.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.058+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.058+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.058+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.058 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.059+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:51.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.061+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.059 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.061+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.060 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.061+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.062+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.063+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.064+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.062 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.064+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.063 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.065+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:51.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.066+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.067+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.067+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.066 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.068+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.069+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.070+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.070+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.071+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:51.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.072+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.073+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.073+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.075+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:51.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.076+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.077+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.077+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.078+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:51.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.079+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.080+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.080+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.081+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:51.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.083+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.083+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.084+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.085+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:51.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.086+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.087+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.085 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.087+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.088+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:51.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.089+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.090+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.090+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.091+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.092+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.092+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.092+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.093+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:51.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.095+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.095+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.095+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.096+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:51.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.098+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.098+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.098+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.099+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:51.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.101+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.102+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.102+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.103+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:51.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.104+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.105+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.105+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.104 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.106+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.107+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.108+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.108+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.109+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:51.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.110+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.110+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.111+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.110 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.112+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.113+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.111 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.113+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.112 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.113+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.113 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.114+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:51.114 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.116+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.116+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.117+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.116 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.118+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:51.117 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.119+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.119+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.118 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.120+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.119 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.121+0000 7fee0bf46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:51.120 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.122+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.123+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:51.121 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.123+0000 7fee0bf46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:51.123 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.124+0000 7fecbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:51.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.127+0000 7fee0bf46800 20 remove_watcher() i=0 2024-09-14T11:37:51.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.127+0000 7fee0bf46800 2 removed watcher, disabling cache 2024-09-14T11:37:51.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.127+0000 7fee0bf46800 20 remove_watcher() i=1 2024-09-14T11:37:51.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.128+0000 7fee0bf46800 20 remove_watcher() i=2 2024-09-14T11:37:51.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.129+0000 7fee0bf46800 20 remove_watcher() i=3 2024-09-14T11:37:51.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.130+0000 7fee0bf46800 20 remove_watcher() i=4 2024-09-14T11:37:51.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.131+0000 7fee0bf46800 20 remove_watcher() i=5 2024-09-14T11:37:51.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.132+0000 7fee0bf46800 20 remove_watcher() i=6 2024-09-14T11:37:51.131 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:37:51.133+0000 7fee0bf46800 20 remove_watcher() i=7 2024-09-14T11:37:51.142 DEBUG:teuthology.orchestra.run.smithi130:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:37:51.625 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :clean 2024-09-14T11:37:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileJava 2024-09-14T11:37:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processResources 2024-09-14T11:37:52.421 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :classes 2024-09-14T11:37:52.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:52.821 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :compileTestJava 2024-09-14T11:37:52.822 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:52.822 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:37:52.822 INFO:teuthology.orchestra.run.smithi130.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:37:52.822 INFO:teuthology.orchestra.run.smithi130.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:37:52.823 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :testClasses 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout:> Task :test 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14 11:37:54,106 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.822 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:54.823 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:37:55.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:55.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:37:55.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:55.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:37:55.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:55.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:37:55.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:55.821 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:37:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:37:56.121 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:37:56.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:37:56.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.421 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:37:56.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:37:56.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:37:56.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:37:56.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:37:56.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:56.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:37:57.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:37:57.421 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.421 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:37:57.421 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.421 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:37:57.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:37:57.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:37:57.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:37:57.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:57.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:37:58.121 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:37:58.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:37:58.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:37:58.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:37:58.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:37:58.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:37:58.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:58.920 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:37:59.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:59.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:37:59.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:59.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:37:59.620 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:37:59.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:38:00.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:00.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:38:04.421 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:04.421 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:38:04.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:04.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:38:04.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:04.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:38:04.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:04.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:38:04.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:04.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:38:05.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:05.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:38:05.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:05.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:38:06.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:06.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:38:06.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:06.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:38:06.121 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:06.121 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:38:06.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:06.821 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:38:07.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:07.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:38:07.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:07.520 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:38:07.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:07.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:38:08.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:08.120 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:38:08.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:08.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:38:12.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:12.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:38:12.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:12.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:38:13.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:13.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:38:13.921 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:13.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:38:14.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:14.821 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:38:15.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:15.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:38:15.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:15.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:38:16.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:38:16.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:38:16.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:38:16.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.421 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:38:16.620 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:38:16.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:38:16.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:38:16.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:16.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:38:17.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.120 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:38:17.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:38:17.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:38:17.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:38:17.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:38:17.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:38:17.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:38:17.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:17.920 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:38:18.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:18.120 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:38:18.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:18.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:38:18.621 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:18.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:38:18.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:18.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:38:18.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:18.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:38:19.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:38:19.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:38:19.221 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:38:19.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.520 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:38:19.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.520 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:38:19.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:38:19.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:19.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:38:20.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:38:20.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.120 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:38:20.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:38:20.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:38:20.620 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:38:20.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:38:20.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:20.920 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:38:21.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:38:21.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:38:21.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:38:21.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:38:21.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:38:21.721 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:38:21.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:21.821 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:38:22.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:38:22.120 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.120 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:38:22.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:38:22.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:38:22.620 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.621 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:38:22.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:38:22.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:22.921 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:38:23.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:38:23.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:38:23.221 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:38:23.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:38:23.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:38:23.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.721 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:38:23.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:23.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:38:24.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:38:24.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.321 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:38:24.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:38:24.521 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.521 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:38:24.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:38:24.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:24.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:38:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:38:25.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.021 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:38:25.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:38:25.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:38:25.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:38:25.620 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.620 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:38:25.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:38:25.821 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.821 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:38:25.920 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:25.920 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:38:26.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:38:26.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.220 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:38:26.221 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.221 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:38:26.420 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.420 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:38:26.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.520 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:38:26.720 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.720 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:38:26.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:26.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:38:27.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:27.020 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:38:27.320 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:27.320 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:38:27.520 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:27.520 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:38:27.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:27.820 INFO:teuthology.orchestra.run.smithi130.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout:---------------------------------------------------------------------- 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout:---------------------------------------------------------------------- 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:28.020 INFO:teuthology.orchestra.run.smithi130.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:38:28.021 INFO:teuthology.orchestra.run.smithi130.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:38:28.021 INFO:teuthology.orchestra.run.smithi130.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:38:28.021 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:28.021 INFO:teuthology.orchestra.run.smithi130.stdout:BUILD SUCCESSFUL in 36s 2024-09-14T11:38:28.021 INFO:teuthology.orchestra.run.smithi130.stdout:5 actionable tasks: 5 executed 2024-09-14T11:38:28.036 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:38:28.088 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:28.088 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:28.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.126+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 realm 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.128+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.129+0000 7f6327620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:28.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.129+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.130+0000 7f6327620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:28.129 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.130+0000 7f6327620800 20 searching for the correct realm 2024-09-14T11:38:28.130 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.132+0000 7f6324910640 0 -- 172.21.15.130:0/252475910 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f6318065040 msgr2=0x7f6318061e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:28.134 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.136+0000 7f6325111640 0 -- 172.21.15.130:0/252475910 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f632006e190 msgr2=0x7f632006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:28.342 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.343+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 zone default found 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 4 Realm: () 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:28.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 zonegroup default 2024-09-14T11:38:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.344 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados->read ofs=0 len=0 2024-09-14T11:38:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 started sync module instance, tier type = 2024-09-14T11:38:28.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.344+0000 7f6327620800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=0 2024-09-14T11:38:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=1 2024-09-14T11:38:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=2 2024-09-14T11:38:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=3 2024-09-14T11:38:28.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=4 2024-09-14T11:38:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=5 2024-09-14T11:38:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.353+0000 7f6327620800 20 add_watcher() i=6 2024-09-14T11:38:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.354+0000 7f6327620800 20 add_watcher() i=7 2024-09-14T11:38:28.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.354+0000 7f6327620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:28.354 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.356+0000 7f61db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.356+0000 7f6327620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:28.355 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.356+0000 7f6327620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:28.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.392+0000 7f61da7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:28.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.392+0000 7f6327620800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:28.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.392+0000 7f6327620800 20 Filter name: none 2024-09-14T11:38:28.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.392+0000 7f614bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:28.391 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.392+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:28.392 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.394+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.394+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8121893235045787746', time=2024-09-14T13:38:14.883691+0000, chain.objs.size()=9 2024-09-14T11:38:28.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__multipart_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.1 2024-09-14T11:38:28.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__shadow_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.1_1 2024-09-14T11:38:28.394 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__multipart_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.2 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__shadow_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.2_1 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__multipart_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.3 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__shadow_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.3_1 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__multipart_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.4 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__shadow_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.4_1 2024-09-14T11:38:28.395 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.395+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.105__multipart_key1.2~JTg_J3YbHRgV_AiFdbO-oViOOcNFFXo.5 2024-09-14T11:38:28.398 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.400+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.402+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:28.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.403+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.404+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.402 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.404+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.405+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:28.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.406+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.407+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.407+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.406 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.408+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:28.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.409+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj', time=2024-09-14T13:38:08.251453+0000, chain.objs.size()=9 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__multipart_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.7 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__shadow_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.7_1 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__multipart_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.8 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__shadow_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.8_1 2024-09-14T11:38:28.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__multipart_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.9 2024-09-14T11:38:28.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__shadow_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.9_1 2024-09-14T11:38:28.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__multipart_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.10 2024-09-14T11:38:28.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__shadow_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.10_1 2024-09-14T11:38:28.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.410+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.102__multipart_key1.2~HL8uxhIzwhk36_O2FxiBNZR_MkPo7Kj.11 2024-09-14T11:38:28.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.414+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.417+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:28.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16389998958985538136', time=2024-09-14T13:38:03.446300+0000, chain.objs.size()=9 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.1 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.1_1 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.2 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.2_1 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.3 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.3_1 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.4 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.4_1 2024-09-14T11:38:28.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.419+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~8NjtoEus8XMNSnTzGIjf_HaAykqgU4v.5 2024-09-14T11:38:28.422 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.424+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.426+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:28.426 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.428+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.428+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16717456556197946943', time=2024-09-14T13:38:05.864895+0000, chain.objs.size()=9 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__multipart_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.1 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__shadow_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.1_1 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__multipart_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.2 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__shadow_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.2_1 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__multipart_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.3 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__shadow_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.3_1 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__multipart_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.4 2024-09-14T11:38:28.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__shadow_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.4_1 2024-09-14T11:38:28.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.99__multipart_key1.2~XUNGv3VtvsPAl03ROMrcQCgY8UK3TwA.5 2024-09-14T11:38:28.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11756311315228151603', time=2024-09-14T13:38:11.958784+0000, chain.objs.size()=7 2024-09-14T11:38:28.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.1 2024-09-14T11:38:28.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.1_1 2024-09-14T11:38:28.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.429+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.1_2 2024-09-14T11:38:28.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.431+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.2 2024-09-14T11:38:28.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.433+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.2_1 2024-09-14T11:38:28.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.435+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.2_2 2024-09-14T11:38:28.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.435+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~UYoup-6_4r4AGmxLZJXw9zn9dUP1P2I.3 2024-09-14T11:38:28.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.438+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.440+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:28.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.441+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.442+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.442+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.443+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:28.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.444+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.443 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5470349978419134416', time=2024-09-14T13:38:03.873822+0000, chain.objs.size()=7 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.1 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.1_1 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.1_2 2024-09-14T11:38:28.444 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.2 2024-09-14T11:38:28.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.2_1 2024-09-14T11:38:28.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.2_2 2024-09-14T11:38:28.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.445+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~qn3MdQYUBHOaNQBrom5fNBIXiPrKMTO.3 2024-09-14T11:38:28.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.449+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.451+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:28.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.453+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.453+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.453+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.454+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:28.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.455+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.4113000837717797421', time=2024-09-14T13:38:12.096125+0000, chain.objs.size()=7 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.1 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.1_1 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.1_2 2024-09-14T11:38:28.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.2 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.2_1 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.2_2 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~L0RXS8cYaHVPW-xyfI8X84m1Nm40NpY.3 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.13641651220250216090', time=2024-09-14T13:38:27.323334+0000, chain.objs.size()=9 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__multipart_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.1 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__shadow_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.1_1 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__multipart_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.2 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__shadow_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.2_1 2024-09-14T11:38:28.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.456+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__multipart_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.3 2024-09-14T11:38:28.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.461+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__shadow_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.3_1 2024-09-14T11:38:28.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.461+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__multipart_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.4 2024-09-14T11:38:28.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.461+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__shadow_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.4_1 2024-09-14T11:38:28.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.461+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.144__multipart_key1.2~Sp3rEy8vxWnDoHOLo-25fy7XSqk7sat.5 2024-09-14T11:38:28.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.465+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.467+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:28.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15893718205683228604', time=2024-09-14T13:38:07.594817+0000, chain.objs.size()=9 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.1 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.1_1 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.2 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.2_1 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.3 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.3_1 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.4 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.4_1 2024-09-14T11:38:28.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.469+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file2.mpg.2~Hc4olVKFtkfBM8LoZZyzahg6iw9E2Li.5 2024-09-14T11:38:28.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.474+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.474 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.476+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:28.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.477+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.476 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.478+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2283693188098768502', time=2024-09-14T13:37:59.691590+0000, chain.objs.size()=9 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.1 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.1_1 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.2 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.2_1 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.3 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.3_1 2024-09-14T11:38:28.478 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.4 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.4_1 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.5 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10168064010293849528', time=2024-09-14T13:38:06.858417+0000, chain.objs.size()=9 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__multipart_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.1 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__shadow_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.1_1 2024-09-14T11:38:28.479 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.479+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__multipart_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.2 2024-09-14T11:38:28.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.483+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__shadow_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.2_1 2024-09-14T11:38:28.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__multipart_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.3 2024-09-14T11:38:28.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__shadow_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.3_1 2024-09-14T11:38:28.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__multipart_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.4 2024-09-14T11:38:28.483 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__shadow_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.4_1 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.100__multipart_key1.2~hC5uUWZzDtFkmA74MJmSttZC_38_RiN.5 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.708569+0000, chain.objs.size()=100 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.1 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.2 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.3 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.4 2024-09-14T11:38:28.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.484+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.5 2024-09-14T11:38:28.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.488+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.6 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.7 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.8 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.9 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.10 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.11 2024-09-14T11:38:28.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.489+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.12 2024-09-14T11:38:28.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.491+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.13 2024-09-14T11:38:28.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.491+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.14 2024-09-14T11:38:28.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.491+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.15 2024-09-14T11:38:28.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.491+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.16 2024-09-14T11:38:28.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.493+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.17 2024-09-14T11:38:28.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.18 2024-09-14T11:38:28.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.19 2024-09-14T11:38:28.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.20 2024-09-14T11:38:28.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.21 2024-09-14T11:38:28.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.22 2024-09-14T11:38:28.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.494+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.23 2024-09-14T11:38:28.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.496+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.24 2024-09-14T11:38:28.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.497+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.25 2024-09-14T11:38:28.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.497+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.26 2024-09-14T11:38:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.499+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.27 2024-09-14T11:38:28.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.499+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.28 2024-09-14T11:38:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.29 2024-09-14T11:38:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.30 2024-09-14T11:38:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.31 2024-09-14T11:38:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.32 2024-09-14T11:38:28.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.33 2024-09-14T11:38:28.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.34 2024-09-14T11:38:28.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.500+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.35 2024-09-14T11:38:28.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.501+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.36 2024-09-14T11:38:28.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.501+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.37 2024-09-14T11:38:28.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.503+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.38 2024-09-14T11:38:28.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.503+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.39 2024-09-14T11:38:28.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.505+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.40 2024-09-14T11:38:28.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.505+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.41 2024-09-14T11:38:28.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.505+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.42 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.43 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.44 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.45 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.46 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.47 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.48 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.49 2024-09-14T11:38:28.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.507+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.50 2024-09-14T11:38:28.507 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.509+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.51 2024-09-14T11:38:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.510+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.52 2024-09-14T11:38:28.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.510+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.53 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.511+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.54 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.511+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.55 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.511+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.56 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.511+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.57 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.512+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.58 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.512+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.59 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.512+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.60 2024-09-14T11:38:28.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.512+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.61 2024-09-14T11:38:28.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.513+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.62 2024-09-14T11:38:28.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.513+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.63 2024-09-14T11:38:28.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.515+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.64 2024-09-14T11:38:28.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.515+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.65 2024-09-14T11:38:28.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.516+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.66 2024-09-14T11:38:28.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.517+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.67 2024-09-14T11:38:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.517+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.68 2024-09-14T11:38:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.518+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.69 2024-09-14T11:38:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.518+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.70 2024-09-14T11:38:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.518+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.71 2024-09-14T11:38:28.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.518+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.72 2024-09-14T11:38:28.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.521+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.73 2024-09-14T11:38:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.521+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.74 2024-09-14T11:38:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.521+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.75 2024-09-14T11:38:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.521+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.76 2024-09-14T11:38:28.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.521+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.77 2024-09-14T11:38:28.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.523+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.78 2024-09-14T11:38:28.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.523+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.79 2024-09-14T11:38:28.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.523+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.80 2024-09-14T11:38:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.524+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.81 2024-09-14T11:38:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.524+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.82 2024-09-14T11:38:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.524+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.83 2024-09-14T11:38:28.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.525+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.84 2024-09-14T11:38:28.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.525+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.85 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.527+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.86 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.527+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.87 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.527+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.88 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.89 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.90 2024-09-14T11:38:28.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.91 2024-09-14T11:38:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.92 2024-09-14T11:38:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.93 2024-09-14T11:38:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.528+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.94 2024-09-14T11:38:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.529+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.95 2024-09-14T11:38:28.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.529+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.96 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.97 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.98 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.99 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.100 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.733054+0000, chain.objs.size()=9 2024-09-14T11:38:28.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.101 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.102 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.103 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.104 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.105 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.106 2024-09-14T11:38:28.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.533+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.107 2024-09-14T11:38:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.108 2024-09-14T11:38:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.109 2024-09-14T11:38:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.747418+0000, chain.objs.size()=3 2024-09-14T11:38:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.110 2024-09-14T11:38:28.537 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.111 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.112 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.770924+0000, chain.objs.size()=8 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.113 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.114 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.115 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.116 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.117 2024-09-14T11:38:28.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.539+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.118 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.119 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.120 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.783681+0000, chain.objs.size()=4 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.121 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.122 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.123 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.124 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.811036+0000, chain.objs.size()=9 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.125 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.126 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.127 2024-09-14T11:38:28.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.544+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.128 2024-09-14T11:38:28.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.546+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.129 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.130 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.131 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.133 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.134 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.846231+0000, chain.objs.size()=10 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.132 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.135 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.136 2024-09-14T11:38:28.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.549+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.137 2024-09-14T11:38:28.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.550+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.138 2024-09-14T11:38:28.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.551+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.139 2024-09-14T11:38:28.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.551+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.140 2024-09-14T11:38:28.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.553+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.141 2024-09-14T11:38:28.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.553+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.142 2024-09-14T11:38:28.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.553+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.143 2024-09-14T11:38:28.552 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.864765+0000, chain.objs.size()=5 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.144 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.145 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.146 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.147 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.148 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.885055+0000, chain.objs.size()=8 2024-09-14T11:38:28.553 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.554+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.149 2024-09-14T11:38:28.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.557+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.150 2024-09-14T11:38:28.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.557+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.151 2024-09-14T11:38:28.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.557+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.152 2024-09-14T11:38:28.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.557+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.153 2024-09-14T11:38:28.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.557+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.154 2024-09-14T11:38:28.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.558+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.155 2024-09-14T11:38:28.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.558+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.156 2024-09-14T11:38:28.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.560+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.901752+0000, chain.objs.size()=5 2024-09-14T11:38:28.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.560+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.157 2024-09-14T11:38:28.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.560+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.158 2024-09-14T11:38:28.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.560+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.159 2024-09-14T11:38:28.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.561+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.160 2024-09-14T11:38:28.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.161 2024-09-14T11:38:28.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.928117+0000, chain.objs.size()=9 2024-09-14T11:38:28.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.162 2024-09-14T11:38:28.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.163 2024-09-14T11:38:28.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.164 2024-09-14T11:38:28.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.165 2024-09-14T11:38:28.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.166 2024-09-14T11:38:28.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.167 2024-09-14T11:38:28.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.564+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.168 2024-09-14T11:38:28.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.565+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.169 2024-09-14T11:38:28.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.565+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.170 2024-09-14T11:38:28.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.565+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.957717+0000, chain.objs.size()=8 2024-09-14T11:38:28.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.565+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.171 2024-09-14T11:38:28.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.172 2024-09-14T11:38:28.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.173 2024-09-14T11:38:28.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.174 2024-09-14T11:38:28.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.176 2024-09-14T11:38:28.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.177 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.179 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.568+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.180 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.569+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:15.976275+0000, chain.objs.size()=5 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.569+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.175 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.569+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.178 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.569+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.181 2024-09-14T11:38:28.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.569+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.182 2024-09-14T11:38:28.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.572+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.184 2024-09-14T11:38:28.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.573+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:16.003664+0000, chain.objs.size()=10 2024-09-14T11:38:28.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.573+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.183 2024-09-14T11:38:28.572 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.574+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.185 2024-09-14T11:38:28.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.186 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.187 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.188 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.189 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.190 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.191 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.192 2024-09-14T11:38:28.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.575+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.193 2024-09-14T11:38:28.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.578+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:16.020207+0000, chain.objs.size()=3 2024-09-14T11:38:28.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.578+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.194 2024-09-14T11:38:28.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.578+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.195 2024-09-14T11:38:28.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.578+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.196 2024-09-14T11:38:28.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.579+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx', time=2024-09-14T13:38:16.189630+0000, chain.objs.size()=212 2024-09-14T11:38:28.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.579+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.1 2024-09-14T11:38:28.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.579+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.2 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.3 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.4 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.5 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.6 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.7 2024-09-14T11:38:28.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.581+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.8 2024-09-14T11:38:28.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.582+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.9 2024-09-14T11:38:28.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.583+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.10 2024-09-14T11:38:28.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.583+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.11 2024-09-14T11:38:28.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.583+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.12 2024-09-14T11:38:28.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.584+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.13 2024-09-14T11:38:28.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.14 2024-09-14T11:38:28.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.15 2024-09-14T11:38:28.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.16 2024-09-14T11:38:28.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.17 2024-09-14T11:38:28.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.18 2024-09-14T11:38:28.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.19 2024-09-14T11:38:28.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.20 2024-09-14T11:38:28.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.586+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.21 2024-09-14T11:38:28.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.588+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.22 2024-09-14T11:38:28.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.588+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.23 2024-09-14T11:38:28.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.588+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.24 2024-09-14T11:38:28.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.588+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.25 2024-09-14T11:38:28.587 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.26 2024-09-14T11:38:28.587 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.27 2024-09-14T11:38:28.587 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.28 2024-09-14T11:38:28.587 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.29 2024-09-14T11:38:28.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.30 2024-09-14T11:38:28.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.31 2024-09-14T11:38:28.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.589+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.32 2024-09-14T11:38:28.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.590+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.33 2024-09-14T11:38:28.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.590+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.34 2024-09-14T11:38:28.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.590+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.35 2024-09-14T11:38:28.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.590+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.36 2024-09-14T11:38:28.590 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.591+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.37 2024-09-14T11:38:28.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.38 2024-09-14T11:38:28.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.39 2024-09-14T11:38:28.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.40 2024-09-14T11:38:28.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.41 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.42 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.43 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.44 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.592+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.45 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.593+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.46 2024-09-14T11:38:28.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.593+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.47 2024-09-14T11:38:28.593 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.48 2024-09-14T11:38:28.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.49 2024-09-14T11:38:28.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.50 2024-09-14T11:38:28.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.51 2024-09-14T11:38:28.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.52 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.53 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.54 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.55 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.56 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.595+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.57 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.596+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.58 2024-09-14T11:38:28.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.597+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.59 2024-09-14T11:38:28.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.598+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.60 2024-09-14T11:38:28.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.598+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.61 2024-09-14T11:38:28.597 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.598+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.62 2024-09-14T11:38:28.597 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.63 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.64 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.65 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.66 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.67 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.68 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.69 2024-09-14T11:38:28.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.599+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.70 2024-09-14T11:38:28.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.71 2024-09-14T11:38:28.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.72 2024-09-14T11:38:28.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.73 2024-09-14T11:38:28.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.74 2024-09-14T11:38:28.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.75 2024-09-14T11:38:28.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.76 2024-09-14T11:38:28.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.601+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.77 2024-09-14T11:38:28.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.602+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.78 2024-09-14T11:38:28.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.602+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.79 2024-09-14T11:38:28.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.602+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.80 2024-09-14T11:38:28.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.602+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.81 2024-09-14T11:38:28.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.604+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.82 2024-09-14T11:38:28.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.604+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.83 2024-09-14T11:38:28.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.604+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.84 2024-09-14T11:38:28.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.604+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.85 2024-09-14T11:38:28.603 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.605+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.86 2024-09-14T11:38:28.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.605+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.87 2024-09-14T11:38:28.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.606+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.88 2024-09-14T11:38:28.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.606+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.89 2024-09-14T11:38:28.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.90 2024-09-14T11:38:28.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.91 2024-09-14T11:38:28.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.92 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.93 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.94 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.95 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.607+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.96 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.608+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.97 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.608+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.98 2024-09-14T11:38:28.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.608+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.99 2024-09-14T11:38:28.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.609+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.100 2024-09-14T11:38:28.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.609+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.101 2024-09-14T11:38:28.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.102 2024-09-14T11:38:28.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.103 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.104 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.105 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.106 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.107 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.108 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.610+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.109 2024-09-14T11:38:28.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.611+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.110 2024-09-14T11:38:28.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.612+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.111 2024-09-14T11:38:28.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.612+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.112 2024-09-14T11:38:28.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.113 2024-09-14T11:38:28.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.114 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.115 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.116 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.117 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.118 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.119 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.120 2024-09-14T11:38:28.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.613+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.121 2024-09-14T11:38:28.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.615+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.122 2024-09-14T11:38:28.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.615+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.123 2024-09-14T11:38:28.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.124 2024-09-14T11:38:28.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.125 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.126 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.127 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.128 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.129 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.130 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.131 2024-09-14T11:38:28.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.616+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.132 2024-09-14T11:38:28.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.617+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.133 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.618+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.134 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.618+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.135 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.618+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.136 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.137 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.138 2024-09-14T11:38:28.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.139 2024-09-14T11:38:28.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.140 2024-09-14T11:38:28.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.141 2024-09-14T11:38:28.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.619+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.142 2024-09-14T11:38:28.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.620+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.143 2024-09-14T11:38:28.619 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.621+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.144 2024-09-14T11:38:28.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.145 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.146 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.147 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.148 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.149 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.150 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.151 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.152 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.153 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.154 2024-09-14T11:38:28.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.622+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.155 2024-09-14T11:38:28.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.624+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.156 2024-09-14T11:38:28.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.157 2024-09-14T11:38:28.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.158 2024-09-14T11:38:28.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.159 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.160 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.161 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.162 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.163 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.625+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.164 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.626+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.165 2024-09-14T11:38:28.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.626+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.166 2024-09-14T11:38:28.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.627+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.167 2024-09-14T11:38:28.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.168 2024-09-14T11:38:28.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.169 2024-09-14T11:38:28.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.170 2024-09-14T11:38:28.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.171 2024-09-14T11:38:28.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.172 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.173 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.174 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.175 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.176 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.177 2024-09-14T11:38:28.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.628+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.178 2024-09-14T11:38:28.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.179 2024-09-14T11:38:28.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.180 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.181 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.182 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.183 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.184 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.631+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.185 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.632+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.186 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.632+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.187 2024-09-14T11:38:28.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.632+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.188 2024-09-14T11:38:28.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.632+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.189 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.190 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.191 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.192 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.193 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.194 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.195 2024-09-14T11:38:28.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.634+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.196 2024-09-14T11:38:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.635+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.197 2024-09-14T11:38:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.635+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.198 2024-09-14T11:38:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.635+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.199 2024-09-14T11:38:28.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.635+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.200 2024-09-14T11:38:28.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.201 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.202 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.203 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.204 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.205 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.206 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.207 2024-09-14T11:38:28.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.637+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.208 2024-09-14T11:38:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.638+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.209 2024-09-14T11:38:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.639+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.210 2024-09-14T11:38:28.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.639+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.211 2024-09-14T11:38:28.640 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.640+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.106__multipart_key1.2~LMyTA9Q8o2l5WJz9e0PFgDL9NBIxPIx.212 2024-09-14T11:38:28.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.644+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.647+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:28.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.648+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.648+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.647 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.649+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.650+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:28.650 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.651+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.650 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.652+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.650 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.652+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.651 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.653+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:28.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.655+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.655+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.655+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.656+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:28.656 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.658+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.658+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.658+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.659+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:28.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.660+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12385232167728067261', time=2024-09-14T13:37:59.812986+0000, chain.objs.size()=9 2024-09-14T11:38:28.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.1 2024-09-14T11:38:28.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.1_1 2024-09-14T11:38:28.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.2 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.2_1 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.3 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.3_1 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.4 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__shadow_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.4_1 2024-09-14T11:38:28.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.661+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.92__multipart_key1.2~ApEOnZxwCN8oTKNkf9BtA0WqcJllG2j.5 2024-09-14T11:38:28.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.666+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.669+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:28.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.670+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.670+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.670+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.670+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1398377768223539270', time=2024-09-14T13:38:07.583646+0000, chain.objs.size()=9 2024-09-14T11:38:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.670+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.1 2024-09-14T11:38:28.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.1_1 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.2 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.2_1 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.3 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.3_1 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.4 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__shadow_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.4_1 2024-09-14T11:38:28.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.671+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.101__multipart_file.mpg.2~b5Lf2PxAOEvWy5kqQ7GRKiNVr8v2Srp.5 2024-09-14T11:38:28.674 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.675+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.678+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:28.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.679+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.679+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.680+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.680+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:28.680 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9072091395351554232', time=2024-09-14T13:37:57.203058+0000, chain.objs.size()=2 2024-09-14T11:38:28.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.84__shadow_.7SgCMgDNtqgUDjUYQqkS0jKVipJfPgQ_1 2024-09-14T11:38:28.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.682+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.84__shadow_.7SgCMgDNtqgUDjUYQqkS0jKVipJfPgQ_2 2024-09-14T11:38:28.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.684+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.684 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.686+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:28.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.687+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.686 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s', time=2024-09-14T13:37:55.813481+0000, chain.objs.size()=9 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__multipart_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.1 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__shadow_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.1_1 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__multipart_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.2 2024-09-14T11:38:28.687 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__shadow_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.2_1 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__multipart_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.3 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__shadow_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.3_1 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__multipart_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.4 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__shadow_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.4_1 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.80__multipart_key1.2~sTZaJkVtW_-yUIaMIj8RlhbJyVIGM6s.5 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.506630490001151762', time=2024-09-14T13:38:13.722418+0000, chain.objs.size()=9 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__multipart_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.1 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__shadow_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.1_1 2024-09-14T11:38:28.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.688+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__multipart_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.2 2024-09-14T11:38:28.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.692+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__shadow_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.2_1 2024-09-14T11:38:28.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.692+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__multipart_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.3 2024-09-14T11:38:28.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.692+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__shadow_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.3_1 2024-09-14T11:38:28.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.693+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__multipart_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.4 2024-09-14T11:38:28.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.693+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__shadow_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.4_1 2024-09-14T11:38:28.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.693+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.104__multipart_key1.2~TiS8VZRGQ6Sro2NSIdBXt_KXJr7b6sw.5 2024-09-14T11:38:28.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.698+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.700+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:28.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.702+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.702+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17459428653012145401', time=2024-09-14T13:38:02.421145+0000, chain.objs.size()=9 2024-09-14T11:38:28.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.1_1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.2 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.2_1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.3 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.3_1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.4 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.4_1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~zpW_yag1KUyyeL8sB9peS83e1XJFZTF.5 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9381302179433834746', time=2024-09-14T13:38:10.441544+0000, chain.objs.size()=9 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.1_1 2024-09-14T11:38:28.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.703+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.2 2024-09-14T11:38:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.708+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.2_1 2024-09-14T11:38:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.709+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.3 2024-09-14T11:38:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.709+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.3_1 2024-09-14T11:38:28.707 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.709+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.4 2024-09-14T11:38:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.709+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.4_1 2024-09-14T11:38:28.708 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.709+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~_a8HP3Rd3C4fqD81xHXcL3ZDHVUxb1F.5 2024-09-14T11:38:28.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.713+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.715+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:28.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.717+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.717+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.612174639671412392', time=2024-09-14T13:38:27.859423+0000, chain.objs.size()=9 2024-09-14T11:38:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__multipart_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.1 2024-09-14T11:38:28.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__shadow_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.1_1 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__multipart_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.2 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__shadow_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.2_1 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__multipart_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.3 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__shadow_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.3_1 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__multipart_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.4 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__shadow_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.4_1 2024-09-14T11:38:28.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.718+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.145__multipart_key1/data/file.mpg.2~qXDY75nIaBQowUoRkjGi0Di5h_lKOis.5 2024-09-14T11:38:28.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.722+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.724+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.726+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.727+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.727+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.728+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:28.727 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.729+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.728 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.729+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.728 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.730+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.729 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.731+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:28.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.732+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.732+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9586253519484421402', time=2024-09-14T13:38:04.442516+0000, chain.objs.size()=7 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.1 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.1_1 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.1_2 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.2 2024-09-14T11:38:28.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.2_1 2024-09-14T11:38:28.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.2_2 2024-09-14T11:38:28.732 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.733+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~Ixb6SN83UzxB1VRM-7ZWx04sN3Vgpba.3 2024-09-14T11:38:28.735 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.737+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.739+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:28.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.741+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.739 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.741+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.740 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.741+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.742+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:28.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.743+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.742 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5744335905278796177', time=2024-09-14T13:38:09.566868+0000, chain.objs.size()=9 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.1 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.1_1 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.2 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.2_1 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.3 2024-09-14T11:38:28.743 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.3_1 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.4 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.4_1 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~ELomzarrDl0uwMKxWtuhk_L_Icg0OzC.5 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12566885477227670989', time=2024-09-14T13:38:10.737858+0000, chain.objs.size()=9 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.1 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.1_1 2024-09-14T11:38:28.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.744+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.2 2024-09-14T11:38:28.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.2_1 2024-09-14T11:38:28.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.3 2024-09-14T11:38:28.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.3_1 2024-09-14T11:38:28.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.4 2024-09-14T11:38:28.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.4_1 2024-09-14T11:38:28.748 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.749+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~zwrLKgZDCawY7QkaJeTAaanBoRDfOgT.5 2024-09-14T11:38:28.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.753+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.754 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.756+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:28.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.757+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.757+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3039205496462518919', time=2024-09-14T13:38:04.302482+0000, chain.objs.size()=7 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.1 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.1_1 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.1_2 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.2 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.2_1 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.2_2 2024-09-14T11:38:28.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.758+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~mqEt7MoDgOPn7hHEWAjIM_QwIPDxYUC.3 2024-09-14T11:38:28.760 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.761+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.762 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.764+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:28.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.765+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.764 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10947427105087716420', time=2024-09-14T13:38:04.561967+0000, chain.objs.size()=5 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.94__shadow_.8O1XdkcMIlOVO2b4JWsVVqYGEC2ZNC0_1 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.94__shadow_.8O1XdkcMIlOVO2b4JWsVVqYGEC2ZNC0_2 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.94__shadow_.8O1XdkcMIlOVO2b4JWsVVqYGEC2ZNC0_3 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.94__shadow_.8O1XdkcMIlOVO2b4JWsVVqYGEC2ZNC0_4 2024-09-14T11:38:28.765 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.766+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.94__shadow_.8O1XdkcMIlOVO2b4JWsVVqYGEC2ZNC0_5 2024-09-14T11:38:28.768 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.769+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.770 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.772+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:28.771 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.773+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.772 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.4655117220064131445', time=2024-09-14T13:38:03.007198+0000, chain.objs.size()=9 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.1 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.1_1 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.2 2024-09-14T11:38:28.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.2_1 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.3 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.3_1 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.4 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__shadow_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.4_1 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.95__multipart_key1.2~GUEl7uFugz5lO2JSYAkdJvekk5t5WHu.5 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3772634649641622980', time=2024-09-14T13:38:11.662582+0000, chain.objs.size()=7 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.1 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.1_1 2024-09-14T11:38:28.774 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.774+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.1_2 2024-09-14T11:38:28.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.778+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.2 2024-09-14T11:38:28.777 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.778+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.2_1 2024-09-14T11:38:28.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.780+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__shadow_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.2_2 2024-09-14T11:38:28.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.780+0000 7f6327620800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.103__multipart_key1.2~1toDbVVtKDSkuSIWoHvBzyKGzz_mjao.3 2024-09-14T11:38:28.781 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.782+0000 7f6327620800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:38:28.783 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.785+0000 7f6327620800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:28.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.786+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.786+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:28.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.787+0000 7f6327620800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:28.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.788+0000 7f61db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:28.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.791+0000 7f6327620800 20 remove_watcher() i=0 2024-09-14T11:38:28.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.791+0000 7f6327620800 2 removed watcher, disabling cache 2024-09-14T11:38:28.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.792+0000 7f6327620800 20 remove_watcher() i=1 2024-09-14T11:38:28.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.793+0000 7f6327620800 20 remove_watcher() i=2 2024-09-14T11:38:28.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.793+0000 7f6327620800 20 remove_watcher() i=3 2024-09-14T11:38:28.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.794+0000 7f6327620800 20 remove_watcher() i=4 2024-09-14T11:38:28.794 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.795+0000 7f6327620800 20 remove_watcher() i=5 2024-09-14T11:38:28.795 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.796+0000 7f6327620800 20 remove_watcher() i=6 2024-09-14T11:38:28.796 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:28.797+0000 7f6327620800 20 remove_watcher() i=7 2024-09-14T11:38:28.807 DEBUG:teuthology.orchestra.run.smithi130:> radosgw-admin gc process --include-all 2024-09-14T11:38:28.859 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:28.859 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:29.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.098+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.099+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.099+0000 7f2bee212800 20 realm 2024-09-14T11:38:29.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.099+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.100+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.100+0000 7f2bee212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:29.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.100+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.100+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.100+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.101+0000 7f2bee212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.099 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.101+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.101+0000 7f2bee212800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:29.100 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.101+0000 7f2bee212800 20 searching for the correct realm 2024-09-14T11:38:29.101 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.103+0000 7f2be91df640 0 -- 172.21.15.130:0/1813415175 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f2bdc03b070 msgr2=0x7f2bdc084ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.308 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.309+0000 7f2be99e0640 0 -- 172.21.15.130:0/1813415175 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f2be4021440 msgr2=0x7f2be40218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.515+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 zone default found 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 4 Realm: () 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 zonegroup default 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.516+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 rados->read ofs=0 len=0 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 started sync module instance, tier type = 2024-09-14T11:38:29.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.517+0000 7f2bee212800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=0 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=1 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=2 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=3 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=4 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=5 2024-09-14T11:38:29.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.527+0000 7f2bee212800 20 add_watcher() i=6 2024-09-14T11:38:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.528+0000 7f2bee212800 20 add_watcher() i=7 2024-09-14T11:38:29.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.528+0000 7f2bee212800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:29.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.529+0000 7f2a9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.530+0000 7f2bee212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:29.528 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.530+0000 7f2bee212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:29.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.566+0000 7f2a9a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:29.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.566+0000 7f2bee212800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:29.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.566+0000 7f2bee212800 20 Filter name: none 2024-09-14T11:38:29.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.566+0000 7f2a0bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:29.565 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.566+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:38:29.566 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.568+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.568+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.569+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.570+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:38:29.569 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.571+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.571+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.572+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.573+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:38:29.572 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.574+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.574+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.575+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.576+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:38:29.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.577+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.577+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.578+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.579+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:38:29.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.580+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.580+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.581+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.582+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:38:29.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.583+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.583+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.583+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.584+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:38:29.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.586+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.584 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.586+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.586+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.586 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.587+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:38:29.587 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.589+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.589+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.589+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.590+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:38:29.590 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.592+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.590 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.592+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.592+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.593+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:38:29.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.596+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.596+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.595 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.597+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.597+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:38:29.597 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.599+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.599+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.600+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.601+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:38:29.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.602+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.602+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.601 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.602+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.603+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:38:29.603 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.605+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.606+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.606+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.607+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:38:29.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.608+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.609+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.609+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.610+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:38:29.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.611+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.612+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.612+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.613+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:38:29.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.614+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.615+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.615+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.614 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.616+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:38:29.616 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.618+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.618+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.619+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.620+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:38:29.619 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.621+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.619 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.621+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.621+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.622+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:38:29.622 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.624+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.624+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.624+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.624 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.625+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:38:29.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.626+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.627+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.627+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.628+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:38:29.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.629+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.629+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.630+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.631+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:38:29.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.632+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.632+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.632+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.633+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:38:29.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.635+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.633 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.635+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.634 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.635+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.636+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:38:29.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.638+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.638+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.639+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.640+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:38:29.640 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.641+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.640 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.642+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.641 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.642+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.641 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.643+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:38:29.642 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.644+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.645+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.645+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.644 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.646+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:38:29.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.647+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.647+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.647+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.648+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:38:29.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.650+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.648 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.650+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.649 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.650+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.650 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.652+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:38:29.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.653+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.654+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.654+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.655+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:38:29.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.656+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.657+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.657+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.656 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.658+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:38:29.657 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.659+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.660+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.660+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.661+0000 7f2bee212800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:38:29.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.662+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.662+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:38:29.661 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.663+0000 7f2bee212800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:38:29.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.664+0000 7f2a9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.667+0000 7f2bee212800 20 remove_watcher() i=0 2024-09-14T11:38:29.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.667+0000 7f2bee212800 2 removed watcher, disabling cache 2024-09-14T11:38:29.666 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.668+0000 7f2bee212800 20 remove_watcher() i=1 2024-09-14T11:38:29.667 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.669+0000 7f2bee212800 20 remove_watcher() i=2 2024-09-14T11:38:29.668 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.670+0000 7f2bee212800 20 remove_watcher() i=3 2024-09-14T11:38:29.669 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.671+0000 7f2bee212800 20 remove_watcher() i=4 2024-09-14T11:38:29.670 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.672+0000 7f2bee212800 20 remove_watcher() i=5 2024-09-14T11:38:29.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.672+0000 7f2bee212800 20 remove_watcher() i=6 2024-09-14T11:38:29.672 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:29.673+0000 7f2bee212800 20 remove_watcher() i=7 2024-09-14T11:38:29.683 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:38:29.700 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:38:29.700 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:38:29.700 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:38:29.700 DEBUG:teuthology.orchestra.run.smithi130:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:38:29.729 INFO:teuthology.orchestra.run.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:38:30.555 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:38:30.555 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T11:38:30.555 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key WADIRXXUTFVTWZBCMOXW --secret FXux/12dgjzF9nTsi7oefNlFBovJ10TlU0/uVmykZZfvHJAa6cMFXw== --cluster ceph 2024-09-14T11:38:30.658 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:30.659 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:30.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.694+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 realm 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.696+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.698+0000 7fceba098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.696 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.698+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.698+0000 7fceba098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:30.697 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.699+0000 7fceba098800 20 searching for the correct realm 2024-09-14T11:38:30.699 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.701+0000 7fceb8383640 0 -- 172.21.15.130:0/1590337351 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fcea006d7a0 msgr2=0x7fcea006b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.909+0000 7fceb8383640 0 -- 172.21.15.130:0/1590337351 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fcea006d7a0 msgr2=0x7fcea006b620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:30.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:30.911 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.912 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.913+0000 7fceba098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:30.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.913 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 zone default found 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 4 Realm: () 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 zonegroup default 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.914+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.915+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.915+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.915+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.915+0000 7fceba098800 20 started sync module instance, tier type = 2024-09-14T11:38:30.914 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.915+0000 7fceba098800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:30.922 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=0 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=1 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=2 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=3 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=4 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=5 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.924+0000 7fceba098800 20 add_watcher() i=6 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.925+0000 7fceba098800 20 add_watcher() i=7 2024-09-14T11:38:30.923 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.925+0000 7fceba098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.926+0000 7fcd6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.926+0000 7fceba098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.926+0000 7fceba098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 5 note: GC not initialized 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fcd6cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 20 Filter name: none 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fcce67fc640 20 reqs_thread_entry: start 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:38:30.927 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.927+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 cache get: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW : miss 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 20 rados->read ofs=0 len=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:30.928 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW info.flags=0x0 2024-09-14T11:38:30.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 adding default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW to cache LRU end 2024-09-14T11:38:30.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 cache get: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW : hit (negative entry) 2024-09-14T11:38:30.929 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.928+0000 7fceba098800 10 cache get: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW : hit (negative entry) 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.929+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.929+0000 7fceba098800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.929+0000 7fceba098800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.930+0000 7fcd96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497166 cookie 93836805953648 notifier 8420 bl.length()=645 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.930+0000 7fcd96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.930+0000 7fcd96ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:38:30.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fceba098800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:30.931 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fceba098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:38:30.931 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fcd967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497167 cookie 93836805970704 notifier 8420 bl.length()=185 2024-09-14T11:38:30.931 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fcd967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:38:30.931 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.931+0000 7fcd967fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fceba098800 10 cache put: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW info.flags=0x7 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fceba098800 10 moving default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW to cache LRU end 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fceba098800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:WADIRXXUTFVTWZBCMOXW, ofs0, ns] 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fcd96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 93836805955856 notifier 8420 bl.length()=186 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fcd96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW info.flags=0x7 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.933+0000 7fcd96ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WADIRXXUTFVTWZBCMOXW to cache LRU end 2024-09-14T11:38:30.932 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "foo.client.0", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "foo+test@test.test", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "foo.client.0", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "WADIRXXUTFVTWZBCMOXW", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "FXux/12dgjzF9nTsi7oefNlFBovJ10TlU0/uVmykZZfvHJAa6cMFXw==", 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:30.933 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:30.929641Z" 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:30.934 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:38:30.935 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:30.929629Z", 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:30.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.935+0000 7fcd6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:30.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.937+0000 7fceba098800 20 remove_watcher() i=0 2024-09-14T11:38:30.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.937+0000 7fceba098800 2 removed watcher, disabling cache 2024-09-14T11:38:30.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.938+0000 7fceba098800 20 remove_watcher() i=1 2024-09-14T11:38:30.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.939+0000 7fceba098800 20 remove_watcher() i=2 2024-09-14T11:38:30.938 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.940+0000 7fceba098800 20 remove_watcher() i=3 2024-09-14T11:38:30.939 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.941+0000 7fceba098800 20 remove_watcher() i=4 2024-09-14T11:38:30.940 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.942+0000 7fceba098800 20 remove_watcher() i=5 2024-09-14T11:38:30.941 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.943+0000 7fceba098800 20 remove_watcher() i=6 2024-09-14T11:38:30.942 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:30.944+0000 7fceba098800 20 remove_watcher() i=7 2024-09-14T11:38:30.953 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 0578678156 --totp-seed QTRHG6YFF5A7LESII4THIYXSIOIOOOQL7BEG3CZ6JEPVBSQ2RMXGVSHM6DRCASDZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:31.018 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:31.019 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:31.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.054+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 realm 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.056+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.057+0000 7f8664892800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.057+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.058+0000 7f8664892800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:31.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.058+0000 7f8664892800 20 searching for the correct realm 2024-09-14T11:38:31.057 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.059+0000 7f866237c640 0 -- 172.21.15.130:0/3170814724 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x55e0cfb18630 msgr2=0x7f865c02c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.061 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.062+0000 7f8661b7b640 0 -- 172.21.15.130:0/3170814724 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f8654053920 msgr2=0x7f86540373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:31.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:31.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.069+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 zone default found 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 4 Realm: () 2024-09-14T11:38:31.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 zonegroup default 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.070+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.071+0000 7f8664892800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:31.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.071+0000 7f8664892800 20 started sync module instance, tier type = 2024-09-14T11:38:31.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.071+0000 7f8664892800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=0 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=1 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=2 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=3 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=4 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=5 2024-09-14T11:38:31.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.079+0000 7f8664892800 20 add_watcher() i=6 2024-09-14T11:38:31.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.080+0000 7f8664892800 20 add_watcher() i=7 2024-09-14T11:38:31.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.080+0000 7f8664892800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8518fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 5 note: GC not initialized 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f84937fe640 20 reqs_thread_entry: start 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 20 Filter name: none 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f84917fa640 20 reqs_thread_entry: start 2024-09-14T11:38:31.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:38:31.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.082+0000 7f8664892800 20 rados->read ofs=0 len=0 2024-09-14T11:38:31.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.083+0000 7f8664892800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:38:31.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.083+0000 7f8664892800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:38:31.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.083+0000 7f8664892800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:31.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:31.083+0000 7f8664892800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.856+0000 7f8664892800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.856+0000 7f8664892800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:32.855 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.856+0000 7f8664892800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:38:32.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.857+0000 7f85457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431760 cookie 94424047489376 notifier 9054 bl.length()=659 2024-09-14T11:38:32.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.857+0000 7f85457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:38:32.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.857+0000 7f85457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:38:32.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.858+0000 7f8518fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:32.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.860+0000 7f8664892800 20 remove_watcher() i=0 2024-09-14T11:38:32.859 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.860+0000 7f8664892800 2 removed watcher, disabling cache 2024-09-14T11:38:32.860 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.862+0000 7f8664892800 20 remove_watcher() i=1 2024-09-14T11:38:32.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.863+0000 7f8664892800 20 remove_watcher() i=2 2024-09-14T11:38:32.862 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.864+0000 7f8664892800 20 remove_watcher() i=3 2024-09-14T11:38:32.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.865+0000 7f8664892800 20 remove_watcher() i=4 2024-09-14T11:38:32.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.866+0000 7f8664892800 20 remove_watcher() i=5 2024-09-14T11:38:32.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.867+0000 7f8664892800 20 remove_watcher() i=6 2024-09-14T11:38:32.866 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.868+0000 7f8664892800 20 remove_watcher() i=7 2024-09-14T11:38:32.879 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:38:32.879 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key CEXIBNICMZZSSVHFVEXJ --secret MoLXIHZzBtU0qdqdRwNpGuIZhDEzo/gXPbITVj5vzaz4BDBV/NSwng== --cluster ceph 2024-09-14T11:38:32.946 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:32.946 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:32.979 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.981+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.982+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.982+0000 7f594ad19800 20 realm 2024-09-14T11:38:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.982+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.983+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.981 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.983+0000 7f594ad19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.983+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.983+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.983+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.984+0000 7f594ad19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:32.982 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.984+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.984+0000 7f594ad19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:32.983 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.984+0000 7f594ad19800 20 searching for the correct realm 2024-09-14T11:38:32.985 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.986+0000 7f5948009640 0 -- 172.21.15.130:0/20952796 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f5938055430 msgr2=0x7f5938055850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:32.988 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:32.990+0000 7f594880a640 0 -- 172.21.15.130:0/20952796 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7f5940018040 msgr2=0x7f59400634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:33.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.195 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.196+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.196 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 zone default found 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 4 Realm: () 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 zonegroup default 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 started sync module instance, tier type = 2024-09-14T11:38:33.197 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.197+0000 7f594ad19800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:33.205 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=0 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=1 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=2 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=3 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=4 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=5 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.207+0000 7f594ad19800 20 add_watcher() i=6 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.208+0000 7f594ad19800 20 add_watcher() i=7 2024-09-14T11:38:33.206 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.208+0000 7f594ad19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.209+0000 7f57ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.209+0000 7f594ad19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.208 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.209+0000 7f594ad19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.209+0000 7f594ad19800 5 note: GC not initialized 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f57fe7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 20 Filter name: none 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f57f77fe640 20 reqs_thread_entry: start 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:38:33.209 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.210+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:33.210 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 cache get: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ : miss 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ info.flags=0x0 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 adding default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ to cache LRU end 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 cache get: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ : hit (negative entry) 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.211+0000 7f594ad19800 10 cache get: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ : hit (negative entry) 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.212+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:33.211 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.212+0000 7f594ad19800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.212+0000 7f594ad19800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:38:33.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.213+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431708 cookie 94867557623552 notifier 8453 bl.length()=645 2024-09-14T11:38:33.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.213+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:33.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.213+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.214+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:38:33.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.214+0000 7f594ad19800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:33.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.214+0000 7f594ad19800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:38:33.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.215+0000 7f581f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431734 cookie 94867557635888 notifier 8453 bl.length()=185 2024-09-14T11:38:33.214 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.215+0000 7f581f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:38:33.214 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.215+0000 7f581f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f594ad19800 10 cache put: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ info.flags=0x7 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f594ad19800 10 moving default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ to cache LRU end 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f594ad19800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:CEXIBNICMZZSSVHFVEXJ, ofs0, ns] 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f581ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94867557629600 notifier 8453 bl.length()=186 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f581ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ info.flags=0x7 2024-09-14T11:38:33.216 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.217+0000 7f581ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CEXIBNICMZZSSVHFVEXJ to cache LRU end 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "bar.client.0", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "bar+test@test.test", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "bar.client.0", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "CEXIBNICMZZSSVHFVEXJ", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "MoLXIHZzBtU0qdqdRwNpGuIZhDEzo/gXPbITVj5vzaz4BDBV/NSwng==", 2024-09-14T11:38:33.217 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:33.212481Z" 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:33.218 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:33.219 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:33.212472Z", 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.218+0000 7f57ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.221+0000 7f594ad19800 20 remove_watcher() i=0 2024-09-14T11:38:33.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.221+0000 7f594ad19800 2 removed watcher, disabling cache 2024-09-14T11:38:33.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.222+0000 7f594ad19800 20 remove_watcher() i=1 2024-09-14T11:38:33.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.223+0000 7f594ad19800 20 remove_watcher() i=2 2024-09-14T11:38:33.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.224+0000 7f594ad19800 20 remove_watcher() i=3 2024-09-14T11:38:33.223 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.225+0000 7f594ad19800 20 remove_watcher() i=4 2024-09-14T11:38:33.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.226+0000 7f594ad19800 20 remove_watcher() i=5 2024-09-14T11:38:33.225 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.227+0000 7f594ad19800 20 remove_watcher() i=6 2024-09-14T11:38:33.226 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.228+0000 7f594ad19800 20 remove_watcher() i=7 2024-09-14T11:38:33.237 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7644966052 --totp-seed Q4V5IQQLTJO6NDI4TQVSUFKQQBELBISUHTHNVCSOYEL5I7X34CAXQZCHW3HLNVTN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.303 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.336 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.338+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.339+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.339+0000 7f4217bad800 20 realm 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.339+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.339+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.340+0000 7f4217bad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.338 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.340+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.340+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.340+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.341+0000 7f4217bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.341+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.341+0000 7f4217bad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.340 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.341+0000 7f4217bad800 20 searching for the correct realm 2024-09-14T11:38:33.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.344+0000 7f4215e98640 0 -- 172.21.15.130:0/1470376705 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f420c0667b0 msgr2=0x7f420c025a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.348+0000 7f4214e96640 0 -- 172.21.15.130:0/1470376705 >> [v2:172.21.15.171:6808/3699648391,v1:172.21.15.171:6809/3699648391] conn(0x557702c05ad0 msgr2=0x557702c07ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:33.350 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.351+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.351 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 zone default found 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 4 Realm: () 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 zonegroup default 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.352+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.352 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.353+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.353+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.353+0000 7f4217bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.353+0000 7f4217bad800 20 started sync module instance, tier type = 2024-09-14T11:38:33.353 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.353+0000 7f4217bad800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=0 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=1 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=2 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=3 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=4 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=5 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.362+0000 7f4217bad800 20 add_watcher() i=6 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.363+0000 7f4217bad800 20 add_watcher() i=7 2024-09-14T11:38:33.361 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.363+0000 7f4217bad800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.364+0000 7f40cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.364+0000 7f4217bad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.363 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.364+0000 7f4217bad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.364+0000 7f4217bad800 5 note: GC not initialized 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f40ca7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f4217bad800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f4217bad800 20 Filter name: none 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f403bfff640 20 reqs_thread_entry: start 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f4217bad800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.365+0000 7f4217bad800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.366+0000 7f4217bad800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:38:33.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.366+0000 7f4217bad800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:38:33.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.366+0000 7f4217bad800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.366+0000 7f4217bad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f4217bad800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f4217bad800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f4217bad800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f40f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431709 cookie 93969635664912 notifier 8468 bl.length()=659 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f40f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:38:33.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.368+0000 7f40f8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:38:33.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.370+0000 7f40cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.372+0000 7f4217bad800 20 remove_watcher() i=0 2024-09-14T11:38:33.370 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.372+0000 7f4217bad800 2 removed watcher, disabling cache 2024-09-14T11:38:33.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.373+0000 7f4217bad800 20 remove_watcher() i=1 2024-09-14T11:38:33.372 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.374+0000 7f4217bad800 20 remove_watcher() i=2 2024-09-14T11:38:33.373 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.374+0000 7f4217bad800 20 remove_watcher() i=3 2024-09-14T11:38:33.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.376+0000 7f4217bad800 20 remove_watcher() i=4 2024-09-14T11:38:33.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.377+0000 7f4217bad800 20 remove_watcher() i=5 2024-09-14T11:38:33.376 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.378+0000 7f4217bad800 20 remove_watcher() i=6 2024-09-14T11:38:33.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.379+0000 7f4217bad800 20 remove_watcher() i=7 2024-09-14T11:38:33.388 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:38:33.450 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.450 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.485+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 realm 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.487+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.488+0000 7f986be15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.488+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.489+0000 7f986be15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.489+0000 7f986be15800 20 searching for the correct realm 2024-09-14T11:38:33.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.491+0000 7f9867d93640 0 -- 172.21.15.130:0/1314378725 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f985c03d070 msgr2=0x7f985c0734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.695 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.697+0000 7f9867d93640 0 -- 172.21.15.130:0/1314378725 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f985c03d070 msgr2=0x7f985c0734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.701+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 zone default found 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 4 Realm: () 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 zonegroup default 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.702+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.703+0000 7f986be15800 20 started sync module instance, tier type = 2024-09-14T11:38:33.702 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.703+0000 7f986be15800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:33.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=0 2024-09-14T11:38:33.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=1 2024-09-14T11:38:33.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=2 2024-09-14T11:38:33.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=3 2024-09-14T11:38:33.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=4 2024-09-14T11:38:33.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=5 2024-09-14T11:38:33.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.712+0000 7f986be15800 20 add_watcher() i=6 2024-09-14T11:38:33.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.713+0000 7f986be15800 20 add_watcher() i=7 2024-09-14T11:38:33.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.713+0000 7f986be15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:33.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f971dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:33.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 5 note: GC not initialized 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f971cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 20 Filter name: none 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f96967fc640 20 reqs_thread_entry: start 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.715+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.716+0000 7f986be15800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f986be15800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f986be15800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:33.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f986be15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:38:33.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f974affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431710 cookie 94727995891264 notifier 8486 bl.length()=389 2024-09-14T11:38:33.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f974affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:33.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.718+0000 7f974affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:33.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f986be15800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:33.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f986be15800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:33.718 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f986be15800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:38:33.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f974affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431761 cookie 94727995905968 notifier 8486 bl.length()=230 2024-09-14T11:38:33.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f974affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:33.719 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.720+0000 7f974affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f986be15800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f986be15800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f986be15800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f974a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94727995903264 notifier 8486 bl.length()=234 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f974a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:38:33.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.722+0000 7f974a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:38:33.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.723+0000 7f971dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:33.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.725+0000 7f986be15800 20 remove_watcher() i=0 2024-09-14T11:38:33.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.725+0000 7f986be15800 2 removed watcher, disabling cache 2024-09-14T11:38:33.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.727+0000 7f986be15800 20 remove_watcher() i=1 2024-09-14T11:38:33.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.728+0000 7f986be15800 20 remove_watcher() i=2 2024-09-14T11:38:33.727 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.729+0000 7f986be15800 20 remove_watcher() i=3 2024-09-14T11:38:33.728 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.730+0000 7f986be15800 20 remove_watcher() i=4 2024-09-14T11:38:33.729 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.731+0000 7f986be15800 20 remove_watcher() i=5 2024-09-14T11:38:33.730 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.732+0000 7f986be15800 20 remove_watcher() i=6 2024-09-14T11:38:33.731 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.733+0000 7f986be15800 20 remove_watcher() i=7 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "id": "RGW33333333333333333", 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "tenant": "testx", 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "quota": { 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:33.740 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_users": 1000, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_roles": 1000, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_groups": 1000, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:33.741 INFO:teuthology.orchestra.run.smithi130.stdout: "max_access_keys": 4 2024-09-14T11:38:33.742 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:33.742 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:38:33.743 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key JTEFLDJCTIWMAERCYKHA --secret QEpTPGcJcHPqN4KwZw4vLMbHhUYqEUIMuUPKJVwwwSuTvuhj77wbKw== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:38:33.810 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:33.810 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:33.845 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.847+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.850+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.850+0000 7f93bd840800 20 realm 2024-09-14T11:38:33.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.850+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.851+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.851+0000 7f93bd840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:33.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.851+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.851+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:33.850 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.851+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.853+0000 7f93bd840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:33.852 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.853+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:33.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.857+0000 7f93bd840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:33.856 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.857+0000 7f93bd840800 20 searching for the correct realm 2024-09-14T11:38:33.861 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:33.863+0000 7f93bbb2b640 0 -- 172.21.15.130:0/2606373124 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f93b0093960 msgr2=0x7f93b006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.073+0000 7f93bbb2b640 0 -- 172.21.15.130:0/2606373124 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f93b0093960 msgr2=0x7f93b006d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.077+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 zone default found 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 4 Realm: () 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 zonegroup default 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.078 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.078+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.079+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.079+0000 7f93bd840800 20 started sync module instance, tier type = 2024-09-14T11:38:34.079 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.079+0000 7f93bd840800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:34.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=0 2024-09-14T11:38:34.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=1 2024-09-14T11:38:34.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=2 2024-09-14T11:38:34.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=3 2024-09-14T11:38:34.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=4 2024-09-14T11:38:34.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=5 2024-09-14T11:38:34.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=6 2024-09-14T11:38:34.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 20 add_watcher() i=7 2024-09-14T11:38:34.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.088+0000 7f93bd840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.089 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.090+0000 7f9271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.090+0000 7f93bd840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.090+0000 7f93bd840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.090+0000 7f93bd840800 5 note: GC not initialized 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.090+0000 7f9270fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 Filter name: none 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f91ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:38:34.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:38:34.091 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 10 cache get: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA : miss 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.091+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.092+0000 7f93bd840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.092+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA info.flags=0x0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.092+0000 7f93bd840800 10 adding default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA to cache LRU end 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.092+0000 7f93bd840800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.092+0000 7f93bd840800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:38:34.092 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 10 cache get: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA : hit (negative entry) 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.093+0000 7f93bd840800 10 cache get: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA : hit (negative entry) 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:34.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f93bd840800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f93bd840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f929effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399031 cookie 94721595038224 notifier 9129 bl.length()=732 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f929effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.094+0000 7f929effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f93bd840800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:34.094 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f93bd840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:38:34.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f929effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398974 cookie 94721595046432 notifier 9129 bl.length()=215 2024-09-14T11:38:34.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f929effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:38:34.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.096+0000 7f929effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:38:34.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f93bd840800 10 cache put: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA info.flags=0x7 2024-09-14T11:38:34.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f93bd840800 10 moving default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA to cache LRU end 2024-09-14T11:38:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f93bd840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:JTEFLDJCTIWMAERCYKHA, ofs0, ns] 2024-09-14T11:38:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f929e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399058 cookie 94721595035552 notifier 9129 bl.length()=201 2024-09-14T11:38:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f929e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA info.flags=0x7 2024-09-14T11:38:34.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.098+0000 7f929e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JTEFLDJCTIWMAERCYKHA to cache LRU end 2024-09-14T11:38:34.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.100+0000 7f93bd840800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:38:34.098 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:34.098 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "JTEFLDJCTIWMAERCYKHA", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "QEpTPGcJcHPqN4KwZw4vLMbHhUYqEUIMuUPKJVwwwSuTvuhj77wbKw==", 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.094239Z" 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:34.099 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:34.100 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "root", 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.094225Z", 2024-09-14T11:38:34.101 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.101+0000 7f9271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.103+0000 7f93bd840800 20 remove_watcher() i=0 2024-09-14T11:38:34.102 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.103+0000 7f93bd840800 2 removed watcher, disabling cache 2024-09-14T11:38:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.104+0000 7f93bd840800 20 remove_watcher() i=1 2024-09-14T11:38:34.103 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.105+0000 7f93bd840800 20 remove_watcher() i=2 2024-09-14T11:38:34.105 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.107+0000 7f93bd840800 20 remove_watcher() i=3 2024-09-14T11:38:34.106 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.108+0000 7f93bd840800 20 remove_watcher() i=4 2024-09-14T11:38:34.107 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.109+0000 7f93bd840800 20 remove_watcher() i=5 2024-09-14T11:38:34.108 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.110+0000 7f93bd840800 20 remove_watcher() i=6 2024-09-14T11:38:34.109 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.111+0000 7f93bd840800 20 remove_watcher() i=7 2024-09-14T11:38:34.120 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5590633192 --totp-seed L6T3T3GN53JTJQNN4LA4BQEHPU3LQKXLJPDQU7BXLED4AOF4CMFDGP27SI6VSRCF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:34.185 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.185 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.218 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.220+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 realm 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.222+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.223+0000 7f0ab9e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.223+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.224+0000 7f0ab9e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.222 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.224+0000 7f0ab9e14800 20 searching for the correct realm 2024-09-14T11:38:34.224 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.226+0000 7f0ab5ccc640 0 -- 172.21.15.130:0/1792568963 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0aa0039920 msgr2=0x7f0aa001c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.432+0000 7f0ab5ccc640 0 -- 172.21.15.130:0/1792568963 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f0aa0039920 msgr2=0x7f0aa001c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.436+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 zone default found 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 4 Realm: () 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 zonegroup default 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.437+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 started sync module instance, tier type = 2024-09-14T11:38:34.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.438+0000 7f0ab9e14800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=0 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=1 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=2 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=3 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=4 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=5 2024-09-14T11:38:34.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.447+0000 7f0ab9e14800 20 add_watcher() i=6 2024-09-14T11:38:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.448+0000 7f0ab9e14800 20 add_watcher() i=7 2024-09-14T11:38:34.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.448+0000 7f0ab9e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.450+0000 7f096b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.450+0000 7f0ab9e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.450+0000 7f0ab9e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.450+0000 7f0ab9e14800 5 note: GC not initialized 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f096a7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 20 Filter name: none 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f08dbfff640 20 reqs_thread_entry: start 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:38:34.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:38:34.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.451+0000 7f0ab9e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0ab9e14800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0ab9e14800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0ab9e14800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0998ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399032 cookie 94145061314688 notifier 8516 bl.length()=746 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0998ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:38:34.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.454+0000 7f0998ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:38:34.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.456+0000 7f096b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.458+0000 7f0ab9e14800 20 remove_watcher() i=0 2024-09-14T11:38:34.456 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.458+0000 7f0ab9e14800 2 removed watcher, disabling cache 2024-09-14T11:38:34.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.459+0000 7f0ab9e14800 20 remove_watcher() i=1 2024-09-14T11:38:34.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.460+0000 7f0ab9e14800 20 remove_watcher() i=2 2024-09-14T11:38:34.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.461+0000 7f0ab9e14800 20 remove_watcher() i=3 2024-09-14T11:38:34.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.462+0000 7f0ab9e14800 20 remove_watcher() i=4 2024-09-14T11:38:34.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.463+0000 7f0ab9e14800 20 remove_watcher() i=5 2024-09-14T11:38:34.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.464+0000 7f0ab9e14800 20 remove_watcher() i=6 2024-09-14T11:38:34.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.465+0000 7f0ab9e14800 20 remove_watcher() i=7 2024-09-14T11:38:34.474 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:38:34.475 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key XOUKHJCIPUJACBGWPUTJ --secret oaFzNeN8kivUpTdyQdRBAAbhD+uX/J+t/E9bPdwIlyiz56e9IU48tA== --cluster ceph 2024-09-14T11:38:34.539 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.539 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.574+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.575+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.574 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 realm 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.576+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.577+0000 7ff047123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.577+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.578+0000 7ff047123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.578+0000 7ff047123800 20 searching for the correct realm 2024-09-14T11:38:34.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.580+0000 7ff04360d640 0 -- 172.21.15.130:0/1881637538 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff03807dc50 msgr2=0x7ff0380873f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.786+0000 7ff04360d640 0 -- 172.21.15.130:0/1881637538 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff03807dc50 msgr2=0x7ff0380873f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:34.788 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:34.788 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:34.788 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.789 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.790+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:34.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 zone default found 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 4 Realm: () 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 zonegroup default 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 started sync module instance, tier type = 2024-09-14T11:38:34.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.791+0000 7ff047123800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=0 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=1 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=2 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=3 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=4 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=5 2024-09-14T11:38:34.799 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.800+0000 7ff047123800 20 add_watcher() i=6 2024-09-14T11:38:34.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.801+0000 7ff047123800 20 add_watcher() i=7 2024-09-14T11:38:34.800 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.801+0000 7ff047123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.803+0000 7feef97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.803+0000 7ff047123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.803+0000 7ff047123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 5 note: GC not initialized 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7fee73fff640 20 reqs_thread_entry: start 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 20 Filter name: none 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7fee71ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.803 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:38:34.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:34.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:38:34.804 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.804+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 cache get: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ : miss 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ info.flags=0x0 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 adding default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ to cache LRU end 2024-09-14T11:38:34.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 cache get: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ : hit (negative entry) 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.805+0000 7ff047123800 10 cache get: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ : hit (negative entry) 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.806+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.806+0000 7ff047123800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.806+0000 7ff047123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.807+0000 7fef267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398975 cookie 93939780439696 notifier 8534 bl.length()=660 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.807+0000 7fef267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:34.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.807+0000 7fef267fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:34.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:38:34.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7ff047123800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:34.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7ff047123800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:38:34.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7fef25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399007 cookie 93939780423936 notifier 8534 bl.length()=191 2024-09-14T11:38:34.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7fef25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:38:34.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.809+0000 7fef25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.810+0000 7ff047123800 10 cache put: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ info.flags=0x7 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.810+0000 7ff047123800 10 moving default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ to cache LRU end 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.810+0000 7ff047123800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:XOUKHJCIPUJACBGWPUTJ, ofs0, ns] 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.811+0000 7fef25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 93939780429120 notifier 8534 bl.length()=189 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.811+0000 7fef25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ info.flags=0x7 2024-09-14T11:38:34.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.811+0000 7fef25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XOUKHJCIPUJACBGWPUTJ to cache LRU end 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "foobar.client.0", 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "foobar+test@test.test", 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "foobar.client.0", 2024-09-14T11:38:34.810 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "XOUKHJCIPUJACBGWPUTJ", 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "oaFzNeN8kivUpTdyQdRBAAbhD+uX/J+t/E9bPdwIlyiz56e9IU48tA==", 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.806708Z" 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:34.811 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:34.812 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.806697Z", 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.812+0000 7feef97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:34.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.814+0000 7ff047123800 20 remove_watcher() i=0 2024-09-14T11:38:34.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.814+0000 7ff047123800 2 removed watcher, disabling cache 2024-09-14T11:38:34.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.815+0000 7ff047123800 20 remove_watcher() i=1 2024-09-14T11:38:34.814 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.816+0000 7ff047123800 20 remove_watcher() i=2 2024-09-14T11:38:34.815 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.817+0000 7ff047123800 20 remove_watcher() i=3 2024-09-14T11:38:34.816 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.818+0000 7ff047123800 20 remove_watcher() i=4 2024-09-14T11:38:34.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.819+0000 7ff047123800 20 remove_watcher() i=5 2024-09-14T11:38:34.818 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.820+0000 7ff047123800 20 remove_watcher() i=6 2024-09-14T11:38:34.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.821+0000 7ff047123800 20 remove_watcher() i=7 2024-09-14T11:38:34.830 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1178793744 --totp-seed XIBH2XYQAIWYWKV62BHODEC2OBOOCQO36QBEZOUANGALUROLWGVX4VBGVPXDWKEF --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:34.897 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:34.897 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:34.930 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.932+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 20 realm 2024-09-14T11:38:34.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.932 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.933+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.934+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.934+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.934+0000 7fe7cd922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:34.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.934+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:34.934 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.935+0000 7fe7cd922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:34.934 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.935+0000 7fe7cd922800 20 searching for the correct realm 2024-09-14T11:38:34.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:34.937+0000 7fe7c9dd3640 0 -- 172.21.15.130:0/1480889451 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe7c0018070 msgr2=0x7fe7c00605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.142 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.143+0000 7fe7c9dd3640 0 -- 172.21.15.130:0/1480889451 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe7c0018070 msgr2=0x7fe7c00605c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.146 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:35.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.147+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.147 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 zone default found 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 4 Realm: () 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:35.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 zonegroup default 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.148+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.149+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.149+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.149+0000 7fe7cd922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.149+0000 7fe7cd922800 20 started sync module instance, tier type = 2024-09-14T11:38:35.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.149+0000 7fe7cd922800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=0 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=1 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=2 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=3 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=4 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=5 2024-09-14T11:38:35.157 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.158+0000 7fe7cd922800 20 add_watcher() i=6 2024-09-14T11:38:35.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.159+0000 7fe7cd922800 20 add_watcher() i=7 2024-09-14T11:38:35.158 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.159+0000 7fe7cd922800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe67ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 5 note: GC not initialized 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe67efe5640 20 reqs_thread_entry: start 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 20 Filter name: none 2024-09-14T11:38:35.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe67cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.161+0000 7fe7cd922800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.162+0000 7fe7cd922800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.162+0000 7fe7cd922800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.162+0000 7fe7cd922800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.161 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.162+0000 7fe7cd922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.164+0000 7fe7cd922800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.164+0000 7fe7cd922800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.164+0000 7fe7cd922800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.165+0000 7fe6acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398976 cookie 94400526608144 notifier 8549 bl.length()=674 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.165+0000 7fe6acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:35.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.165+0000 7fe6acff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.166+0000 7fe67ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.168+0000 7fe7cd922800 20 remove_watcher() i=0 2024-09-14T11:38:35.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.168+0000 7fe7cd922800 2 removed watcher, disabling cache 2024-09-14T11:38:35.167 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.169+0000 7fe7cd922800 20 remove_watcher() i=1 2024-09-14T11:38:35.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.170+0000 7fe7cd922800 20 remove_watcher() i=2 2024-09-14T11:38:35.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.171+0000 7fe7cd922800 20 remove_watcher() i=3 2024-09-14T11:38:35.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.172+0000 7fe7cd922800 20 remove_watcher() i=4 2024-09-14T11:38:35.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.173+0000 7fe7cd922800 20 remove_watcher() i=5 2024-09-14T11:38:35.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.174+0000 7fe7cd922800 20 remove_watcher() i=6 2024-09-14T11:38:35.173 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.175+0000 7fe7cd922800 20 remove_watcher() i=7 2024-09-14T11:38:35.184 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:38:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.242 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.277+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 realm 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.279+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.280+0000 7f9882f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.280+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.281+0000 7f9882f22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.279 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.281+0000 7f9882f22800 20 searching for the correct realm 2024-09-14T11:38:35.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.284+0000 7f987f303640 0 -- 172.21.15.130:0/3176957461 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f98680a2030 msgr2=0x7f98680686a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.287+0000 7f987f303640 0 -- 172.21.15.130:0/3176957461 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f97480885b0 msgr2=0x7f974808a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:35.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.291+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.291 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 zone default found 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 4 Realm: () 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.292 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 zonegroup default 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.292+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.293+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.293+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.293+0000 7f9882f22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.293+0000 7f9882f22800 20 started sync module instance, tier type = 2024-09-14T11:38:35.293 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.293+0000 7f9882f22800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:35.300 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=0 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=1 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=2 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=3 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=4 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=5 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.302+0000 7f9882f22800 20 add_watcher() i=6 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.303+0000 7f9882f22800 20 add_watcher() i=7 2024-09-14T11:38:35.301 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.303+0000 7f9882f22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f97357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 5 note: GC not initialized 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f96affff640 20 reqs_thread_entry: start 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 20 Filter name: none 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f96adffb640 20 reqs_thread_entry: start 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:38:35.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.305+0000 7f9882f22800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.306+0000 7f9882f22800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:38:35.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.306+0000 7f9882f22800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:38:35.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.306+0000 7f9882f22800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.305 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.306+0000 7f9882f22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f9882f22800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f9882f22800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f9882f22800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f97627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94562830606832 notifier 8567 bl.length()=727 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f97627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.307+0000 7f97627fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:35.306 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "foobar.client.0", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "foobar+test@test.test", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "foobar.client.0", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "XOUKHJCIPUJACBGWPUTJ", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "oaFzNeN8kivUpTdyQdRBAAbhD+uX/J+t/E9bPdwIlyiz56e9IU48tA==", 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.806708Z" 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:35.307 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [ 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "oidc-provider", 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "perm": "*" 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "roles", 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "perm": "*" 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "user-policy", 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "perm": "*" 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:35.308 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.309 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "rgw", 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [ 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "1178793744" 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "", 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:34.806697Z", 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:35.310 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:35.311 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.308+0000 7f97357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.311 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.311+0000 7f9882f22800 20 remove_watcher() i=0 2024-09-14T11:38:35.311 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.311+0000 7f9882f22800 2 removed watcher, disabling cache 2024-09-14T11:38:35.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.312+0000 7f9882f22800 20 remove_watcher() i=1 2024-09-14T11:38:35.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.313+0000 7f9882f22800 20 remove_watcher() i=2 2024-09-14T11:38:35.312 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.314+0000 7f9882f22800 20 remove_watcher() i=3 2024-09-14T11:38:35.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.315+0000 7f9882f22800 20 remove_watcher() i=4 2024-09-14T11:38:35.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.316+0000 7f9882f22800 20 remove_watcher() i=5 2024-09-14T11:38:35.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.317+0000 7f9882f22800 20 remove_watcher() i=6 2024-09-14T11:38:35.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.318+0000 7f9882f22800 20 remove_watcher() i=7 2024-09-14T11:38:35.327 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:38:35.387 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.387 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.420 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.422+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 realm 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.424+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.425+0000 7f506560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.425+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.426+0000 7f506560e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.426+0000 7f506560e800 20 searching for the correct realm 2024-09-14T11:38:35.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.428+0000 7f506145a640 0 -- 172.21.15.130:0/98398624 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f504c01e060 msgr2=0x7f504c05fcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.432+0000 7f506145a640 0 -- 172.21.15.130:0/98398624 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f4f2c0885e0 msgr2=0x7f4f2c08aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.436+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 zone default found 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 4 Realm: () 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 zonegroup default 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.437+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.438+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.438+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.438+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.438+0000 7f506560e800 20 started sync module instance, tier type = 2024-09-14T11:38:35.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.438+0000 7f506560e800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=0 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=1 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=2 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=3 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=4 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=5 2024-09-14T11:38:35.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.446+0000 7f506560e800 20 add_watcher() i=6 2024-09-14T11:38:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.447+0000 7f506560e800 20 add_watcher() i=7 2024-09-14T11:38:35.446 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.447+0000 7f506560e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f4f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f506560e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f506560e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f506560e800 5 note: GC not initialized 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f4f167e4640 20 reqs_thread_entry: start 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.449+0000 7f506560e800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 Filter name: none 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f4f0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.449 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:35.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.450+0000 7f506560e800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f506560e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f506560e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f506560e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f4f37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399008 cookie 93981301251728 notifier 8582 bl.length()=384 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f4f37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:35.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.452+0000 7f4f37fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.453+0000 7f506560e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:35.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.453+0000 7f506560e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.453+0000 7f506560e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:38:35.452 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.454+0000 7f4f37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399059 cookie 93981301260208 notifier 8582 bl.length()=225 2024-09-14T11:38:35.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.454+0000 7f4f37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:35.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.454+0000 7f4f37fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.455+0000 7f506560e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.455+0000 7f506560e800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.455+0000 7f506560e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.456+0000 7f4f377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 93981301257552 notifier 8582 bl.length()=234 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.456+0000 7f4f377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:38:35.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.456+0000 7f4f377fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:38:35.455 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.457+0000 7f4f177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.459+0000 7f506560e800 20 remove_watcher() i=0 2024-09-14T11:38:35.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.459+0000 7f506560e800 2 removed watcher, disabling cache 2024-09-14T11:38:35.458 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.460+0000 7f506560e800 20 remove_watcher() i=1 2024-09-14T11:38:35.459 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.461+0000 7f506560e800 20 remove_watcher() i=2 2024-09-14T11:38:35.460 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.462+0000 7f506560e800 20 remove_watcher() i=3 2024-09-14T11:38:35.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.463+0000 7f506560e800 20 remove_watcher() i=4 2024-09-14T11:38:35.462 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.463+0000 7f506560e800 20 remove_watcher() i=5 2024-09-14T11:38:35.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.464+0000 7f506560e800 20 remove_watcher() i=6 2024-09-14T11:38:35.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.465+0000 7f506560e800 20 remove_watcher() i=7 2024-09-14T11:38:35.472 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:35.472 INFO:teuthology.orchestra.run.smithi130.stdout: "id": "RGW88888888888888888", 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "tenant": "", 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "quota": { 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_users": 1000, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_roles": 1000, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_groups": 1000, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout: "max_access_keys": 4 2024-09-14T11:38:35.474 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:35.475 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:38:35.475 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key PCYSFCOZKIYEUKBLVXSM --secret h0Yaorea7FAzAUcUDiBcixvUebF9UYp3VePHC4w1CDw0Tz7S1bvE0Q== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:38:35.542 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.542 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.576 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.577+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 20 realm 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.578+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.579+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.579+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.579+0000 7fe19cf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.579+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.580+0000 7fe19cf26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.580+0000 7fe19cf26800 20 searching for the correct realm 2024-09-14T11:38:35.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.582+0000 7fe1993da640 0 -- 172.21.15.130:0/2554473141 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe180045c60 msgr2=0x7fe18003a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.786 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.788+0000 7fe1993da640 0 -- 172.21.15.130:0/2554473141 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fe180045c60 msgr2=0x7fe18003a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:35.790 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.791 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 zone default found 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 4 Realm: () 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:35.792 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 zonegroup default 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.792+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 started sync module instance, tier type = 2024-09-14T11:38:35.793 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.793+0000 7fe19cf26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=0 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=1 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=2 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=3 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=4 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=5 2024-09-14T11:38:35.801 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.802+0000 7fe19cf26800 20 add_watcher() i=6 2024-09-14T11:38:35.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.803+0000 7fe19cf26800 20 add_watcher() i=7 2024-09-14T11:38:35.802 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.803+0000 7fe19cf26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe04efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe19cf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe19cf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe19cf26800 5 note: GC not initialized 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe04dfe3640 20 reqs_thread_entry: start 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe19cf26800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.805+0000 7fe19cf26800 20 Filter name: none 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fdfbf7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:38:35.805 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM : miss 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM info.flags=0x0 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 adding default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM to cache LRU end 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:38:35.806 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.806+0000 7fe19cf26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:38:35.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:38:35.807 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM : hit (negative entry) 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.807+0000 7fe19cf26800 10 cache get: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM : hit (negative entry) 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe19cf26800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe19cf26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe06ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399009 cookie 94507116764352 notifier 8600 bl.length()=681 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe06ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:35.808 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.809+0000 7fe06ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.810+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.810+0000 7fe19cf26800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.810+0000 7fe19cf26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.811+0000 7fe06ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399033 cookie 94507116775920 notifier 8600 bl.length()=189 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.811+0000 7fe06ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:38:35.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.811+0000 7fe06ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.812+0000 7fe19cf26800 10 cache put: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM info.flags=0x7 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.812+0000 7fe19cf26800 10 moving default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM to cache LRU end 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.812+0000 7fe19cf26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:PCYSFCOZKIYEUKBLVXSM, ofs0, ns] 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.813+0000 7fe06f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399060 cookie 94507116774384 notifier 8600 bl.length()=188 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.813+0000 7fe06f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM info.flags=0x7 2024-09-14T11:38:35.811 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.813+0000 7fe06f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PCYSFCOZKIYEUKBLVXSM to cache LRU end 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.814+0000 7fe19cf26800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "root1.client.0", 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "root1+test@test.test", 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:35.813 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "root1.client.0", 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "PCYSFCOZKIYEUKBLVXSM", 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "h0Yaorea7FAzAUcUDiBcixvUebF9UYp3VePHC4w1CDw0Tz7S1bvE0Q==", 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:35.808574Z" 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:35.814 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:35.815 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "root", 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:35.808562Z", 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:35.816 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:35.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.815+0000 7fe04efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:35.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.817+0000 7fe19cf26800 20 remove_watcher() i=0 2024-09-14T11:38:35.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.817+0000 7fe19cf26800 2 removed watcher, disabling cache 2024-09-14T11:38:35.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.818+0000 7fe19cf26800 20 remove_watcher() i=1 2024-09-14T11:38:35.817 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.819+0000 7fe19cf26800 20 remove_watcher() i=2 2024-09-14T11:38:35.819 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.820+0000 7fe19cf26800 20 remove_watcher() i=3 2024-09-14T11:38:35.820 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.821+0000 7fe19cf26800 20 remove_watcher() i=4 2024-09-14T11:38:35.821 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.822+0000 7fe19cf26800 20 remove_watcher() i=5 2024-09-14T11:38:35.822 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.823+0000 7fe19cf26800 20 remove_watcher() i=6 2024-09-14T11:38:35.823 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.824+0000 7fe19cf26800 20 remove_watcher() i=7 2024-09-14T11:38:35.834 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 5441468321 --totp-seed SKPTHYAM2L4TTMPZEK4Y2ZZPZHPCNSLM2LGP5QZCZP5MSKDPQUK5OFHEDSFOHDVI --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:35.900 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:35.900 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:35.933 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.935+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 realm 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:35.935 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.936+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.937+0000 7f8431926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:35.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.937+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:35.936 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.938+0000 7f8431926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:35.937 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.938+0000 7f8431926800 20 searching for the correct realm 2024-09-14T11:38:35.938 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:35.940+0000 7f842dd0a640 0 -- 172.21.15.130:0/4044030127 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8424043920 msgr2=0x7f842402d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:36.144 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.146+0000 7f842dd0a640 0 -- 172.21.15.130:0/4044030127 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f8424043920 msgr2=0x7f842402d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.148 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.149 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.150+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.150 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 zone default found 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 4 Realm: () 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 zonegroup default 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.151+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.152+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.152+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.152+0000 7f8431926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.152+0000 7f8431926800 20 started sync module instance, tier type = 2024-09-14T11:38:36.151 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.152+0000 7f8431926800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=0 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=1 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=2 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=3 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=4 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=5 2024-09-14T11:38:36.159 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.161+0000 7f8431926800 20 add_watcher() i=6 2024-09-14T11:38:36.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.162+0000 7f8431926800 20 add_watcher() i=7 2024-09-14T11:38:36.160 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.162+0000 7f8431926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.163+0000 7f82e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.162 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.163+0000 7f8431926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.163+0000 7f8431926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.163+0000 7f8431926800 5 note: GC not initialized 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f82e27e4640 20 reqs_thread_entry: start 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 20 Filter name: none 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8253fff640 20 reqs_thread_entry: start 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:38:36.163 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:38:36.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:36.164 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.164+0000 7f8431926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8431926800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8431926800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8431926800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8310ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399010 cookie 94167504579392 notifier 9261 bl.length()=695 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8310ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.167+0000 7f8310ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:38:36.166 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.168+0000 7f82e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.170+0000 7f8431926800 20 remove_watcher() i=0 2024-09-14T11:38:36.169 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.170+0000 7f8431926800 2 removed watcher, disabling cache 2024-09-14T11:38:36.170 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.172+0000 7f8431926800 20 remove_watcher() i=1 2024-09-14T11:38:36.171 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.173+0000 7f8431926800 20 remove_watcher() i=2 2024-09-14T11:38:36.172 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.174+0000 7f8431926800 20 remove_watcher() i=3 2024-09-14T11:38:36.174 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.175+0000 7f8431926800 20 remove_watcher() i=4 2024-09-14T11:38:36.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.176+0000 7f8431926800 20 remove_watcher() i=5 2024-09-14T11:38:36.175 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.177+0000 7f8431926800 20 remove_watcher() i=6 2024-09-14T11:38:36.176 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.178+0000 7f8431926800 20 remove_watcher() i=7 2024-09-14T11:38:36.187 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:38:36.247 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:36.247 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:36.280 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.281+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 realm 2024-09-14T11:38:36.281 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.283+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.284+0000 7f49fbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.284+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.285+0000 7f49fbb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.285+0000 7f49fbb26800 20 searching for the correct realm 2024-09-14T11:38:36.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.287+0000 7f49f7f0a640 0 -- 172.21.15.130:0/717082049 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f49e00a7be0 msgr2=0x7f49e0067dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.492+0000 7f49f7f0a640 0 -- 172.21.15.130:0/717082049 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f49e00a7be0 msgr2=0x7f49e0067dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:36.494 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 zone default found 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 4 Realm: () 2024-09-14T11:38:36.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 zonegroup default 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.496+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 started sync module instance, tier type = 2024-09-14T11:38:36.497 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.497+0000 7f49fbb26800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:36.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=0 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=1 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=2 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=3 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=4 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=5 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.506+0000 7f49fbb26800 20 add_watcher() i=6 2024-09-14T11:38:36.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.507+0000 7f49fbb26800 20 add_watcher() i=7 2024-09-14T11:38:36.506 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.507+0000 7f49fbb26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:36.508 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f48adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f49fbb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f49fbb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f49fbb26800 5 note: GC not initialized 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f48acfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.509+0000 7f49fbb26800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 Filter name: none 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f48267fc640 20 reqs_thread_entry: start 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:38:36.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.510+0000 7f49fbb26800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.511+0000 7f49fbb26800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.511+0000 7f49fbb26800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.511+0000 7f49fbb26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.512+0000 7f48daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399011 cookie 94791501725472 notifier 8636 bl.length()=384 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.512+0000 7f48daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.512+0000 7f48daffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f49fbb26800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f49fbb26800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f49fbb26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:38:36.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f48daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399061 cookie 94791501740304 notifier 8636 bl.length()=225 2024-09-14T11:38:36.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f48daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:36.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.513+0000 7f48daffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:36.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f49fbb26800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:38:36.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f49fbb26800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:36.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f49fbb26800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:38:36.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f48daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 94791501730336 notifier 8636 bl.length()=234 2024-09-14T11:38:36.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f48daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:38:36.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.515+0000 7f48daffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:38:36.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.516+0000 7f48adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:36.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.519+0000 7f49fbb26800 20 remove_watcher() i=0 2024-09-14T11:38:36.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.519+0000 7f49fbb26800 2 removed watcher, disabling cache 2024-09-14T11:38:36.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.520+0000 7f49fbb26800 20 remove_watcher() i=1 2024-09-14T11:38:36.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.521+0000 7f49fbb26800 20 remove_watcher() i=2 2024-09-14T11:38:36.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.522+0000 7f49fbb26800 20 remove_watcher() i=3 2024-09-14T11:38:36.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.523+0000 7f49fbb26800 20 remove_watcher() i=4 2024-09-14T11:38:36.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.524+0000 7f49fbb26800 20 remove_watcher() i=5 2024-09-14T11:38:36.523 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.525+0000 7f49fbb26800 20 remove_watcher() i=6 2024-09-14T11:38:36.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.526+0000 7f49fbb26800 20 remove_watcher() i=7 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "id": "RGW99999999999999999", 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "tenant": "", 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "quota": { 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:36.533 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_users": 1000, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_roles": 1000, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_groups": 1000, 2024-09-14T11:38:36.534 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:36.535 INFO:teuthology.orchestra.run.smithi130.stdout: "max_access_keys": 4 2024-09-14T11:38:36.535 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:36.536 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:38:36.536 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key CHHACXOYDJDZLESWVBIN --secret FKJhOXw3qOHFBMON1dvstYmSJSH4IHS3FnRAFEgPhXBCrYDZV81Blw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:38:36.603 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:36.603 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:36.636 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.638+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.637 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 realm 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.639+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.640+0000 7fef79126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:36.639 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.640+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:36.639 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.641+0000 7fef79126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:36.639 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.641+0000 7fef79126800 20 searching for the correct realm 2024-09-14T11:38:36.641 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.643+0000 7fef7550a640 0 -- 172.21.15.130:0/1069286356 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fef6001a040 msgr2=0x7fef60061cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:36.847 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:36.848+0000 7fef74d09640 0 -- 172.21.15.130:0/1069286356 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fef7004b960 msgr2=0x7fef7003f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:37.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:37.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.054+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.054 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 zone default found 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 4 Realm: () 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 zonegroup default 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.055+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.056+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.056+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.056+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.056+0000 7fef79126800 20 started sync module instance, tier type = 2024-09-14T11:38:37.056 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.056+0000 7fef79126800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:37.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=0 2024-09-14T11:38:37.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=1 2024-09-14T11:38:37.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=2 2024-09-14T11:38:37.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=3 2024-09-14T11:38:37.064 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=4 2024-09-14T11:38:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=5 2024-09-14T11:38:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.066+0000 7fef79126800 20 add_watcher() i=6 2024-09-14T11:38:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.067+0000 7fef79126800 20 add_watcher() i=7 2024-09-14T11:38:37.065 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.067+0000 7fef79126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.068+0000 7fee2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.068+0000 7fef79126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.068+0000 7fef79126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:37.068 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.068+0000 7fef79126800 5 note: GC not initialized 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fee2a7e4640 20 reqs_thread_entry: start 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 20 Filter name: none 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fee23fff640 20 reqs_thread_entry: start 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.069+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:38:37.069 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 cache get: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN : miss 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN info.flags=0x0 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 adding default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN to cache LRU end 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:38:37.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.070+0000 7fef79126800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 10 cache get: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN : hit (negative entry) 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.071+0000 7fef79126800 10 cache get: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN : hit (negative entry) 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.072+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:37.071 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.072+0000 7fef79126800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.072+0000 7fef79126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:38:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.073+0000 7fee4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399012 cookie 94769463917808 notifier 8654 bl.length()=681 2024-09-14T11:38:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.073+0000 7fee4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:37.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.073+0000 7fee4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fef79126800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fef79126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fee4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399034 cookie 94769463929616 notifier 8654 bl.length()=189 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fee4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:38:37.073 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.074+0000 7fee4bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:38:37.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fef79126800 10 cache put: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN info.flags=0x7 2024-09-14T11:38:37.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fef79126800 10 moving default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN to cache LRU end 2024-09-14T11:38:37.074 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fef79126800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:CHHACXOYDJDZLESWVBIN, ofs0, ns] 2024-09-14T11:38:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fee4b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398939 cookie 94769463891568 notifier 8654 bl.length()=188 2024-09-14T11:38:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fee4b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN info.flags=0x7 2024-09-14T11:38:37.075 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.076+0000 7fee4b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CHHACXOYDJDZLESWVBIN to cache LRU end 2024-09-14T11:38:37.076 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.078+0000 7fef79126800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "user_id": "root2.client.0", 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "email": "root2+test@test.test", 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "suspended": 0, 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "max_buckets": 1000, 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "subusers": [], 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "keys": [ 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: { 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "user": "root2.client.0", 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "access_key": "CHHACXOYDJDZLESWVBIN", 2024-09-14T11:38:37.077 INFO:teuthology.orchestra.run.smithi130.stdout: "secret_key": "FKJhOXw3qOHFBMON1dvstYmSJSH4IHS3FnRAFEgPhXBCrYDZV81Blw==", 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "active": true, 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:37.072394Z" 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: ], 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "swift_keys": [], 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": [], 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "op_mask": "read, write, delete", 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "default_placement": "", 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "default_storage_class": "", 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "placement_tags": [], 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "bucket_quota": { 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:37.078 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "user_quota": { 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "enabled": false, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "check_on_raw": false, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size": -1, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_size_kb": 0, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "max_objects": -1 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "temp_url_keys": [], 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "root", 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "mfa_ids": [], 2024-09-14T11:38:37.079 INFO:teuthology.orchestra.run.smithi130.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "path": "/", 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "create_date": "2024-09-14T11:38:37.072382Z", 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "tags": [], 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: "group_ids": [] 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.079+0000 7fee2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.080 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.081+0000 7fef79126800 20 remove_watcher() i=0 2024-09-14T11:38:37.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.081+0000 7fef79126800 2 removed watcher, disabling cache 2024-09-14T11:38:37.081 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.082+0000 7fef79126800 20 remove_watcher() i=1 2024-09-14T11:38:37.082 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.083+0000 7fef79126800 20 remove_watcher() i=2 2024-09-14T11:38:37.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.084+0000 7fef79126800 20 remove_watcher() i=3 2024-09-14T11:38:37.084 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.085+0000 7fef79126800 20 remove_watcher() i=4 2024-09-14T11:38:37.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.087+0000 7fef79126800 20 remove_watcher() i=5 2024-09-14T11:38:37.086 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.088+0000 7fef79126800 20 remove_watcher() i=6 2024-09-14T11:38:37.087 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.089+0000 7fef79126800 20 remove_watcher() i=7 2024-09-14T11:38:37.098 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 3928823962 --totp-seed AZFJJ67WMKP7ESJNGPT7EUNZMH5T7KTW4S3732GD3K5R5FUZ2O2NWZIPDP4QRMVB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:38:37.164 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:37.164 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:37.198 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.199+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.199 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 realm 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.201+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.200 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.202+0000 7fc65cc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.202+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.203+0000 7fc65cc13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:37.201 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.203+0000 7fc65cc13800 20 searching for the correct realm 2024-09-14T11:38:37.203 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.205+0000 7fc658b49640 0 -- 172.21.15.130:0/2588754691 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc640030040 msgr2=0x7fc640040430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:37.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.410+0000 7fc658b49640 0 -- 172.21.15.130:0/2588754691 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fc640030040 msgr2=0x7fc640040430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.414+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:37.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 zone default found 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 4 Realm: () 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 zonegroup default 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.415 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.415+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.416+0000 7fc65cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.416+0000 7fc65cc13800 20 started sync module instance, tier type = 2024-09-14T11:38:37.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.416+0000 7fc65cc13800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=0 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=1 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=2 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=3 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=4 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=5 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.426+0000 7fc65cc13800 20 add_watcher() i=6 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.427+0000 7fc65cc13800 20 add_watcher() i=7 2024-09-14T11:38:37.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.427+0000 7fc65cc13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc50efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc65cc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc65cc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc65cc13800 5 note: GC not initialized 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc50dfdb640 20 reqs_thread_entry: start 2024-09-14T11:38:37.428 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc65cc13800 20 init_complete bucket index max shards: 11 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc65cc13800 20 Filter name: none 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.429+0000 7fc47f7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 20 rados->read ofs=0 len=0 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:38:37.429 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.430+0000 7fc65cc13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.432+0000 7fc65cc13800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.432+0000 7fc65cc13800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.432+0000 7fc65cc13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.433+0000 7fc52f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399013 cookie 94470615371552 notifier 8672 bl.length()=695 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.433+0000 7fc52f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:38:37.431 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.433+0000 7fc52f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:38:37.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.434+0000 7fc50efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:37.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.436+0000 7fc65cc13800 20 remove_watcher() i=0 2024-09-14T11:38:37.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.436+0000 7fc65cc13800 2 removed watcher, disabling cache 2024-09-14T11:38:37.435 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.437+0000 7fc65cc13800 20 remove_watcher() i=1 2024-09-14T11:38:37.436 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.438+0000 7fc65cc13800 20 remove_watcher() i=2 2024-09-14T11:38:37.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.439+0000 7fc65cc13800 20 remove_watcher() i=3 2024-09-14T11:38:37.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.440+0000 7fc65cc13800 20 remove_watcher() i=4 2024-09-14T11:38:37.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.441+0000 7fc65cc13800 20 remove_watcher() i=5 2024-09-14T11:38:37.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.442+0000 7fc65cc13800 20 remove_watcher() i=6 2024-09-14T11:38:37.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:38:37.443+0000 7fc65cc13800 20 remove_watcher() i=7 2024-09-14T11:38:37.451 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:38:37.452 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:38:37.452 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:38:37.482 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:38:37.482 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:38:37.482 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:38:37.551 DEBUG:teuthology.orchestra.run.smithi130:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:38:37.730 INFO:teuthology.orchestra.run.smithi130.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:38:37.908 INFO:teuthology.orchestra.run.smithi130.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:38:38.166 INFO:teuthology.orchestra.run.smithi130.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:40:19.207 INFO:teuthology.orchestra.run.smithi130.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:40:20.600 INFO:teuthology.orchestra.run.smithi130.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=9d132b35e93deaee2f152e456ee3402e98ec726605e54a08b61632e909b5f8ff,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:40:20.600 INFO:teuthology.orchestra.run.smithi130.stdout:py run-test-pre: PYTHONHASHSEED='939521224' 2024-09-14T11:40:20.600 INFO:teuthology.orchestra.run.smithi130.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:40:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:============================= test session starts ============================== 2024-09-14T11:40:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:40:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:40:20.735 INFO:teuthology.orchestra.run.smithi130.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:40:20.736 INFO:teuthology.orchestra.run.smithi130.stdout:configfile: pytest.ini 2024-09-14T11:40:22.530 INFO:teuthology.orchestra.run.smithi130.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:40:22.530 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:40:22.859 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:40:23.035 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:40:23.208 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:40:23.382 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:40:23.555 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:40:23.676 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:40:23.848 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:40:23.973 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:40:24.060 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:40:24.147 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:40:24.321 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:40:24.493 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:40:24.669 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:40:24.846 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:40:24.932 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:40:25.020 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:40:25.065 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.157 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.204 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.251 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.297 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:40:25.343 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.389 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.436 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.482 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.529 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.574 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.621 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:40:25.667 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.713 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.759 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.805 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.852 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.897 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.943 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:40:25.989 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:40:26.037 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.082 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.128 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.174 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.219 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.265 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.311 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:40:26.358 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.403 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.449 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.495 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.542 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.589 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.635 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.682 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:40:26.727 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:40:27.144 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:40:27.722 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:40:28.755 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:40:29.749 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:40:31.497 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:40:32.064 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:40:32.886 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:40:33.120 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:40:33.254 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:40:33.469 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:40:33.682 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:40:34.019 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:40:34.215 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:40:34.458 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:40:34.459 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:40:34.459 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:40:34.460 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:40:34.461 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:40:34.462 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:40:34.463 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:40:34.464 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:40:34.465 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.465 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.466 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.467 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.468 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:40:34.468 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.469 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.470 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:40:34.471 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:40:34.472 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:40:34.473 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:40:34.473 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:40:34.474 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:40:34.475 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:40:34.476 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:40:34.477 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:40:34.478 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:40:34.478 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:40:34.479 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:40:34.480 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:40:34.565 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:40:34.577 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:40:35.142 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:40:41.100 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:40:41.492 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:40:41.983 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:40:42.596 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:40:43.076 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:40:43.516 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:40:43.867 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:40:44.346 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:40:44.741 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:40:45.382 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:40:45.805 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:40:46.176 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:40:46.549 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:40:46.852 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:40:47.270 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:40:47.679 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:40:48.148 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:40:48.575 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:40:49.004 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:40:49.429 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:40:49.819 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:40:50.245 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:40:50.618 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:40:50.994 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:40:51.288 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:40:51.624 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:40:51.927 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:40:52.219 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:40:52.522 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:40:53.024 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:40:53.329 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:40:53.631 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:40:54.038 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:40:54.436 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:40:54.741 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:40:55.172 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:40:55.578 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:40:56.059 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:40:56.422 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:40:56.829 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:40:57.215 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:40:57.793 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:40:58.254 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:40:58.691 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:40:59.117 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:40:59.688 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:00.175 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:00.687 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:01.231 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:01.763 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:41:02.212 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:41:02.780 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:41:03.259 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:41:04.238 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:41:04.949 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:41:05.787 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:41:07.458 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:41:09.733 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:41:10.999 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:41:12.162 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:41:13.080 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:41:13.667 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:41:14.705 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:41:15.478 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:41:16.472 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:41:17.196 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:41:18.455 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:41:19.370 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:41:20.788 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:41:22.135 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:41:23.063 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:41:23.927 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:41:24.663 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:41:26.333 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:41:27.523 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:41:28.947 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:41:30.328 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:41:31.521 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:41:32.710 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:41:33.684 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:41:34.412 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:41:35.231 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:41:36.737 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:41:38.715 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:41:39.624 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:41:40.922 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:41:42.207 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:41:43.357 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:41:44.629 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:41:46.112 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:41:47.383 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:41:48.583 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:41:49.386 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:41:50.089 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:41:50.793 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:41:51.489 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:41:52.568 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:41:53.748 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:41:54.848 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:41:55.942 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:41:57.062 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:41:58.144 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:41:59.208 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:42:00.370 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:42:01.467 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:02.570 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:03.658 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:42:04.776 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:42:05.532 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:42:06.277 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:42:06.978 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:42:07.680 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:42:08.217 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:42:08.864 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:42:09.398 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:42:09.933 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:42:10.380 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:42:10.842 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:42:11.326 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:42:11.791 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:42:12.284 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:42:13.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:42:13.966 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:42:14.397 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:42:14.860 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:42:15.359 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:42:15.813 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:42:16.693 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:42:17.537 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:42:18.464 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:42:18.937 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:42:19.434 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:42:19.935 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:42:20.469 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:42:20.931 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:42:21.387 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:42:21.883 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:42:22.371 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:42:22.861 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:42:23.387 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:42:24.338 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:42:24.820 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:42:25.268 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:42:25.764 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:42:26.253 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:42:34.396 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:42:34.882 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:42:35.327 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:42:35.811 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:42:36.266 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:42:36.709 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:42:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:42:37.770 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:42:38.289 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:42:38.769 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:42:39.228 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:42:39.686 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:42:40.142 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:42:40.595 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:42:41.081 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:42:41.582 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:42:42.076 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:42:42.558 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:42:43.053 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:42:43.538 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:42:44.042 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:42:44.541 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:42:45.053 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:42:45.582 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:42:46.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:42:46.599 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:42:47.079 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:42:47.566 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:42:48.090 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:42:48.392 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:42:48.783 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:42:49.603 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:42:50.367 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:42:50.820 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:42:51.355 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:42:51.851 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:42:52.312 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:42:52.845 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:42:53.351 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:42:53.804 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:42:54.268 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:42:54.796 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:42:55.256 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:42:55.748 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:42:56.199 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:42:56.855 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:42:57.595 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:42:58.069 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:42:58.492 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:42:58.873 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:42:59.298 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:42:59.601 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:42:59.893 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:43:00.196 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:43:00.677 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:43:01.128 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:43:01.468 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:43:01.900 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:43:02.276 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:43:02.689 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:43:03.102 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:43:03.756 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:43:04.368 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:43:04.986 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:43:13.353 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:43:21.865 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:43:22.290 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:43:22.685 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:43:23.118 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:43:23.516 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:43:23.992 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:43:24.392 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:43:24.812 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:43:25.331 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:43:25.741 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:43:26.184 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:43:26.665 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:43:27.142 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:43:27.614 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:43:28.005 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:43:28.438 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:43:28.906 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:43:29.424 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:43:29.929 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:43:30.405 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:43:30.882 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:43:31.396 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:43:31.869 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:43:32.292 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:43:32.714 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:43:33.148 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:43:33.574 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:43:33.975 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:43:34.396 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:43:34.921 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:43:35.338 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:43:35.762 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:43:36.155 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:43:36.591 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:43:37.105 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:43:37.566 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:43:38.007 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:43:38.446 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:43:38.864 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:43:39.281 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:43:39.719 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:43:40.150 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:43:40.624 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:43:41.046 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:43:41.518 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:43:42.000 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:43:42.438 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:43:42.951 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:43:43.434 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:43:44.925 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:43:45.409 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:43:45.877 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:43:46.472 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:43:47.055 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:43:47.609 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:43:48.040 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:43:48.569 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:43:49.185 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:43:49.674 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:43:50.201 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:43:50.688 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:43:51.057 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:43:51.481 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:43:51.915 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:43:52.258 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:43:52.512 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:43:53.013 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:43:53.453 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:43:53.926 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:43:56.689 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:43:57.129 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:43:57.566 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:43:58.000 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:43:58.389 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:43:58.774 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:43:59.178 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:43:59.683 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:44:00.213 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:44:00.687 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:44:01.130 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:44:01.568 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:44:02.041 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:44:02.512 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:44:02.946 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:44:03.427 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:44:03.952 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:44:04.440 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:44:04.732 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:44:05.041 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:44:05.336 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:44:05.715 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:44:06.096 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:44:06.436 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:44:06.805 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:44:07.185 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:44:07.491 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:44:07.795 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:44:08.182 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:44:08.477 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:44:08.774 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:44:09.081 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:44:09.389 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:44:09.786 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:44:10.208 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:44:10.591 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:44:10.989 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:44:11.417 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:44:11.854 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:44:12.234 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:44:12.673 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:44:13.055 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:44:13.436 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:44:13.914 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:44:14.348 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:44:14.842 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:44:15.284 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:44:15.797 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:44:16.496 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:44:17.012 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:44:17.509 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:44:18.039 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:44:18.416 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:44:18.943 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:44:19.441 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:44:19.926 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:44:20.425 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:44:20.960 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:44:21.566 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:44:22.267 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:44:22.936 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:44:23.645 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:44:24.275 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:44:24.769 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:44:25.260 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:44:25.751 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:44:26.204 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:44:26.679 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:44:27.249 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:44:28.016 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:44:28.752 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:44:29.489 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:44:30.195 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:44:30.926 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:44:31.700 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:44:32.474 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:44:33.178 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:44:33.906 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:44:34.518 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:44:35.128 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:44:35.741 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:44:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:44:37.671 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:44:37.962 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:44:38.253 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:44:38.544 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:44:38.970 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:44:39.408 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:44:39.783 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:44:40.125 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:44:40.706 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:44:41.845 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:44:42.385 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:44:42.887 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:44:43.457 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:44:44.024 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:44:44.553 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:44:45.077 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:44:45.559 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:44:46.261 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:44:46.774 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:44:47.398 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:44:47.965 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:44:48.682 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:44:49.371 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:44:49.722 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:44:50.069 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:44:51.315 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:44:51.818 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:44:53.822 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:44:54.342 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:44:54.888 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:44:55.721 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:44:56.230 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:44:57.150 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:44:59.102 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:45:01.015 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:45:03.429 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:45:12.214 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:45:13.535 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:45:16.351 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:45:16.885 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:45:17.634 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:45:18.359 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:45:18.928 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:45:19.369 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:45:20.103 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:45:20.608 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:45:21.070 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:45:21.604 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:45:37.345 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:45:39.499 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:45:39.991 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:45:40.366 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:45:40.849 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:45:45.972 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:45:49.488 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:45:53.038 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:45:53.563 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:45:54.103 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:45:54.606 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:45:55.102 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:45:55.598 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:45:56.082 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:45:56.558 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:45:57.076 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:45:57.724 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:45:58.316 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:45:58.882 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:45:59.672 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:46:00.462 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:46:01.070 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:46:01.643 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:46:02.312 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:46:02.824 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:46:03.429 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:46:04.135 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:46:04.614 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:46:09.407 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:46:09.896 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:46:10.373 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:46:10.859 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:46:11.330 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:46:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:46:18.342 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:46:18.947 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:46:19.545 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:46:20.284 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:46:21.016 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:46:23.776 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:46:24.471 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:46:27.979 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:46:40.685 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:46:42.996 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:46:44.132 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:46:45.428 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:46:46.101 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:46:46.786 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:46:47.561 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:46:48.256 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:46:48.894 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:46:49.621 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:46:50.006 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:46:50.432 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:46:50.840 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:46:51.223 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:46:51.690 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:46:52.156 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:46:52.582 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:46:52.999 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:46:53.424 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:46:53.774 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:46:54.201 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:46:54.614 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:46:55.040 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:46:55.480 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:46:55.948 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:46:56.396 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:46:56.847 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:46:57.309 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:46:57.737 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:46:58.173 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:46:58.644 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:46:59.072 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:46:59.489 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:46:59.871 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:47:00.287 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:47:03.060 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:47:05.704 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:47:06.700 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:47:07.219 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:48:08.805 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:49:09.763 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:49:10.217 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:49:10.661 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:49:11.089 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:49:11.475 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:49:13.368 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:49:14.154 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:49:15.012 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:49:15.632 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:49:16.117 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:49:16.590 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:49:17.012 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:49:17.473 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:49:17.945 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:49:18.387 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:49:18.920 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:49:19.478 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:49:19.933 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:49:20.372 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:49:20.808 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:49:21.524 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:49:22.298 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:49:22.867 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:49:23.382 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:49:23.964 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:49:24.563 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:49:25.163 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:49:25.735 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:49:26.338 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:49:26.967 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:49:27.562 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:49:28.043 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:49:28.526 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:49:29.077 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:49:29.673 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:49:30.300 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:49:30.868 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:49:31.765 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:49:33.770 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:49:34.370 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:49:35.055 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:49:35.653 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:49:36.542 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:49:37.285 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:49:37.810 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:49:38.508 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:49:38.894 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:49:39.272 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:49:39.684 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:49:40.065 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:49:40.537 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:49:40.989 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:49:41.590 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:49:41.983 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:49:42.394 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:49:42.798 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:49:43.216 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:49:43.623 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:49:44.113 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:49:44.524 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:49:44.901 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:49:45.311 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:49:45.727 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:49:46.135 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:49:46.594 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:49:47.087 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:49:47.496 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:49:47.877 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:49:48.357 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:49:48.833 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:49:49.249 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:49:49.697 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:49:50.135 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:49:50.563 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:49:51.013 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:49:51.531 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:49:52.004 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:49:52.526 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:49:52.940 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:49:53.365 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:49:53.804 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:49:54.303 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:49:54.729 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:49:55.211 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:49:55.751 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:49:56.115 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:49:56.536 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:49:56.961 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:50:07.289 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:50:07.766 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:50:17.282 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:50:17.775 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:50:18.313 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:50:18.736 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:50:19.153 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:50:19.571 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:50:20.077 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:50:20.533 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:50:20.999 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:50:21.412 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:50:21.841 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:50:22.319 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:50:22.790 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:50:23.357 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:50:23.864 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:50:24.366 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:50:24.760 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:50:25.377 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:50:26.367 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:50:26.766 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:50:27.208 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:50:27.660 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:50:28.186 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:50:28.723 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:50:29.164 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:50:30.685 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:50:31.367 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:50:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:50:42.224 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:50:42.738 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:50:43.462 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:50:44.688 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:50:45.915 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:50:47.099 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:50:48.136 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:50:48.993 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:50:49.775 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:50:50.342 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:50:51.460 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:50:52.591 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:50:54.433 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:50:55.533 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:50:56.412 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:50:57.145 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:50:57.731 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:50:58.528 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:50:59.290 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:51:00.099 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:51:00.814 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:51:01.686 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:51:02.419 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:51:03.314 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:51:04.082 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:51:04.330 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:51:05.371 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:51:06.641 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:51:07.363 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:51:08.088 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:51:08.949 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:51:19.424 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:51:19.668 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:51:20.403 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:51:21.005 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:51:21.512 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:51:22.089 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout:=============================== warnings summary =============================== 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: import imp 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.109 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: if boto_type is 'S3Connection': 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: if k is 'BucketName': 2024-09-14T11:51:22.110 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: @pytest.mark.timeout(10) 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:51:22.111 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:51:22.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:51:22.113 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T11:51:22.114 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi130.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: warnings.warn( 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:51:22.115 INFO:teuthology.orchestra.run.smithi130.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 661.37s (0:11:01) = 2024-09-14T11:51:22.243 INFO:teuthology.orchestra.run.smithi130.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:51:22.243 INFO:teuthology.orchestra.run.smithi130.stdout: py: commands succeeded 2024-09-14T11:51:22.243 INFO:teuthology.orchestra.run.smithi130.stdout: congratulations :) 2024-09-14T11:51:22.261 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:51:22.262 DEBUG:teuthology.orchestra.run.smithi130:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:51:22.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:51:22.378 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:51:22.378 DEBUG:teuthology.orchestra.run.smithi130:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:51:22.407 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:51:22.407 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:51:22.597 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:51:22.609 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:51:22.609 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:51:22.609 DEBUG:teuthology.orchestra.run.smithi130:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:51:22.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:51:22.638 INFO:teuthology.orchestra.run.smithi130.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:51:22.638 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:51:22.706 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:51:22.706 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:51:22.776 INFO:tasks.workunit:timeout=3h 2024-09-14T11:51:22.776 INFO:tasks.workunit:cleanup=True 2024-09-14T11:51:22.776 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:51:22.846 INFO:tasks.workunit.client.0.smithi130.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:52:19.585 INFO:tasks.workunit.client.0.smithi130.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: git switch -c 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr:Or undo this operation with: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: git switch - 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:19.586 INFO:tasks.workunit.client.0.smithi130.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:52:19.587 DEBUG:teuthology.orchestra.run.smithi130:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:52:19.655 INFO:tasks.workunit.client.0.smithi130.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:52:19.658 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:52:19.658 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:52:19.707 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:52:19.756 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:52:19.795 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:52:19.797 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:52:19.797 INFO:tasks.workunit.client.0.smithi130.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:52:19.835 INFO:tasks.workunit.client.0.smithi130.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:52:19.839 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-09-14T11:52:19.839 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:52:19.909 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:52:19.910 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:52:19.910 DEBUG:teuthology.orchestra.run.smithi130:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:52:19.983 INFO:tasks.workunit.client.0.smithi130.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:52:19.984 INFO:tasks.workunit.client.0.smithi130.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:52:19.984 INFO:tasks.workunit.client.0.smithi130.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:52:22.370 INFO:tasks.workunit.client.0.smithi130.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ deactivate nondestructive 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ export VIRTUAL_ENV 2024-09-14T11:52:22.371 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:52:22.372 INFO:tasks.workunit.client.0.smithi130.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PATH 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n '' ']' 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -z '' ']' 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ PS1='(rgw) ' 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ export PS1 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:++ hash -r 2024-09-14T11:52:22.373 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install pip --upgrade 2024-09-14T11:52:22.596 INFO:tasks.workunit.client.0.smithi130.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:52:22.780 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting pip 2024-09-14T11:52:22.786 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:52:22.831 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: pip 2024-09-14T11:52:22.831 INFO:tasks.workunit.client.0.smithi130.stdout: Attempting uninstall: pip 2024-09-14T11:52:22.831 INFO:tasks.workunit.client.0.smithi130.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:52:22.983 INFO:tasks.workunit.client.0.smithi130.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:52:22.988 INFO:tasks.workunit.client.0.smithi130.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:52:23.721 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed pip-24.2 2024-09-14T11:52:23.771 INFO:tasks.workunit.client.0.smithi130.stderr:+ pip install boto3 2024-09-14T11:52:24.537 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting boto3 2024-09-14T11:52:24.538 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:52:25.125 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:52:25.126 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:52:25.175 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:52:25.176 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:52:25.230 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:52:25.231 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:52:25.281 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:52:25.282 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:52:25.358 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:52:25.359 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:52:25.612 INFO:tasks.workunit.client.0.smithi130.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:52:25.613 INFO:tasks.workunit.client.0.smithi130.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:52:25.617 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:52:25.618 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:52:25.628 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:52:25.629 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:52:25.630 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:52:25.632 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:52:25.633 INFO:tasks.workunit.client.0.smithi130.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:52:25.707 INFO:tasks.workunit.client.0.smithi130.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:52:26.793 INFO:tasks.workunit.client.0.smithi130.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:52:26.912 INFO:tasks.workunit.client.0.smithi130.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:52:27.036 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:52:27.072 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:27.072 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:27.109 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.111+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 20 realm 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.112+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.113+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.111 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.113+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.113+0000 7f7df4298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:27.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.113+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.114+0000 7f7df4298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:27.112 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.114+0000 7f7df4298800 20 searching for the correct realm 2024-09-14T11:52:27.116 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.118+0000 7f7df1d89640 0 -- 172.21.15.130:0/1343325985 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f7dec014030 msgr2=0x7f7dec048b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:27.119 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.122+0000 7f7df1d89640 0 -- 172.21.15.130:0/1343325985 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f7cbc088660 msgr2=0x7f7cbc08aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.124 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 zone default found 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 4 Realm: () 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 zonegroup default 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.126+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 started sync module instance, tier type = 2024-09-14T11:52:27.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.127+0000 7f7df4298800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=0 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=1 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=2 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=3 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=4 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=5 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.136+0000 7f7df4298800 20 add_watcher() i=6 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.137+0000 7f7df4298800 20 add_watcher() i=7 2024-09-14T11:52:27.135 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.137+0000 7f7df4298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:27.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.139+0000 7f7ca37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.139+0000 7f7df4298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.139+0000 7f7df4298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.139+0000 7f7df4298800 5 note: GC not initialized 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7ca27fc640 20 reqs_thread_entry: start 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 20 Filter name: none 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7c13fff640 20 reqs_thread_entry: start 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:52:27.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.140+0000 7f7df4298800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.141+0000 7f7df4298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.139 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.141+0000 7f7df4298800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.141+0000 7f7df4298800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.141+0000 7f7df4298800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.141+0000 7f7df4298800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7df4298800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7df4298800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:52:27.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7df4298800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:52:27.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7cd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399062 cookie 94604665609168 notifier 9333 bl.length()=613 2024-09-14T11:52:27.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7cd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:52:27.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.142+0000 7f7cd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:52:27.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7df4298800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7df4298800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7df4298800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7cd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400252 cookie 94604665606528 notifier 9333 bl.length()=191 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7cd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.144+0000 7f7cd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:52:27.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.146+0000 7f7ca37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:27.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.148+0000 7f7df4298800 20 remove_watcher() i=0 2024-09-14T11:52:27.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.148+0000 7f7df4298800 2 removed watcher, disabling cache 2024-09-14T11:52:27.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.149+0000 7f7df4298800 20 remove_watcher() i=1 2024-09-14T11:52:27.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.150+0000 7f7df4298800 20 remove_watcher() i=2 2024-09-14T11:52:27.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.151+0000 7f7df4298800 20 remove_watcher() i=3 2024-09-14T11:52:27.150 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.152+0000 7f7df4298800 20 remove_watcher() i=4 2024-09-14T11:52:27.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.153+0000 7f7df4298800 20 remove_watcher() i=5 2024-09-14T11:52:27.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.154+0000 7f7df4298800 20 remove_watcher() i=6 2024-09-14T11:52:27.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.155+0000 7f7df4298800 20 remove_watcher() i=7 2024-09-14T11:52:27.294 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.295 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.340 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.340 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.385 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.386 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.398 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.398 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.402 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:52:27.402 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:27.405 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.405 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.414 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.415 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.422 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:27.422 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:27.433 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:52:27.461 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:27.462 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:27.498 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.500+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.501+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.501+0000 7fb0f9687800 20 realm 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.501+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.502+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.502+0000 7fb0f9687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.502+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.502+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.500 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.502+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.503+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:27.501 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.503+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.504+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:27.502 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.504+0000 7fb0f9687800 20 searching for the correct realm 2024-09-14T11:52:27.504 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.506+0000 7fb0f7972640 0 -- 172.21.15.130:0/3662286913 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb0e0039ba0 msgr2=0x7fb0e0045420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:27.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.713+0000 7fb0f7972640 0 -- 172.21.15.130:0/3662286913 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7fb0e0039ba0 msgr2=0x7fb0e0045420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:27.715 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.716 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.717+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 zone default found 2024-09-14T11:52:27.717 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 4 Realm: () 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 zonegroup default 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.718+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.719+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.719+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.719+0000 7fb0f9687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.719+0000 7fb0f9687800 20 started sync module instance, tier type = 2024-09-14T11:52:27.718 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.719+0000 7fb0f9687800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=0 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=1 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=2 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=3 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=4 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=5 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.728+0000 7fb0f9687800 20 add_watcher() i=6 2024-09-14T11:52:27.727 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.729+0000 7fb0f9687800 20 add_watcher() i=7 2024-09-14T11:52:27.728 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.729+0000 7fb0f9687800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:27.729 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.731+0000 7fafadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.731+0000 7fb0f9687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.731+0000 7fb0f9687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7fb0f9687800 5 note: GC not initialized 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7fafacfe1640 20 reqs_thread_entry: start 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7fb0f9687800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:27.730 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7fb0f9687800 20 Filter name: none 2024-09-14T11:52:27.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7faf267fc640 20 reqs_thread_entry: start 2024-09-14T11:52:27.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.732+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.731 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 rados->read ofs=0 len=0 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 INFO: main: starting shard=0 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.733+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.0 2024-09-14T11:52:27.732 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 INFO: main: starting shard=1 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.1 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 INFO: main: starting shard=2 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.734+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.2 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.735+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.735+0000 7fb0f9687800 20 INFO: main: starting shard=3 2024-09-14T11:52:27.733 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.735+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.3 2024-09-14T11:52:27.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.736+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.736+0000 7fb0f9687800 20 INFO: main: starting shard=4 2024-09-14T11:52:27.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.736+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.4 2024-09-14T11:52:27.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.734 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 INFO: main: starting shard=5 2024-09-14T11:52:27.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.5 2024-09-14T11:52:27.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 INFO: main: starting shard=6 2024-09-14T11:52:27.735 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.737+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.6 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 INFO: main: starting shard=7 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.7 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 INFO: main: starting shard=8 2024-09-14T11:52:27.736 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.738+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.8 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 INFO: main: starting shard=9 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.9 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 INFO: main: starting shard=10 2024-09-14T11:52:27.737 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.739+0000 7fb0f9687800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.10 2024-09-14T11:52:27.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.740+0000 7fb0f9687800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:27.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.740+0000 7fb0f9687800 20 INFO: main: done 2024-09-14T11:52:27.738 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.741+0000 7fafadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:27.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.743+0000 7fb0f9687800 20 remove_watcher() i=0 2024-09-14T11:52:27.741 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.743+0000 7fb0f9687800 2 removed watcher, disabling cache 2024-09-14T11:52:27.742 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.744+0000 7fb0f9687800 20 remove_watcher() i=1 2024-09-14T11:52:27.743 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.745+0000 7fb0f9687800 20 remove_watcher() i=2 2024-09-14T11:52:27.745 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.747+0000 7fb0f9687800 20 remove_watcher() i=3 2024-09-14T11:52:27.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.748+0000 7fb0f9687800 20 remove_watcher() i=4 2024-09-14T11:52:27.746 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.748+0000 7fb0f9687800 20 remove_watcher() i=5 2024-09-14T11:52:27.747 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.749+0000 7fb0f9687800 20 remove_watcher() i=6 2024-09-14T11:52:27.748 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.750+0000 7fb0f9687800 20 remove_watcher() i=7 2024-09-14T11:52:27.760 INFO:tasks.workunit.client.0.smithi130.stderr:rados -p default.rgw.buckets.data ls | grep 4f3522c6-62f7-444a-a95d-f54430aea0bb 2024-09-14T11:52:27.783 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:27.783 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:27.822 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.825+0000 7f57aba69640 0 -- 172.21.15.130:0/86261900 >> [v2:172.21.15.171:6826/803554996,v1:172.21.15.171:6827/803554996] conn(0x7f579c007a90 msgr2=0x7f579c056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:27.831 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:27.833+0000 7f57ac26a640 0 -- 172.21.15.130:0/86261900 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x7f579c07a000 msgr2=0x7f579c063920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:27.834 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:52:27.834 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:27.835 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:52:29.234 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:29.234 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:29.245 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:52:29.640 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:52:29.668 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:29.669 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:29.706 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.708+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 20 realm 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.710+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.711+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:29.709 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.711+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:29.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.712+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:29.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.712+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:29.710 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.712+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:29.711 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.713+0000 7fd535339800 20 searching for the correct realm 2024-09-14T11:52:29.712 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.714+0000 7fd528824640 0 -- 172.21.15.130:0/2690053020 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7fd524051960 msgr2=0x7fd524038400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:29.919 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:29.920+0000 7fd531025640 0 -- 172.21.15.130:0/2690053020 >> [v2:172.21.15.130:6808/4246152659,v1:172.21.15.130:6809/4246152659] conn(0x7fd52c0a87f0 msgr2=0x7fd52c0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:30.126 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.127+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.127 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 zone default found 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 4 Realm: () 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 zonegroup default 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.128+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.128 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:30.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:30.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 started sync module instance, tier type = 2024-09-14T11:52:30.129 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.129+0000 7fd535339800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:30.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=0 2024-09-14T11:52:30.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=1 2024-09-14T11:52:30.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=2 2024-09-14T11:52:30.137 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=3 2024-09-14T11:52:30.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=4 2024-09-14T11:52:30.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=5 2024-09-14T11:52:30.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.139+0000 7fd535339800 20 add_watcher() i=6 2024-09-14T11:52:30.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.140+0000 7fd535339800 20 add_watcher() i=7 2024-09-14T11:52:30.138 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.140+0000 7fd535339800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:30.140 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.142+0000 7fd3e2ffd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:30.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.142+0000 7fd535339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:30.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.142+0000 7fd535339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:30.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.142+0000 7fd535339800 5 note: GC not initialized 2024-09-14T11:52:30.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd3e1ffb640 20 reqs_thread_entry: start 2024-09-14T11:52:30.141 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd535339800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:30.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd535339800 20 Filter name: none 2024-09-14T11:52:30.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd3537fe640 20 reqs_thread_entry: start 2024-09-14T11:52:30.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:52:30.142 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.143+0000 7fd535339800 20 rados->read ofs=0 len=0 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 INFO: main: starting shard=0 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.0 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 INFO: main: starting shard=1 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.144+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.1 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.145+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.143 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.145+0000 7fd535339800 20 INFO: main: starting shard=2 2024-09-14T11:52:30.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.145+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.2 2024-09-14T11:52:30.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 INFO: main: starting shard=3 2024-09-14T11:52:30.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.3 2024-09-14T11:52:30.144 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 INFO: main: starting shard=4 2024-09-14T11:52:30.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.146+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.4 2024-09-14T11:52:30.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 INFO: main: starting shard=5 2024-09-14T11:52:30.145 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.5 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 INFO: main: starting shard=6 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.147+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.6 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.148+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.148+0000 7fd535339800 20 INFO: main: starting shard=7 2024-09-14T11:52:30.146 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.148+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.7 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 INFO: main: starting shard=8 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.8 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 INFO: main: starting shard=9 2024-09-14T11:52:30.147 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.149+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.9 2024-09-14T11:52:30.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.150+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.150+0000 7fd535339800 20 INFO: main: starting shard=10 2024-09-14T11:52:30.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.150+0000 7fd535339800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.10 2024-09-14T11:52:30.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.150+0000 7fd535339800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:52:30.148 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.150+0000 7fd535339800 20 INFO: main: done 2024-09-14T11:52:30.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.151+0000 7fd3e2ffd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:30.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.154+0000 7fd535339800 20 remove_watcher() i=0 2024-09-14T11:52:30.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.154+0000 7fd535339800 2 removed watcher, disabling cache 2024-09-14T11:52:30.153 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.155+0000 7fd535339800 20 remove_watcher() i=1 2024-09-14T11:52:30.154 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.156+0000 7fd535339800 20 remove_watcher() i=2 2024-09-14T11:52:30.155 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.157+0000 7fd535339800 20 remove_watcher() i=3 2024-09-14T11:52:30.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.158+0000 7fd535339800 20 remove_watcher() i=4 2024-09-14T11:52:30.157 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.159+0000 7fd535339800 20 remove_watcher() i=5 2024-09-14T11:52:30.158 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.160+0000 7fd535339800 20 remove_watcher() i=6 2024-09-14T11:52:30.159 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.161+0000 7fd535339800 20 remove_watcher() i=7 2024-09-14T11:52:30.171 INFO:tasks.workunit.client.0.smithi130.stderr:rados -p default.rgw.buckets.data ls | grep ec1b970a-12b2-46a9-8fa6-98253e3fc418 2024-09-14T11:52:30.194 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:30.194 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:30.233 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:30.235+0000 7f61c6f74640 0 -- 172.21.15.130:0/828366653 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f61c003d400 msgr2=0x7f61c003d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:52:30.245 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:52:30.245 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:30.247 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:30.247 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:30.252 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:30.253 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:30.260 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:30.260 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:30.265 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:52:31.655 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:31.655 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:31.708 INFO:tasks.workunit.client.0.smithi130.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:52:31.710 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:52:32.113 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:32.113 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:32.121 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:32.121 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:32.163 INFO:tasks.workunit.client.0.smithi130.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:52:32.163 INFO:tasks.workunit.client.0.smithi130.stderr: 2024-09-14T11:52:32.164 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:32.164 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:32.210 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:32.210 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:32.253 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:32.254 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:32.263 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:52:33.659 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:33.659 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:33.663 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:33.663 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:35.682 INFO:tasks.workunit.client.0.smithi130.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:52:36.081 INFO:tasks.workunit.client.0.smithi130.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:52:36.111 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:36.111 INFO:tasks.workunit.client.0.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:36.149 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.151+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 20 realm 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.152+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.153+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.151 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.153+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.154+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:36.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.154+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.154+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:36.152 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.154+0000 7f0978575800 20 searching for the correct realm 2024-09-14T11:52:36.156 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.157+0000 7f0976867640 0 -- 172.21.15.130:0/474186584 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f096c056470 msgr2=0x7f096c0568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:52:36.362 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.364+0000 7f0976867640 0 -- 172.21.15.130:0/474186584 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7f096c056470 msgr2=0x7f096c0568b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:36.366 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:36.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.367 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.368+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 zone default found 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 4 Realm: () 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:36.368 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 zonegroup default 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.369+0000 7f0978575800 20 started sync module instance, tier type = 2024-09-14T11:52:36.369 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.370+0000 7f0978575800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:36.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=0 2024-09-14T11:52:36.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=1 2024-09-14T11:52:36.378 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=2 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=3 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=4 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.380+0000 7f0978575800 20 add_watcher() i=5 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.381+0000 7f0978575800 20 add_watcher() i=6 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.381+0000 7f0978575800 20 add_watcher() i=7 2024-09-14T11:52:36.379 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.381+0000 7f0978575800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:36.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f082cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:36.382 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f0978575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f0978575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f0978575800 5 note: GC not initialized 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f07a77fe640 20 reqs_thread_entry: start 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f0978575800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.383+0000 7f0978575800 20 Filter name: none 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f07a57fa640 20 reqs_thread_entry: start 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:52:36.383 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.783 : miss 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 20 rados->read ofs=0 len=0 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.783 info.flags=0x17 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.783 to cache LRU end 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.384+0000 7f0978575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:a588039c-1457-497f-adbd-8890a12279b7.4508.783 2024-09-14T11:52:36.384 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.385+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.0 2024-09-14T11:52:36.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.385+0000 7f0978575800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:52:36.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.385+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.1 2024-09-14T11:52:36.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.386+0000 7f0978575800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:52:36.385 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.386+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.2 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.386+0000 7f0978575800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.386+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.3 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.387+0000 7f0978575800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.387+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.4 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.387+0000 7f0978575800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.387+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.5 2024-09-14T11:52:36.386 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.388+0000 7f0978575800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.388+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.6 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.388+0000 7f0978575800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.388+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.7 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.389+0000 7f0978575800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.389+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.8 2024-09-14T11:52:36.387 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.389+0000 7f0978575800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:52:36.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.389+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.9 2024-09-14T11:52:36.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.390+0000 7f0978575800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:52:36.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.390+0000 7f0978575800 20 bucket index object: :.dir.a588039c-1457-497f-adbd-8890a12279b7.4508.783.10 2024-09-14T11:52:36.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.390+0000 7f0978575800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:52:36.388 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.390+0000 7f0978575800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:52:36.389 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.391+0000 7f082cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:36.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.393+0000 7f0978575800 20 remove_watcher() i=0 2024-09-14T11:52:36.391 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.393+0000 7f0978575800 2 removed watcher, disabling cache 2024-09-14T11:52:36.392 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.394+0000 7f0978575800 20 remove_watcher() i=1 2024-09-14T11:52:36.393 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.395+0000 7f0978575800 20 remove_watcher() i=2 2024-09-14T11:52:36.395 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.397+0000 7f0978575800 20 remove_watcher() i=3 2024-09-14T11:52:36.396 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.398+0000 7f0978575800 20 remove_watcher() i=4 2024-09-14T11:52:36.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.399+0000 7f0978575800 20 remove_watcher() i=5 2024-09-14T11:52:36.397 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.399+0000 7f0978575800 20 remove_watcher() i=6 2024-09-14T11:52:36.398 INFO:tasks.workunit.client.0.smithi130.stderr:2024-09-14T11:52:36.400+0000 7f0978575800 20 remove_watcher() i=7 2024-09-14T11:52:36.409 INFO:tasks.workunit.client.0.smithi130.stderr:Deleting bucket versioning-bucket 2024-09-14T11:52:36.411 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:36.411 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:36.416 INFO:tasks.workunit.client.0.smithi130.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:52:36.416 INFO:tasks.workunit.client.0.smithi130.stderr: warnings.warn( 2024-09-14T11:52:36.445 INFO:tasks.workunit.client.0.smithi130.stderr:Completed bucket versioning tests 2024-09-14T11:52:36.445 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:52:36.445 INFO:tasks.workunit.client.0.smithi130.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:52:36.445 INFO:tasks.workunit.client.0.smithi130.stdout:connected to https://localhost:443 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ deactivate 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ export PATH 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:52:36.508 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ hash -r 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' -n '' ']' 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ unset -f deactivate 2024-09-14T11:52:36.509 INFO:tasks.workunit.client.0.smithi130.stderr:+ echo OK. 2024-09-14T11:52:36.510 INFO:tasks.workunit.client.0.smithi130.stdout:OK. 2024-09-14T11:52:36.510 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:52:36.510 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:52:36.589 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:52:36.590 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:52:36.960 DEBUG:teuthology.parallel:result is None 2024-09-14T11:52:36.960 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:52:36.998 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:52:36.999 DEBUG:teuthology.orchestra.run.smithi130:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:52:37.067 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:52:37.067 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:52:37.081 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:52:37.090 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:52:37.090 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:52:37.090 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:52:37.171 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:52:37.172 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:52:37.229 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:37.229 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:37.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.274+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.275+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.275+0000 7ff955b75800 20 realm 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.275+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.275+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.275+0000 7ff955b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.276+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.276+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.274 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.276+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.277+0000 7ff955b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:37.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.277+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.275 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.278+0000 7ff955b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:37.276 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.278+0000 7ff955b75800 20 searching for the correct realm 2024-09-14T11:52:37.278 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.280+0000 7ff953e60640 0 -- 172.21.15.130:0/1454912400 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff93c01a040 msgr2=0x7ff93c068170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:37.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.486+0000 7ff953e60640 0 -- 172.21.15.130:0/1454912400 >> [v2:172.21.15.171:6816/2608434775,v1:172.21.15.171:6817/2608434775] conn(0x7ff93c01a040 msgr2=0x7ff93c068170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:37.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:37.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:37.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:37.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:37.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:37.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:37.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.490 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.491+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 zone default found 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 4 Realm: () 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:37.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 zonegroup default 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.492+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.493+0000 7ff955b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.493+0000 7ff955b75800 20 started sync module instance, tier type = 2024-09-14T11:52:37.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.493+0000 7ff955b75800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=0 2024-09-14T11:52:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=1 2024-09-14T11:52:37.500 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=2 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=3 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=4 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=5 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.502+0000 7ff955b75800 20 add_watcher() i=6 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.503+0000 7ff955b75800 20 add_watcher() i=7 2024-09-14T11:52:37.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.503+0000 7ff955b75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.505+0000 7ff809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.505+0000 7ff955b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:37.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.505+0000 7ff955b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.543+0000 7ff808fe1640 20 reqs_thread_entry: start 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.544+0000 7ff955b75800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.544+0000 7ff955b75800 20 Filter name: none 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.544+0000 7ff7827fc640 20 reqs_thread_entry: start 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.544+0000 7ff955b75800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:52:37.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.544+0000 7ff955b75800 20 rados->read ofs=0 len=0 2024-09-14T11:52:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.545+0000 7ff955b75800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:52:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.545+0000 7ff955b75800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:52:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.545+0000 7ff955b75800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:52:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.545+0000 7ff955b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:52:37.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.545+0000 7ff955b75800 10 removing key index: YGXDHOGCZWUVABNEHGNE 2024-09-14T11:52:37.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.546+0000 7ff955b75800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:YGXDHOGCZWUVABNEHGNE, ofs0, ns] 2024-09-14T11:52:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.546+0000 7ff836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399063 cookie 94142230363168 notifier 9465 bl.length()=170 2024-09-14T11:52:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.547+0000 7ff955b75800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:52:37.546 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.548+0000 7ff955b75800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:52:37.546 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.548+0000 7ff8367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399173 cookie 94142230348512 notifier 9465 bl.length()=181 2024-09-14T11:52:37.546 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.548+0000 7ff955b75800 10 removing user buckets index 2024-09-14T11:52:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.550+0000 7ff955b75800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:52:37.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.550+0000 7ff836ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399064 cookie 94142230363168 notifier 9465 bl.length()=172 2024-09-14T11:52:37.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.551+0000 7ff955b75800 10 removing user index: tester.client.0 2024-09-14T11:52:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.552+0000 7ff955b75800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:52:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.552+0000 7ff955b75800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:52:37.550 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.552+0000 7ff8367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400255 cookie 94142230368976 notifier 9465 bl.length()=164 2024-09-14T11:52:37.551 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.553+0000 7ff809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.556+0000 7ff955b75800 20 remove_watcher() i=0 2024-09-14T11:52:37.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.556+0000 7ff955b75800 2 removed watcher, disabling cache 2024-09-14T11:52:37.555 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.557+0000 7ff955b75800 20 remove_watcher() i=1 2024-09-14T11:52:37.556 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.558+0000 7ff955b75800 20 remove_watcher() i=2 2024-09-14T11:52:37.557 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.559+0000 7ff955b75800 20 remove_watcher() i=3 2024-09-14T11:52:37.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.560+0000 7ff955b75800 20 remove_watcher() i=4 2024-09-14T11:52:37.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.561+0000 7ff955b75800 20 remove_watcher() i=5 2024-09-14T11:52:37.559 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.562+0000 7ff955b75800 20 remove_watcher() i=6 2024-09-14T11:52:37.560 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:37.563+0000 7ff955b75800 20 remove_watcher() i=7 2024-09-14T11:52:37.572 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:52:37.584 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:52:37.593 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:52:37.649 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:52:37.658 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:52:37.658 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:52:37.659 INFO:tasks.rgw.client.0.smithi130.stdout:2024-09-14T11:52:37.661+0000 7f6426611640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44615) UID: 0 2024-09-14T11:52:37.659 INFO:tasks.rgw.client.0.smithi130.stdout:2024-09-14T11:52:37.661+0000 7f6429e6c880 -1 shutting down 2024-09-14T11:52:43.760 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:52:43.760 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:52:43.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:52:43.880 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:52:43.961 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:52:43.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:52:43.962 DEBUG:teuthology.orchestra.run.smithi130:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:52:44.059 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:52:44.060 INFO:teuthology.orchestra.run.smithi130.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:52:44.093 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.095+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.095 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 realm 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.096 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.097+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.098+0000 7f3990535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.098+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.099+0000 7f3990535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:52:44.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.099+0000 7f3990535800 20 searching for the correct realm 2024-09-14T11:52:44.098 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.100+0000 7f398c2e4640 0 -- 172.21.15.130:0/82479746 >> [v2:172.21.15.171:6800/1745960304,v1:172.21.15.171:6801/1745960304] conn(0x55cfe8f22760 msgr2=0x7f398402b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:44.304 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.305+0000 7f398bae3640 0 -- 172.21.15.130:0/82479746 >> [v2:172.21.15.130:6824/1425785084,v1:172.21.15.130:6825/1425785084] conn(0x7f397c01a020 msgr2=0x7f397c047c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:52:44.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:52:44.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:52:44.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got zonegroup_info.be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6 2024-09-14T11:52:44.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:52:44.313 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:52:44.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 RGWRados::pool_iterate: got zone_info.a588039c-1457-497f-adbd-8890a12279b7 2024-09-14T11:52:44.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.312+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.314 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 zone default found 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 4 Realm: () 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 4 ZoneGroup: default (be54f0f9-41c0-4ac8-a2ad-b6d46dc7fcc6) 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 4 Zone: default (a588039c-1457-497f-adbd-8890a12279b7) 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 zonegroup default 2024-09-14T11:52:44.315 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.313+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 rados->read ofs=0 len=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 started sync module instance, tier type = 2024-09-14T11:52:44.316 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.314+0000 7f3990535800 20 started zone id=a588039c-1457-497f-adbd-8890a12279b7 (name=default) with tier type = 2024-09-14T11:52:44.321 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=0 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=1 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=2 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=3 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=4 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=5 2024-09-14T11:52:44.322 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.323+0000 7f3990535800 20 add_watcher() i=6 2024-09-14T11:52:44.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.324+0000 7f3990535800 20 add_watcher() i=7 2024-09-14T11:52:44.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.324+0000 7f3990535800 2 all 8 watchers are set, enabling cache 2024-09-14T11:52:44.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.326+0000 7f3842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:44.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.326+0000 7f3990535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:52:44.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.326+0000 7f3990535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:52:44.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.365+0000 7f3841fdb640 20 reqs_thread_entry: start 2024-09-14T11:52:44.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.365+0000 7f3990535800 20 init_complete bucket index max shards: 11 2024-09-14T11:52:44.364 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.365+0000 7f3990535800 20 Filter name: none 2024-09-14T11:52:44.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.366+0000 7f37b37fe640 20 reqs_thread_entry: start 2024-09-14T11:52:44.365 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.366+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:52:44.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.367+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.367+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:52:44.367 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_TEorOTeCkiG7d4zSk-s_uvDcIVWzKoi', time=2024-09-14T13:40:31.302409+0000, chain.objs.size()=2 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.bKA7NKtP5SvcSFjBlDUseAAKaDvIYHb_1 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.bKA7NKtP5SvcSFjBlDUseAAKaDvIYHb_2 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.4074795213358755714', time=2024-09-14T13:44:58.472905+0000, chain.objs.size()=1 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.519__multipart_mymultipart.2~Vs6BdtLY4Nl-HsIA4_aFMhvTMCHC89T.1 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16659568398690804338', time=2024-09-14T13:45:11.964377+0000, chain.objs.size()=6 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.BSW_qn-F2n-8djAThA_sF-QcgVCFsvLx.1 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.SsuMoVB-3HeGz1u_sdRCPgoJ5S1-oTEL.2 2024-09-14T11:52:44.368 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.OYFBAo-Aw8q50IszRlJ_vmx2No5Vx0BK.3 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.7i6OnLazPtxbMUHGNcDElFEgC8xQVF8Q.4 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.rQ-9dR_QlS_e8ZVD5JYK-pDRgw3DMAP-.5 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.hHJKNdOONoBHtR7H1kCwCGC8niy-g8SS.6 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9921774585758266037', time=2024-09-14T13:45:14.183121+0000, chain.objs.size()=1 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~OCEdS5AhNE2-4ixjQOy3UbeX2mOjNWO.1 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12944218403093985572', time=2024-09-14T13:46:03.599874+0000, chain.objs.size()=1 2024-09-14T11:52:44.369 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.368+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.562__multipart_mymultipart.2~pyhNdeHZKU6P65g0aHC2CEyue70njZu.1 2024-09-14T11:52:44.371 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.373+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.374 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.376+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:52:44.375 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.377+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.377+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16387739395516264789', time=2024-09-14T13:40:28.722803+0000, chain.objs.size()=5 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-LUKEWARM.2~LzbDjg53eHyddJGA9WcKQ7H4vviC-WH.1 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.160__shadow_mymultipart-LUKEWARM.2~LzbDjg53eHyddJGA9WcKQ7H4vviC-WH.1_1 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-LUKEWARM.2~LzbDjg53eHyddJGA9WcKQ7H4vviC-WH.2 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.160__shadow_mymultipart-LUKEWARM.2~LzbDjg53eHyddJGA9WcKQ7H4vviC-WH.2_1 2024-09-14T11:52:44.377 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.378+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-LUKEWARM.2~LzbDjg53eHyddJGA9WcKQ7H4vviC-WH.3 2024-09-14T11:52:44.378 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.380+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.380 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.382+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:52:44.382 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.384+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.383 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.384+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.384 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11841457728199393797', time=2024-09-14T13:44:43.207876+0000, chain.objs.size()=4 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_1 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_2 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_3 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_4 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2001470256961064889', time=2024-09-14T13:45:02.408994+0000, chain.objs.size()=6 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.1 2024-09-14T11:52:44.385 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__shadow_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.1_1 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.2 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__shadow_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.2_1 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.3 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__shadow_mymultipart.2~x1N7ShAgh5M4i88O6swXdBaEM109bqv.3_1 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk', time=2024-09-14T13:45:09.281910+0000, chain.objs.size()=2 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.2 2024-09-14T11:52:44.386 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.385+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.2_1 2024-09-14T11:52:44.387 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.389+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk', time=2024-09-14T13:45:09.283407+0000, chain.objs.size()=2 2024-09-14T11:52:44.387 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.389+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.3 2024-09-14T11:52:44.387 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.389+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.3_1 2024-09-14T11:52:44.393 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.395+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.396 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.398+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:52:44.397 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.399+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.399+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.399 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_Xlm-0KnCbTkMIbVh_fiZUKthJ-hLr40', time=2024-09-14T13:40:32.859330+0000, chain.objs.size()=3 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.ddsgE_LAPvKL9aiRNbbHqX1euFzpYgF_0 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.ddsgE_LAPvKL9aiRNbbHqX1euFzpYgF_1 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.ddsgE_LAPvKL9aiRNbbHqX1euFzpYgF_2 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf', time=2024-09-14T13:45:05.318362+0000, chain.objs.size()=1 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.2 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.936175+0000, chain.objs.size()=1 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.1 2024-09-14T11:52:44.400 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.937464+0000, chain.objs.size()=1 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.2 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.938596+0000, chain.objs.size()=1 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.3 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.939708+0000, chain.objs.size()=1 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.4 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.940835+0000, chain.objs.size()=1 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.400+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.5 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.401+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H', time=2024-09-14T13:45:10.941924+0000, chain.objs.size()=1 2024-09-14T11:52:44.401 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.401+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~xbQE8EVuqaIo9_WpdrhKJCO__4JHr0H.6 2024-09-14T11:52:44.403 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.405+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.405 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.407+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:52:44.407 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.408 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9789128641064410039', time=2024-09-14T13:45:15.972913+0000, chain.objs.size()=3 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.525__shadow_._PwZl_QxtJ5VJqHl9OLikIjlSGsrXwB_1 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.525__shadow_._PwZl_QxtJ5VJqHl9OLikIjlSGsrXwB_2 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.525__shadow_._PwZl_QxtJ5VJqHl9OLikIjlSGsrXwB_3 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12758423278190443150', time=2024-09-14T13:46:00.032748+0000, chain.objs.size()=2 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.556__shadow_.3sUGKSCMluC0-fVP8J8TVC6nS9pRRyD_1 2024-09-14T11:52:44.409 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.409+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.556__shadow_.3sUGKSCMluC0-fVP8J8TVC6nS9pRRyD_2 2024-09-14T11:52:44.410 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.412+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.413 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.415+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:52:44.414 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.416+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_XdS7Wuqcpah1SZXvdPFGr7DRHciJlut', time=2024-09-14T13:40:32.037336+0000, chain.objs.size()=1 2024-09-14T11:52:44.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.164__shadow_.4mULu0pdASs7Eiifh1flVAkVjVXmnHn_0 2024-09-14T11:52:44.416 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.4816667498646916445', time=2024-09-14T13:44:53.571822+0000, chain.objs.size()=6 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16509618623348285935', time=2024-09-14T13:44:57.742006+0000, chain.objs.size()=1 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.519__multipart_mymultipart.2~xAqpIZotOO35vntNYSqAEKR0uKxC2Ob.1 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.18396765903406704212', time=2024-09-14T13:45:16.088920+0000, chain.objs.size()=2 2024-09-14T11:52:44.417 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~xR_qHztpOlhKWeIXXEkbdoloWCbgYsv.1 2024-09-14T11:52:44.418 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.417+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~xR_qHztpOlhKWeIXXEkbdoloWCbgYsv.2 2024-09-14T11:52:44.419 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.421+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.421 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.423+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:52:44.423 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.425+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.425+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1105444479225889337', time=2024-09-14T13:45:02.810893+0000, chain.objs.size()=3 2024-09-14T11:52:44.424 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~wY23MPSWBoKLCdEApZEbQgVQE7N4EUR.1 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~wY23MPSWBoKLCdEApZEbQgVQE7N4EUR.2 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~wY23MPSWBoKLCdEApZEbQgVQE7N4EUR.3 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12747187783454706122', time=2024-09-14T13:45:15.429534+0000, chain.objs.size()=5 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~TmFV4KgXCL59ivUGibRlKXbNDMK3mln.1 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__shadow_mymultipart.2~TmFV4KgXCL59ivUGibRlKXbNDMK3mln.1_1 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~TmFV4KgXCL59ivUGibRlKXbNDMK3mln.2 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__shadow_mymultipart.2~TmFV4KgXCL59ivUGibRlKXbNDMK3mln.2_1 2024-09-14T11:52:44.425 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.426+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~TmFV4KgXCL59ivUGibRlKXbNDMK3mln.3 2024-09-14T11:52:44.427 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.429+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.430 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.432+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:52:44.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.433+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.432 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~VKU1k09XLyUA0oEJfNOmLfUZL3Qvj_Q', time=2024-09-14T13:40:59.895502+0000, chain.objs.size()=1 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.202__multipart_mymultipart.2~VKU1k09XLyUA0oEJfNOmLfUZL3Qvj_Q.1 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8255741524440837061', time=2024-09-14T13:45:03.176036+0000, chain.objs.size()=3 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~OxSSo--X1R0EQ74WxEpBesLgkRZmI2i.1 2024-09-14T11:52:44.433 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~OxSSo--X1R0EQ74WxEpBesLgkRZmI2i.2 2024-09-14T11:52:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.434+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.522__multipart_mymultipart.2~OxSSo--X1R0EQ74WxEpBesLgkRZmI2i.3 2024-09-14T11:52:44.434 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.436+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.437 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.439+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:52:44.438 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.440+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.439 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8754985171233316035', time=2024-09-14T13:40:27.685775+0000, chain.objs.size()=3 2024-09-14T11:52:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.t25Yl81S6Xs-hAXIcl6fRkDPBbxrk-j_0 2024-09-14T11:52:44.440 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.t25Yl81S6Xs-hAXIcl6fRkDPBbxrk-j_1 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.t25Yl81S6Xs-hAXIcl6fRkDPBbxrk-j_2 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16973917915132366529', time=2024-09-14T13:44:53.571504+0000, chain.objs.size()=6 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~OBR_JEJyiDj8AUxj7BmVO8Yz1MZcHdM', time=2024-09-14T13:45:20.852468+0000, chain.objs.size()=1 2024-09-14T11:52:44.441 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.441+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.534__multipart_mymultipart.2~OBR_JEJyiDj8AUxj7BmVO8Yz1MZcHdM.1 2024-09-14T11:52:44.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.442+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10677991733835731008', time=2024-09-14T13:49:30.612061+0000, chain.objs.size()=1 2024-09-14T11:52:44.442 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.442+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.657__shadow_.DVwmZ6wrDPWLs-1XVtJTezQ1jTUNXJ3_1 2024-09-14T11:52:44.445 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.447+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.447 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.449+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:52:44.448 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.450+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14831122298336080354', time=2024-09-14T13:45:13.013540+0000, chain.objs.size()=3 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~V-gvsILfDReTxviTDmq0UglqeDqV_Ro.1 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~V-gvsILfDReTxviTDmq0UglqeDqV_Ro.2 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~V-gvsILfDReTxviTDmq0UglqeDqV_Ro.3 2024-09-14T11:52:44.450 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~FjxNK1m1ekBmvTderxcaH4M80XPvT72', time=2024-09-14T13:45:21.952282+0000, chain.objs.size()=1 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.536__multipart_mymultipart.2~FjxNK1m1ekBmvTderxcaH4M80XPvT72.3 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9466928238778788555', time=2024-09-14T13:49:23.713615+0000, chain.objs.size()=1 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.645__shadow_.O03PDKMngdBoFTb-ilyUHDXKfdTikx2_1 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12808714154624522591', time=2024-09-14T13:50:26.101313+0000, chain.objs.size()=10 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.1 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.2 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.3 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.4 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.5 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.6 2024-09-14T11:52:44.451 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.451+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.7 2024-09-14T11:52:44.453 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.455+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.8 2024-09-14T11:52:44.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.456+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.9 2024-09-14T11:52:44.454 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.456+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.736__multipart_foo.2~uSO41-FpmU4U3_FHI5awvNY7oydGmK-.10 2024-09-14T11:52:44.457 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.459+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.459 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.461+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:52:44.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.462+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.461 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.462 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.462 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_74At0MCPtuUDsgC5eNRJStsocnm5bxx', time=2024-09-14T13:40:29.723244+0000, chain.objs.size()=1 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.9YrDQvbgSFuPUPROCUxe1zGM_tr4Kx__0 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9989790366139880729', time=2024-09-14T13:45:15.721814+0000, chain.objs.size()=3 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~1pMAY1cywVWu55f-hTVQ1teghY5z5Wq.1 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~1pMAY1cywVWu55f-hTVQ1teghY5z5Wq.2 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.463+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~1pMAY1cywVWu55f-hTVQ1teghY5z5Wq.3 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~f6NL-5SY9dM1vm9_MAUxIM1rdDKoNjW', time=2024-09-14T13:46:03.673950+0000, chain.objs.size()=1 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.562__multipart_mymultipart.2~f6NL-5SY9dM1vm9_MAUxIM1rdDKoNjW.1 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7287658056936199395', time=2024-09-14T13:49:33.525092+0000, chain.objs.size()=6 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.1 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.2 2024-09-14T11:52:44.463 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.3 2024-09-14T11:52:44.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.4 2024-09-14T11:52:44.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.5 2024-09-14T11:52:44.464 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.464+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.663__multipart_foo.2~jC7mZ-eGyyPxMK7VHFtIv325bOzNvp9.6 2024-09-14T11:52:44.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.468+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.471+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:52:44.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.472+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.471 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.472+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9018701864743650789', time=2024-09-14T13:47:06.447583+0000, chain.objs.size()=12 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.1 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.1_1 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.2 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.2_1 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.3 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.3_1 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.4 2024-09-14T11:52:44.472 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.4_1 2024-09-14T11:52:44.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.5 2024-09-14T11:52:44.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.5_1 2024-09-14T11:52:44.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__multipart_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.6 2024-09-14T11:52:44.473 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.473+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.616__shadow_multipart_enc.2~7bddVRafRAcuffmJ-DxL1-L0hEFvDeE.6_1 2024-09-14T11:52:44.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.477+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~9Y8Pz8aOylLznnIcJ1AtP_ujpr93Vsz', time=2024-09-14T13:50:29.694961+0000, chain.objs.size()=1 2024-09-14T11:52:44.475 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.477+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.743__multipart_mymultipart.2~9Y8Pz8aOylLznnIcJ1AtP_ujpr93Vsz.1 2024-09-14T11:52:44.480 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.480+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.481 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.483+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:52:44.482 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.484+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_WzmSH0xEhWtqpL_k5op8F8q5jIdh2dO', time=2024-09-14T13:40:31.458227+0000, chain.objs.size()=3 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.r3b9Y0oQW3uE-Hq1kgN72mZ8HxyPsyv_0 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.r3b9Y0oQW3uE-Hq1kgN72mZ8HxyPsyv_1 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.r3b9Y0oQW3uE-Hq1kgN72mZ8HxyPsyv_2 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17038032103805732819', time=2024-09-14T13:44:43.207360+0000, chain.objs.size()=4 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_1 2024-09-14T11:52:44.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_2 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_3 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.487__shadow_.FcWveStOH762fDGOFSfSqsX_WLJO0GW_4 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17375139676841823841', time=2024-09-14T13:44:58.051733+0000, chain.objs.size()=1 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.519__multipart_mymultipart.2~xcGRMrxU-xBfJsYZygB8V2rDkWMNjkp.1 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17245256777098497458', time=2024-09-14T13:45:05.324156+0000, chain.objs.size()=6 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.gGj4mon2EGvPRmUEKlGn2gQOD60m-7tj.1 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.2 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.3 2024-09-14T11:52:44.485 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.485+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.4 2024-09-14T11:52:44.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.488+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.5 2024-09-14T11:52:44.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.488+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.6 2024-09-14T11:52:44.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.488+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3', time=2024-09-14T13:45:16.678720+0000, chain.objs.size()=10 2024-09-14T11:52:44.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.488+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.1 2024-09-14T11:52:44.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.488+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.2 2024-09-14T11:52:44.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.489+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.3 2024-09-14T11:52:44.487 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.489+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.4 2024-09-14T11:52:44.488 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.489+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.5 2024-09-14T11:52:44.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.490+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.6 2024-09-14T11:52:44.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.490+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.7 2024-09-14T11:52:44.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.490+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.8 2024-09-14T11:52:44.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.490+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.9 2024-09-14T11:52:44.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.527__multipart_mymultipart.2~jgu1Bx6K08nnui-1LOM82RD46xUKBJ3.10 2024-09-14T11:52:44.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5976428114123720536', time=2024-09-14T13:46:42.489375+0000, chain.objs.size()=4 2024-09-14T11:52:44.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~G6sQ-FA122v77nEbHSC4a0bI13_Wd4s.1 2024-09-14T11:52:44.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~G6sQ-FA122v77nEbHSC4a0bI13_Wd4s.2 2024-09-14T11:52:44.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~G6sQ-FA122v77nEbHSC4a0bI13_Wd4s.3 2024-09-14T11:52:44.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.493+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~G6sQ-FA122v77nEbHSC4a0bI13_Wd4s.4 2024-09-14T11:52:44.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.497+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.500+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:52:44.499 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.501+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2851589714232304096', time=2024-09-14T13:45:00.762308+0000, chain.objs.size()=12 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.1 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.1_1 2024-09-14T11:52:44.501 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.2 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.2_1 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.3 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.3_1 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.4 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.4_1 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.5 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.5_1 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__multipart_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.6 2024-09-14T11:52:44.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.502+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.520__shadow_mymultipart.2~qMm6GN720kYhgGtDOrjCAYkgjGVSsST.6_1 2024-09-14T11:52:44.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.506+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF', time=2024-09-14T13:45:07.595435+0000, chain.objs.size()=2 2024-09-14T11:52:44.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.506+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.3 2024-09-14T11:52:44.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.506+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.3_1 2024-09-14T11:52:44.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.507+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14107306205447871438', time=2024-09-14T13:45:14.975159+0000, chain.objs.size()=2 2024-09-14T11:52:44.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.507+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~frXFdwg6CYAeVT2zRzrqMFlNAuTLgv_.1 2024-09-14T11:52:44.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.507+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~frXFdwg6CYAeVT2zRzrqMFlNAuTLgv_.2 2024-09-14T11:52:44.509 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.511+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.511 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.513+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:52:44.512 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.514+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3775028242909168963', time=2024-09-14T13:49:33.410112+0000, chain.objs.size()=6 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.1 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.2 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.3 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.4 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.5 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.662__multipart_baz.2~Nm3om3xZzZs3Tcu76zFtVx8JkMePTJj.6 2024-09-14T11:52:44.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6492945247383494637', time=2024-09-14T13:50:30.435448+0000, chain.objs.size()=3 2024-09-14T11:52:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.744__multipart_mymultipart3.2~KN9Ans0F_-3ge6Zq_WApwgund2dOEnx.1 2024-09-14T11:52:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.744__multipart_mymultipart3.2~KN9Ans0F_-3ge6Zq_WApwgund2dOEnx.2 2024-09-14T11:52:44.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.515+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.744__multipart_mymultipart3.2~KN9Ans0F_-3ge6Zq_WApwgund2dOEnx.3 2024-09-14T11:52:44.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.520+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.522+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:52:44.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12919800618561731254', time=2024-09-14T13:40:28.716957+0000, chain.objs.size()=5 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-FROZEN.2~55gSfb01ur7AA8jpcjVphQk2t5WKlvz.1 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.160__shadow_mymultipart-FROZEN.2~55gSfb01ur7AA8jpcjVphQk2t5WKlvz.1_1 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-FROZEN.2~55gSfb01ur7AA8jpcjVphQk2t5WKlvz.2 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.524+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.160__shadow_mymultipart-FROZEN.2~55gSfb01ur7AA8jpcjVphQk2t5WKlvz.2_1 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-FROZEN.2~55gSfb01ur7AA8jpcjVphQk2t5WKlvz.3 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6031636594795436245', time=2024-09-14T13:40:29.149489+0000, chain.objs.size()=3 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.mrh04ffhWRLGlxzqBFsY35_WviJOjNf_0 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.mrh04ffhWRLGlxzqBFsY35_WviJOjNf_1 2024-09-14T11:52:44.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.mrh04ffhWRLGlxzqBFsY35_WviJOjNf_2 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_RNp-FWmI92ey5atq8-PCjYoWk0lX-UH', time=2024-09-14T13:40:29.711547+0000, chain.objs.size()=3 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.6b3TrBC6vA7sk3ZJIgxrA3AU2SC2G4C_0 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.6b3TrBC6vA7sk3ZJIgxrA3AU2SC2G4C_1 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.6b3TrBC6vA7sk3ZJIgxrA3AU2SC2G4C_2 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9745739599156643824', time=2024-09-14T13:45:09.289186+0000, chain.objs.size()=12 2024-09-14T11:52:44.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.525+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.1 2024-09-14T11:52:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.1_1 2024-09-14T11:52:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.2 2024-09-14T11:52:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.2_1 2024-09-14T11:52:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.sXnDhfAcLyJj-3fRi3L3l7b4_g11hHWp.3 2024-09-14T11:52:44.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.sXnDhfAcLyJj-3fRi3L3l7b4_g11hHWp.3_1 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.4 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.4_1 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.5 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.5_1 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.6 2024-09-14T11:52:44.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.528+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~_VfqK0GaUZuYdmeNq_i_yFdJVGgDSsF.6_1 2024-09-14T11:52:44.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.531+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11836112990416623123', time=2024-09-14T13:45:13.274025+0000, chain.objs.size()=2 2024-09-14T11:52:44.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.531+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~0Lx1O7EXhU5_E61X9LKwZRhMVSrI7yo.1 2024-09-14T11:52:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.533+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~0Lx1O7EXhU5_E61X9LKwZRhMVSrI7yo.2 2024-09-14T11:52:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.533+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3926723521652506579', time=2024-09-14T13:45:14.531973+0000, chain.objs.size()=2 2024-09-14T11:52:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.533+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~Uk07lWROt9BGor091g03FBSYw-8hK1d.1 2024-09-14T11:52:44.531 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.533+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.526__multipart_mymultipart.2~Uk07lWROt9BGor091g03FBSYw-8hK1d.2 2024-09-14T11:52:44.532 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.534+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~-y2NF8OPgS-nflFJLesOKwCKFMDUp0L', time=2024-09-14T13:45:21.384885+0000, chain.objs.size()=1 2024-09-14T11:52:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.534+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.535__multipart_mymultipart.2~-y2NF8OPgS-nflFJLesOKwCKFMDUp0L.1 2024-09-14T11:52:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.534+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10089716238009652551', time=2024-09-14T13:49:51.203828+0000, chain.objs.size()=1 2024-09-14T11:52:44.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.534+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.703__multipart_file1.2~SQ56mBVo_0xCtmoTN2TLiFIken9ZnEU.1 2024-09-14T11:52:44.536 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.538+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.538 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.541+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:52:44.540 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:52:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15181454550680130433', time=2024-09-14T13:40:28.728155+0000, chain.objs.size()=3 2024-09-14T11:52:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-STANDARD.2~1wHXaXxu2PEyhQEjPaHzNsobrjwjzXj.1 2024-09-14T11:52:44.541 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-STANDARD.2~1wHXaXxu2PEyhQEjPaHzNsobrjwjzXj.2 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.160__multipart_mymultipart-STANDARD.2~1wHXaXxu2PEyhQEjPaHzNsobrjwjzXj.3 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_ZGzW-lyZKuIf_NviD4nf8ZGlzvQ7NEX', time=2024-09-14T13:40:31.468697+0000, chain.objs.size()=1 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.LvPaaxLid0sZs_qIX8ByHfWInHhNJmw_0 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7858967581917384578', time=2024-09-14T13:44:53.342742+0000, chain.objs.size()=6 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.542+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~--AxthOIBl49Lb6gLf17ZHprhtJ8kxa', time=2024-09-14T13:45:18.568008+0000, chain.objs.size()=2 2024-09-14T11:52:44.542 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.530__multipart_mymultipart.2~--AxthOIBl49Lb6gLf17ZHprhtJ8kxa.1 2024-09-14T11:52:44.543 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.543+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.530__multipart_mymultipart.2~--AxthOIBl49Lb6gLf17ZHprhtJ8kxa.2 2024-09-14T11:52:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3938613703376395605', time=2024-09-14T13:47:05.442056+0000, chain.objs.size()=12 2024-09-14T11:52:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.1 2024-09-14T11:52:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.1_1 2024-09-14T11:52:44.544 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.2 2024-09-14T11:52:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.2_1 2024-09-14T11:52:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.3 2024-09-14T11:52:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.3_1 2024-09-14T11:52:44.545 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.546+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.4 2024-09-14T11:52:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.549+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.4_1 2024-09-14T11:52:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.549+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.5 2024-09-14T11:52:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.549+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.5_1 2024-09-14T11:52:44.547 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.549+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__multipart_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.6 2024-09-14T11:52:44.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.615__shadow_multipart_enc.2~8SwEzFuE33t1BCdJWwZnzBEZC43r9rm.6_1 2024-09-14T11:52:44.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB', time=2024-09-14T13:49:14.795382+0000, chain.objs.size()=12 2024-09-14T11:52:44.548 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.1 2024-09-14T11:52:44.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.1_1 2024-09-14T11:52:44.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.2 2024-09-14T11:52:44.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.2_1 2024-09-14T11:52:44.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.3 2024-09-14T11:52:44.549 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.550+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.3_1 2024-09-14T11:52:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.554+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.4 2024-09-14T11:52:44.552 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.554+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.4_1 2024-09-14T11:52:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.556+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.5 2024-09-14T11:52:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.556+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.5_1 2024-09-14T11:52:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.556+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__multipart_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.6 2024-09-14T11:52:44.554 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.556+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.626__shadow_multipart_enc.2~zAeiJaHG0ACdGJtzk78KH0-rLc0UvxB.6_1 2024-09-14T11:52:44.558 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.560+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.561 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.563+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:52:44.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.564+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.562 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.564+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.565+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:52:44.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.565+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_o6eQpAluU5EfpeYZn_6BJqmEvFt57DX', time=2024-09-14T13:40:29.245851+0000, chain.objs.size()=2 2024-09-14T11:52:44.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.565+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.dc3HfsixLSCsm5JnXBG9NQt-hZ-UEGz_1 2024-09-14T11:52:44.563 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.565+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.dc3HfsixLSCsm5JnXBG9NQt-hZ-UEGz_2 2024-09-14T11:52:44.564 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.566+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.567 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.569+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:52:44.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.570+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.568 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_CdlRW6MSp4mVj6uM0qXBCvmlnB0r_a1', time=2024-09-14T13:40:32.031940+0000, chain.objs.size()=1 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.164__shadow_.fT8ZN20W0K_qVsPKTnEacdFS2zuvlWf_0 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.7822006174223368782', time=2024-09-14T13:44:53.344214+0000, chain.objs.size()=6 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.570 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17309669670199890136', time=2024-09-14T13:44:56.897016+0000, chain.objs.size()=1 2024-09-14T11:52:44.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.517__multipart_mymultipartcopy.2~B7sJEDwaBgzhBtJArncgHzrjkYlGUmW.1 2024-09-14T11:52:44.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10507486930270997831', time=2024-09-14T13:50:28.473698+0000, chain.objs.size()=1 2024-09-14T11:52:44.571 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.571+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.741__shadow_.NBYGcdSVhnjOnR-d78-MWZGUJD-yfqJ_1 2024-09-14T11:52:44.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.575+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.575 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.577+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:52:44.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.577 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz', time=2024-09-14T13:45:03.817033+0000, chain.objs.size()=1 2024-09-14T11:52:44.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~XOL8S2pVPWJyWwABCjk_SBPlO2sn3Zz.1 2024-09-14T11:52:44.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.16590879965332264656', time=2024-09-14T13:45:57.456784+0000, chain.objs.size()=1 2024-09-14T11:52:44.578 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.552__shadow_.b91NuSPAv6PdG1Gsvbv0Rf2tF7qwD3v_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6100919877189505533', time=2024-09-14T13:45:59.252974+0000, chain.objs.size()=1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.555__shadow_.0q1eTGxMC0S56lWvS2JbOHm3iezsq-s_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP', time=2024-09-14T13:49:13.950138+0000, chain.objs.size()=12 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.1_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.2 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.2_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.3 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.3_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.4 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.4_1 2024-09-14T11:52:44.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.579+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.5 2024-09-14T11:52:44.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.583+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.5_1 2024-09-14T11:52:44.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.583+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__multipart_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.6 2024-09-14T11:52:44.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.584+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.625__shadow_multipart_enc.2~gc0v8IHehFcoLhCNBT3QXBe3gWxv_JP.6_1 2024-09-14T11:52:44.585 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.587+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.588 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.590+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:52:44.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.591+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.589 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.591+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.731309583116878137', time=2024-09-14T13:40:27.691254+0000, chain.objs.size()=3 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.LHKxAb2Ar5B0azdq-0Vu_2KGbJHnDkc_0 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.LHKxAb2Ar5B0azdq-0Vu_2KGbJHnDkc_1 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.159__shadow_.LHKxAb2Ar5B0azdq-0Vu_2KGbJHnDkc_2 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1305381631205966050', time=2024-09-14T13:45:12.552870+0000, chain.objs.size()=1 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~-o5DaDY2UiAQdGEwkt_g2EDqOZrcOl-.1 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~SrmVAN7-0807SLb8nJmmL5Cu-6ObjVq', time=2024-09-14T13:45:19.780855+0000, chain.objs.size()=2 2024-09-14T11:52:44.591 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.532__multipart_mymultipart.2~SrmVAN7-0807SLb8nJmmL5Cu-6ObjVq.1 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.532__multipart_mymultipart.2~SrmVAN7-0807SLb8nJmmL5Cu-6ObjVq.2 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2625513899706865209', time=2024-09-14T13:45:37.078324+0000, chain.objs.size()=4 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.536__multipart_mymultipart.2~FjxNK1m1ekBmvTderxcaH4M80XPvT72.1 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.536__multipart_mymultipart.2~FjxNK1m1ekBmvTderxcaH4M80XPvT72.2 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.536__multipart_mymultipart.uvJcWLT8B7JFzgOEYBCvaDlH6Sx3ggTx.3 2024-09-14T11:52:44.592 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.592+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.536__multipart_mymultipart.2~FjxNK1m1ekBmvTderxcaH4M80XPvT72.4 2024-09-14T11:52:44.594 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.596+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.596 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.598+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:52:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.600+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.598 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.600+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.600+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:52:44.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.600+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11565721066627809315', time=2024-09-14T13:44:55.462156+0000, chain.objs.size()=1 2024-09-14T11:52:44.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.601+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.514__multipart_mymultipart.2~v2lJ__EyGUI0OC6l1vJBUgFWZf708qE.1 2024-09-14T11:52:44.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.601+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~bW7jjw4v_QuC3k5acK14T4UIX1m34zQ', time=2024-09-14T13:50:29.699703+0000, chain.objs.size()=1 2024-09-14T11:52:44.599 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.601+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.743__multipart_mymultipart2.2~bW7jjw4v_QuC3k5acK14T4UIX1m34zQ.1 2024-09-14T11:52:44.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.602+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.602 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.604+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:52:44.603 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.605+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.604 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~SbWPSA7aiDh0fJa_6OdEXXhzHIVIqsG', time=2024-09-14T13:41:00.412084+0000, chain.objs.size()=2 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.203__multipart_mymultipart.2~SbWPSA7aiDh0fJa_6OdEXXhzHIVIqsG.1 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.203__shadow_mymultipart.2~SbWPSA7aiDh0fJa_6OdEXXhzHIVIqsG.1_1 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9035575323416512470', time=2024-09-14T13:45:12.673601+0000, chain.objs.size()=3 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~auk1-xcjxeCTlyn-H_aMgjvL2uAVQ1S.1 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__shadow_mymultipart.2~auk1-xcjxeCTlyn-H_aMgjvL2uAVQ1S.1_1 2024-09-14T11:52:44.605 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~auk1-xcjxeCTlyn-H_aMgjvL2uAVQ1S.2 2024-09-14T11:52:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~gsMvYFUL_VxtO5O4Wa5XVOnkJUyCo7t', time=2024-09-14T13:45:19.772786+0000, chain.objs.size()=1 2024-09-14T11:52:44.606 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.606+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.532__multipart_mymultipart.2~gsMvYFUL_VxtO5O4Wa5XVOnkJUyCo7t.1 2024-09-14T11:52:44.607 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.609+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.611+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:52:44.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.613+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.611 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.613+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.613+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.613+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9556970667165613008', time=2024-09-14T13:40:30.114013+0000, chain.objs.size()=3 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.613+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-STANDARD.2~_enRuvPirRdDP7k0X3DG3OZa9Jj0v42.1 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-STANDARD.2~_enRuvPirRdDP7k0X3DG3OZa9Jj0v42.2 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-STANDARD.2~_enRuvPirRdDP7k0X3DG3OZa9Jj0v42.3 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='2~vvW58tix3KoffF_QWBWrM7BgO1SPPti', time=2024-09-14T13:45:19.788046+0000, chain.objs.size()=1 2024-09-14T11:52:44.612 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.532__multipart_mymultipart2.2~vvW58tix3KoffF_QWBWrM7BgO1SPPti.1 2024-09-14T11:52:44.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5365194893553477861', time=2024-09-14T13:46:03.881387+0000, chain.objs.size()=1 2024-09-14T11:52:44.613 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.614+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.562__multipart_mymultipart.YC2SS_a1cZ1S8tN9hq5A9qNpx7HgOI5H.1 2024-09-14T11:52:44.615 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.616+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.617 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.619+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:52:44.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.620+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.619 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.620+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.619 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10393031085367840462', time=2024-09-14T13:40:29.466867+0000, chain.objs.size()=3 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.8LYaLUuG3Q_v5-AgqS2mBMnEsmsUt38_0 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.8LYaLUuG3Q_v5-AgqS2mBMnEsmsUt38_1 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.8LYaLUuG3Q_v5-AgqS2mBMnEsmsUt38_2 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.18225919842692485258', time=2024-09-14T13:45:17.383091+0000, chain.objs.size()=4 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.528__multipart_mymultipart.2~P1MHShlEUrklSCJNt9jlJ-q3Fm0vyMR.1 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.528__multipart_mymultipart.2~P1MHShlEUrklSCJNt9jlJ-q3Fm0vyMR.2 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.528__multipart_mymultipart.2~P1MHShlEUrklSCJNt9jlJ-q3Fm0vyMR.3 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.528__multipart_mymultipart.2~P1MHShlEUrklSCJNt9jlJ-q3Fm0vyMR.4 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.479138498440230394', time=2024-09-14T13:45:18.110295+0000, chain.objs.size()=2 2024-09-14T11:52:44.620 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.529__multipart_mymultipart.2~2p4LoVpIDwa5EhMV5E36mFTt3ZBSEvy.1 2024-09-14T11:52:44.621 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.621+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.529__multipart_mymultipart.2~2p4LoVpIDwa5EhMV5E36mFTt3ZBSEvy.2 2024-09-14T11:52:44.623 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.625+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.625 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.627+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:52:44.626 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.628+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.627 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12335867879756995507', time=2024-09-14T13:40:30.618898+0000, chain.objs.size()=5 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-LUKEWARM.2~fBXpm7kN3hthq413mWhdZaYxCQNE9SN.1 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_foo-LUKEWARM.2~fBXpm7kN3hthq413mWhdZaYxCQNE9SN.1_1 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-LUKEWARM.2~fBXpm7kN3hthq413mWhdZaYxCQNE9SN.2 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_foo-LUKEWARM.2~fBXpm7kN3hthq413mWhdZaYxCQNE9SN.2_1 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-LUKEWARM.2~fBXpm7kN3hthq413mWhdZaYxCQNE9SN.3 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_HVHY4zzIY1IN28HAgDbPwYrNE3I-Wlu', time=2024-09-14T13:40:32.853838+0000, chain.objs.size()=3 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.81YuUa82_GxU15yG2p1AQw5ZKY9LaNs_0 2024-09-14T11:52:44.628 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.81YuUa82_GxU15yG2p1AQw5ZKY9LaNs_1 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.166__shadow_.81YuUa82_GxU15yG2p1AQw5ZKY9LaNs_2 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12069227458869753125', time=2024-09-14T13:45:07.601633+0000, chain.objs.size()=6 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.1 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.BGNrBnOXeUZAfsRtqpi55NGxkCqb0wXK.2 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.3 2024-09-14T11:52:44.629 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.629+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.4 2024-09-14T11:52:44.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.5 2024-09-14T11:52:44.630 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~MWW6UIu46WJW2JtlhH3oAiBIO3C8eNf.6 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12644518125418483995', time=2024-09-14T13:45:13.166780+0000, chain.objs.size()=3 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~j_mzGy0lBXrtr-3Z-6y_9JcQxmF3Jf4.1 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~j_mzGy0lBXrtr-3Z-6y_9JcQxmF3Jf4.2 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~j_mzGy0lBXrtr-3Z-6y_9JcQxmF3Jf4.3 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.110908423264652245', time=2024-09-14T13:51:19.159125+0000, chain.objs.size()=9 2024-09-14T11:52:44.631 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.632+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_1 2024-09-14T11:52:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.633+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_2 2024-09-14T11:52:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.633+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_3 2024-09-14T11:52:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.633+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_4 2024-09-14T11:52:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.634+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_5 2024-09-14T11:52:44.632 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.634+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_6 2024-09-14T11:52:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.636+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_7 2024-09-14T11:52:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.636+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_8 2024-09-14T11:52:44.635 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.636+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.780__shadow_._yOtV-V_aPSDuXXvRmJdKEY-5TnzixG_9 2024-09-14T11:52:44.638 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.640+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.641 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.643+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:52:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.644+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.643 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_xqVdyWtDR9x5inFE4nmEHMurMhce2kp', time=2024-09-14T13:40:29.717447+0000, chain.objs.size()=3 2024-09-14T11:52:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.y6K1e9AsXoTJgQ-aLI7F2gjqpWBvHJ9_0 2024-09-14T11:52:44.644 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.y6K1e9AsXoTJgQ-aLI7F2gjqpWBvHJ9_1 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.y6K1e9AsXoTJgQ-aLI7F2gjqpWBvHJ9_2 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.15533351817601926887', time=2024-09-14T13:40:31.194837+0000, chain.objs.size()=5 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-FROZEN.2~1515u6Ez8u8Ky0_S8feixGN8LfjfFsP.1 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_foo-FROZEN.2~1515u6Ez8u8Ky0_S8feixGN8LfjfFsP.1_1 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-FROZEN.2~1515u6Ez8u8Ky0_S8feixGN8LfjfFsP.2 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_foo-FROZEN.2~1515u6Ez8u8Ky0_S8feixGN8LfjfFsP.2_1 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__multipart_foo-FROZEN.2~1515u6Ez8u8Ky0_S8feixGN8LfjfFsP.3 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_QDFdEpQtofEzP6wEuHuq57NxXucPqcb', time=2024-09-14T13:40:31.463477+0000, chain.objs.size()=3 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.JIx5_ukW_rf6mim1kfYia6zBxJ5TaT6_0 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.JIx5_ukW_rf6mim1kfYia6zBxJ5TaT6_1 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.JIx5_ukW_rf6mim1kfYia6zBxJ5TaT6_2 2024-09-14T11:52:44.645 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.2615584632859251726', time=2024-09-14T13:46:42.661925+0000, chain.objs.size()=4 2024-09-14T11:52:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.645+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~TZ16vn6THBXomI4yeMgej5tWb4aMXRE.1 2024-09-14T11:52:44.646 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.648+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~TZ16vn6THBXomI4yeMgej5tWb4aMXRE.2 2024-09-14T11:52:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.649+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~TZ16vn6THBXomI4yeMgej5tWb4aMXRE.3 2024-09-14T11:52:44.647 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.649+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~TZ16vn6THBXomI4yeMgej5tWb4aMXRE.4 2024-09-14T11:52:44.649 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.651+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.652 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.654+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:52:44.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.655+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.655+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:52:44.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_zwSALlbdhooViIWs3McuTxKtgG5wsvu', time=2024-09-14T13:40:30.741683+0000, chain.objs.size()=2 2024-09-14T11:52:44.654 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.I4IJJkQADk9i8PmIvsNZ_UR5yJpRjCi_1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.I4IJJkQADk9i8PmIvsNZ_UR5yJpRjCi_2 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10031315787826911825', time=2024-09-14T13:40:32.779594+0000, chain.objs.size()=4 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.165__multipart_foo.2~_KS7FCE2JI6sEvbPW2xn-waND6qfU7b.1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.165__shadow_foo.2~_KS7FCE2JI6sEvbPW2xn-waND6qfU7b.1_1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.165__multipart_foo.2~_KS7FCE2JI6sEvbPW2xn-waND6qfU7b.2 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.165__shadow_foo.2~_KS7FCE2JI6sEvbPW2xn-waND6qfU7b.2_1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11714157687381054452', time=2024-09-14T13:45:10.948010+0000, chain.objs.size()=12 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.1_1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.u_VBy1-0E0yKUk-G1VqqiqNHANxwJU-x.2 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.u_VBy1-0E0yKUk-G1VqqiqNHANxwJU-x.2_1 2024-09-14T11:52:44.655 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.GuRreC3dr4Qf8dfgNcVR4NAJ128AxoRK.3 2024-09-14T11:52:44.656 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.656+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.GuRreC3dr4Qf8dfgNcVR4NAJ128AxoRK.3_1 2024-09-14T11:52:44.658 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.660+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.4 2024-09-14T11:52:44.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.4_1 2024-09-14T11:52:44.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.5 2024-09-14T11:52:44.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.5_1 2024-09-14T11:52:44.659 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__multipart_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.6 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.523__shadow_mymultipart.2~k7NcMgm_P-G5BrW7T59-WSMwSn5EJHk.6_1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6107548489528167669', time=2024-09-14T13:45:17.892077+0000, chain.objs.size()=1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.529__shadow_.DvlNcZstxL2s7KKN-COmZKLTKRXmpxx_1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.6257629874435964983', time=2024-09-14T13:45:39.243615+0000, chain.objs.size()=1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.537__multipart_mymultipart.2~iAzJ38aY8S63pxL49eml5wmMqC_4RAt.1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.14926515183299365014', time=2024-09-14T13:46:09.153147+0000, chain.objs.size()=1 2024-09-14T11:52:44.660 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.661+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.564__shadow_.Z94bIlMDj574avnwogDEJfVMH1MvpQH_1 2024-09-14T11:52:44.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.663+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.12019709272426217579', time=2024-09-14T13:49:13.117325+0000, chain.objs.size()=12 2024-09-14T11:52:44.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.663+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.1 2024-09-14T11:52:44.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.664+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.1_1 2024-09-14T11:52:44.662 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.664+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.2 2024-09-14T11:52:44.663 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.665+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.2_1 2024-09-14T11:52:44.664 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.666+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.3 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.666+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.3_1 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.666+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.4 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.667+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.4_1 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.667+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.5 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.667+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.5_1 2024-09-14T11:52:44.665 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.667+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__multipart_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.6 2024-09-14T11:52:44.666 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.668+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.624__shadow_multipart_enc.2~2VQkQ3v0w1pkJism2N--9zW6xeIkuVd.6_1 2024-09-14T11:52:44.671 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.673+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.673 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.676+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:52:44.675 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.10887454220713181010', time=2024-09-14T13:44:53.458527+0000, chain.objs.size()=6 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.676 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.8252013942546794796', time=2024-09-14T13:44:54.624795+0000, chain.objs.size()=1 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.512__multipart_mymultipart.2~MVcNyDlFyPlaVpczpgE6nm5UnjI2OOV.1 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.677+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17644444327593734690', time=2024-09-14T13:44:58.839962+0000, chain.objs.size()=1 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.519__multipart_mymultipart.2~NjdQbuwAePdFd4bPWCpnDxMGcCxL-xR.1 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.17091703369293083044', time=2024-09-14T13:46:42.234822+0000, chain.objs.size()=4 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~voAcMw2eY4FtU8PbpD0BCzHSfDzdqnl.1 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~voAcMw2eY4FtU8PbpD0BCzHSfDzdqnl.2 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~voAcMw2eY4FtU8PbpD0BCzHSfDzdqnl.3 2024-09-14T11:52:44.677 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.678+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.579__multipart_testobj.2~voAcMw2eY4FtU8PbpD0BCzHSfDzdqnl.4 2024-09-14T11:52:44.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.681+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9319827721939969099', time=2024-09-14T13:49:33.300535+0000, chain.objs.size()=12 2024-09-14T11:52:44.679 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.681+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.1 2024-09-14T11:52:44.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.1_1 2024-09-14T11:52:44.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.2 2024-09-14T11:52:44.681 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.2_1 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.3 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.3_1 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.4 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.4_1 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.5 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.5_1 2024-09-14T11:52:44.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.683+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__multipart_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.6 2024-09-14T11:52:44.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.685+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.661__shadow_bar.2~8mS-O0feystmjwZvRWD8r0ndFsb3ckF.6_1 2024-09-14T11:52:44.688 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.690+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.690 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.692+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:52:44.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.693+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_8PeUdGW_1GbTin1XbTZgGo0jWVm4SNx', time=2024-09-14T13:40:28.942412+0000, chain.objs.size()=1 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.koCO4qHSmqQId0r1UhArKAYrTLQc3tT_0 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.3568576583879516622', time=2024-09-14T13:44:53.344060+0000, chain.objs.size()=6 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.1 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.2 2024-09-14T11:52:44.693 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.3 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.4 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.5 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.508__multipart_srcmultipart.2~lM1J-IssIkBFfysrm-65Y1e6giaa0Eo.6 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.5951352898097752092', time=2024-09-14T13:44:58.728851+0000, chain.objs.size()=1 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.518__shadow_.rPl1N4_ZNndBQKDFJsxZvPMUT0M6W5__1 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.1206422576925187964', time=2024-09-14T13:46:01.254354+0000, chain.objs.size()=1 2024-09-14T11:52:44.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.694+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.558__shadow_.8DKJv-hPTVC6zwjNGNGQ7ADrU63fMg0_1 2024-09-14T11:52:44.698 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.700+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.700 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.702+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:52:44.701 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.703+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_uo7L3O_C5aCcf_j3mkiIFzAA4Q5l6eW', time=2024-09-14T13:40:30.177525+0000, chain.objs.size()=1 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:a588039c-1457-497f-adbd-8890a12279b7.4508.162__shadow_.aQ3ZkcFmn7d1ObcPxeW7bWLIsjVi5ih_0 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.9711292158573099632', time=2024-09-14T13:45:12.840848+0000, chain.objs.size()=2 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~88vm-Nl1ZyfGI7Zfj_1_NNGRF1DzSyc.1 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.524__multipart_mymultipart.2~88vm-Nl1ZyfGI7Zfj_1_NNGRF1DzSyc.2 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.13175651836109895421', time=2024-09-14T13:47:02.792850+0000, chain.objs.size()=12 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.1 2024-09-14T11:52:44.703 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.1_1 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.2 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.2_1 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.3 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.3_1 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.4 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.4_1 2024-09-14T11:52:44.704 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.704+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.5 2024-09-14T11:52:44.705 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.707+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.5_1 2024-09-14T11:52:44.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.708+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__multipart_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.6 2024-09-14T11:52:44.706 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.708+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.614__shadow_multipart_enc.2~AfVoeV1S0UQ0lZA_iCgLC3rTfbEaZz5.6_1 2024-09-14T11:52:44.710 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.712+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.715+0000 7f3990535800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:52:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.716+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:52:44.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.716+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:52:44.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:52:44.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='_XthJv_QYwMcmAYCr-_v88S5hJQsonaO', time=2024-09-14T13:40:29.563011+0000, chain.objs.size()=2 2024-09-14T11:52:44.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.MG5xXgvcJwLbE_sGIgHFZ4x1cxhNW4Q_1 2024-09-14T11:52:44.715 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.161__shadow_.MG5xXgvcJwLbE_sGIgHFZ4x1cxhNW4Q_2 2024-09-14T11:52:44.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11393815654677560502', time=2024-09-14T13:49:55.504831+0000, chain.objs.size()=1 2024-09-14T11:52:44.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.712__multipart_file1.2~DLy3BD6Ih39M-jpMiq3PMahSDQV6Oiy.1 2024-09-14T11:52:44.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 20 garbage collection: RGWGC::process iterating over entry tag='a588039c-1457-497f-adbd-8890a12279b7.4508.11810223006276234702', time=2024-09-14T13:50:29.642248+0000, chain.objs.size()=1 2024-09-14T11:52:44.716 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.717+0000 7f3990535800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:a588039c-1457-497f-adbd-8890a12279b7.4508.743__multipart_mymultipart3.2~J-j65m_P0YB9uBBAo_TRScAIKIjQcbx.1 2024-09-14T11:52:44.717 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.719+0000 7f3990535800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:52:44.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.722+0000 7f3842fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:52:44.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.724+0000 7f3990535800 20 remove_watcher() i=0 2024-09-14T11:52:44.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.724+0000 7f3990535800 2 removed watcher, disabling cache 2024-09-14T11:52:44.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.725+0000 7f3990535800 20 remove_watcher() i=1 2024-09-14T11:52:44.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.726+0000 7f3990535800 20 remove_watcher() i=2 2024-09-14T11:52:44.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.727+0000 7f3990535800 20 remove_watcher() i=3 2024-09-14T11:52:44.726 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.728+0000 7f3990535800 20 remove_watcher() i=4 2024-09-14T11:52:44.727 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.729+0000 7f3990535800 20 remove_watcher() i=5 2024-09-14T11:52:44.728 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.730+0000 7f3990535800 20 remove_watcher() i=6 2024-09-14T11:52:44.729 INFO:teuthology.orchestra.run.smithi130.stderr:2024-09-14T11:52:44.731+0000 7f3990535800 20 remove_watcher() i=7 2024-09-14T11:52:44.741 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:52:44.753 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T11:52:44.782 DEBUG:teuthology.orchestra.run.smithi130:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:52:44.851 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T11:52:44.920 DEBUG:teuthology.orchestra.run.smithi130:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:52:44.989 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:52:45.068 DEBUG:teuthology.orchestra.run.smithi130:> sudo update-ca-trust 2024-09-14T11:52:46.088 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:52:46.104 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:52:46.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:52:46.436 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:52:46.453 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:52:46.456 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1517,"stamp":"2024-09-14T11:52:45.071145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662413282,"num_objects":1017,"num_object_clones":0,"num_object_copies":3028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1017,"num_whiteouts":0,"num_read":298782,"num_read_kb":3127342,"num_write":145881,"num_write_kb":2544918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12789,"ondisk_log_size":12789,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444008,"kb_used_data":993832,"kb_used_omap":12,"kb_used_meta":1450035,"kb_avail":752530712,"statfs":{"total":773094113280,"available":770591449088,"internally_reserved":0,"allocated":1017683968,"data_stored":1001698376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1484836401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1152,"num_objects":-16,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":465,"num_read_kb":440,"num_write":122,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004932"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:49.032072+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:47:49.032072+0000","last_peered":"2024-09-14T11:47:49.032072+0000","last_clean":"2024-09-14T11:47:49.032072+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:47:49.032072+0000","last_undegraded":"2024-09-14T11:47:49.032072+0000","last_fullsized":"2024-09-14T11:47:49.032072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929194+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:50:13.929194+0000","last_peered":"2024-09-14T11:50:13.929194+0000","last_clean":"2024-09-14T11:50:13.929194+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:50:13.929194+0000","last_undegraded":"2024-09-14T11:50:13.929194+0000","last_fullsized":"2024-09-14T11:50:13.929194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.491129+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:50:29.491129+0000","last_peered":"2024-09-14T11:50:29.491129+0000","last_clean":"2024-09-14T11:50:29.491129+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:50:29.491129+0000","last_undegraded":"2024-09-14T11:50:29.491129+0000","last_fullsized":"2024-09-14T11:50:29.491129+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.932210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.020550+0000","last_change":"2024-09-14T11:38:32.849060+0000","last_active":"2024-09-14T11:48:34.020550+0000","last_peered":"2024-09-14T11:48:34.020550+0000","last_clean":"2024-09-14T11:48:34.020550+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:48:34.020550+0000","last_undegraded":"2024-09-14T11:48:34.020550+0000","last_fullsized":"2024-09-14T11:48:34.020550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:37.543006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.906147+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:47:48.906147+0000","last_peered":"2024-09-14T11:47:48.906147+0000","last_clean":"2024-09-14T11:47:48.906147+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:47:48.906147+0000","last_undegraded":"2024-09-14T11:47:48.906147+0000","last_fullsized":"2024-09-14T11:47:48.906147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929084+0000","last_change":"2024-09-14T11:27:43.844600+0000","last_active":"2024-09-14T11:50:13.929084+0000","last_peered":"2024-09-14T11:50:13.929084+0000","last_clean":"2024-09-14T11:50:13.929084+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:50:13.929084+0000","last_undegraded":"2024-09-14T11:50:13.929084+0000","last_fullsized":"2024-09-14T11:50:13.929084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:40.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.031874+0000","last_change":"2024-09-14T11:26:02.011475+0000","last_active":"2024-09-14T11:50:04.031874+0000","last_peered":"2024-09-14T11:50:04.031874+0000","last_clean":"2024-09-14T11:50:04.031874+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:50:04.031874+0000","last_undegraded":"2024-09-14T11:50:04.031874+0000","last_fullsized":"2024-09-14T11:50:04.031874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:06.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.904430+0000","last_change":"2024-09-14T11:38:32.844854+0000","last_active":"2024-09-14T11:48:13.904430+0000","last_peered":"2024-09-14T11:48:13.904430+0000","last_clean":"2024-09-14T11:48:13.904430+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:48:13.904430+0000","last_undegraded":"2024-09-14T11:48:13.904430+0000","last_fullsized":"2024-09-14T11:48:13.904430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:24.240149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'8","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914798+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:48:38.914798+0000","last_peered":"2024-09-14T11:48:38.914798+0000","last_clean":"2024-09-14T11:48:38.914798+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:48:38.914798+0000","last_undegraded":"2024-09-14T11:48:38.914798+0000","last_fullsized":"2024-09-14T11:48:38.914798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":15373,"num_write":8,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.029442+0000","last_change":"2024-09-14T11:27:43.839478+0000","last_active":"2024-09-14T11:49:44.029442+0000","last_peered":"2024-09-14T11:49:44.029442+0000","last_clean":"2024-09-14T11:49:44.029442+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:49:44.029442+0000","last_undegraded":"2024-09-14T11:49:44.029442+0000","last_fullsized":"2024-09-14T11:49:44.029442+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:44.742446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:18.912574+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:48:18.912574+0000","last_peered":"2024-09-14T11:48:18.912574+0000","last_clean":"2024-09-14T11:48:18.912574+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:48:18.912574+0000","last_undegraded":"2024-09-14T11:48:18.912574+0000","last_fullsized":"2024-09-14T11:48:18.912574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:25.443932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930348+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:50:38.930348+0000","last_peered":"2024-09-14T11:50:38.930348+0000","last_clean":"2024-09-14T11:50:38.930348+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:50:38.930348+0000","last_undegraded":"2024-09-14T11:50:38.930348+0000","last_fullsized":"2024-09-14T11:50:38.930348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.922656+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:49:38.922656+0000","last_peered":"2024-09-14T11:49:38.922656+0000","last_clean":"2024-09-14T11:49:38.922656+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:49:38.922656+0000","last_undegraded":"2024-09-14T11:49:38.922656+0000","last_fullsized":"2024-09-14T11:49:38.922656+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918289+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:48:58.918289+0000","last_peered":"2024-09-14T11:48:58.918289+0000","last_clean":"2024-09-14T11:48:58.918289+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:48:58.918289+0000","last_undegraded":"2024-09-14T11:48:58.918289+0000","last_fullsized":"2024-09-14T11:48:58.918289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.194975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.916014+0000","last_change":"2024-09-14T11:27:46.877556+0000","last_active":"2024-09-14T11:49:33.916014+0000","last_peered":"2024-09-14T11:49:33.916014+0000","last_clean":"2024-09-14T11:49:33.916014+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:49:33.916014+0000","last_undegraded":"2024-09-14T11:49:33.916014+0000","last_fullsized":"2024-09-14T11:49:33.916014+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:18.433716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.921935+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:49:33.921935+0000","last_peered":"2024-09-14T11:49:33.921935+0000","last_clean":"2024-09-14T11:49:33.921935+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:49:33.921935+0000","last_undegraded":"2024-09-14T11:49:33.921935+0000","last_fullsized":"2024-09-14T11:49:33.921935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907414+0000","last_change":"2024-09-14T11:26:02.016774+0000","last_active":"2024-09-14T11:48:33.907414+0000","last_peered":"2024-09-14T11:48:33.907414+0000","last_clean":"2024-09-14T11:48:33.907414+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:48:33.907414+0000","last_undegraded":"2024-09-14T11:48:33.907414+0000","last_fullsized":"2024-09-14T11:48:33.907414+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:07.106001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'13","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.901076+0000","last_change":"2024-09-14T11:27:46.886470+0000","last_active":"2024-09-14T11:47:48.901076+0000","last_peered":"2024-09-14T11:47:48.901076+0000","last_clean":"2024-09-14T11:47:48.901076+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:47:48.901076+0000","last_undegraded":"2024-09-14T11:47:48.901076+0000","last_fullsized":"2024-09-14T11:47:48.901076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:31.966694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19456,"num_write":23,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927162+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:50:13.927162+0000","last_peered":"2024-09-14T11:50:13.927162+0000","last_clean":"2024-09-14T11:50:13.927162+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:50:13.927162+0000","last_undegraded":"2024-09-14T11:50:13.927162+0000","last_fullsized":"2024-09-14T11:50:13.927162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301531,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5174,"num_write":11,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929327+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:50:13.929327+0000","last_peered":"2024-09-14T11:50:13.929327+0000","last_clean":"2024-09-14T11:50:13.929327+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:50:13.929327+0000","last_undegraded":"2024-09-14T11:50:13.929327+0000","last_fullsized":"2024-09-14T11:50:13.929327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12280,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.928980+0000","last_change":"2024-09-14T11:26:02.018044+0000","last_active":"2024-09-14T11:50:13.928980+0000","last_peered":"2024-09-14T11:50:13.928980+0000","last_clean":"2024-09-14T11:50:13.928980+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:50:13.928980+0000","last_undegraded":"2024-09-14T11:50:13.928980+0000","last_fullsized":"2024-09-14T11:50:13.928980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:20.434831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923623+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:49:33.923623+0000","last_peered":"2024-09-14T11:49:33.923623+0000","last_clean":"2024-09-14T11:49:33.923623+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:49:33.923623+0000","last_undegraded":"2024-09-14T11:49:33.923623+0000","last_fullsized":"2024-09-14T11:49:33.923623+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040301+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:48:44.040301+0000","last_peered":"2024-09-14T11:48:44.040301+0000","last_clean":"2024-09-14T11:48:44.040301+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:48:44.040301+0000","last_undegraded":"2024-09-14T11:48:44.040301+0000","last_fullsized":"2024-09-14T11:48:44.040301+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:57.988895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5124,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033275+0000","last_change":"2024-09-14T11:38:32.848295+0000","last_active":"2024-09-14T11:50:14.033275+0000","last_peered":"2024-09-14T11:50:14.033275+0000","last_clean":"2024-09-14T11:50:14.033275+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:50:14.033275+0000","last_undegraded":"2024-09-14T11:50:14.033275+0000","last_fullsized":"2024-09-14T11:50:14.033275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:48.994528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:53.917687+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:48:53.917687+0000","last_peered":"2024-09-14T11:48:53.917687+0000","last_clean":"2024-09-14T11:48:53.917687+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:48:53.917687+0000","last_undegraded":"2024-09-14T11:48:53.917687+0000","last_fullsized":"2024-09-14T11:48:53.917687+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042145+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:49:29.042145+0000","last_peered":"2024-09-14T11:49:29.042145+0000","last_clean":"2024-09-14T11:49:29.042145+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:49:29.042145+0000","last_undegraded":"2024-09-14T11:49:29.042145+0000","last_fullsized":"2024-09-14T11:49:29.042145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923673+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:49:33.923673+0000","last_peered":"2024-09-14T11:49:33.923673+0000","last_clean":"2024-09-14T11:49:33.923673+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:49:33.923673+0000","last_undegraded":"2024-09-14T11:49:33.923673+0000","last_fullsized":"2024-09-14T11:49:33.923673+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.027786+0000","last_change":"2024-09-14T11:27:43.833928+0000","last_active":"2024-09-14T11:49:29.027786+0000","last_peered":"2024-09-14T11:49:29.027786+0000","last_clean":"2024-09-14T11:49:29.027786+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:49:29.027786+0000","last_undegraded":"2024-09-14T11:49:29.027786+0000","last_fullsized":"2024-09-14T11:49:29.027786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:18.568174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033312+0000","last_change":"2024-09-14T11:26:02.016653+0000","last_active":"2024-09-14T11:50:14.033312+0000","last_peered":"2024-09-14T11:50:14.033312+0000","last_clean":"2024-09-14T11:50:14.033312+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:50:14.033312+0000","last_undegraded":"2024-09-14T11:50:14.033312+0000","last_fullsized":"2024-09-14T11:50:14.033312+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:16.371317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.922005+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:49:33.922005+0000","last_peered":"2024-09-14T11:49:33.922005+0000","last_clean":"2024-09-14T11:49:33.922005+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:49:33.922005+0000","last_undegraded":"2024-09-14T11:49:33.922005+0000","last_fullsized":"2024-09-14T11:49:33.922005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911902+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:48:13.911902+0000","last_peered":"2024-09-14T11:48:13.911902+0000","last_clean":"2024-09-14T11:48:13.911902+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:48:13.911902+0000","last_undegraded":"2024-09-14T11:48:13.911902+0000","last_fullsized":"2024-09-14T11:48:13.911902+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:00.999425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916585+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:48:48.916585+0000","last_peered":"2024-09-14T11:48:48.916585+0000","last_clean":"2024-09-14T11:48:48.916585+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:48:48.916585+0000","last_undegraded":"2024-09-14T11:48:48.916585+0000","last_fullsized":"2024-09-14T11:48:48.916585+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:19.871430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3076,"num_write":3,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914944+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:48:43.914944+0000","last_peered":"2024-09-14T11:48:43.914944+0000","last_clean":"2024-09-14T11:48:43.914944+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:48:43.914944+0000","last_undegraded":"2024-09-14T11:48:43.914944+0000","last_fullsized":"2024-09-14T11:48:43.914944+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:16.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.909890+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:48:13.909890+0000","last_peered":"2024-09-14T11:48:13.909890+0000","last_clean":"2024-09-14T11:48:13.909890+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:48:13.909890+0000","last_undegraded":"2024-09-14T11:48:13.909890+0000","last_fullsized":"2024-09-14T11:48:13.909890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:42.939970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916531+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:48:48.916531+0000","last_peered":"2024-09-14T11:48:48.916531+0000","last_clean":"2024-09-14T11:48:48.916531+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:48:48.916531+0000","last_undegraded":"2024-09-14T11:48:48.916531+0000","last_fullsized":"2024-09-14T11:48:48.916531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:11.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916162+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:48:43.916162+0000","last_peered":"2024-09-14T11:48:43.916162+0000","last_clean":"2024-09-14T11:48:43.916162+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:48:43.916162+0000","last_undegraded":"2024-09-14T11:48:43.916162+0000","last_fullsized":"2024-09-14T11:48:43.916162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916982+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:48:48.916982+0000","last_peered":"2024-09-14T11:48:48.916982+0000","last_clean":"2024-09-14T11:48:48.916982+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:48:48.916982+0000","last_undegraded":"2024-09-14T11:48:48.916982+0000","last_fullsized":"2024-09-14T11:48:48.916982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:18.041265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.909029+0000","last_change":"2024-09-14T11:27:43.841798+0000","last_active":"2024-09-14T11:48:43.909029+0000","last_peered":"2024-09-14T11:48:43.909029+0000","last_clean":"2024-09-14T11:48:43.909029+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:48:43.909029+0000","last_undegraded":"2024-09-14T11:48:43.909029+0000","last_fullsized":"2024-09-14T11:48:43.909029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920603+0000","last_change":"2024-09-14T11:26:02.017294+0000","last_active":"2024-09-14T11:49:23.920603+0000","last_peered":"2024-09-14T11:49:23.920603+0000","last_clean":"2024-09-14T11:49:23.920603+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:49:23.920603+0000","last_undegraded":"2024-09-14T11:49:23.920603+0000","last_fullsized":"2024-09-14T11:49:23.920603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.763964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911882+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:48:13.911882+0000","last_peered":"2024-09-14T11:48:13.911882+0000","last_clean":"2024-09-14T11:48:13.911882+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:48:13.911882+0000","last_undegraded":"2024-09-14T11:48:13.911882+0000","last_fullsized":"2024-09-14T11:48:13.911882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.077724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.909728+0000","last_change":"2024-09-14T11:27:46.878156+0000","last_active":"2024-09-14T11:48:48.909728+0000","last_peered":"2024-09-14T11:48:48.909728+0000","last_clean":"2024-09-14T11:48:48.909728+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:48:48.909728+0000","last_undegraded":"2024-09-14T11:48:48.909728+0000","last_fullsized":"2024-09-14T11:48:48.909728+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:16.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9432205,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":8188,"num_write":4,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040261+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:48:44.040261+0000","last_peered":"2024-09-14T11:48:44.040261+0000","last_clean":"2024-09-14T11:48:44.040261+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:48:44.040261+0000","last_undegraded":"2024-09-14T11:48:44.040261+0000","last_fullsized":"2024-09-14T11:48:44.040261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:04.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027203+0000","last_change":"2024-09-14T11:38:32.848761+0000","last_active":"2024-09-14T11:49:24.027203+0000","last_peered":"2024-09-14T11:49:24.027203+0000","last_clean":"2024-09-14T11:49:24.027203+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:49:24.027203+0000","last_undegraded":"2024-09-14T11:49:24.027203+0000","last_fullsized":"2024-09-14T11:49:24.027203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.405538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930037+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:50:18.930037+0000","last_peered":"2024-09-14T11:50:18.930037+0000","last_clean":"2024-09-14T11:50:18.930037+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:50:18.930037+0000","last_undegraded":"2024-09-14T11:50:18.930037+0000","last_fullsized":"2024-09-14T11:50:18.930037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048504+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:50:14.048504+0000","last_peered":"2024-09-14T11:50:14.048504+0000","last_clean":"2024-09-14T11:50:14.048504+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:50:14.048504+0000","last_undegraded":"2024-09-14T11:50:14.048504+0000","last_fullsized":"2024-09-14T11:50:14.048504+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21510,"num_write":19,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915562+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:48:38.915562+0000","last_peered":"2024-09-14T11:48:38.915562+0000","last_clean":"2024-09-14T11:48:38.915562+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:48:38.915562+0000","last_undegraded":"2024-09-14T11:48:38.915562+0000","last_fullsized":"2024-09-14T11:48:38.915562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:22.557110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033300+0000","last_change":"2024-09-14T11:27:43.841930+0000","last_active":"2024-09-14T11:50:14.033300+0000","last_peered":"2024-09-14T11:50:14.033300+0000","last_clean":"2024-09-14T11:50:14.033300+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:50:14.033300+0000","last_undegraded":"2024-09-14T11:50:14.033300+0000","last_fullsized":"2024-09-14T11:50:14.033300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:26.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.039040+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:48:34.039040+0000","last_peered":"2024-09-14T11:48:34.039040+0000","last_clean":"2024-09-14T11:48:34.039040+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:48:34.039040+0000","last_undegraded":"2024-09-14T11:48:34.039040+0000","last_fullsized":"2024-09-14T11:48:34.039040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:32.266973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.914592+0000","last_change":"2024-09-14T11:38:32.850327+0000","last_active":"2024-09-14T11:49:23.914592+0000","last_peered":"2024-09-14T11:49:23.914592+0000","last_clean":"2024-09-14T11:49:23.914592+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:49:23.914592+0000","last_undegraded":"2024-09-14T11:49:23.914592+0000","last_fullsized":"2024-09-14T11:49:23.914592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930485+0000","last_change":"2024-09-14T11:27:47.189562+0000","last_active":"2024-09-14T11:50:23.930485+0000","last_peered":"2024-09-14T11:50:23.930485+0000","last_clean":"2024-09-14T11:50:23.930485+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:50:23.930485+0000","last_undegraded":"2024-09-14T11:50:23.930485+0000","last_fullsized":"2024-09-14T11:50:23.930485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:40.247709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929405+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:50:13.929405+0000","last_peered":"2024-09-14T11:50:13.929405+0000","last_clean":"2024-09-14T11:50:13.929405+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:50:13.929405+0000","last_undegraded":"2024-09-14T11:50:13.929405+0000","last_fullsized":"2024-09-14T11:50:13.929405+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907514+0000","last_change":"2024-09-14T11:26:02.014516+0000","last_active":"2024-09-14T11:48:33.907514+0000","last_peered":"2024-09-14T11:48:33.907514+0000","last_clean":"2024-09-14T11:48:33.907514+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:48:33.907514+0000","last_undegraded":"2024-09-14T11:48:33.907514+0000","last_fullsized":"2024-09-14T11:48:33.907514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:24.171152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930066+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:50:18.930066+0000","last_peered":"2024-09-14T11:50:18.930066+0000","last_clean":"2024-09-14T11:50:18.930066+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:50:18.930066+0000","last_undegraded":"2024-09-14T11:50:18.930066+0000","last_fullsized":"2024-09-14T11:50:18.930066+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4112,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929898+0000","last_change":"2024-09-14T11:27:43.842788+0000","last_active":"2024-09-14T11:50:18.929898+0000","last_peered":"2024-09-14T11:50:18.929898+0000","last_clean":"2024-09-14T11:50:18.929898+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:50:18.929898+0000","last_undegraded":"2024-09-14T11:50:18.929898+0000","last_fullsized":"2024-09-14T11:50:18.929898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.953106+0000","last_change":"2024-09-14T11:26:02.009131+0000","last_active":"2024-09-14T11:50:25.953106+0000","last_peered":"2024-09-14T11:50:25.953106+0000","last_clean":"2024-09-14T11:50:25.953106+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:50:25.953106+0000","last_undegraded":"2024-09-14T11:50:25.953106+0000","last_fullsized":"2024-09-14T11:50:25.953106+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921298+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:49:28.921298+0000","last_peered":"2024-09-14T11:49:28.921298+0000","last_clean":"2024-09-14T11:49:28.921298+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:49:28.921298+0000","last_undegraded":"2024-09-14T11:49:28.921298+0000","last_fullsized":"2024-09-14T11:49:28.921298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6166,"num_write":5,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.698490+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:29.698490+0000","last_peered":"2024-09-14T11:50:29.698490+0000","last_clean":"2024-09-14T11:50:29.698490+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:29.698490+0000","last_undegraded":"2024-09-14T11:50:29.698490+0000","last_fullsized":"2024-09-14T11:50:29.698490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:46.261351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042041+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:49:29.042041+0000","last_peered":"2024-09-14T11:49:29.042041+0000","last_clean":"2024-09-14T11:49:29.042041+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:49:29.042041+0000","last_undegraded":"2024-09-14T11:49:29.042041+0000","last_fullsized":"2024-09-14T11:49:29.042041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922127+0000","last_change":"2024-09-14T11:27:43.843512+0000","last_active":"2024-09-14T11:49:23.922127+0000","last_peered":"2024-09-14T11:49:23.922127+0000","last_clean":"2024-09-14T11:49:23.922127+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:49:23.922127+0000","last_undegraded":"2024-09-14T11:49:23.922127+0000","last_fullsized":"2024-09-14T11:49:23.922127+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":4143,"num_write":12,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929860+0000","last_change":"2024-09-14T11:27:46.881654+0000","last_active":"2024-09-14T11:50:18.929860+0000","last_peered":"2024-09-14T11:50:18.929860+0000","last_clean":"2024-09-14T11:50:18.929860+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:50:18.929860+0000","last_undegraded":"2024-09-14T11:50:18.929860+0000","last_fullsized":"2024-09-14T11:50:18.929860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:09.752180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042090+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:49:29.042090+0000","last_peered":"2024-09-14T11:49:29.042090+0000","last_clean":"2024-09-14T11:49:29.042090+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:49:29.042090+0000","last_undegraded":"2024-09-14T11:49:29.042090+0000","last_fullsized":"2024-09-14T11:49:29.042090+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918260+0000","last_change":"2024-09-14T11:26:02.015867+0000","last_active":"2024-09-14T11:49:53.918260+0000","last_peered":"2024-09-14T11:49:53.918260+0000","last_clean":"2024-09-14T11:49:53.918260+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:49:53.918260+0000","last_undegraded":"2024-09-14T11:49:53.918260+0000","last_fullsized":"2024-09-14T11:49:53.918260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:45.729260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037984+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:48:59.037984+0000","last_peered":"2024-09-14T11:48:59.037984+0000","last_clean":"2024-09-14T11:48:59.037984+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:48:59.037984+0000","last_undegraded":"2024-09-14T11:48:59.037984+0000","last_fullsized":"2024-09-14T11:48:59.037984+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:52.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915712+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:48:43.915712+0000","last_peered":"2024-09-14T11:48:43.915712+0000","last_clean":"2024-09-14T11:48:43.915712+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:48:43.915712+0000","last_undegraded":"2024-09-14T11:48:43.915712+0000","last_fullsized":"2024-09-14T11:48:43.915712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052459+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:50:39.052459+0000","last_peered":"2024-09-14T11:50:39.052459+0000","last_clean":"2024-09-14T11:50:39.052459+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:50:39.052459+0000","last_undegraded":"2024-09-14T11:50:39.052459+0000","last_fullsized":"2024-09-14T11:50:39.052459+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10258,"num_write":6,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042361+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:48:59.042361+0000","last_peered":"2024-09-14T11:48:59.042361+0000","last_clean":"2024-09-14T11:48:59.042361+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:48:59.042361+0000","last_undegraded":"2024-09-14T11:48:59.042361+0000","last_fullsized":"2024-09-14T11:48:59.042361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:40.838198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914723+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:48:38.914723+0000","last_peered":"2024-09-14T11:48:38.914723+0000","last_clean":"2024-09-14T11:48:38.914723+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:48:38.914723+0000","last_undegraded":"2024-09-14T11:48:38.914723+0000","last_fullsized":"2024-09-14T11:48:38.914723+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036469+0000","last_change":"2024-09-14T11:27:43.842571+0000","last_active":"2024-09-14T11:50:39.036469+0000","last_peered":"2024-09-14T11:50:39.036469+0000","last_clean":"2024-09-14T11:50:39.036469+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:50:39.036469+0000","last_undegraded":"2024-09-14T11:50:39.036469+0000","last_fullsized":"2024-09-14T11:50:39.036469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:54.316859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137297,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":9,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918333+0000","last_change":"2024-09-14T11:26:02.017925+0000","last_active":"2024-09-14T11:49:53.918333+0000","last_peered":"2024-09-14T11:49:53.918333+0000","last_clean":"2024-09-14T11:49:53.918333+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:49:53.918333+0000","last_undegraded":"2024-09-14T11:49:53.918333+0000","last_fullsized":"2024-09-14T11:49:53.918333+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:08.536746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920684+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:49:23.920684+0000","last_peered":"2024-09-14T11:49:23.920684+0000","last_clean":"2024-09-14T11:49:23.920684+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:49:23.920684+0000","last_undegraded":"2024-09-14T11:49:23.920684+0000","last_fullsized":"2024-09-14T11:49:23.920684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:13.953562+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:49:13.953562+0000","last_peered":"2024-09-14T11:49:13.953562+0000","last_clean":"2024-09-14T11:49:13.953562+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:49:13.953562+0000","last_undegraded":"2024-09-14T11:49:13.953562+0000","last_fullsized":"2024-09-14T11:49:13.953562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:55.854911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.917107+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:48:58.917107+0000","last_peered":"2024-09-14T11:48:58.917107+0000","last_clean":"2024-09-14T11:48:58.917107+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:48:58.917107+0000","last_undegraded":"2024-09-14T11:48:58.917107+0000","last_fullsized":"2024-09-14T11:48:58.917107+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:10.571334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'1","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921390+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:49:28.921390+0000","last_peered":"2024-09-14T11:49:28.921390+0000","last_clean":"2024-09-14T11:49:28.921390+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:49:28.921390+0000","last_undegraded":"2024-09-14T11:49:28.921390+0000","last_fullsized":"2024-09-14T11:49:28.921390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041365+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:49:24.041365+0000","last_peered":"2024-09-14T11:49:24.041365+0000","last_clean":"2024-09-14T11:49:24.041365+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:49:24.041365+0000","last_undegraded":"2024-09-14T11:49:24.041365+0000","last_fullsized":"2024-09-14T11:49:24.041365+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918208+0000","last_change":"2024-09-14T11:26:02.017129+0000","last_active":"2024-09-14T11:48:58.918208+0000","last_peered":"2024-09-14T11:48:58.918208+0000","last_clean":"2024-09-14T11:48:58.918208+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:48:58.918208+0000","last_undegraded":"2024-09-14T11:48:58.918208+0000","last_fullsized":"2024-09-14T11:48:58.918208+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:31.419402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027265+0000","last_change":"2024-09-14T11:38:32.849590+0000","last_active":"2024-09-14T11:49:24.027265+0000","last_peered":"2024-09-14T11:49:24.027265+0000","last_clean":"2024-09-14T11:49:24.027265+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:49:24.027265+0000","last_undegraded":"2024-09-14T11:49:24.027265+0000","last_fullsized":"2024-09-14T11:49:24.027265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:47.728058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914584+0000","last_change":"2024-09-14T11:27:46.881829+0000","last_active":"2024-09-14T11:48:38.914584+0000","last_peered":"2024-09-14T11:48:38.914584+0000","last_clean":"2024-09-14T11:48:38.914584+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:48:38.914584+0000","last_undegraded":"2024-09-14T11:48:38.914584+0000","last_fullsized":"2024-09-14T11:48:38.914584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:28.272707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":8,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.043981+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:49:44.043981+0000","last_peered":"2024-09-14T11:49:44.043981+0000","last_clean":"2024-09-14T11:49:44.043981+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:49:44.043981+0000","last_undegraded":"2024-09-14T11:49:44.043981+0000","last_fullsized":"2024-09-14T11:49:44.043981+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042401+0000","last_change":"2024-09-14T11:26:02.004701+0000","last_active":"2024-09-14T11:48:59.042401+0000","last_peered":"2024-09-14T11:48:59.042401+0000","last_clean":"2024-09-14T11:48:59.042401+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:48:59.042401+0000","last_undegraded":"2024-09-14T11:48:59.042401+0000","last_fullsized":"2024-09-14T11:48:59.042401+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:25.708478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052376+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:50:39.052376+0000","last_peered":"2024-09-14T11:50:39.052376+0000","last_clean":"2024-09-14T11:50:39.052376+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:50:39.052376+0000","last_undegraded":"2024-09-14T11:50:39.052376+0000","last_fullsized":"2024-09-14T11:50:39.052376+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:32.268368+0000","last_change":"2024-09-14T11:26:02.017353+0000","last_active":"2024-09-14T11:49:32.268368+0000","last_peered":"2024-09-14T11:49:32.268368+0000","last_clean":"2024-09-14T11:49:32.268368+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:49:32.268368+0000","last_undegraded":"2024-09-14T11:49:32.268368+0000","last_fullsized":"2024-09-14T11:49:32.268368+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:27.288411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918234+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:48:58.918234+0000","last_peered":"2024-09-14T11:48:58.918234+0000","last_clean":"2024-09-14T11:48:58.918234+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:48:58.918234+0000","last_undegraded":"2024-09-14T11:48:58.918234+0000","last_fullsized":"2024-09-14T11:48:58.918234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:40.224008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908230+0000","last_change":"2024-09-14T11:27:46.880908+0000","last_active":"2024-09-14T11:48:38.908230+0000","last_peered":"2024-09-14T11:48:38.908230+0000","last_clean":"2024-09-14T11:48:38.908230+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:48:38.908230+0000","last_undegraded":"2024-09-14T11:48:38.908230+0000","last_fullsized":"2024-09-14T11:48:38.908230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:28.300991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932313+0000","last_change":"2024-09-14T11:27:43.841331+0000","last_active":"2024-09-14T11:50:38.932313+0000","last_peered":"2024-09-14T11:50:38.932313+0000","last_clean":"2024-09-14T11:50:38.932313+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:50:38.932313+0000","last_undegraded":"2024-09-14T11:50:38.932313+0000","last_fullsized":"2024-09-14T11:50:38.932313+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:03.837930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.911190+0000","last_change":"2024-09-14T11:26:02.017191+0000","last_active":"2024-09-14T11:48:58.911190+0000","last_peered":"2024-09-14T11:48:58.911190+0000","last_clean":"2024-09-14T11:48:58.911190+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:48:58.911190+0000","last_undegraded":"2024-09-14T11:48:58.911190+0000","last_fullsized":"2024-09-14T11:48:58.911190+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:53.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.038037+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:48:59.038037+0000","last_peered":"2024-09-14T11:48:59.038037+0000","last_clean":"2024-09-14T11:48:59.038037+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:48:59.038037+0000","last_undegraded":"2024-09-14T11:48:59.038037+0000","last_fullsized":"2024-09-14T11:48:59.038037+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:26.761199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914041+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:48:38.914041+0000","last_peered":"2024-09-14T11:48:38.914041+0000","last_clean":"2024-09-14T11:48:38.914041+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:48:38.914041+0000","last_undegraded":"2024-09-14T11:48:38.914041+0000","last_fullsized":"2024-09-14T11:48:38.914041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.924861+0000","last_change":"2024-09-14T11:27:43.841443+0000","last_active":"2024-09-14T11:50:38.924861+0000","last_peered":"2024-09-14T11:50:38.924861+0000","last_clean":"2024-09-14T11:50:38.924861+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:50:38.924861+0000","last_undegraded":"2024-09-14T11:50:38.924861+0000","last_fullsized":"2024-09-14T11:50:38.924861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10252,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.046775+0000","last_change":"2024-09-14T11:26:02.020510+0000","last_active":"2024-09-14T11:50:04.046775+0000","last_peered":"2024-09-14T11:50:04.046775+0000","last_clean":"2024-09-14T11:50:04.046775+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:50:04.046775+0000","last_undegraded":"2024-09-14T11:50:04.046775+0000","last_fullsized":"2024-09-14T11:50:04.046775+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'209","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052524+0000","last_change":"2024-09-14T11:11:04.667841+0000","last_active":"2024-09-14T11:50:39.052524+0000","last_peered":"2024-09-14T11:50:39.052524+0000","last_clean":"2024-09-14T11:50:39.052524+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:50:39.052524+0000","last_undegraded":"2024-09-14T11:50:39.052524+0000","last_fullsized":"2024-09-14T11:50:39.052524+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:30.918136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8431804,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":26846,"num_write":995,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1170","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.942831+0000","last_change":"2024-09-14T11:11:06.652913+0000","last_active":"2024-09-14T11:50:47.942831+0000","last_peered":"2024-09-14T11:50:47.942831+0000","last_clean":"2024-09-14T11:50:47.942831+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:50:47.942831+0000","last_undegraded":"2024-09-14T11:50:47.942831+0000","last_fullsized":"2024-09-14T11:50:47.942831+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:14.129052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'193","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932374+0000","last_change":"2024-09-14T11:11:04.654208+0000","last_active":"2024-09-14T11:50:38.932374+0000","last_peered":"2024-09-14T11:50:38.932374+0000","last_clean":"2024-09-14T11:50:38.932374+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:50:38.932374+0000","last_undegraded":"2024-09-14T11:50:38.932374+0000","last_fullsized":"2024-09-14T11:50:38.932374+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:33.758275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2139742,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":7476,"num_write":911,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'449","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.437450+0000","last_change":"2024-09-14T11:11:06.659297+0000","last_active":"2024-09-14T11:52:36.437450+0000","last_peered":"2024-09-14T11:52:36.437450+0000","last_clean":"2024-09-14T11:52:36.437450+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:52:36.437450+0000","last_undegraded":"2024-09-14T11:52:36.437450+0000","last_fullsized":"2024-09-14T11:52:36.437450+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:11.366968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'217","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932471+0000","last_change":"2024-09-14T11:11:04.651404+0000","last_active":"2024-09-14T11:50:38.932471+0000","last_peered":"2024-09-14T11:50:38.932471+0000","last_clean":"2024-09-14T11:50:38.932471+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:50:38.932471+0000","last_undegraded":"2024-09-14T11:50:38.932471+0000","last_fullsized":"2024-09-14T11:50:38.932471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:30.338647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8827718,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":593,"num_read_kb":30059,"num_write":1068,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'879","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892231+0000","last_change":"2024-09-14T11:11:06.647529+0000","last_active":"2024-09-14T11:51:03.892231+0000","last_peered":"2024-09-14T11:51:03.892231+0000","last_clean":"2024-09-14T11:51:03.892231+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:51:03.892231+0000","last_undegraded":"2024-09-14T11:51:03.892231+0000","last_fullsized":"2024-09-14T11:51:03.892231+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:50.451539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'211","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.160046+0000","last_change":"2024-09-14T11:11:04.655250+0000","last_active":"2024-09-14T11:50:56.160046+0000","last_peered":"2024-09-14T11:50:56.160046+0000","last_clean":"2024-09-14T11:50:56.160046+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:50:56.160046+0000","last_undegraded":"2024-09-14T11:50:56.160046+0000","last_fullsized":"2024-09-14T11:50:56.160046+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:56.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6603918,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":721,"num_read_kb":74662,"num_write":884,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'393","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884504+0000","last_change":"2024-09-14T11:11:06.651444+0000","last_active":"2024-09-14T11:51:07.884504+0000","last_peered":"2024-09-14T11:51:07.884504+0000","last_clean":"2024-09-14T11:51:07.884504+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:51:07.884504+0000","last_undegraded":"2024-09-14T11:51:07.884504+0000","last_fullsized":"2024-09-14T11:51:07.884504+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:10.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'240","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.369693+0000","last_change":"2024-09-14T11:11:04.668428+0000","last_active":"2024-09-14T11:51:06.369693+0000","last_peered":"2024-09-14T11:51:06.369693+0000","last_clean":"2024-09-14T11:51:06.369693+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:51:06.369693+0000","last_undegraded":"2024-09-14T11:51:06.369693+0000","last_fullsized":"2024-09-14T11:51:06.369693+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:29.887388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10515237,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":17405,"num_write":1112,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'821","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172559+0000","last_change":"2024-09-14T11:11:06.657319+0000","last_active":"2024-09-14T11:51:07.172559+0000","last_peered":"2024-09-14T11:51:07.172559+0000","last_clean":"2024-09-14T11:51:07.172559+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:51:07.172559+0000","last_undegraded":"2024-09-14T11:51:07.172559+0000","last_fullsized":"2024-09-14T11:51:07.172559+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:34.511950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'208","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.190600+0000","last_change":"2024-09-14T11:11:04.664423+0000","last_active":"2024-09-14T11:51:18.190600+0000","last_peered":"2024-09-14T11:51:18.190600+0000","last_clean":"2024-09-14T11:51:18.190600+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:51:18.190600+0000","last_undegraded":"2024-09-14T11:51:18.190600+0000","last_fullsized":"2024-09-14T11:51:18.190600+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.472044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18938362,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":70473,"num_write":971,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'495","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.163975+0000","last_change":"2024-09-14T11:11:06.646675+0000","last_active":"2024-09-14T11:51:07.163975+0000","last_peered":"2024-09-14T11:51:07.163975+0000","last_clean":"2024-09-14T11:51:07.163975+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:51:07.163975+0000","last_undegraded":"2024-09-14T11:51:07.163975+0000","last_fullsized":"2024-09-14T11:51:07.163975+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:56.132334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'220","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.200016+0000","last_change":"2024-09-14T11:11:04.667849+0000","last_active":"2024-09-14T11:50:43.200016+0000","last_peered":"2024-09-14T11:50:43.200016+0000","last_clean":"2024-09-14T11:50:43.200016+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:50:43.200016+0000","last_undegraded":"2024-09-14T11:50:43.200016+0000","last_fullsized":"2024-09-14T11:50:43.200016+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:54.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385564,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":10772,"num_write":1046,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'701","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.166203+0000","last_change":"2024-09-14T11:11:06.661372+0000","last_active":"2024-09-14T11:51:07.166203+0000","last_peered":"2024-09-14T11:51:07.166203+0000","last_clean":"2024-09-14T11:51:07.166203+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:51:07.166203+0000","last_undegraded":"2024-09-14T11:51:07.166203+0000","last_fullsized":"2024-09-14T11:51:07.166203+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:52.380188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'228","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:36.642723+0000","last_change":"2024-09-14T11:11:04.640592+0000","last_active":"2024-09-14T11:50:36.642723+0000","last_peered":"2024-09-14T11:50:36.642723+0000","last_clean":"2024-09-14T11:50:36.642723+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:50:36.642723+0000","last_undegraded":"2024-09-14T11:50:36.642723+0000","last_fullsized":"2024-09-14T11:50:36.642723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13670080,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1294,"num_read_kb":98345,"num_write":1089,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'780","reported_seq":2329,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.839282+0000","last_change":"2024-09-14T11:11:06.661394+0000","last_active":"2024-09-14T11:51:21.839282+0000","last_peered":"2024-09-14T11:51:21.839282+0000","last_clean":"2024-09-14T11:51:21.839282+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:51:21.839282+0000","last_undegraded":"2024-09-14T11:51:21.839282+0000","last_fullsized":"2024-09-14T11:51:21.839282+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'845","reported_seq":2375,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444047+0000","last_change":"2024-09-14T11:11:06.647432+0000","last_active":"2024-09-14T11:52:36.444047+0000","last_peered":"2024-09-14T11:52:36.444047+0000","last_clean":"2024-09-14T11:52:36.444047+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:52:36.444047+0000","last_undegraded":"2024-09-14T11:52:36.444047+0000","last_fullsized":"2024-09-14T11:52:36.444047+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:37.920539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'233","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044684+0000","last_change":"2024-09-14T11:11:04.664149+0000","last_active":"2024-09-14T11:49:49.044684+0000","last_peered":"2024-09-14T11:49:49.044684+0000","last_clean":"2024-09-14T11:49:49.044684+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:49:49.044684+0000","last_undegraded":"2024-09-14T11:49:49.044684+0000","last_fullsized":"2024-09-14T11:49:49.044684+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:28.501517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213754,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":29179,"num_write":1116,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884906+0000","last_change":"2024-09-14T11:11:06.659339+0000","last_active":"2024-09-14T11:51:07.884906+0000","last_peered":"2024-09-14T11:51:07.884906+0000","last_clean":"2024-09-14T11:51:07.884906+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:51:07.884906+0000","last_undegraded":"2024-09-14T11:51:07.884906+0000","last_fullsized":"2024-09-14T11:51:07.884906+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:19.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'226","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.473221+0000","last_change":"2024-09-14T11:11:04.664561+0000","last_active":"2024-09-14T11:50:28.473221+0000","last_peered":"2024-09-14T11:50:28.473221+0000","last_clean":"2024-09-14T11:50:28.473221+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:50:28.473221+0000","last_undegraded":"2024-09-14T11:50:28.473221+0000","last_fullsized":"2024-09-14T11:50:28.473221+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.906199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13997357,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":811,"num_read_kb":241766,"num_write":931,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'516","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.877314+0000","last_change":"2024-09-14T11:11:06.656279+0000","last_active":"2024-09-14T11:51:07.877314+0000","last_peered":"2024-09-14T11:51:07.877314+0000","last_clean":"2024-09-14T11:51:07.877314+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:51:07.877314+0000","last_undegraded":"2024-09-14T11:51:07.877314+0000","last_fullsized":"2024-09-14T11:51:07.877314+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:24.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'264","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.379755+0000","last_change":"2024-09-14T11:11:04.661546+0000","last_active":"2024-09-14T11:50:29.379755+0000","last_peered":"2024-09-14T11:50:29.379755+0000","last_clean":"2024-09-14T11:50:29.379755+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:50:29.379755+0000","last_undegraded":"2024-09-14T11:50:29.379755+0000","last_fullsized":"2024-09-14T11:50:29.379755+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:24.019669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116413,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":32322,"num_write":1000,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'857","reported_seq":2392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316678+0000","last_change":"2024-09-14T11:11:06.659835+0000","last_active":"2024-09-14T11:51:21.316678+0000","last_peered":"2024-09-14T11:51:21.316678+0000","last_clean":"2024-09-14T11:51:21.316678+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:51:21.316678+0000","last_undegraded":"2024-09-14T11:51:21.316678+0000","last_fullsized":"2024-09-14T11:51:21.316678+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.436038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'229","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.321356+0000","last_change":"2024-09-14T11:11:04.651670+0000","last_active":"2024-09-14T11:51:18.321356+0000","last_peered":"2024-09-14T11:51:18.321356+0000","last_clean":"2024-09-14T11:51:18.321356+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:51:18.321356+0000","last_undegraded":"2024-09-14T11:51:18.321356+0000","last_fullsized":"2024-09-14T11:51:18.321356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:12.731774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747755,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":708,"num_read_kb":18423,"num_write":1031,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1027","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746607+0000","last_change":"2024-09-14T11:11:06.659366+0000","last_active":"2024-09-14T11:51:08.746607+0000","last_peered":"2024-09-14T11:51:08.746607+0000","last_clean":"2024-09-14T11:51:08.746607+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:51:08.746607+0000","last_undegraded":"2024-09-14T11:51:08.746607+0000","last_fullsized":"2024-09-14T11:51:08.746607+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:22.893626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'206","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.383060+0000","last_change":"2024-09-14T11:11:04.656617+0000","last_active":"2024-09-14T11:51:01.383060+0000","last_peered":"2024-09-14T11:51:01.383060+0000","last_clean":"2024-09-14T11:51:01.383060+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:51:01.383060+0000","last_undegraded":"2024-09-14T11:51:01.383060+0000","last_fullsized":"2024-09-14T11:51:01.383060+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242894,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":19801,"num_write":943,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'477","reported_seq":2041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172995+0000","last_change":"2024-09-14T11:11:06.651961+0000","last_active":"2024-09-14T11:51:07.172995+0000","last_peered":"2024-09-14T11:51:07.172995+0000","last_clean":"2024-09-14T11:51:07.172995+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:51:07.172995+0000","last_undegraded":"2024-09-14T11:51:07.172995+0000","last_fullsized":"2024-09-14T11:51:07.172995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:22.258915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'228","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:41.967486+0000","last_change":"2024-09-14T11:11:04.655697+0000","last_active":"2024-09-14T11:50:41.967486+0000","last_peered":"2024-09-14T11:50:41.967486+0000","last_clean":"2024-09-14T11:50:41.967486+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:50:41.967486+0000","last_undegraded":"2024-09-14T11:50:41.967486+0000","last_fullsized":"2024-09-14T11:50:41.967486+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:15.626721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512993,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1263,"num_read_kb":11303,"num_write":1120,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'134","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.905769+0000","last_change":"2024-09-14T11:11:14.694441+0000","last_active":"2024-09-14T11:51:21.905769+0000","last_peered":"2024-09-14T11:51:21.905769+0000","last_clean":"2024-09-14T11:51:21.905769+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:51:21.905769+0000","last_undegraded":"2024-09-14T11:51:21.905769+0000","last_fullsized":"2024-09-14T11:51:21.905769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:00.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'942","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.164829+0000","last_change":"2024-09-14T11:11:06.652516+0000","last_active":"2024-09-14T11:51:07.164829+0000","last_peered":"2024-09-14T11:51:07.164829+0000","last_clean":"2024-09-14T11:51:07.164829+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:51:07.164829+0000","last_undegraded":"2024-09-14T11:51:07.164829+0000","last_fullsized":"2024-09-14T11:51:07.164829+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":900,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:57.934785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'231","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:46.126009+0000","last_change":"2024-09-14T11:11:04.656642+0000","last_active":"2024-09-14T11:50:46.126009+0000","last_peered":"2024-09-14T11:50:46.126009+0000","last_clean":"2024-09-14T11:50:46.126009+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:50:46.126009+0000","last_undegraded":"2024-09-14T11:50:46.126009+0000","last_fullsized":"2024-09-14T11:50:46.126009+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:50.939065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":730,"num_read_kb":7795,"num_write":1211,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.266018+0000","last_change":"2024-09-14T11:11:08.656138+0000","last_active":"2024-09-14T11:52:37.266018+0000","last_peered":"2024-09-14T11:52:37.266018+0000","last_clean":"2024-09-14T11:52:37.266018+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:52:37.266018+0000","last_undegraded":"2024-09-14T11:52:37.266018+0000","last_fullsized":"2024-09-14T11:52:37.266018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:46.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'187","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945861+0000","last_change":"2024-09-14T11:11:10.669375+0000","last_active":"2024-09-14T11:52:18.945861+0000","last_peered":"2024-09-14T11:52:18.945861+0000","last_clean":"2024-09-14T11:52:18.945861+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:52:18.945861+0000","last_undegraded":"2024-09-14T11:52:18.945861+0000","last_fullsized":"2024-09-14T11:52:18.945861+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:40.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19747,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":326,"num_write":148,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045436+0000","last_change":"2024-09-14T11:11:12.678656+0000","last_active":"2024-09-14T11:49:54.045436+0000","last_peered":"2024-09-14T11:49:54.045436+0000","last_clean":"2024-09-14T11:49:54.045436+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:49:54.045436+0000","last_undegraded":"2024-09-14T11:49:54.045436+0000","last_fullsized":"2024-09-14T11:49:54.045436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:17.903974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2494","reported_seq":4314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.904000+0000","last_change":"2024-09-14T11:11:14.691811+0000","last_active":"2024-09-14T11:51:21.904000+0000","last_peered":"2024-09-14T11:51:21.904000+0000","last_clean":"2024-09-14T11:51:21.904000+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:51:21.904000+0000","last_undegraded":"2024-09-14T11:51:21.904000+0000","last_fullsized":"2024-09-14T11:51:21.904000+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.391799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'506","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845475+0000","last_change":"2024-09-14T11:11:06.653951+0000","last_active":"2024-09-14T11:51:21.845475+0000","last_peered":"2024-09-14T11:51:21.845475+0000","last_clean":"2024-09-14T11:51:21.845475+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:51:21.845475+0000","last_undegraded":"2024-09-14T11:51:21.845475+0000","last_fullsized":"2024-09-14T11:51:21.845475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:23.277940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'187","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.054338+0000","last_change":"2024-09-14T11:11:04.658016+0000","last_active":"2024-09-14T11:51:03.054338+0000","last_peered":"2024-09-14T11:51:03.054338+0000","last_clean":"2024-09-14T11:51:03.054338+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:51:03.054338+0000","last_undegraded":"2024-09-14T11:51:03.054338+0000","last_fullsized":"2024-09-14T11:51:03.054338+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.325176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075352,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":11633,"num_write":912,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915492+0000","last_change":"2024-09-14T11:11:08.651536+0000","last_active":"2024-09-14T11:48:38.915492+0000","last_peered":"2024-09-14T11:48:38.915492+0000","last_clean":"2024-09-14T11:48:38.915492+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:48:38.915492+0000","last_undegraded":"2024-09-14T11:48:38.915492+0000","last_fullsized":"2024-09-14T11:48:38.915492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:53.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'91","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.281938+0000","last_change":"2024-09-14T11:11:10.665667+0000","last_active":"2024-09-14T11:51:19.281938+0000","last_peered":"2024-09-14T11:51:19.281938+0000","last_clean":"2024-09-14T11:51:19.281938+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:51:19.281938+0000","last_undegraded":"2024-09-14T11:51:19.281938+0000","last_fullsized":"2024-09-14T11:51:19.281938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924491+0000","last_change":"2024-09-14T11:11:12.680761+0000","last_active":"2024-09-14T11:49:53.924491+0000","last_peered":"2024-09-14T11:49:53.924491+0000","last_clean":"2024-09-14T11:49:53.924491+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:49:53.924491+0000","last_undegraded":"2024-09-14T11:49:53.924491+0000","last_fullsized":"2024-09-14T11:49:53.924491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:43.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'123","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.339329+0000","last_change":"2024-09-14T11:11:14.689043+0000","last_active":"2024-09-14T11:50:55.339329+0000","last_peered":"2024-09-14T11:50:55.339329+0000","last_clean":"2024-09-14T11:50:55.339329+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:50:55.339329+0000","last_undegraded":"2024-09-14T11:50:55.339329+0000","last_fullsized":"2024-09-14T11:50:55.339329+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:04.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845324+0000","last_change":"2024-09-14T11:11:06.647241+0000","last_active":"2024-09-14T11:51:21.845324+0000","last_peered":"2024-09-14T11:51:21.845324+0000","last_clean":"2024-09-14T11:51:21.845324+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:51:21.845324+0000","last_undegraded":"2024-09-14T11:51:21.845324+0000","last_fullsized":"2024-09-14T11:51:21.845324+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'181","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:51.690075+0000","last_change":"2024-09-14T11:11:04.664751+0000","last_active":"2024-09-14T11:49:51.690075+0000","last_peered":"2024-09-14T11:49:51.690075+0000","last_clean":"2024-09-14T11:49:51.690075+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:49:51.690075+0000","last_undegraded":"2024-09-14T11:49:51.690075+0000","last_fullsized":"2024-09-14T11:49:51.690075+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.450319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5390582,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":25054,"num_write":823,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925536+0000","last_change":"2024-09-14T11:11:08.651600+0000","last_active":"2024-09-14T11:49:48.925536+0000","last_peered":"2024-09-14T11:49:48.925536+0000","last_clean":"2024-09-14T11:49:48.925536+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:49:48.925536+0000","last_undegraded":"2024-09-14T11:49:48.925536+0000","last_fullsized":"2024-09-14T11:49:48.925536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.328934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'113","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.299521+0000","last_change":"2024-09-14T11:11:10.667489+0000","last_active":"2024-09-14T11:51:19.299521+0000","last_peered":"2024-09-14T11:51:19.299521+0000","last_clean":"2024-09-14T11:51:19.299521+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:51:19.299521+0000","last_undegraded":"2024-09-14T11:51:19.299521+0000","last_fullsized":"2024-09-14T11:51:19.299521+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:08.313976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.559155+0000","last_change":"2024-09-14T11:11:12.682478+0000","last_active":"2024-09-14T11:52:37.559155+0000","last_peered":"2024-09-14T11:52:37.559155+0000","last_clean":"2024-09-14T11:52:37.559155+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:52:37.559155+0000","last_undegraded":"2024-09-14T11:52:37.559155+0000","last_fullsized":"2024-09-14T11:52:37.559155+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:25.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'257","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.373071+0000","last_change":"2024-09-14T11:11:14.886604+0000","last_active":"2024-09-14T11:51:21.373071+0000","last_peered":"2024-09-14T11:51:21.373071+0000","last_clean":"2024-09-14T11:51:21.373071+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:51:21.373071+0000","last_undegraded":"2024-09-14T11:51:21.373071+0000","last_fullsized":"2024-09-14T11:51:21.373071+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:17.055065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'608","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845477+0000","last_change":"2024-09-14T11:11:06.655177+0000","last_active":"2024-09-14T11:51:21.845477+0000","last_peered":"2024-09-14T11:51:21.845477+0000","last_clean":"2024-09-14T11:51:21.845477+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:51:21.845477+0000","last_undegraded":"2024-09-14T11:51:21.845477+0000","last_fullsized":"2024-09-14T11:51:21.845477+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.592691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'252","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.034403+0000","last_change":"2024-09-14T11:11:04.660596+0000","last_active":"2024-09-14T11:50:59.034403+0000","last_peered":"2024-09-14T11:50:59.034403+0000","last_clean":"2024-09-14T11:50:59.034403+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:50:59.034403+0000","last_undegraded":"2024-09-14T11:50:59.034403+0000","last_fullsized":"2024-09-14T11:50:59.034403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:08.025245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305578,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1218,"num_read_kb":9329,"num_write":1108,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.924083+0000","last_change":"2024-09-14T11:11:08.658911+0000","last_active":"2024-09-14T11:49:48.924083+0000","last_peered":"2024-09-14T11:49:48.924083+0000","last_clean":"2024-09-14T11:49:48.924083+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:49:48.924083+0000","last_undegraded":"2024-09-14T11:49:48.924083+0000","last_fullsized":"2024-09-14T11:49:48.924083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:43.590217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'112","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.068059+0000","last_change":"2024-09-14T11:11:10.883531+0000","last_active":"2024-09-14T11:52:19.068059+0000","last_peered":"2024-09-14T11:52:19.068059+0000","last_clean":"2024-09-14T11:52:19.068059+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:52:19.068059+0000","last_undegraded":"2024-09-14T11:52:19.068059+0000","last_fullsized":"2024-09-14T11:52:19.068059+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:37.652994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":149,"num_read_kb":192,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'816","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.563054+0000","last_change":"2024-09-14T11:11:12.683537+0000","last_active":"2024-09-14T11:52:37.563054+0000","last_peered":"2024-09-14T11:52:37.563054+0000","last_clean":"2024-09-14T11:52:37.563054+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:52:37.563054+0000","last_undegraded":"2024-09-14T11:52:37.563054+0000","last_fullsized":"2024-09-14T11:52:37.563054+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:38.308562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'475","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316625+0000","last_change":"2024-09-14T11:11:06.651830+0000","last_active":"2024-09-14T11:51:21.316625+0000","last_peered":"2024-09-14T11:51:21.316625+0000","last_clean":"2024-09-14T11:51:21.316625+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:51:21.316625+0000","last_undegraded":"2024-09-14T11:51:21.316625+0000","last_fullsized":"2024-09-14T11:51:21.316625+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:55.868674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'218","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.175726+0000","last_change":"2024-09-14T11:11:04.665193+0000","last_active":"2024-09-14T11:50:54.175726+0000","last_peered":"2024-09-14T11:50:54.175726+0000","last_clean":"2024-09-14T11:50:54.175726+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:50:54.175726+0000","last_undegraded":"2024-09-14T11:50:54.175726+0000","last_fullsized":"2024-09-14T11:50:54.175726+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:01.335563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10562869,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":75141,"num_write":983,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.047547+0000","last_change":"2024-09-14T11:11:08.659594+0000","last_active":"2024-09-14T11:50:09.047547+0000","last_peered":"2024-09-14T11:50:09.047547+0000","last_clean":"2024-09-14T11:50:09.047547+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:50:09.047547+0000","last_undegraded":"2024-09-14T11:50:09.047547+0000","last_fullsized":"2024-09-14T11:50:09.047547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:14.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'199","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.947343+0000","last_change":"2024-09-14T11:11:10.883185+0000","last_active":"2024-09-14T11:52:33.947343+0000","last_peered":"2024-09-14T11:52:33.947343+0000","last_clean":"2024-09-14T11:52:33.947343+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:52:33.947343+0000","last_undegraded":"2024-09-14T11:52:33.947343+0000","last_fullsized":"2024-09-14T11:52:33.947343+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:41.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14491,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":272,"num_read_kb":340,"num_write":158,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922914+0000","last_change":"2024-09-14T11:11:12.678507+0000","last_active":"2024-09-14T11:49:28.922914+0000","last_peered":"2024-09-14T11:49:28.922914+0000","last_clean":"2024-09-14T11:49:28.922914+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:49:28.922914+0000","last_undegraded":"2024-09-14T11:49:28.922914+0000","last_fullsized":"2024-09-14T11:49:28.922914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:11.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'544","reported_seq":1345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546676+0000","last_change":"2024-09-14T11:11:14.691810+0000","last_active":"2024-09-14T11:52:37.546676+0000","last_peered":"2024-09-14T11:52:37.546676+0000","last_clean":"2024-09-14T11:52:37.546676+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:52:37.546676+0000","last_undegraded":"2024-09-14T11:52:37.546676+0000","last_fullsized":"2024-09-14T11:52:37.546676+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:33.081563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892238+0000","last_change":"2024-09-14T11:11:06.650970+0000","last_active":"2024-09-14T11:51:03.892238+0000","last_peered":"2024-09-14T11:51:03.892238+0000","last_clean":"2024-09-14T11:51:03.892238+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:51:03.892238+0000","last_undegraded":"2024-09-14T11:51:03.892238+0000","last_fullsized":"2024-09-14T11:51:03.892238+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:08.200982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'221","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.223936+0000","last_change":"2024-09-14T11:11:04.653785+0000","last_active":"2024-09-14T11:52:32.223936+0000","last_peered":"2024-09-14T11:52:32.223936+0000","last_clean":"2024-09-14T11:52:32.223936+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:32.223936+0000","last_undegraded":"2024-09-14T11:52:32.223936+0000","last_fullsized":"2024-09-14T11:52:32.223936+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:13.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272073,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":64064,"num_write":1009,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032486+0000","last_change":"2024-09-14T11:11:08.650799+0000","last_active":"2024-09-14T11:50:09.032486+0000","last_peered":"2024-09-14T11:50:09.032486+0000","last_clean":"2024-09-14T11:50:09.032486+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:50:09.032486+0000","last_undegraded":"2024-09-14T11:50:09.032486+0000","last_fullsized":"2024-09-14T11:50:09.032486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:34.338293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'134","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.941199+0000","last_change":"2024-09-14T11:11:10.669181+0000","last_active":"2024-09-14T11:51:43.941199+0000","last_peered":"2024-09-14T11:51:43.941199+0000","last_clean":"2024-09-14T11:51:43.941199+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:51:43.941199+0000","last_undegraded":"2024-09-14T11:51:43.941199+0000","last_fullsized":"2024-09-14T11:51:43.941199+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:51.810244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":196,"num_write":80,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930561+0000","last_change":"2024-09-14T11:11:12.677186+0000","last_active":"2024-09-14T11:50:23.930561+0000","last_peered":"2024-09-14T11:50:23.930561+0000","last_clean":"2024-09-14T11:50:23.930561+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:50:23.930561+0000","last_undegraded":"2024-09-14T11:50:23.930561+0000","last_fullsized":"2024-09-14T11:50:23.930561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:15.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'120","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217471+0000","last_change":"2024-09-14T11:11:14.693436+0000","last_active":"2024-09-14T11:51:19.217471+0000","last_peered":"2024-09-14T11:51:19.217471+0000","last_clean":"2024-09-14T11:51:19.217471+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:51:19.217471+0000","last_undegraded":"2024-09-14T11:51:19.217471+0000","last_fullsized":"2024-09-14T11:51:19.217471+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:36.190584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'378","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220246+0000","last_change":"2024-09-14T11:11:06.660214+0000","last_active":"2024-09-14T11:51:19.220246+0000","last_peered":"2024-09-14T11:51:19.220246+0000","last_clean":"2024-09-14T11:51:19.220246+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:51:19.220246+0000","last_undegraded":"2024-09-14T11:51:19.220246+0000","last_fullsized":"2024-09-14T11:51:19.220246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:34.858894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'210","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.434739+0000","last_change":"2024-09-14T11:11:04.668094+0000","last_active":"2024-09-14T11:50:30.434739+0000","last_peered":"2024-09-14T11:50:30.434739+0000","last_clean":"2024-09-14T11:50:30.434739+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:50:30.434739+0000","last_undegraded":"2024-09-14T11:50:30.434739+0000","last_fullsized":"2024-09-14T11:50:30.434739+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:01.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11916459,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":527,"num_read_kb":106187,"num_write":922,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027228+0000","last_change":"2024-09-14T11:11:08.655858+0000","last_active":"2024-09-14T11:49:24.027228+0000","last_peered":"2024-09-14T11:49:24.027228+0000","last_clean":"2024-09-14T11:49:24.027228+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:49:24.027228+0000","last_undegraded":"2024-09-14T11:49:24.027228+0000","last_fullsized":"2024-09-14T11:49:24.027228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.623644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'155","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.068936+0000","last_change":"2024-09-14T11:11:10.670978+0000","last_active":"2024-09-14T11:52:24.068936+0000","last_peered":"2024-09-14T11:52:24.068936+0000","last_clean":"2024-09-14T11:52:24.068936+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:52:24.068936+0000","last_undegraded":"2024-09-14T11:52:24.068936+0000","last_fullsized":"2024-09-14T11:52:24.068936+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:50.765426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13443,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":191,"num_read_kb":234,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'771","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.564067+0000","last_change":"2024-09-14T11:11:12.682806+0000","last_active":"2024-09-14T11:52:37.564067+0000","last_peered":"2024-09-14T11:52:37.564067+0000","last_clean":"2024-09-14T11:52:37.564067+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:52:37.564067+0000","last_undegraded":"2024-09-14T11:52:37.564067+0000","last_fullsized":"2024-09-14T11:52:37.564067+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:25.160041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.385498+0000","last_change":"2024-09-14T11:11:14.691211+0000","last_active":"2024-09-14T11:52:36.385498+0000","last_peered":"2024-09-14T11:52:36.385498+0000","last_clean":"2024-09-14T11:52:36.385498+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:52:36.385498+0000","last_undegraded":"2024-09-14T11:52:36.385498+0000","last_fullsized":"2024-09-14T11:52:36.385498+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:53.737487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'567","reported_seq":2331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746198+0000","last_change":"2024-09-14T11:11:06.650873+0000","last_active":"2024-09-14T11:51:08.746198+0000","last_peered":"2024-09-14T11:51:08.746198+0000","last_clean":"2024-09-14T11:51:08.746198+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:51:08.746198+0000","last_undegraded":"2024-09-14T11:51:08.746198+0000","last_fullsized":"2024-09-14T11:51:08.746198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:08.434480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'196","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.339362+0000","last_change":"2024-09-14T11:11:04.660578+0000","last_active":"2024-09-14T11:51:18.339362+0000","last_peered":"2024-09-14T11:51:18.339362+0000","last_clean":"2024-09-14T11:51:18.339362+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:51:18.339362+0000","last_undegraded":"2024-09-14T11:51:18.339362+0000","last_fullsized":"2024-09-14T11:51:18.339362+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:17.074637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19961458,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":448,"num_read_kb":32213,"num_write":864,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033264+0000","last_change":"2024-09-14T11:11:08.657835+0000","last_active":"2024-09-14T11:50:14.033264+0000","last_peered":"2024-09-14T11:50:14.033264+0000","last_clean":"2024-09-14T11:50:14.033264+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:50:14.033264+0000","last_undegraded":"2024-09-14T11:50:14.033264+0000","last_fullsized":"2024-09-14T11:50:14.033264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:05.975239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.513319+0000","last_change":"2024-09-14T11:11:10.668579+0000","last_active":"2024-09-14T11:52:37.513319+0000","last_peered":"2024-09-14T11:52:37.513319+0000","last_clean":"2024-09-14T11:52:37.513319+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:52:37.513319+0000","last_undegraded":"2024-09-14T11:52:37.513319+0000","last_fullsized":"2024-09-14T11:52:37.513319+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:33.675356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":342,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033234+0000","last_change":"2024-09-14T11:11:12.682825+0000","last_active":"2024-09-14T11:50:14.033234+0000","last_peered":"2024-09-14T11:50:14.033234+0000","last_clean":"2024-09-14T11:50:14.033234+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:50:14.033234+0000","last_undegraded":"2024-09-14T11:50:14.033234+0000","last_fullsized":"2024-09-14T11:50:14.033234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.085965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'136","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.046297+0000","last_change":"2024-09-14T11:11:14.694759+0000","last_active":"2024-09-14T11:51:20.046297+0000","last_peered":"2024-09-14T11:51:20.046297+0000","last_clean":"2024-09-14T11:51:20.046297+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:51:20.046297+0000","last_undegraded":"2024-09-14T11:51:20.046297+0000","last_fullsized":"2024-09-14T11:51:20.046297+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:34.568185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'810","reported_seq":2363,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892524+0000","last_change":"2024-09-14T11:11:06.652129+0000","last_active":"2024-09-14T11:51:03.892524+0000","last_peered":"2024-09-14T11:51:03.892524+0000","last_clean":"2024-09-14T11:51:03.892524+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:51:03.892524+0000","last_undegraded":"2024-09-14T11:51:03.892524+0000","last_fullsized":"2024-09-14T11:51:03.892524+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.890024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'183","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.874736+0000","last_change":"2024-09-14T11:11:37.865182+0000","last_active":"2024-09-14T11:50:56.874736+0000","last_peered":"2024-09-14T11:50:56.874736+0000","last_clean":"2024-09-14T11:50:56.874736+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:50:56.874736+0000","last_undegraded":"2024-09-14T11:50:56.874736+0000","last_fullsized":"2024-09-14T11:50:56.874736+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:29.726878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623312,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":54806,"num_write":888,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027253+0000","last_change":"2024-09-14T11:11:08.653918+0000","last_active":"2024-09-14T11:49:24.027253+0000","last_peered":"2024-09-14T11:49:24.027253+0000","last_clean":"2024-09-14T11:49:24.027253+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:49:24.027253+0000","last_undegraded":"2024-09-14T11:49:24.027253+0000","last_fullsized":"2024-09-14T11:49:24.027253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:12.531488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'134","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.939981+0000","last_change":"2024-09-14T11:11:10.665945+0000","last_active":"2024-09-14T11:51:43.939981+0000","last_peered":"2024-09-14T11:51:43.939981+0000","last_clean":"2024-09-14T11:51:43.939981+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:51:43.939981+0000","last_undegraded":"2024-09-14T11:51:43.939981+0000","last_fullsized":"2024-09-14T11:51:43.939981+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8529,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":213,"num_write":158,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.924548+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:49:38.924548+0000","last_peered":"2024-09-14T11:49:38.924548+0000","last_clean":"2024-09-14T11:49:38.924548+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:49:38.924548+0000","last_undegraded":"2024-09-14T11:49:38.924548+0000","last_fullsized":"2024-09-14T11:49:38.924548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:21.465336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938149+0000","last_change":"2024-09-14T11:11:14.690952+0000","last_active":"2024-09-14T11:51:23.938149+0000","last_peered":"2024-09-14T11:51:23.938149+0000","last_clean":"2024-09-14T11:51:23.938149+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:51:23.938149+0000","last_undegraded":"2024-09-14T11:51:23.938149+0000","last_fullsized":"2024-09-14T11:51:23.938149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:31.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'616","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444129+0000","last_change":"2024-09-14T11:11:06.651982+0000","last_active":"2024-09-14T11:52:36.444129+0000","last_peered":"2024-09-14T11:52:36.444129+0000","last_clean":"2024-09-14T11:52:36.444129+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:36.444129+0000","last_undegraded":"2024-09-14T11:52:36.444129+0000","last_fullsized":"2024-09-14T11:52:36.444129+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:10.685569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'216","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.024934+0000","last_change":"2024-09-14T11:11:37.866224+0000","last_active":"2024-09-14T11:50:17.024934+0000","last_peered":"2024-09-14T11:50:17.024934+0000","last_clean":"2024-09-14T11:50:17.024934+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:50:17.024934+0000","last_undegraded":"2024-09-14T11:50:17.024934+0000","last_fullsized":"2024-09-14T11:50:17.024934+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:52.787000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102567,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1165,"num_read_kb":81327,"num_write":1107,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922198+0000","last_change":"2024-09-14T11:11:08.657858+0000","last_active":"2024-09-14T11:49:23.922198+0000","last_peered":"2024-09-14T11:49:23.922198+0000","last_clean":"2024-09-14T11:49:23.922198+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:49:23.922198+0000","last_undegraded":"2024-09-14T11:49:23.922198+0000","last_fullsized":"2024-09-14T11:49:23.922198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:46.337725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'185","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.045239+0000","last_change":"2024-09-14T11:11:10.669699+0000","last_active":"2024-09-14T11:51:49.045239+0000","last_peered":"2024-09-14T11:51:49.045239+0000","last_clean":"2024-09-14T11:51:49.045239+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:51:49.045239+0000","last_undegraded":"2024-09-14T11:51:49.045239+0000","last_fullsized":"2024-09-14T11:51:49.045239+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:05.013360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10070,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":240,"num_write":126,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.560250+0000","last_change":"2024-09-14T11:11:12.680262+0000","last_active":"2024-09-14T11:52:37.560250+0000","last_peered":"2024-09-14T11:52:37.560250+0000","last_clean":"2024-09-14T11:52:37.560250+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:52:37.560250+0000","last_undegraded":"2024-09-14T11:52:37.560250+0000","last_fullsized":"2024-09-14T11:52:37.560250+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:15.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'112","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.672032+0000","last_change":"2024-09-14T11:11:14.694188+0000","last_active":"2024-09-14T11:51:21.672032+0000","last_peered":"2024-09-14T11:51:21.672032+0000","last_clean":"2024-09-14T11:51:21.672032+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:51:21.672032+0000","last_undegraded":"2024-09-14T11:51:21.672032+0000","last_fullsized":"2024-09-14T11:51:21.672032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:45.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438948+0000","last_change":"2024-09-14T11:11:06.655465+0000","last_active":"2024-09-14T11:52:36.438948+0000","last_peered":"2024-09-14T11:52:36.438948+0000","last_clean":"2024-09-14T11:52:36.438948+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:52:36.438948+0000","last_undegraded":"2024-09-14T11:52:36.438948+0000","last_fullsized":"2024-09-14T11:52:36.438948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:40.046089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'211","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.828145+0000","last_change":"2024-09-14T11:11:04.650554+0000","last_active":"2024-09-14T11:51:03.828145+0000","last_peered":"2024-09-14T11:51:03.828145+0000","last_clean":"2024-09-14T11:51:03.828145+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:51:03.828145+0000","last_undegraded":"2024-09-14T11:51:03.828145+0000","last_fullsized":"2024-09-14T11:51:03.828145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:21.487349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159355,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":779,"num_read_kb":15229,"num_write":1051,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.278236+0000","last_change":"2024-09-14T11:11:08.657746+0000","last_active":"2024-09-14T11:52:37.278236+0000","last_peered":"2024-09-14T11:52:37.278236+0000","last_clean":"2024-09-14T11:52:37.278236+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:52:37.278236+0000","last_undegraded":"2024-09-14T11:52:37.278236+0000","last_fullsized":"2024-09-14T11:52:37.278236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:46.646901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'65","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.268760+0000","last_change":"2024-09-14T11:11:10.883189+0000","last_active":"2024-09-14T11:51:19.268760+0000","last_peered":"2024-09-14T11:51:19.268760+0000","last_clean":"2024-09-14T11:51:19.268760+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:51:19.268760+0000","last_undegraded":"2024-09-14T11:51:19.268760+0000","last_fullsized":"2024-09-14T11:51:19.268760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:23.532287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'765","reported_seq":2415,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.561158+0000","last_change":"2024-09-14T11:11:12.682993+0000","last_active":"2024-09-14T11:52:37.561158+0000","last_peered":"2024-09-14T11:52:37.561158+0000","last_clean":"2024-09-14T11:52:37.561158+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:52:37.561158+0000","last_undegraded":"2024-09-14T11:52:37.561158+0000","last_fullsized":"2024-09-14T11:52:37.561158+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:56.550659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.800307+0000","last_change":"2024-09-14T11:11:14.697448+0000","last_active":"2024-09-14T11:50:57.800307+0000","last_peered":"2024-09-14T11:50:57.800307+0000","last_clean":"2024-09-14T11:50:57.800307+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:50:57.800307+0000","last_undegraded":"2024-09-14T11:50:57.800307+0000","last_fullsized":"2024-09-14T11:50:57.800307+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220492+0000","last_change":"2024-09-14T11:11:06.661084+0000","last_active":"2024-09-14T11:51:19.220492+0000","last_peered":"2024-09-14T11:51:19.220492+0000","last_clean":"2024-09-14T11:51:19.220492+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:51:19.220492+0000","last_undegraded":"2024-09-14T11:51:19.220492+0000","last_fullsized":"2024-09-14T11:51:19.220492+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:51.729421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'196","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.343430+0000","last_change":"2024-09-14T11:11:04.652428+0000","last_active":"2024-09-14T11:51:18.343430+0000","last_peered":"2024-09-14T11:51:18.343430+0000","last_clean":"2024-09-14T11:51:18.343430+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:51:18.343430+0000","last_undegraded":"2024-09-14T11:51:18.343430+0000","last_fullsized":"2024-09-14T11:51:18.343430+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:16.387464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13627420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":47606,"num_write":834,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920747+0000","last_change":"2024-09-14T11:11:08.651170+0000","last_active":"2024-09-14T11:49:23.920747+0000","last_peered":"2024-09-14T11:49:23.920747+0000","last_clean":"2024-09-14T11:49:23.920747+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:49:23.920747+0000","last_undegraded":"2024-09-14T11:49:23.920747+0000","last_fullsized":"2024-09-14T11:49:23.920747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'219","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:47.928636+0000","last_change":"2024-09-14T11:11:10.671679+0000","last_active":"2024-09-14T11:51:47.928636+0000","last_peered":"2024-09-14T11:51:47.928636+0000","last_clean":"2024-09-14T11:51:47.928636+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:51:47.928636+0000","last_undegraded":"2024-09-14T11:51:47.928636+0000","last_fullsized":"2024-09-14T11:51:47.928636+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":905,"num_read_kb":1011,"num_write":1432,"num_write_kb":1317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.915519+0000","last_change":"2024-09-14T11:11:12.685335+0000","last_active":"2024-09-14T11:49:28.915519+0000","last_peered":"2024-09-14T11:49:28.915519+0000","last_clean":"2024-09-14T11:49:28.915519+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:49:28.915519+0000","last_undegraded":"2024-09-14T11:49:28.915519+0000","last_fullsized":"2024-09-14T11:49:28.915519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:34.384085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'111","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.714149+0000","last_change":"2024-09-14T11:11:14.691254+0000","last_active":"2024-09-14T11:50:29.714149+0000","last_peered":"2024-09-14T11:50:29.714149+0000","last_clean":"2024-09-14T11:50:29.714149+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:50:29.714149+0000","last_undegraded":"2024-09-14T11:50:29.714149+0000","last_fullsized":"2024-09-14T11:50:29.714149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:56.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.216524+0000","last_change":"2024-09-14T11:11:06.652040+0000","last_active":"2024-09-14T11:51:02.216524+0000","last_peered":"2024-09-14T11:51:02.216524+0000","last_clean":"2024-09-14T11:51:02.216524+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:51:02.216524+0000","last_undegraded":"2024-09-14T11:51:02.216524+0000","last_fullsized":"2024-09-14T11:51:02.216524+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:46.498291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:54.037135+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:48:54.037135+0000","last_peered":"2024-09-14T11:48:54.037135+0000","last_clean":"2024-09-14T11:48:54.037135+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:48:54.037135+0000","last_undegraded":"2024-09-14T11:48:54.037135+0000","last_fullsized":"2024-09-14T11:48:54.037135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929313+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:50:28.929313+0000","last_peered":"2024-09-14T11:50:28.929313+0000","last_clean":"2024-09-14T11:50:28.929313+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:50:28.929313+0000","last_undegraded":"2024-09-14T11:50:28.929313+0000","last_fullsized":"2024-09-14T11:50:28.929313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.842569+0000","last_change":"2024-09-14T11:11:04.653542+0000","last_active":"2024-09-14T11:50:59.842569+0000","last_peered":"2024-09-14T11:50:59.842569+0000","last_clean":"2024-09-14T11:50:59.842569+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:50:59.842569+0000","last_undegraded":"2024-09-14T11:50:59.842569+0000","last_fullsized":"2024-09-14T11:50:59.842569+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.899497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294246,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1040,"num_read_kb":764,"num_write":1135,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034878+0000","last_change":"2024-09-14T11:11:08.651808+0000","last_active":"2024-09-14T11:48:39.034878+0000","last_peered":"2024-09-14T11:48:39.034878+0000","last_clean":"2024-09-14T11:48:39.034878+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:48:39.034878+0000","last_undegraded":"2024-09-14T11:48:39.034878+0000","last_fullsized":"2024-09-14T11:48:39.034878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:02.176317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'312","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.531968+0000","last_change":"2024-09-14T11:11:10.671108+0000","last_active":"2024-09-14T11:52:37.531968+0000","last_peered":"2024-09-14T11:52:37.531968+0000","last_clean":"2024-09-14T11:52:37.531968+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:52:37.531968+0000","last_undegraded":"2024-09-14T11:52:37.531968+0000","last_fullsized":"2024-09-14T11:52:37.531968+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:12.563174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138600,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":1025,"num_write":532,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929432+0000","last_change":"2024-09-14T11:11:12.679614+0000","last_active":"2024-09-14T11:50:13.929432+0000","last_peered":"2024-09-14T11:50:13.929432+0000","last_clean":"2024-09-14T11:50:13.929432+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:50:13.929432+0000","last_undegraded":"2024-09-14T11:50:13.929432+0000","last_fullsized":"2024-09-14T11:50:13.929432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:26.539650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'194","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.853045+0000","last_change":"2024-09-14T11:11:14.691705+0000","last_active":"2024-09-14T11:51:21.853045+0000","last_peered":"2024-09-14T11:51:21.853045+0000","last_clean":"2024-09-14T11:51:21.853045+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:51:21.853045+0000","last_undegraded":"2024-09-14T11:51:21.853045+0000","last_fullsized":"2024-09-14T11:51:21.853045+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:32.101457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'446","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316797+0000","last_change":"2024-09-14T11:11:06.653878+0000","last_active":"2024-09-14T11:51:21.316797+0000","last_peered":"2024-09-14T11:51:21.316797+0000","last_clean":"2024-09-14T11:51:21.316797+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:51:21.316797+0000","last_undegraded":"2024-09-14T11:51:21.316797+0000","last_fullsized":"2024-09-14T11:51:21.316797+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:53.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037939+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:48:59.037939+0000","last_peered":"2024-09-14T11:48:59.037939+0000","last_clean":"2024-09-14T11:48:59.037939+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:48:59.037939+0000","last_undegraded":"2024-09-14T11:48:59.037939+0000","last_fullsized":"2024-09-14T11:48:59.037939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'225","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:31.663831+0000","last_change":"2024-09-14T11:11:04.647226+0000","last_active":"2024-09-14T11:52:31.663831+0000","last_peered":"2024-09-14T11:52:31.663831+0000","last_clean":"2024-09-14T11:52:31.663831+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:31.663831+0000","last_undegraded":"2024-09-14T11:52:31.663831+0000","last_fullsized":"2024-09-14T11:52:31.663831+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:42.012243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437198,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":5636,"num_write":1045,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.926741+0000","last_change":"2024-09-14T11:11:08.653354+0000","last_active":"2024-09-14T11:50:08.926741+0000","last_peered":"2024-09-14T11:50:08.926741+0000","last_clean":"2024-09-14T11:50:08.926741+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:50:08.926741+0000","last_undegraded":"2024-09-14T11:50:08.926741+0000","last_fullsized":"2024-09-14T11:50:08.926741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:02.387161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'846","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.556076+0000","last_change":"2024-09-14T11:11:10.668218+0000","last_active":"2024-09-14T11:52:37.556076+0000","last_peered":"2024-09-14T11:52:37.556076+0000","last_clean":"2024-09-14T11:52:37.556076+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:52:37.556076+0000","last_undegraded":"2024-09-14T11:52:37.556076+0000","last_fullsized":"2024-09-14T11:52:37.556076+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:48.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34713,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1137,"num_read_kb":1303,"num_write":260,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:49.036418+0000","last_change":"2024-09-14T11:11:12.677600+0000","last_active":"2024-09-14T11:48:49.036418+0000","last_peered":"2024-09-14T11:48:49.036418+0000","last_clean":"2024-09-14T11:48:49.036418+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:48:49.036418+0000","last_undegraded":"2024-09-14T11:48:49.036418+0000","last_fullsized":"2024-09-14T11:48:49.036418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.483584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'130","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.325684+0000","last_change":"2024-09-14T11:11:14.883766+0000","last_active":"2024-09-14T11:51:21.325684+0000","last_peered":"2024-09-14T11:51:21.325684+0000","last_clean":"2024-09-14T11:51:21.325684+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:51:21.325684+0000","last_undegraded":"2024-09-14T11:51:21.325684+0000","last_fullsized":"2024-09-14T11:51:21.325684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:47.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'426","reported_seq":1905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179728+0000","last_change":"2024-09-14T11:11:06.661418+0000","last_active":"2024-09-14T11:51:05.179728+0000","last_peered":"2024-09-14T11:51:05.179728+0000","last_clean":"2024-09-14T11:51:05.179728+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:51:05.179728+0000","last_undegraded":"2024-09-14T11:51:05.179728+0000","last_fullsized":"2024-09-14T11:51:05.179728+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.916202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.035176+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:50:29.035176+0000","last_peered":"2024-09-14T11:50:29.035176+0000","last_clean":"2024-09-14T11:50:29.035176+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:50:29.035176+0000","last_undegraded":"2024-09-14T11:50:29.035176+0000","last_fullsized":"2024-09-14T11:50:29.035176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'202","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:45.647851+0000","last_change":"2024-09-14T11:11:04.650254+0000","last_active":"2024-09-14T11:50:45.647851+0000","last_peered":"2024-09-14T11:50:45.647851+0000","last_clean":"2024-09-14T11:50:45.647851+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:50:45.647851+0000","last_undegraded":"2024-09-14T11:50:45.647851+0000","last_fullsized":"2024-09-14T11:50:45.647851+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:24.467276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":697,"num_read_kb":52749,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032552+0000","last_change":"2024-09-14T11:11:08.653735+0000","last_active":"2024-09-14T11:50:09.032552+0000","last_peered":"2024-09-14T11:50:09.032552+0000","last_clean":"2024-09-14T11:50:09.032552+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:50:09.032552+0000","last_undegraded":"2024-09-14T11:50:09.032552+0000","last_fullsized":"2024-09-14T11:50:09.032552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:27.550107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'219","reported_seq":1256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.446104+0000","last_change":"2024-09-14T11:11:10.885665+0000","last_active":"2024-09-14T11:52:36.446104+0000","last_peered":"2024-09-14T11:52:36.446104+0000","last_clean":"2024-09-14T11:52:36.446104+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:52:36.446104+0000","last_undegraded":"2024-09-14T11:52:36.446104+0000","last_fullsized":"2024-09-14T11:52:36.446104+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:53.645745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915668+0000","last_change":"2024-09-14T11:11:12.679585+0000","last_active":"2024-09-14T11:48:43.915668+0000","last_peered":"2024-09-14T11:48:43.915668+0000","last_clean":"2024-09-14T11:48:43.915668+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:48:43.915668+0000","last_undegraded":"2024-09-14T11:48:43.915668+0000","last_fullsized":"2024-09-14T11:48:43.915668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:37.689890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'250","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.995575+0000","last_change":"2024-09-14T11:11:14.691912+0000","last_active":"2024-09-14T11:51:21.995575+0000","last_peered":"2024-09-14T11:51:21.995575+0000","last_clean":"2024-09-14T11:51:21.995575+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:51:21.995575+0000","last_undegraded":"2024-09-14T11:51:21.995575+0000","last_fullsized":"2024-09-14T11:51:21.995575+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:38.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'458","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.436141+0000","last_change":"2024-09-14T11:11:06.652932+0000","last_active":"2024-09-14T11:51:01.436141+0000","last_peered":"2024-09-14T11:51:01.436141+0000","last_clean":"2024-09-14T11:51:01.436141+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:51:01.436141+0000","last_undegraded":"2024-09-14T11:51:01.436141+0000","last_fullsized":"2024-09-14T11:51:01.436141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:11.789080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929286+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:50:28.929286+0000","last_peered":"2024-09-14T11:50:28.929286+0000","last_clean":"2024-09-14T11:50:28.929286+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:50:28.929286+0000","last_undegraded":"2024-09-14T11:50:28.929286+0000","last_fullsized":"2024-09-14T11:50:28.929286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'182","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.682880+0000","last_change":"2024-09-14T11:11:04.652412+0000","last_active":"2024-09-14T11:51:08.682880+0000","last_peered":"2024-09-14T11:51:08.682880+0000","last_clean":"2024-09-14T11:51:08.682880+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:51:08.682880+0000","last_undegraded":"2024-09-14T11:51:08.682880+0000","last_fullsized":"2024-09-14T11:51:08.682880+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:20.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":11748,"num_write":872,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916639+0000","last_change":"2024-09-14T11:11:08.656266+0000","last_active":"2024-09-14T11:48:48.916639+0000","last_peered":"2024-09-14T11:48:48.916639+0000","last_clean":"2024-09-14T11:48:48.916639+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:48:48.916639+0000","last_undegraded":"2024-09-14T11:48:48.916639+0000","last_fullsized":"2024-09-14T11:48:48.916639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.330377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'126","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.946961+0000","last_change":"2024-09-14T11:11:10.668058+0000","last_active":"2024-09-14T11:52:23.946961+0000","last_peered":"2024-09-14T11:52:23.946961+0000","last_clean":"2024-09-14T11:52:23.946961+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:52:23.946961+0000","last_undegraded":"2024-09-14T11:52:23.946961+0000","last_fullsized":"2024-09-14T11:52:23.946961+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:05.286724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.921295+0000","last_change":"2024-09-14T11:11:12.681877+0000","last_active":"2024-09-14T11:50:13.921295+0000","last_peered":"2024-09-14T11:50:13.921295+0000","last_clean":"2024-09-14T11:50:13.921295+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:50:13.921295+0000","last_undegraded":"2024-09-14T11:50:13.921295+0000","last_fullsized":"2024-09-14T11:50:13.921295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.120129+0000","last_change":"2024-09-14T11:11:14.692245+0000","last_active":"2024-09-14T11:51:03.120129+0000","last_peered":"2024-09-14T11:51:03.120129+0000","last_clean":"2024-09-14T11:51:03.120129+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:51:03.120129+0000","last_undegraded":"2024-09-14T11:51:03.120129+0000","last_fullsized":"2024-09-14T11:51:03.120129+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:24.950841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.122816+0000","last_change":"2024-09-14T11:11:06.661346+0000","last_active":"2024-09-14T11:51:03.122816+0000","last_peered":"2024-09-14T11:51:03.122816+0000","last_clean":"2024-09-14T11:51:03.122816+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:51:03.122816+0000","last_undegraded":"2024-09-14T11:51:03.122816+0000","last_fullsized":"2024-09-14T11:51:03.122816+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:19.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'222","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.159868+0000","last_change":"2024-09-14T11:11:04.657514+0000","last_active":"2024-09-14T11:51:02.159868+0000","last_peered":"2024-09-14T11:51:02.159868+0000","last_clean":"2024-09-14T11:51:02.159868+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:51:02.159868+0000","last_undegraded":"2024-09-14T11:51:02.159868+0000","last_fullsized":"2024-09-14T11:51:02.159868+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:47.332379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8451677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":613,"num_read_kb":15435,"num_write":879,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.931026+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:50:28.931026+0000","last_peered":"2024-09-14T11:50:28.931026+0000","last_clean":"2024-09-14T11:50:28.931026+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:50:28.931026+0000","last_undegraded":"2024-09-14T11:50:28.931026+0000","last_fullsized":"2024-09-14T11:50:28.931026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914647+0000","last_change":"2024-09-14T11:11:08.653119+0000","last_active":"2024-09-14T11:48:38.914647+0000","last_peered":"2024-09-14T11:48:38.914647+0000","last_clean":"2024-09-14T11:48:38.914647+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:48:38.914647+0000","last_undegraded":"2024-09-14T11:48:38.914647+0000","last_fullsized":"2024-09-14T11:48:38.914647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:46.444354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'286","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.522282+0000","last_change":"2024-09-14T11:11:10.670087+0000","last_active":"2024-09-14T11:52:37.522282+0000","last_peered":"2024-09-14T11:52:37.522282+0000","last_clean":"2024-09-14T11:52:37.522282+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:52:37.522282+0000","last_undegraded":"2024-09-14T11:52:37.522282+0000","last_fullsized":"2024-09-14T11:52:37.522282+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:50.318692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36366,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":405,"num_read_kb":567,"num_write":274,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914988+0000","last_change":"2024-09-14T11:11:12.679038+0000","last_active":"2024-09-14T11:48:43.914988+0000","last_peered":"2024-09-14T11:48:43.914988+0000","last_clean":"2024-09-14T11:48:43.914988+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:48:43.914988+0000","last_undegraded":"2024-09-14T11:48:43.914988+0000","last_fullsized":"2024-09-14T11:48:43.914988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:12.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'209","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.215679+0000","last_change":"2024-09-14T11:11:14.886549+0000","last_active":"2024-09-14T11:51:19.215679+0000","last_peered":"2024-09-14T11:51:19.215679+0000","last_clean":"2024-09-14T11:51:19.215679+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:51:19.215679+0000","last_undegraded":"2024-09-14T11:51:19.215679+0000","last_fullsized":"2024-09-14T11:51:19.215679+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:17.379453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'431","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434777+0000","last_change":"2024-09-14T11:11:06.654715+0000","last_active":"2024-09-14T11:52:36.434777+0000","last_peered":"2024-09-14T11:52:36.434777+0000","last_clean":"2024-09-14T11:52:36.434777+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:36.434777+0000","last_undegraded":"2024-09-14T11:52:36.434777+0000","last_fullsized":"2024-09-14T11:52:36.434777+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.183803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'213","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932340+0000","last_change":"2024-09-14T11:11:04.642737+0000","last_active":"2024-09-14T11:50:38.932340+0000","last_peered":"2024-09-14T11:50:38.932340+0000","last_clean":"2024-09-14T11:50:38.932340+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:50:38.932340+0000","last_undegraded":"2024-09-14T11:50:38.932340+0000","last_fullsized":"2024-09-14T11:50:38.932340+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.508714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":599,"num_read_kb":78521,"num_write":1028,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.051572+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:50:34.051572+0000","last_peered":"2024-09-14T11:50:34.051572+0000","last_clean":"2024-09-14T11:50:34.051572+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:50:34.051572+0000","last_undegraded":"2024-09-14T11:50:34.051572+0000","last_fullsized":"2024-09-14T11:50:34.051572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908212+0000","last_change":"2024-09-14T11:11:08.650994+0000","last_active":"2024-09-14T11:48:38.908212+0000","last_peered":"2024-09-14T11:48:38.908212+0000","last_clean":"2024-09-14T11:48:38.908212+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:48:38.908212+0000","last_undegraded":"2024-09-14T11:48:38.908212+0000","last_fullsized":"2024-09-14T11:48:38.908212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.962646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'156","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.318854+0000","last_change":"2024-09-14T11:11:10.883309+0000","last_active":"2024-09-14T11:51:19.318854+0000","last_peered":"2024-09-14T11:51:19.318854+0000","last_clean":"2024-09-14T11:51:19.318854+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:51:19.318854+0000","last_undegraded":"2024-09-14T11:51:19.318854+0000","last_fullsized":"2024-09-14T11:51:19.318854+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:14.780666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'799","reported_seq":4884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.558169+0000","last_change":"2024-09-14T11:11:12.682874+0000","last_active":"2024-09-14T11:52:37.558169+0000","last_peered":"2024-09-14T11:52:37.558169+0000","last_clean":"2024-09-14T11:52:37.558169+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:52:37.558169+0000","last_undegraded":"2024-09-14T11:52:37.558169+0000","last_fullsized":"2024-09-14T11:52:37.558169+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.028768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'341","reported_seq":1706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179290+0000","last_change":"2024-09-14T11:11:37.864782+0000","last_active":"2024-09-14T11:51:05.179290+0000","last_peered":"2024-09-14T11:51:05.179290+0000","last_clean":"2024-09-14T11:51:05.179290+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:51:05.179290+0000","last_undegraded":"2024-09-14T11:51:05.179290+0000","last_fullsized":"2024-09-14T11:51:05.179290+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.779073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'290","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.641781+0000","last_change":"2024-09-14T11:11:04.646682+0000","last_active":"2024-09-14T11:50:29.641781+0000","last_peered":"2024-09-14T11:50:29.641781+0000","last_clean":"2024-09-14T11:50:29.641781+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:50:29.641781+0000","last_undegraded":"2024-09-14T11:50:29.641781+0000","last_fullsized":"2024-09-14T11:50:29.641781+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:31.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18192632,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1178,"num_read_kb":53005,"num_write":1232,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926354+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:49:53.926354+0000","last_peered":"2024-09-14T11:49:53.926354+0000","last_clean":"2024-09-14T11:49:53.926354+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:49:53.926354+0000","last_undegraded":"2024-09-14T11:49:53.926354+0000","last_fullsized":"2024-09-14T11:49:53.926354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.913999+0000","last_change":"2024-09-14T11:11:08.649058+0000","last_active":"2024-09-14T11:48:38.913999+0000","last_peered":"2024-09-14T11:48:38.913999+0000","last_clean":"2024-09-14T11:48:38.913999+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:48:38.913999+0000","last_undegraded":"2024-09-14T11:48:38.913999+0000","last_fullsized":"2024-09-14T11:48:38.913999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:32.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.304291+0000","last_change":"2024-09-14T11:11:10.671331+0000","last_active":"2024-09-14T11:51:19.304291+0000","last_peered":"2024-09-14T11:51:19.304291+0000","last_clean":"2024-09-14T11:51:19.304291+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:51:19.304291+0000","last_undegraded":"2024-09-14T11:51:19.304291+0000","last_fullsized":"2024-09-14T11:51:19.304291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:52.798905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'817","reported_seq":4183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.562184+0000","last_change":"2024-09-14T11:11:12.678672+0000","last_active":"2024-09-14T11:52:37.562184+0000","last_peered":"2024-09-14T11:52:37.562184+0000","last_clean":"2024-09-14T11:52:37.562184+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:52:37.562184+0000","last_undegraded":"2024-09-14T11:52:37.562184+0000","last_fullsized":"2024-09-14T11:52:37.562184+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:12.941981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'298","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.901850+0000","last_change":"2024-09-14T11:11:14.686960+0000","last_active":"2024-09-14T11:51:21.901850+0000","last_peered":"2024-09-14T11:51:21.901850+0000","last_clean":"2024-09-14T11:51:21.901850+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:51:21.901850+0000","last_undegraded":"2024-09-14T11:51:21.901850+0000","last_fullsized":"2024-09-14T11:51:21.901850+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'544","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.929778+0000","last_change":"2024-09-14T11:11:06.655767+0000","last_active":"2024-09-14T11:50:56.929778+0000","last_peered":"2024-09-14T11:50:56.929778+0000","last_clean":"2024-09-14T11:50:56.929778+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:50:56.929778+0000","last_undegraded":"2024-09-14T11:50:56.929778+0000","last_fullsized":"2024-09-14T11:50:56.929778+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:44.124270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.107941+0000","last_change":"2024-09-14T11:11:04.656471+0000","last_active":"2024-09-14T11:51:07.107941+0000","last_peered":"2024-09-14T11:51:07.107941+0000","last_clean":"2024-09-14T11:51:07.107941+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:51:07.107941+0000","last_undegraded":"2024-09-14T11:51:07.107941+0000","last_fullsized":"2024-09-14T11:51:07.107941+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:48.156669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14274652,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59716,"num_write":947,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918354+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:49:53.918354+0000","last_peered":"2024-09-14T11:49:53.918354+0000","last_clean":"2024-09-14T11:49:53.918354+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:49:53.918354+0000","last_undegraded":"2024-09-14T11:49:53.918354+0000","last_fullsized":"2024-09-14T11:49:53.918354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921314+0000","last_change":"2024-09-14T11:11:08.656366+0000","last_active":"2024-09-14T11:49:18.921314+0000","last_peered":"2024-09-14T11:49:18.921314+0000","last_clean":"2024-09-14T11:49:18.921314+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:49:18.921314+0000","last_undegraded":"2024-09-14T11:49:18.921314+0000","last_fullsized":"2024-09-14T11:49:18.921314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:14.566083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.518869+0000","last_change":"2024-09-14T11:11:10.883247+0000","last_active":"2024-09-14T11:52:37.518869+0000","last_peered":"2024-09-14T11:52:37.518869+0000","last_clean":"2024-09-14T11:52:37.518869+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:52:37.518869+0000","last_undegraded":"2024-09-14T11:52:37.518869+0000","last_fullsized":"2024-09-14T11:52:37.518869+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:02.820687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":633,"num_write":226,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916205+0000","last_change":"2024-09-14T11:11:12.682882+0000","last_active":"2024-09-14T11:48:43.916205+0000","last_peered":"2024-09-14T11:48:43.916205+0000","last_clean":"2024-09-14T11:48:43.916205+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:48:43.916205+0000","last_undegraded":"2024-09-14T11:48:43.916205+0000","last_fullsized":"2024-09-14T11:48:43.916205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:35.551263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'120","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.820332+0000","last_change":"2024-09-14T11:11:14.692652+0000","last_active":"2024-09-14T11:51:20.820332+0000","last_peered":"2024-09-14T11:51:20.820332+0000","last_clean":"2024-09-14T11:51:20.820332+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:51:20.820332+0000","last_undegraded":"2024-09-14T11:51:20.820332+0000","last_fullsized":"2024-09-14T11:51:20.820332+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:49.033241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.375702+0000","last_change":"2024-09-14T11:11:14.691282+0000","last_active":"2024-09-14T11:51:21.375702+0000","last_peered":"2024-09-14T11:51:21.375702+0000","last_clean":"2024-09-14T11:51:21.375702+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:51:21.375702+0000","last_undegraded":"2024-09-14T11:51:21.375702+0000","last_fullsized":"2024-09-14T11:51:21.375702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.621120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'729","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.436271+0000","last_change":"2024-09-14T11:11:06.653550+0000","last_active":"2024-09-14T11:52:36.436271+0000","last_peered":"2024-09-14T11:52:36.436271+0000","last_clean":"2024-09-14T11:52:36.436271+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:36.436271+0000","last_undegraded":"2024-09-14T11:52:36.436271+0000","last_fullsized":"2024-09-14T11:52:36.436271+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:16.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'229","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:50.685402+0000","last_change":"2024-09-14T11:11:38.680906+0000","last_active":"2024-09-14T11:49:50.685402+0000","last_peered":"2024-09-14T11:49:50.685402+0000","last_clean":"2024-09-14T11:49:50.685402+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:49:50.685402+0000","last_undegraded":"2024-09-14T11:49:50.685402+0000","last_fullsized":"2024-09-14T11:49:50.685402+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:40.878361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11588317,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":661,"num_read_kb":19030,"num_write":1053,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.912602+0000","last_change":"2024-09-14T11:11:08.653208+0000","last_active":"2024-09-14T11:48:28.912602+0000","last_peered":"2024-09-14T11:48:28.912602+0000","last_clean":"2024-09-14T11:48:28.912602+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:48:28.912602+0000","last_undegraded":"2024-09-14T11:48:28.912602+0000","last_fullsized":"2024-09-14T11:48:28.912602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.990347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.322211+0000","last_change":"2024-09-14T11:11:10.670870+0000","last_active":"2024-09-14T11:51:19.322211+0000","last_peered":"2024-09-14T11:51:19.322211+0000","last_clean":"2024-09-14T11:51:19.322211+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:51:19.322211+0000","last_undegraded":"2024-09-14T11:51:19.322211+0000","last_fullsized":"2024-09-14T11:51:19.322211+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:25.995412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":230,"num_write":94,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914699+0000","last_change":"2024-09-14T11:11:12.679809+0000","last_active":"2024-09-14T11:48:33.914699+0000","last_peered":"2024-09-14T11:48:33.914699+0000","last_clean":"2024-09-14T11:48:33.914699+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:48:33.914699+0000","last_undegraded":"2024-09-14T11:48:33.914699+0000","last_fullsized":"2024-09-14T11:48:33.914699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:59.317292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.176366+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:05.176366+0000","last_peered":"2024-09-14T11:51:05.176366+0000","last_clean":"2024-09-14T11:51:05.176366+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:05.176366+0000","last_undegraded":"2024-09-14T11:51:05.176366+0000","last_fullsized":"2024-09-14T11:51:05.176366+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:48.809610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'712","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308610+0000","last_change":"2024-09-14T11:11:06.656572+0000","last_active":"2024-09-14T11:51:21.308610+0000","last_peered":"2024-09-14T11:51:21.308610+0000","last_clean":"2024-09-14T11:51:21.308610+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:51:21.308610+0000","last_undegraded":"2024-09-14T11:51:21.308610+0000","last_fullsized":"2024-09-14T11:51:21.308610+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:32.091729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'184","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.047526+0000","last_change":"2024-09-14T11:11:04.662627+0000","last_active":"2024-09-14T11:50:18.047526+0000","last_peered":"2024-09-14T11:50:18.047526+0000","last_clean":"2024-09-14T11:50:18.047526+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:50:18.047526+0000","last_undegraded":"2024-09-14T11:50:18.047526+0000","last_fullsized":"2024-09-14T11:50:18.047526+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:25.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8407655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":26239,"num_write":891,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.914104+0000","last_change":"2024-09-14T11:11:08.649769+0000","last_active":"2024-09-14T11:48:28.914104+0000","last_peered":"2024-09-14T11:48:28.914104+0000","last_clean":"2024-09-14T11:48:28.914104+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:48:28.914104+0000","last_undegraded":"2024-09-14T11:48:28.914104+0000","last_fullsized":"2024-09-14T11:48:28.914104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.869183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'53","reported_seq":548,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.138152+0000","last_change":"2024-09-14T11:11:10.669313+0000","last_active":"2024-09-14T11:51:19.138152+0000","last_peered":"2024-09-14T11:51:19.138152+0000","last_clean":"2024-09-14T11:51:19.138152+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:51:19.138152+0000","last_undegraded":"2024-09-14T11:51:19.138152+0000","last_fullsized":"2024-09-14T11:51:19.138152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:59.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034011+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:48:34.034011+0000","last_peered":"2024-09-14T11:48:34.034011+0000","last_clean":"2024-09-14T11:48:34.034011+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:48:34.034011+0000","last_undegraded":"2024-09-14T11:48:34.034011+0000","last_fullsized":"2024-09-14T11:48:34.034011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:34.408102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'195","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.441751+0000","last_change":"2024-09-14T11:11:14.692367+0000","last_active":"2024-09-14T11:52:36.441751+0000","last_peered":"2024-09-14T11:52:36.441751+0000","last_clean":"2024-09-14T11:52:36.441751+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:52:36.441751+0000","last_undegraded":"2024-09-14T11:52:36.441751+0000","last_fullsized":"2024-09-14T11:52:36.441751+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.861427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'486","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310927+0000","last_change":"2024-09-14T11:11:06.656240+0000","last_active":"2024-09-14T11:51:21.310927+0000","last_peered":"2024-09-14T11:51:21.310927+0000","last_clean":"2024-09-14T11:51:21.310927+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:51:21.310927+0000","last_undegraded":"2024-09-14T11:51:21.310927+0000","last_fullsized":"2024-09-14T11:51:21.310927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.647919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'201","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.923286+0000","last_change":"2024-09-14T11:11:04.661433+0000","last_active":"2024-09-14T11:49:43.923286+0000","last_peered":"2024-09-14T11:49:43.923286+0000","last_clean":"2024-09-14T11:49:43.923286+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:49:43.923286+0000","last_undegraded":"2024-09-14T11:49:43.923286+0000","last_fullsized":"2024-09-14T11:49:43.923286+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.817478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319969,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":470,"num_read_kb":67081,"num_write":923,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:29.033082+0000","last_change":"2024-09-14T11:11:08.654324+0000","last_active":"2024-09-14T11:48:29.033082+0000","last_peered":"2024-09-14T11:48:29.033082+0000","last_clean":"2024-09-14T11:48:29.033082+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:48:29.033082+0000","last_undegraded":"2024-09-14T11:48:29.033082+0000","last_fullsized":"2024-09-14T11:48:29.033082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:57.708332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'158","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.318332+0000","last_change":"2024-09-14T11:11:10.672080+0000","last_active":"2024-09-14T11:51:21.318332+0000","last_peered":"2024-09-14T11:51:21.318332+0000","last_clean":"2024-09-14T11:51:21.318332+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:51:21.318332+0000","last_undegraded":"2024-09-14T11:51:21.318332+0000","last_fullsized":"2024-09-14T11:51:21.318332+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:19.936617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":255,"num_write":112,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907458+0000","last_change":"2024-09-14T11:11:12.680936+0000","last_active":"2024-09-14T11:48:33.907458+0000","last_peered":"2024-09-14T11:48:33.907458+0000","last_clean":"2024-09-14T11:48:33.907458+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:48:33.907458+0000","last_undegraded":"2024-09-14T11:48:33.907458+0000","last_fullsized":"2024-09-14T11:48:33.907458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:51.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'159","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.741928+0000","last_change":"2024-09-14T11:11:14.690690+0000","last_active":"2024-09-14T11:51:08.741928+0000","last_peered":"2024-09-14T11:51:08.741928+0000","last_clean":"2024-09-14T11:51:08.741928+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:51:08.741928+0000","last_undegraded":"2024-09-14T11:51:08.741928+0000","last_fullsized":"2024-09-14T11:51:08.741928+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:02.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1177","reported_seq":2918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310166+0000","last_change":"2024-09-14T11:11:06.652306+0000","last_active":"2024-09-14T11:51:21.310166+0000","last_peered":"2024-09-14T11:51:21.310166+0000","last_clean":"2024-09-14T11:51:21.310166+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:51:21.310166+0000","last_undegraded":"2024-09-14T11:51:21.310166+0000","last_fullsized":"2024-09-14T11:51:21.310166+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:10.911326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'181","reported_seq":780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.880317+0000","last_change":"2024-09-14T11:11:04.663210+0000","last_active":"2024-09-14T11:50:47.880317+0000","last_peered":"2024-09-14T11:50:47.880317+0000","last_clean":"2024-09-14T11:50:47.880317+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:50:47.880317+0000","last_undegraded":"2024-09-14T11:50:47.880317+0000","last_fullsized":"2024-09-14T11:50:47.880317+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:37.285836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594761,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":13203,"num_write":821,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.906630+0000","last_change":"2024-09-14T11:11:08.653546+0000","last_active":"2024-09-14T11:48:28.906630+0000","last_peered":"2024-09-14T11:48:28.906630+0000","last_clean":"2024-09-14T11:48:28.906630+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:48:28.906630+0000","last_undegraded":"2024-09-14T11:48:28.906630+0000","last_fullsized":"2024-09-14T11:48:28.906630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.193897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'120","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217492+0000","last_change":"2024-09-14T11:11:10.670918+0000","last_active":"2024-09-14T11:51:19.217492+0000","last_peered":"2024-09-14T11:51:19.217492+0000","last_clean":"2024-09-14T11:51:19.217492+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:51:19.217492+0000","last_undegraded":"2024-09-14T11:51:19.217492+0000","last_fullsized":"2024-09-14T11:51:19.217492+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:05.847749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9545,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":189,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913655+0000","last_change":"2024-09-14T11:11:12.682390+0000","last_active":"2024-09-14T11:48:33.913655+0000","last_peered":"2024-09-14T11:48:33.913655+0000","last_clean":"2024-09-14T11:48:33.913655+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:48:33.913655+0000","last_undegraded":"2024-09-14T11:48:33.913655+0000","last_fullsized":"2024-09-14T11:48:33.913655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:05.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1627","reported_seq":3326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.112689+0000","last_change":"2024-09-14T11:11:06.654317+0000","last_active":"2024-09-14T11:51:03.112689+0000","last_peered":"2024-09-14T11:51:03.112689+0000","last_clean":"2024-09-14T11:51:03.112689+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:51:03.112689+0000","last_undegraded":"2024-09-14T11:51:03.112689+0000","last_fullsized":"2024-09-14T11:51:03.112689+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.474698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'226","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.242660+0000","last_change":"2024-09-14T11:11:04.645419+0000","last_active":"2024-09-14T11:52:29.242660+0000","last_peered":"2024-09-14T11:52:29.242660+0000","last_clean":"2024-09-14T11:52:29.242660+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:29.242660+0000","last_undegraded":"2024-09-14T11:52:29.242660+0000","last_fullsized":"2024-09-14T11:52:29.242660+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:57.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13625374,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":62996,"num_write":1110,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921634+0000","last_change":"2024-09-14T11:11:08.650958+0000","last_active":"2024-09-14T11:49:18.921634+0000","last_peered":"2024-09-14T11:49:18.921634+0000","last_clean":"2024-09-14T11:49:18.921634+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:49:18.921634+0000","last_undegraded":"2024-09-14T11:49:18.921634+0000","last_fullsized":"2024-09-14T11:49:18.921634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:09.330791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'199","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.515439+0000","last_change":"2024-09-14T11:11:10.670001+0000","last_active":"2024-09-14T11:52:37.515439+0000","last_peered":"2024-09-14T11:52:37.515439+0000","last_clean":"2024-09-14T11:52:37.515439+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:52:37.515439+0000","last_undegraded":"2024-09-14T11:52:37.515439+0000","last_fullsized":"2024-09-14T11:52:37.515439+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:12.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":299,"num_read_kb":444,"num_write":196,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040316+0000","last_change":"2024-09-14T11:11:12.683170+0000","last_active":"2024-09-14T11:48:44.040316+0000","last_peered":"2024-09-14T11:48:44.040316+0000","last_clean":"2024-09-14T11:48:44.040316+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:48:44.040316+0000","last_undegraded":"2024-09-14T11:48:44.040316+0000","last_fullsized":"2024-09-14T11:48:44.040316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.360262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.306430+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.306430+0000","last_peered":"2024-09-14T11:51:21.306430+0000","last_clean":"2024-09-14T11:51:21.306430+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.306430+0000","last_undegraded":"2024-09-14T11:51:21.306430+0000","last_fullsized":"2024-09-14T11:51:21.306430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'422","reported_seq":2027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172836+0000","last_change":"2024-09-14T11:11:06.650905+0000","last_active":"2024-09-14T11:51:07.172836+0000","last_peered":"2024-09-14T11:51:07.172836+0000","last_clean":"2024-09-14T11:51:07.172836+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:51:07.172836+0000","last_undegraded":"2024-09-14T11:51:07.172836+0000","last_fullsized":"2024-09-14T11:51:07.172836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:45.627603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'177","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.318053+0000","last_change":"2024-09-14T11:11:04.650203+0000","last_active":"2024-09-14T11:51:18.318053+0000","last_peered":"2024-09-14T11:51:18.318053+0000","last_clean":"2024-09-14T11:51:18.318053+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:51:18.318053+0000","last_undegraded":"2024-09-14T11:51:18.318053+0000","last_fullsized":"2024-09-14T11:51:18.318053+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8743742,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":12441,"num_write":902,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.265290+0000","last_change":"2024-09-14T11:11:08.653366+0000","last_active":"2024-09-14T11:52:37.265290+0000","last_peered":"2024-09-14T11:52:37.265290+0000","last_clean":"2024-09-14T11:52:37.265290+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:52:37.265290+0000","last_undegraded":"2024-09-14T11:52:37.265290+0000","last_fullsized":"2024-09-14T11:52:37.265290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:44.850713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":1189,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'159","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.259129+0000","last_change":"2024-09-14T11:11:10.668831+0000","last_active":"2024-09-14T11:51:19.259129+0000","last_peered":"2024-09-14T11:51:19.259129+0000","last_clean":"2024-09-14T11:51:19.259129+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:51:19.259129+0000","last_undegraded":"2024-09-14T11:51:19.259129+0000","last_fullsized":"2024-09-14T11:51:19.259129+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:09.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":282,"num_write":144,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915697+0000","last_change":"2024-09-14T11:11:12.681008+0000","last_active":"2024-09-14T11:48:43.915697+0000","last_peered":"2024-09-14T11:48:43.915697+0000","last_clean":"2024-09-14T11:48:43.915697+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:48:43.915697+0000","last_undegraded":"2024-09-14T11:48:43.915697+0000","last_fullsized":"2024-09-14T11:48:43.915697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:58.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'173","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:07.089853+0000","last_change":"2024-09-14T11:11:14.690312+0000","last_active":"2024-09-14T11:50:07.089853+0000","last_peered":"2024-09-14T11:50:07.089853+0000","last_clean":"2024-09-14T11:50:07.089853+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:50:07.089853+0000","last_undegraded":"2024-09-14T11:50:07.089853+0000","last_fullsized":"2024-09-14T11:50:07.089853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.026241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'376","reported_seq":1780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.226513+0000","last_change":"2024-09-14T11:11:06.651125+0000","last_active":"2024-09-14T11:51:02.226513+0000","last_peered":"2024-09-14T11:51:02.226513+0000","last_clean":"2024-09-14T11:51:02.226513+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:51:02.226513+0000","last_undegraded":"2024-09-14T11:51:02.226513+0000","last_fullsized":"2024-09-14T11:51:02.226513+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:57.162983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:42.471759+0000","last_change":"2024-09-14T11:11:04.647959+0000","last_active":"2024-09-14T11:50:42.471759+0000","last_peered":"2024-09-14T11:50:42.471759+0000","last_clean":"2024-09-14T11:50:42.471759+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:50:42.471759+0000","last_undegraded":"2024-09-14T11:50:42.471759+0000","last_fullsized":"2024-09-14T11:50:42.471759+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:50.954784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206736,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":545,"num_read_kb":23729,"num_write":1064,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914129+0000","last_change":"2024-09-14T11:11:08.651803+0000","last_active":"2024-09-14T11:48:38.914129+0000","last_peered":"2024-09-14T11:48:38.914129+0000","last_clean":"2024-09-14T11:48:38.914129+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:48:38.914129+0000","last_undegraded":"2024-09-14T11:48:38.914129+0000","last_fullsized":"2024-09-14T11:48:38.914129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:43.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'142","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.324251+0000","last_change":"2024-09-14T11:11:10.883223+0000","last_active":"2024-09-14T11:51:19.324251+0000","last_peered":"2024-09-14T11:51:19.324251+0000","last_clean":"2024-09-14T11:51:19.324251+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:51:19.324251+0000","last_undegraded":"2024-09-14T11:51:19.324251+0000","last_fullsized":"2024-09-14T11:51:19.324251+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:29.696874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39965,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":290,"num_write":96,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921566+0000","last_change":"2024-09-14T11:11:12.681509+0000","last_active":"2024-09-14T11:49:18.921566+0000","last_peered":"2024-09-14T11:49:18.921566+0000","last_clean":"2024-09-14T11:49:18.921566+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:49:18.921566+0000","last_undegraded":"2024-09-14T11:49:18.921566+0000","last_fullsized":"2024-09-14T11:49:18.921566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:59.776741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'122","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546132+0000","last_change":"2024-09-14T11:11:14.691723+0000","last_active":"2024-09-14T11:52:37.546132+0000","last_peered":"2024-09-14T11:52:37.546132+0000","last_clean":"2024-09-14T11:52:37.546132+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:52:37.546132+0000","last_undegraded":"2024-09-14T11:52:37.546132+0000","last_fullsized":"2024-09-14T11:52:37.546132+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:16.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'480","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219612+0000","last_change":"2024-09-14T11:11:37.748529+0000","last_active":"2024-09-14T11:51:19.219612+0000","last_peered":"2024-09-14T11:51:19.219612+0000","last_clean":"2024-09-14T11:51:19.219612+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:51:19.219612+0000","last_undegraded":"2024-09-14T11:51:19.219612+0000","last_fullsized":"2024-09-14T11:51:19.219612+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:31.281473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'290","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:50.085422+0000","last_change":"2024-09-14T11:11:04.649863+0000","last_active":"2024-09-14T11:50:50.085422+0000","last_peered":"2024-09-14T11:50:50.085422+0000","last_clean":"2024-09-14T11:50:50.085422+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:50:50.085422+0000","last_undegraded":"2024-09-14T11:50:50.085422+0000","last_fullsized":"2024-09-14T11:50:50.085422+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.369405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9472693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":27321,"num_write":1070,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914708+0000","last_change":"2024-09-14T11:11:08.657837+0000","last_active":"2024-09-14T11:48:38.914708+0000","last_peered":"2024-09-14T11:48:38.914708+0000","last_clean":"2024-09-14T11:48:38.914708+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:48:38.914708+0000","last_undegraded":"2024-09-14T11:48:38.914708+0000","last_fullsized":"2024-09-14T11:48:38.914708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'70","reported_seq":582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.316786+0000","last_change":"2024-09-14T11:11:10.883222+0000","last_active":"2024-09-14T11:51:19.316786+0000","last_peered":"2024-09-14T11:51:19.316786+0000","last_clean":"2024-09-14T11:51:19.316786+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:51:19.316786+0000","last_undegraded":"2024-09-14T11:51:19.316786+0000","last_fullsized":"2024-09-14T11:51:19.316786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:29.226087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'764","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.557166+0000","last_change":"2024-09-14T11:11:12.679582+0000","last_active":"2024-09-14T11:52:37.557166+0000","last_peered":"2024-09-14T11:52:37.557166+0000","last_clean":"2024-09-14T11:52:37.557166+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:52:37.557166+0000","last_undegraded":"2024-09-14T11:52:37.557166+0000","last_fullsized":"2024-09-14T11:52:37.557166+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:59.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.781791+0000","last_change":"2024-09-14T11:11:14.693282+0000","last_active":"2024-09-14T11:50:48.781791+0000","last_peered":"2024-09-14T11:50:48.781791+0000","last_clean":"2024-09-14T11:50:48.781791+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:50:48.781791+0000","last_undegraded":"2024-09-14T11:50:48.781791+0000","last_fullsized":"2024-09-14T11:50:48.781791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:09.483259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.836272+0000","last_change":"2024-09-14T11:11:06.652140+0000","last_active":"2024-09-14T11:51:21.836272+0000","last_peered":"2024-09-14T11:51:21.836272+0000","last_clean":"2024-09-14T11:51:21.836272+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:51:21.836272+0000","last_undegraded":"2024-09-14T11:51:21.836272+0000","last_fullsized":"2024-09-14T11:51:21.836272+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.172703+0000","last_change":"2024-09-14T11:11:04.661487+0000","last_active":"2024-09-14T11:51:18.172703+0000","last_peered":"2024-09-14T11:51:18.172703+0000","last_clean":"2024-09-14T11:51:18.172703+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:51:18.172703+0000","last_undegraded":"2024-09-14T11:51:18.172703+0000","last_fullsized":"2024-09-14T11:51:18.172703+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:20.676205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545915,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":12794,"num_write":1045,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034846+0000","last_change":"2024-09-14T11:11:08.653717+0000","last_active":"2024-09-14T11:48:39.034846+0000","last_peered":"2024-09-14T11:48:39.034846+0000","last_clean":"2024-09-14T11:48:39.034846+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:48:39.034846+0000","last_undegraded":"2024-09-14T11:48:39.034846+0000","last_fullsized":"2024-09-14T11:48:39.034846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:32.879931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'165","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.946447+0000","last_change":"2024-09-14T11:11:10.669599+0000","last_active":"2024-09-14T11:52:28.946447+0000","last_peered":"2024-09-14T11:52:28.946447+0000","last_clean":"2024-09-14T11:52:28.946447+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:52:28.946447+0000","last_undegraded":"2024-09-14T11:52:28.946447+0000","last_fullsized":"2024-09-14T11:52:28.946447+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:43.348380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":273,"num_write":118,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926374+0000","last_change":"2024-09-14T11:11:12.681246+0000","last_active":"2024-09-14T11:49:53.926374+0000","last_peered":"2024-09-14T11:49:53.926374+0000","last_clean":"2024-09-14T11:49:53.926374+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:49:53.926374+0000","last_undegraded":"2024-09-14T11:49:53.926374+0000","last_fullsized":"2024-09-14T11:49:53.926374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:07.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'115","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.880410+0000","last_change":"2024-09-14T11:11:14.697190+0000","last_active":"2024-09-14T11:51:07.880410+0000","last_peered":"2024-09-14T11:51:07.880410+0000","last_clean":"2024-09-14T11:51:07.880410+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:51:07.880410+0000","last_undegraded":"2024-09-14T11:51:07.880410+0000","last_fullsized":"2024-09-14T11:51:07.880410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:51.323211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1156","reported_seq":2809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.337919+0000","last_change":"2024-09-14T11:11:06.642481+0000","last_active":"2024-09-14T11:50:58.337919+0000","last_peered":"2024-09-14T11:50:58.337919+0000","last_clean":"2024-09-14T11:50:58.337919+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:50:58.337919+0000","last_undegraded":"2024-09-14T11:50:58.337919+0000","last_fullsized":"2024-09-14T11:50:58.337919+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.677463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:51.208702+0000","last_change":"2024-09-14T11:11:04.662351+0000","last_active":"2024-09-14T11:50:51.208702+0000","last_peered":"2024-09-14T11:50:51.208702+0000","last_clean":"2024-09-14T11:50:51.208702+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:50:51.208702+0000","last_undegraded":"2024-09-14T11:50:51.208702+0000","last_fullsized":"2024-09-14T11:50:51.208702+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:07.797389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5955950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":655,"num_read_kb":26583,"num_write":933,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039639+0000","last_change":"2024-09-14T11:11:08.655874+0000","last_active":"2024-09-14T11:48:39.039639+0000","last_peered":"2024-09-14T11:48:39.039639+0000","last_clean":"2024-09-14T11:48:39.039639+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:48:39.039639+0000","last_undegraded":"2024-09-14T11:48:39.039639+0000","last_fullsized":"2024-09-14T11:48:39.039639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:09.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945761+0000","last_change":"2024-09-14T11:11:10.673119+0000","last_active":"2024-09-14T11:52:18.945761+0000","last_peered":"2024-09-14T11:52:18.945761+0000","last_clean":"2024-09-14T11:52:18.945761+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:52:18.945761+0000","last_undegraded":"2024-09-14T11:52:18.945761+0000","last_fullsized":"2024-09-14T11:52:18.945761+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.182477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":215,"num_write":86,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:03.919674+0000","last_change":"2024-09-14T11:11:12.680784+0000","last_active":"2024-09-14T11:50:03.919674+0000","last_peered":"2024-09-14T11:50:03.919674+0000","last_clean":"2024-09-14T11:50:03.919674+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:50:03.919674+0000","last_undegraded":"2024-09-14T11:50:03.919674+0000","last_fullsized":"2024-09-14T11:50:03.919674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:59.544800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'508","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.436715+0000","last_change":"2024-09-14T11:11:06.653662+0000","last_active":"2024-09-14T11:51:06.436715+0000","last_peered":"2024-09-14T11:51:06.436715+0000","last_clean":"2024-09-14T11:51:06.436715+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:51:06.436715+0000","last_undegraded":"2024-09-14T11:51:06.436715+0000","last_fullsized":"2024-09-14T11:51:06.436715+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:06.494569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'216","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.094191+0000","last_change":"2024-09-14T11:11:04.650685+0000","last_active":"2024-09-14T11:49:48.094191+0000","last_peered":"2024-09-14T11:49:48.094191+0000","last_clean":"2024-09-14T11:49:48.094191+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:49:48.094191+0000","last_undegraded":"2024-09-14T11:49:48.094191+0000","last_fullsized":"2024-09-14T11:49:48.094191+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.078217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404555,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":512,"num_read_kb":7926,"num_write":970,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.923902+0000","last_change":"2024-09-14T11:11:08.654095+0000","last_active":"2024-09-14T11:49:48.923902+0000","last_peered":"2024-09-14T11:49:48.923902+0000","last_clean":"2024-09-14T11:49:48.923902+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:49:48.923902+0000","last_undegraded":"2024-09-14T11:49:48.923902+0000","last_fullsized":"2024-09-14T11:49:48.923902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:24.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'103","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.201792+0000","last_change":"2024-09-14T11:11:10.669556+0000","last_active":"2024-09-14T11:51:19.201792+0000","last_peered":"2024-09-14T11:51:19.201792+0000","last_clean":"2024-09-14T11:51:19.201792+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:51:19.201792+0000","last_undegraded":"2024-09-14T11:51:19.201792+0000","last_fullsized":"2024-09-14T11:51:19.201792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:15.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":185,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915062+0000","last_change":"2024-09-14T11:11:12.682253+0000","last_active":"2024-09-14T11:48:43.915062+0000","last_peered":"2024-09-14T11:48:43.915062+0000","last_clean":"2024-09-14T11:48:43.915062+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:48:43.915062+0000","last_undegraded":"2024-09-14T11:48:43.915062+0000","last_fullsized":"2024-09-14T11:48:43.915062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:58.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'186","reported_seq":1636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.774324+0000","last_change":"2024-09-14T11:11:14.690239+0000","last_active":"2024-09-14T11:51:19.774324+0000","last_peered":"2024-09-14T11:51:19.774324+0000","last_clean":"2024-09-14T11:51:19.774324+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:51:19.774324+0000","last_undegraded":"2024-09-14T11:51:19.774324+0000","last_fullsized":"2024-09-14T11:51:19.774324+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:45.377535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219526+0000","last_change":"2024-09-14T11:11:06.656585+0000","last_active":"2024-09-14T11:51:19.219526+0000","last_peered":"2024-09-14T11:51:19.219526+0000","last_clean":"2024-09-14T11:51:19.219526+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:51:19.219526+0000","last_undegraded":"2024-09-14T11:51:19.219526+0000","last_fullsized":"2024-09-14T11:51:19.219526+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:33.246710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'223","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.276658+0000","last_change":"2024-09-14T11:11:04.658553+0000","last_active":"2024-09-14T11:50:55.276658+0000","last_peered":"2024-09-14T11:50:55.276658+0000","last_clean":"2024-09-14T11:50:55.276658+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:50:55.276658+0000","last_undegraded":"2024-09-14T11:50:55.276658+0000","last_fullsized":"2024-09-14T11:50:55.276658+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:55.574919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489935,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1050,"num_read_kb":144594,"num_write":1038,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926285+0000","last_change":"2024-09-14T11:11:08.653002+0000","last_active":"2024-09-14T11:49:53.926285+0000","last_peered":"2024-09-14T11:49:53.926285+0000","last_clean":"2024-09-14T11:49:53.926285+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:49:53.926285+0000","last_undegraded":"2024-09-14T11:49:53.926285+0000","last_fullsized":"2024-09-14T11:49:53.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:11.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.225139+0000","last_change":"2024-09-14T11:11:10.668336+0000","last_active":"2024-09-14T11:51:19.225139+0000","last_peered":"2024-09-14T11:51:19.225139+0000","last_clean":"2024-09-14T11:51:19.225139+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:51:19.225139+0000","last_undegraded":"2024-09-14T11:51:19.225139+0000","last_fullsized":"2024-09-14T11:51:19.225139+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:48.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6768,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":189,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915597+0000","last_change":"2024-09-14T11:11:12.681192+0000","last_active":"2024-09-14T11:48:43.915597+0000","last_peered":"2024-09-14T11:48:43.915597+0000","last_clean":"2024-09-14T11:48:43.915597+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:48:43.915597+0000","last_undegraded":"2024-09-14T11:48:43.915597+0000","last_fullsized":"2024-09-14T11:48:43.915597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'131","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434001+0000","last_change":"2024-09-14T11:11:14.697156+0000","last_active":"2024-09-14T11:52:36.434001+0000","last_peered":"2024-09-14T11:52:36.434001+0000","last_clean":"2024-09-14T11:52:36.434001+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:52:36.434001+0000","last_undegraded":"2024-09-14T11:52:36.434001+0000","last_fullsized":"2024-09-14T11:52:36.434001+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.319859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'851","reported_seq":2569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179734+0000","last_change":"2024-09-14T11:11:06.655238+0000","last_active":"2024-09-14T11:51:05.179734+0000","last_peered":"2024-09-14T11:51:05.179734+0000","last_clean":"2024-09-14T11:51:05.179734+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:51:05.179734+0000","last_undegraded":"2024-09-14T11:51:05.179734+0000","last_fullsized":"2024-09-14T11:51:05.179734+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:38.378965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'242","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.431900+0000","last_change":"2024-09-14T11:11:04.666811+0000","last_active":"2024-09-14T11:50:44.431900+0000","last_peered":"2024-09-14T11:50:44.431900+0000","last_clean":"2024-09-14T11:50:44.431900+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:50:44.431900+0000","last_undegraded":"2024-09-14T11:50:44.431900+0000","last_fullsized":"2024-09-14T11:50:44.431900+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5492619,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":42950,"num_write":1086,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'565","reported_seq":2225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844932+0000","last_change":"2024-09-14T11:11:06.651614+0000","last_active":"2024-09-14T11:51:21.844932+0000","last_peered":"2024-09-14T11:51:21.844932+0000","last_clean":"2024-09-14T11:51:21.844932+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:51:21.844932+0000","last_undegraded":"2024-09-14T11:51:21.844932+0000","last_fullsized":"2024-09-14T11:51:21.844932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:03.537283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'177","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036406+0000","last_change":"2024-09-14T11:11:38.680106+0000","last_active":"2024-09-14T11:50:39.036406+0000","last_peered":"2024-09-14T11:50:39.036406+0000","last_clean":"2024-09-14T11:50:39.036406+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:50:39.036406+0000","last_undegraded":"2024-09-14T11:50:39.036406+0000","last_fullsized":"2024-09-14T11:50:39.036406+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:36.864373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399983,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":43631,"num_write":869,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'524","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845111+0000","last_change":"2024-09-14T11:11:06.653770+0000","last_active":"2024-09-14T11:51:21.845111+0000","last_peered":"2024-09-14T11:51:21.845111+0000","last_clean":"2024-09-14T11:51:21.845111+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:51:21.845111+0000","last_undegraded":"2024-09-14T11:51:21.845111+0000","last_fullsized":"2024-09-14T11:51:21.845111+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'211","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930676+0000","last_change":"2024-09-14T11:11:04.659611+0000","last_active":"2024-09-14T11:50:38.930676+0000","last_peered":"2024-09-14T11:50:38.930676+0000","last_clean":"2024-09-14T11:50:38.930676+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:50:38.930676+0000","last_undegraded":"2024-09-14T11:50:38.930676+0000","last_fullsized":"2024-09-14T11:50:38.930676+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.810419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8880526,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":22878,"num_write":1004,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'803","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435453+0000","last_change":"2024-09-14T11:11:06.651188+0000","last_active":"2024-09-14T11:52:36.435453+0000","last_peered":"2024-09-14T11:52:36.435453+0000","last_clean":"2024-09-14T11:52:36.435453+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:52:36.435453+0000","last_undegraded":"2024-09-14T11:52:36.435453+0000","last_fullsized":"2024-09-14T11:52:36.435453+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:08.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'189","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.242403+0000","last_change":"2024-09-14T11:11:04.650789+0000","last_active":"2024-09-14T11:51:18.242403+0000","last_peered":"2024-09-14T11:51:18.242403+0000","last_clean":"2024-09-14T11:51:18.242403+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:51:18.242403+0000","last_undegraded":"2024-09-14T11:51:18.242403+0000","last_fullsized":"2024-09-14T11:51:18.242403+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.442954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15769276,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":47732,"num_write":870,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1006","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.837526+0000","last_change":"2024-09-14T11:11:06.654587+0000","last_active":"2024-09-14T11:51:21.837526+0000","last_peered":"2024-09-14T11:51:21.837526+0000","last_clean":"2024-09-14T11:51:21.837526+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:51:21.837526+0000","last_undegraded":"2024-09-14T11:51:21.837526+0000","last_fullsized":"2024-09-14T11:51:21.837526+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:08.260560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'274","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.432091+0000","last_change":"2024-09-14T11:11:38.149249+0000","last_active":"2024-09-14T11:52:27.432091+0000","last_peered":"2024-09-14T11:52:27.432091+0000","last_clean":"2024-09-14T11:52:27.432091+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:27.432091+0000","last_undegraded":"2024-09-14T11:52:27.432091+0000","last_fullsized":"2024-09-14T11:52:27.432091+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:11.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8423062,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":714,"num_read_kb":31338,"num_write":1100,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'442","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.878230+0000","last_change":"2024-09-14T11:11:06.653604+0000","last_active":"2024-09-14T11:51:07.878230+0000","last_peered":"2024-09-14T11:51:07.878230+0000","last_clean":"2024-09-14T11:51:07.878230+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:51:07.878230+0000","last_undegraded":"2024-09-14T11:51:07.878230+0000","last_fullsized":"2024-09-14T11:51:07.878230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:35.321390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'248","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.028817+0000","last_change":"2024-09-14T11:11:04.642725+0000","last_active":"2024-09-14T11:50:17.028817+0000","last_peered":"2024-09-14T11:50:17.028817+0000","last_clean":"2024-09-14T11:50:17.028817+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:50:17.028817+0000","last_undegraded":"2024-09-14T11:50:17.028817+0000","last_fullsized":"2024-09-14T11:50:17.028817+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:47.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670221,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1014,"num_read_kb":155037,"num_write":1111,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1175","reported_seq":2833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438627+0000","last_change":"2024-09-14T11:11:06.651627+0000","last_active":"2024-09-14T11:52:36.438627+0000","last_peered":"2024-09-14T11:52:36.438627+0000","last_clean":"2024-09-14T11:52:36.438627+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:52:36.438627+0000","last_undegraded":"2024-09-14T11:52:36.438627+0000","last_fullsized":"2024-09-14T11:52:36.438627+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:01.008892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'237","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.325344+0000","last_change":"2024-09-14T11:11:04.657109+0000","last_active":"2024-09-14T11:51:18.325344+0000","last_peered":"2024-09-14T11:51:18.325344+0000","last_clean":"2024-09-14T11:51:18.325344+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:51:18.325344+0000","last_undegraded":"2024-09-14T11:51:18.325344+0000","last_fullsized":"2024-09-14T11:51:18.325344+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.402916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10919282,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":17781,"num_write":1111,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'425","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.875685+0000","last_change":"2024-09-14T11:11:06.654109+0000","last_active":"2024-09-14T11:51:07.875685+0000","last_peered":"2024-09-14T11:51:07.875685+0000","last_clean":"2024-09-14T11:51:07.875685+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:51:07.875685+0000","last_undegraded":"2024-09-14T11:51:07.875685+0000","last_fullsized":"2024-09-14T11:51:07.875685+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:48.495731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'181","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.472986+0000","last_change":"2024-09-14T11:11:04.654477+0000","last_active":"2024-09-14T11:50:57.472986+0000","last_peered":"2024-09-14T11:50:57.472986+0000","last_clean":"2024-09-14T11:50:57.472986+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:50:57.472986+0000","last_undegraded":"2024-09-14T11:50:57.472986+0000","last_fullsized":"2024-09-14T11:50:57.472986+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:01.338332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404304,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":12452,"num_write":856,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1179","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308328+0000","last_change":"2024-09-14T11:11:06.652958+0000","last_active":"2024-09-14T11:51:21.308328+0000","last_peered":"2024-09-14T11:51:21.308328+0000","last_clean":"2024-09-14T11:51:21.308328+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:51:21.308328+0000","last_undegraded":"2024-09-14T11:51:21.308328+0000","last_fullsized":"2024-09-14T11:51:21.308328+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:24.552197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'243","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.680131+0000","last_change":"2024-09-14T11:11:04.657280+0000","last_active":"2024-09-14T11:52:35.680131+0000","last_peered":"2024-09-14T11:52:35.680131+0000","last_clean":"2024-09-14T11:52:35.680131+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:52:35.680131+0000","last_undegraded":"2024-09-14T11:52:35.680131+0000","last_fullsized":"2024-09-14T11:52:35.680131+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:41.400680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4514884,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":3825,"num_write":1014,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'758","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435815+0000","last_change":"2024-09-14T11:11:06.651996+0000","last_active":"2024-09-14T11:52:36.435815+0000","last_peered":"2024-09-14T11:52:36.435815+0000","last_clean":"2024-09-14T11:52:36.435815+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:52:36.435815+0000","last_undegraded":"2024-09-14T11:52:36.435815+0000","last_fullsized":"2024-09-14T11:52:36.435815+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:06.359659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'239","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.342127+0000","last_change":"2024-09-14T11:11:04.651232+0000","last_active":"2024-09-14T11:51:18.342127+0000","last_peered":"2024-09-14T11:51:18.342127+0000","last_clean":"2024-09-14T11:51:18.342127+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:51:18.342127+0000","last_undegraded":"2024-09-14T11:51:18.342127+0000","last_fullsized":"2024-09-14T11:51:18.342127+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:16.752449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283448,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":9466,"num_write":1102,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.437393+0000","last_change":"2024-09-14T11:11:06.656624+0000","last_active":"2024-09-14T11:51:06.437393+0000","last_peered":"2024-09-14T11:51:06.437393+0000","last_clean":"2024-09-14T11:51:06.437393+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:51:06.437393+0000","last_undegraded":"2024-09-14T11:51:06.437393+0000","last_fullsized":"2024-09-14T11:51:06.437393+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'225","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.819833+0000","last_change":"2024-09-14T11:11:38.680828+0000","last_active":"2024-09-14T11:51:07.819833+0000","last_peered":"2024-09-14T11:51:07.819833+0000","last_clean":"2024-09-14T11:51:07.819833+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:51:07.819833+0000","last_undegraded":"2024-09-14T11:51:07.819833+0000","last_fullsized":"2024-09-14T11:51:07.819833+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:19.072768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439893,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":20654,"num_write":1081,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'570","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.123272+0000","last_change":"2024-09-14T11:11:06.655967+0000","last_active":"2024-09-14T11:51:03.123272+0000","last_peered":"2024-09-14T11:51:03.123272+0000","last_clean":"2024-09-14T11:51:03.123272+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:51:03.123272+0000","last_undegraded":"2024-09-14T11:51:03.123272+0000","last_fullsized":"2024-09-14T11:51:03.123272+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:20.387986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'175","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.177437+0000","last_change":"2024-09-14T11:11:04.663147+0000","last_active":"2024-09-14T11:50:44.177437+0000","last_peered":"2024-09-14T11:50:44.177437+0000","last_clean":"2024-09-14T11:50:44.177437+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:50:44.177437+0000","last_undegraded":"2024-09-14T11:50:44.177437+0000","last_fullsized":"2024-09-14T11:50:44.177437+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:33.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9689661,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":19362,"num_write":815,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'501","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746597+0000","last_change":"2024-09-14T11:11:06.659368+0000","last_active":"2024-09-14T11:51:08.746597+0000","last_peered":"2024-09-14T11:51:08.746597+0000","last_clean":"2024-09-14T11:51:08.746597+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:51:08.746597+0000","last_undegraded":"2024-09-14T11:51:08.746597+0000","last_fullsized":"2024-09-14T11:51:08.746597+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:58.840799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'214","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:56.211247+0000","last_change":"2024-09-14T11:11:04.663046+0000","last_active":"2024-09-14T11:49:56.211247+0000","last_peered":"2024-09-14T11:49:56.211247+0000","last_clean":"2024-09-14T11:49:56.211247+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:49:56.211247+0000","last_undegraded":"2024-09-14T11:49:56.211247+0000","last_fullsized":"2024-09-14T11:49:56.211247+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:13.422693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11883891,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":490,"num_read_kb":22963,"num_write":990,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1725","reported_seq":3529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220305+0000","last_change":"2024-09-14T11:11:06.649254+0000","last_active":"2024-09-14T11:51:19.220305+0000","last_peered":"2024-09-14T11:51:19.220305+0000","last_clean":"2024-09-14T11:51:19.220305+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:51:19.220305+0000","last_undegraded":"2024-09-14T11:51:19.220305+0000","last_fullsized":"2024-09-14T11:51:19.220305+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:09.019220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:47.550503+0000","last_change":"2024-09-14T11:11:04.667994+0000","last_active":"2024-09-14T11:49:47.550503+0000","last_peered":"2024-09-14T11:49:47.550503+0000","last_clean":"2024-09-14T11:49:47.550503+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:49:47.550503+0000","last_undegraded":"2024-09-14T11:49:47.550503+0000","last_fullsized":"2024-09-14T11:49:47.550503+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:02.592974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193762,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":9299,"num_write":1024,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'390","reported_seq":1862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316772+0000","last_change":"2024-09-14T11:11:06.646168+0000","last_active":"2024-09-14T11:51:21.316772+0000","last_peered":"2024-09-14T11:51:21.316772+0000","last_clean":"2024-09-14T11:51:21.316772+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:51:21.316772+0000","last_undegraded":"2024-09-14T11:51:21.316772+0000","last_fullsized":"2024-09-14T11:51:21.316772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:16.898215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'218","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.895001+0000","last_change":"2024-09-14T11:11:04.651268+0000","last_active":"2024-09-14T11:50:25.895001+0000","last_peered":"2024-09-14T11:50:25.895001+0000","last_clean":"2024-09-14T11:50:25.895001+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:50:25.895001+0000","last_undegraded":"2024-09-14T11:50:25.895001+0000","last_fullsized":"2024-09-14T11:50:25.895001+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:23.982692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":67022,"num_write":1008,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845379+0000","last_change":"2024-09-14T11:11:06.659988+0000","last_active":"2024-09-14T11:51:21.845379+0000","last_peered":"2024-09-14T11:51:21.845379+0000","last_clean":"2024-09-14T11:51:21.845379+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:51:21.845379+0000","last_undegraded":"2024-09-14T11:51:21.845379+0000","last_fullsized":"2024-09-14T11:51:21.845379+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:38.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'203","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.533851+0000","last_change":"2024-09-14T11:11:38.680954+0000","last_active":"2024-09-14T11:50:25.533851+0000","last_peered":"2024-09-14T11:50:25.533851+0000","last_clean":"2024-09-14T11:50:25.533851+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:50:25.533851+0000","last_undegraded":"2024-09-14T11:50:25.533851+0000","last_fullsized":"2024-09-14T11:50:25.533851+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:16.743206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646946,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":636,"num_read_kb":27752,"num_write":881,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'205","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:55.508425+0000","last_change":"2024-09-14T11:11:04.661066+0000","last_active":"2024-09-14T11:49:55.508425+0000","last_peered":"2024-09-14T11:49:55.508425+0000","last_clean":"2024-09-14T11:49:55.508425+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:49:55.508425+0000","last_undegraded":"2024-09-14T11:49:55.508425+0000","last_fullsized":"2024-09-14T11:49:55.508425+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:37.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105464,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":450,"num_read_kb":2089,"num_write":992,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'473","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179160+0000","last_change":"2024-09-14T11:11:06.654014+0000","last_active":"2024-09-14T11:51:05.179160+0000","last_peered":"2024-09-14T11:51:05.179160+0000","last_clean":"2024-09-14T11:51:05.179160+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:51:05.179160+0000","last_undegraded":"2024-09-14T11:51:05.179160+0000","last_fullsized":"2024-09-14T11:51:05.179160+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.254011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'257","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.156014+0000","last_change":"2024-09-14T11:11:04.647071+0000","last_active":"2024-09-14T11:51:19.156014+0000","last_peered":"2024-09-14T11:51:19.156014+0000","last_clean":"2024-09-14T11:51:19.156014+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:51:19.156014+0000","last_undegraded":"2024-09-14T11:51:19.156014+0000","last_fullsized":"2024-09-14T11:51:19.156014+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:36.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":738,"num_read_kb":42624,"num_write":1177,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'381","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844858+0000","last_change":"2024-09-14T11:11:06.651474+0000","last_active":"2024-09-14T11:51:21.844858+0000","last_peered":"2024-09-14T11:51:21.844858+0000","last_clean":"2024-09-14T11:51:21.844858+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:51:21.844858+0000","last_undegraded":"2024-09-14T11:51:21.844858+0000","last_fullsized":"2024-09-14T11:51:21.844858+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:12.583169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1586,"ondisk_log_size":1586,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":441,"ondisk_log_size":441,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":549287,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8076,"num_read_kb":10163,"num_write":5523,"num_write_kb":2827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":246138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1822,"ondisk_log_size":1822,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2859,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4062,"ondisk_log_size":4062,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":516365168,"num_objects":497,"num_object_clones":0,"num_object_copies":1988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42119,"num_read_kb":2539582,"num_write":63965,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":692436992,"data_stored":692436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3581,"ondisk_log_size":3581,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":132,"num_read_kb":168157,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":181387,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542654,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363936,"kb_used_data":125904,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94007904,"statfs":{"total":96636764160,"available":96264093696,"internally_reserved":0,"allocated":128925696,"data_stored":126882893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542654,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348908,"kb_used_data":110876,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94022932,"statfs":{"total":96636764160,"available":96279482368,"internally_reserved":0,"allocated":113537024,"data_stored":111570785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542652,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244012,"kb_used_data":132316,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94127828,"statfs":{"total":96636764160,"available":96386895872,"internally_reserved":0,"allocated":135491584,"data_stored":133446387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542652,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239172,"kb_used_data":127476,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94132668,"statfs":{"total":96636764160,"available":96391852032,"internally_reserved":0,"allocated":130535424,"data_stored":128601245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542651,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394872,"kb_used_data":138792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93976968,"statfs":{"total":96636764160,"available":96232415232,"internally_reserved":0,"allocated":142123008,"data_stored":140103253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542652,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188868,"kb_used_data":103540,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94182972,"statfs":{"total":96636764160,"available":96443363328,"internally_reserved":0,"allocated":106024960,"data_stored":104085158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542652,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267800,"kb_used_data":128392,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94104040,"statfs":{"total":96636764160,"available":96362536960,"internally_reserved":0,"allocated":131473408,"data_stored":129466388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542653,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396440,"kb_used_data":126536,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93975400,"statfs":{"total":96636764160,"available":96230809600,"internally_reserved":0,"allocated":129572864,"data_stored":127542267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95223808,"data_stored":95223808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91357184,"data_stored":91357184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62988288,"data_stored":62988288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86421504,"data_stored":86421504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92721152,"data_stored":92721152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93364224,"data_stored":93364224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83079168,"data_stored":83079168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":87281664,"data_stored":87281664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":37449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":36402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":37213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":24241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":50688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16814080,"data_stored":16812382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14746907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14708736,"data_stored":14707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22016000,"data_stored":22015117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19977499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26210304,"data_stored":26210304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10489856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19931136,"data_stored":19931136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12621083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21073920,"data_stored":21069433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24121344,"data_stored":24121344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29372416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13639680,"data_stored":13639680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":15719565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16773120,"data_stored":16773120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:52:46.474 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:52:46.799 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:52:46.818 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:52:46.822 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1517,"stamp":"2024-09-14T11:52:45.071145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662413282,"num_objects":1017,"num_object_clones":0,"num_object_copies":3028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1017,"num_whiteouts":0,"num_read":298782,"num_read_kb":3127342,"num_write":145881,"num_write_kb":2544918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12789,"ondisk_log_size":12789,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444008,"kb_used_data":993832,"kb_used_omap":12,"kb_used_meta":1450035,"kb_avail":752530712,"statfs":{"total":773094113280,"available":770591449088,"internally_reserved":0,"allocated":1017683968,"data_stored":1001698376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1484836401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1152,"num_objects":-16,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":465,"num_read_kb":440,"num_write":122,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004932"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:49.032072+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:47:49.032072+0000","last_peered":"2024-09-14T11:47:49.032072+0000","last_clean":"2024-09-14T11:47:49.032072+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:47:49.032072+0000","last_undegraded":"2024-09-14T11:47:49.032072+0000","last_fullsized":"2024-09-14T11:47:49.032072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929194+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:50:13.929194+0000","last_peered":"2024-09-14T11:50:13.929194+0000","last_clean":"2024-09-14T11:50:13.929194+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:50:13.929194+0000","last_undegraded":"2024-09-14T11:50:13.929194+0000","last_fullsized":"2024-09-14T11:50:13.929194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.491129+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:50:29.491129+0000","last_peered":"2024-09-14T11:50:29.491129+0000","last_clean":"2024-09-14T11:50:29.491129+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:50:29.491129+0000","last_undegraded":"2024-09-14T11:50:29.491129+0000","last_fullsized":"2024-09-14T11:50:29.491129+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.932210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.020550+0000","last_change":"2024-09-14T11:38:32.849060+0000","last_active":"2024-09-14T11:48:34.020550+0000","last_peered":"2024-09-14T11:48:34.020550+0000","last_clean":"2024-09-14T11:48:34.020550+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:48:34.020550+0000","last_undegraded":"2024-09-14T11:48:34.020550+0000","last_fullsized":"2024-09-14T11:48:34.020550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:37.543006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.906147+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:47:48.906147+0000","last_peered":"2024-09-14T11:47:48.906147+0000","last_clean":"2024-09-14T11:47:48.906147+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:47:48.906147+0000","last_undegraded":"2024-09-14T11:47:48.906147+0000","last_fullsized":"2024-09-14T11:47:48.906147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929084+0000","last_change":"2024-09-14T11:27:43.844600+0000","last_active":"2024-09-14T11:50:13.929084+0000","last_peered":"2024-09-14T11:50:13.929084+0000","last_clean":"2024-09-14T11:50:13.929084+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:50:13.929084+0000","last_undegraded":"2024-09-14T11:50:13.929084+0000","last_fullsized":"2024-09-14T11:50:13.929084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:40.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.031874+0000","last_change":"2024-09-14T11:26:02.011475+0000","last_active":"2024-09-14T11:50:04.031874+0000","last_peered":"2024-09-14T11:50:04.031874+0000","last_clean":"2024-09-14T11:50:04.031874+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:50:04.031874+0000","last_undegraded":"2024-09-14T11:50:04.031874+0000","last_fullsized":"2024-09-14T11:50:04.031874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:06.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.904430+0000","last_change":"2024-09-14T11:38:32.844854+0000","last_active":"2024-09-14T11:48:13.904430+0000","last_peered":"2024-09-14T11:48:13.904430+0000","last_clean":"2024-09-14T11:48:13.904430+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:48:13.904430+0000","last_undegraded":"2024-09-14T11:48:13.904430+0000","last_fullsized":"2024-09-14T11:48:13.904430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:24.240149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'8","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914798+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:48:38.914798+0000","last_peered":"2024-09-14T11:48:38.914798+0000","last_clean":"2024-09-14T11:48:38.914798+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:48:38.914798+0000","last_undegraded":"2024-09-14T11:48:38.914798+0000","last_fullsized":"2024-09-14T11:48:38.914798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":15373,"num_write":8,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.029442+0000","last_change":"2024-09-14T11:27:43.839478+0000","last_active":"2024-09-14T11:49:44.029442+0000","last_peered":"2024-09-14T11:49:44.029442+0000","last_clean":"2024-09-14T11:49:44.029442+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:49:44.029442+0000","last_undegraded":"2024-09-14T11:49:44.029442+0000","last_fullsized":"2024-09-14T11:49:44.029442+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:44.742446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:18.912574+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:48:18.912574+0000","last_peered":"2024-09-14T11:48:18.912574+0000","last_clean":"2024-09-14T11:48:18.912574+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:48:18.912574+0000","last_undegraded":"2024-09-14T11:48:18.912574+0000","last_fullsized":"2024-09-14T11:48:18.912574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:25.443932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930348+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:50:38.930348+0000","last_peered":"2024-09-14T11:50:38.930348+0000","last_clean":"2024-09-14T11:50:38.930348+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:50:38.930348+0000","last_undegraded":"2024-09-14T11:50:38.930348+0000","last_fullsized":"2024-09-14T11:50:38.930348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.922656+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:49:38.922656+0000","last_peered":"2024-09-14T11:49:38.922656+0000","last_clean":"2024-09-14T11:49:38.922656+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:49:38.922656+0000","last_undegraded":"2024-09-14T11:49:38.922656+0000","last_fullsized":"2024-09-14T11:49:38.922656+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918289+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:48:58.918289+0000","last_peered":"2024-09-14T11:48:58.918289+0000","last_clean":"2024-09-14T11:48:58.918289+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:48:58.918289+0000","last_undegraded":"2024-09-14T11:48:58.918289+0000","last_fullsized":"2024-09-14T11:48:58.918289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.194975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.916014+0000","last_change":"2024-09-14T11:27:46.877556+0000","last_active":"2024-09-14T11:49:33.916014+0000","last_peered":"2024-09-14T11:49:33.916014+0000","last_clean":"2024-09-14T11:49:33.916014+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:49:33.916014+0000","last_undegraded":"2024-09-14T11:49:33.916014+0000","last_fullsized":"2024-09-14T11:49:33.916014+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:18.433716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.921935+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:49:33.921935+0000","last_peered":"2024-09-14T11:49:33.921935+0000","last_clean":"2024-09-14T11:49:33.921935+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:49:33.921935+0000","last_undegraded":"2024-09-14T11:49:33.921935+0000","last_fullsized":"2024-09-14T11:49:33.921935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907414+0000","last_change":"2024-09-14T11:26:02.016774+0000","last_active":"2024-09-14T11:48:33.907414+0000","last_peered":"2024-09-14T11:48:33.907414+0000","last_clean":"2024-09-14T11:48:33.907414+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:48:33.907414+0000","last_undegraded":"2024-09-14T11:48:33.907414+0000","last_fullsized":"2024-09-14T11:48:33.907414+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:07.106001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'13","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.901076+0000","last_change":"2024-09-14T11:27:46.886470+0000","last_active":"2024-09-14T11:47:48.901076+0000","last_peered":"2024-09-14T11:47:48.901076+0000","last_clean":"2024-09-14T11:47:48.901076+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:47:48.901076+0000","last_undegraded":"2024-09-14T11:47:48.901076+0000","last_fullsized":"2024-09-14T11:47:48.901076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:31.966694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19456,"num_write":23,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927162+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:50:13.927162+0000","last_peered":"2024-09-14T11:50:13.927162+0000","last_clean":"2024-09-14T11:50:13.927162+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:50:13.927162+0000","last_undegraded":"2024-09-14T11:50:13.927162+0000","last_fullsized":"2024-09-14T11:50:13.927162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301531,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5174,"num_write":11,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929327+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:50:13.929327+0000","last_peered":"2024-09-14T11:50:13.929327+0000","last_clean":"2024-09-14T11:50:13.929327+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:50:13.929327+0000","last_undegraded":"2024-09-14T11:50:13.929327+0000","last_fullsized":"2024-09-14T11:50:13.929327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12280,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.928980+0000","last_change":"2024-09-14T11:26:02.018044+0000","last_active":"2024-09-14T11:50:13.928980+0000","last_peered":"2024-09-14T11:50:13.928980+0000","last_clean":"2024-09-14T11:50:13.928980+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:50:13.928980+0000","last_undegraded":"2024-09-14T11:50:13.928980+0000","last_fullsized":"2024-09-14T11:50:13.928980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:20.434831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923623+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:49:33.923623+0000","last_peered":"2024-09-14T11:49:33.923623+0000","last_clean":"2024-09-14T11:49:33.923623+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:49:33.923623+0000","last_undegraded":"2024-09-14T11:49:33.923623+0000","last_fullsized":"2024-09-14T11:49:33.923623+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040301+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:48:44.040301+0000","last_peered":"2024-09-14T11:48:44.040301+0000","last_clean":"2024-09-14T11:48:44.040301+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:48:44.040301+0000","last_undegraded":"2024-09-14T11:48:44.040301+0000","last_fullsized":"2024-09-14T11:48:44.040301+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:57.988895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5124,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033275+0000","last_change":"2024-09-14T11:38:32.848295+0000","last_active":"2024-09-14T11:50:14.033275+0000","last_peered":"2024-09-14T11:50:14.033275+0000","last_clean":"2024-09-14T11:50:14.033275+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:50:14.033275+0000","last_undegraded":"2024-09-14T11:50:14.033275+0000","last_fullsized":"2024-09-14T11:50:14.033275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:48.994528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:53.917687+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:48:53.917687+0000","last_peered":"2024-09-14T11:48:53.917687+0000","last_clean":"2024-09-14T11:48:53.917687+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:48:53.917687+0000","last_undegraded":"2024-09-14T11:48:53.917687+0000","last_fullsized":"2024-09-14T11:48:53.917687+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042145+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:49:29.042145+0000","last_peered":"2024-09-14T11:49:29.042145+0000","last_clean":"2024-09-14T11:49:29.042145+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:49:29.042145+0000","last_undegraded":"2024-09-14T11:49:29.042145+0000","last_fullsized":"2024-09-14T11:49:29.042145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923673+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:49:33.923673+0000","last_peered":"2024-09-14T11:49:33.923673+0000","last_clean":"2024-09-14T11:49:33.923673+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:49:33.923673+0000","last_undegraded":"2024-09-14T11:49:33.923673+0000","last_fullsized":"2024-09-14T11:49:33.923673+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.027786+0000","last_change":"2024-09-14T11:27:43.833928+0000","last_active":"2024-09-14T11:49:29.027786+0000","last_peered":"2024-09-14T11:49:29.027786+0000","last_clean":"2024-09-14T11:49:29.027786+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:49:29.027786+0000","last_undegraded":"2024-09-14T11:49:29.027786+0000","last_fullsized":"2024-09-14T11:49:29.027786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:18.568174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033312+0000","last_change":"2024-09-14T11:26:02.016653+0000","last_active":"2024-09-14T11:50:14.033312+0000","last_peered":"2024-09-14T11:50:14.033312+0000","last_clean":"2024-09-14T11:50:14.033312+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:50:14.033312+0000","last_undegraded":"2024-09-14T11:50:14.033312+0000","last_fullsized":"2024-09-14T11:50:14.033312+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:16.371317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.922005+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:49:33.922005+0000","last_peered":"2024-09-14T11:49:33.922005+0000","last_clean":"2024-09-14T11:49:33.922005+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:49:33.922005+0000","last_undegraded":"2024-09-14T11:49:33.922005+0000","last_fullsized":"2024-09-14T11:49:33.922005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911902+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:48:13.911902+0000","last_peered":"2024-09-14T11:48:13.911902+0000","last_clean":"2024-09-14T11:48:13.911902+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:48:13.911902+0000","last_undegraded":"2024-09-14T11:48:13.911902+0000","last_fullsized":"2024-09-14T11:48:13.911902+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:00.999425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916585+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:48:48.916585+0000","last_peered":"2024-09-14T11:48:48.916585+0000","last_clean":"2024-09-14T11:48:48.916585+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:48:48.916585+0000","last_undegraded":"2024-09-14T11:48:48.916585+0000","last_fullsized":"2024-09-14T11:48:48.916585+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:19.871430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3076,"num_write":3,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914944+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:48:43.914944+0000","last_peered":"2024-09-14T11:48:43.914944+0000","last_clean":"2024-09-14T11:48:43.914944+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:48:43.914944+0000","last_undegraded":"2024-09-14T11:48:43.914944+0000","last_fullsized":"2024-09-14T11:48:43.914944+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:16.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.909890+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:48:13.909890+0000","last_peered":"2024-09-14T11:48:13.909890+0000","last_clean":"2024-09-14T11:48:13.909890+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:48:13.909890+0000","last_undegraded":"2024-09-14T11:48:13.909890+0000","last_fullsized":"2024-09-14T11:48:13.909890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:42.939970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916531+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:48:48.916531+0000","last_peered":"2024-09-14T11:48:48.916531+0000","last_clean":"2024-09-14T11:48:48.916531+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:48:48.916531+0000","last_undegraded":"2024-09-14T11:48:48.916531+0000","last_fullsized":"2024-09-14T11:48:48.916531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:11.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916162+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:48:43.916162+0000","last_peered":"2024-09-14T11:48:43.916162+0000","last_clean":"2024-09-14T11:48:43.916162+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:48:43.916162+0000","last_undegraded":"2024-09-14T11:48:43.916162+0000","last_fullsized":"2024-09-14T11:48:43.916162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916982+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:48:48.916982+0000","last_peered":"2024-09-14T11:48:48.916982+0000","last_clean":"2024-09-14T11:48:48.916982+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:48:48.916982+0000","last_undegraded":"2024-09-14T11:48:48.916982+0000","last_fullsized":"2024-09-14T11:48:48.916982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:18.041265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.909029+0000","last_change":"2024-09-14T11:27:43.841798+0000","last_active":"2024-09-14T11:48:43.909029+0000","last_peered":"2024-09-14T11:48:43.909029+0000","last_clean":"2024-09-14T11:48:43.909029+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:48:43.909029+0000","last_undegraded":"2024-09-14T11:48:43.909029+0000","last_fullsized":"2024-09-14T11:48:43.909029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920603+0000","last_change":"2024-09-14T11:26:02.017294+0000","last_active":"2024-09-14T11:49:23.920603+0000","last_peered":"2024-09-14T11:49:23.920603+0000","last_clean":"2024-09-14T11:49:23.920603+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:49:23.920603+0000","last_undegraded":"2024-09-14T11:49:23.920603+0000","last_fullsized":"2024-09-14T11:49:23.920603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.763964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911882+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:48:13.911882+0000","last_peered":"2024-09-14T11:48:13.911882+0000","last_clean":"2024-09-14T11:48:13.911882+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:48:13.911882+0000","last_undegraded":"2024-09-14T11:48:13.911882+0000","last_fullsized":"2024-09-14T11:48:13.911882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.077724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.909728+0000","last_change":"2024-09-14T11:27:46.878156+0000","last_active":"2024-09-14T11:48:48.909728+0000","last_peered":"2024-09-14T11:48:48.909728+0000","last_clean":"2024-09-14T11:48:48.909728+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:48:48.909728+0000","last_undegraded":"2024-09-14T11:48:48.909728+0000","last_fullsized":"2024-09-14T11:48:48.909728+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:16.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9432205,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":8188,"num_write":4,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040261+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:48:44.040261+0000","last_peered":"2024-09-14T11:48:44.040261+0000","last_clean":"2024-09-14T11:48:44.040261+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:48:44.040261+0000","last_undegraded":"2024-09-14T11:48:44.040261+0000","last_fullsized":"2024-09-14T11:48:44.040261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:04.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027203+0000","last_change":"2024-09-14T11:38:32.848761+0000","last_active":"2024-09-14T11:49:24.027203+0000","last_peered":"2024-09-14T11:49:24.027203+0000","last_clean":"2024-09-14T11:49:24.027203+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:49:24.027203+0000","last_undegraded":"2024-09-14T11:49:24.027203+0000","last_fullsized":"2024-09-14T11:49:24.027203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.405538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930037+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:50:18.930037+0000","last_peered":"2024-09-14T11:50:18.930037+0000","last_clean":"2024-09-14T11:50:18.930037+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:50:18.930037+0000","last_undegraded":"2024-09-14T11:50:18.930037+0000","last_fullsized":"2024-09-14T11:50:18.930037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048504+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:50:14.048504+0000","last_peered":"2024-09-14T11:50:14.048504+0000","last_clean":"2024-09-14T11:50:14.048504+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:50:14.048504+0000","last_undegraded":"2024-09-14T11:50:14.048504+0000","last_fullsized":"2024-09-14T11:50:14.048504+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21510,"num_write":19,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915562+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:48:38.915562+0000","last_peered":"2024-09-14T11:48:38.915562+0000","last_clean":"2024-09-14T11:48:38.915562+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:48:38.915562+0000","last_undegraded":"2024-09-14T11:48:38.915562+0000","last_fullsized":"2024-09-14T11:48:38.915562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:22.557110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033300+0000","last_change":"2024-09-14T11:27:43.841930+0000","last_active":"2024-09-14T11:50:14.033300+0000","last_peered":"2024-09-14T11:50:14.033300+0000","last_clean":"2024-09-14T11:50:14.033300+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:50:14.033300+0000","last_undegraded":"2024-09-14T11:50:14.033300+0000","last_fullsized":"2024-09-14T11:50:14.033300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:26.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.039040+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:48:34.039040+0000","last_peered":"2024-09-14T11:48:34.039040+0000","last_clean":"2024-09-14T11:48:34.039040+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:48:34.039040+0000","last_undegraded":"2024-09-14T11:48:34.039040+0000","last_fullsized":"2024-09-14T11:48:34.039040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:32.266973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.914592+0000","last_change":"2024-09-14T11:38:32.850327+0000","last_active":"2024-09-14T11:49:23.914592+0000","last_peered":"2024-09-14T11:49:23.914592+0000","last_clean":"2024-09-14T11:49:23.914592+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:49:23.914592+0000","last_undegraded":"2024-09-14T11:49:23.914592+0000","last_fullsized":"2024-09-14T11:49:23.914592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930485+0000","last_change":"2024-09-14T11:27:47.189562+0000","last_active":"2024-09-14T11:50:23.930485+0000","last_peered":"2024-09-14T11:50:23.930485+0000","last_clean":"2024-09-14T11:50:23.930485+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:50:23.930485+0000","last_undegraded":"2024-09-14T11:50:23.930485+0000","last_fullsized":"2024-09-14T11:50:23.930485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:40.247709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929405+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:50:13.929405+0000","last_peered":"2024-09-14T11:50:13.929405+0000","last_clean":"2024-09-14T11:50:13.929405+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:50:13.929405+0000","last_undegraded":"2024-09-14T11:50:13.929405+0000","last_fullsized":"2024-09-14T11:50:13.929405+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907514+0000","last_change":"2024-09-14T11:26:02.014516+0000","last_active":"2024-09-14T11:48:33.907514+0000","last_peered":"2024-09-14T11:48:33.907514+0000","last_clean":"2024-09-14T11:48:33.907514+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:48:33.907514+0000","last_undegraded":"2024-09-14T11:48:33.907514+0000","last_fullsized":"2024-09-14T11:48:33.907514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:24.171152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930066+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:50:18.930066+0000","last_peered":"2024-09-14T11:50:18.930066+0000","last_clean":"2024-09-14T11:50:18.930066+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:50:18.930066+0000","last_undegraded":"2024-09-14T11:50:18.930066+0000","last_fullsized":"2024-09-14T11:50:18.930066+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4112,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929898+0000","last_change":"2024-09-14T11:27:43.842788+0000","last_active":"2024-09-14T11:50:18.929898+0000","last_peered":"2024-09-14T11:50:18.929898+0000","last_clean":"2024-09-14T11:50:18.929898+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:50:18.929898+0000","last_undegraded":"2024-09-14T11:50:18.929898+0000","last_fullsized":"2024-09-14T11:50:18.929898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.953106+0000","last_change":"2024-09-14T11:26:02.009131+0000","last_active":"2024-09-14T11:50:25.953106+0000","last_peered":"2024-09-14T11:50:25.953106+0000","last_clean":"2024-09-14T11:50:25.953106+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:50:25.953106+0000","last_undegraded":"2024-09-14T11:50:25.953106+0000","last_fullsized":"2024-09-14T11:50:25.953106+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921298+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:49:28.921298+0000","last_peered":"2024-09-14T11:49:28.921298+0000","last_clean":"2024-09-14T11:49:28.921298+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:49:28.921298+0000","last_undegraded":"2024-09-14T11:49:28.921298+0000","last_fullsized":"2024-09-14T11:49:28.921298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6166,"num_write":5,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.698490+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:29.698490+0000","last_peered":"2024-09-14T11:50:29.698490+0000","last_clean":"2024-09-14T11:50:29.698490+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:29.698490+0000","last_undegraded":"2024-09-14T11:50:29.698490+0000","last_fullsized":"2024-09-14T11:50:29.698490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:46.261351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042041+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:49:29.042041+0000","last_peered":"2024-09-14T11:49:29.042041+0000","last_clean":"2024-09-14T11:49:29.042041+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:49:29.042041+0000","last_undegraded":"2024-09-14T11:49:29.042041+0000","last_fullsized":"2024-09-14T11:49:29.042041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922127+0000","last_change":"2024-09-14T11:27:43.843512+0000","last_active":"2024-09-14T11:49:23.922127+0000","last_peered":"2024-09-14T11:49:23.922127+0000","last_clean":"2024-09-14T11:49:23.922127+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:49:23.922127+0000","last_undegraded":"2024-09-14T11:49:23.922127+0000","last_fullsized":"2024-09-14T11:49:23.922127+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":4143,"num_write":12,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929860+0000","last_change":"2024-09-14T11:27:46.881654+0000","last_active":"2024-09-14T11:50:18.929860+0000","last_peered":"2024-09-14T11:50:18.929860+0000","last_clean":"2024-09-14T11:50:18.929860+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:50:18.929860+0000","last_undegraded":"2024-09-14T11:50:18.929860+0000","last_fullsized":"2024-09-14T11:50:18.929860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:09.752180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042090+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:49:29.042090+0000","last_peered":"2024-09-14T11:49:29.042090+0000","last_clean":"2024-09-14T11:49:29.042090+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:49:29.042090+0000","last_undegraded":"2024-09-14T11:49:29.042090+0000","last_fullsized":"2024-09-14T11:49:29.042090+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918260+0000","last_change":"2024-09-14T11:26:02.015867+0000","last_active":"2024-09-14T11:49:53.918260+0000","last_peered":"2024-09-14T11:49:53.918260+0000","last_clean":"2024-09-14T11:49:53.918260+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:49:53.918260+0000","last_undegraded":"2024-09-14T11:49:53.918260+0000","last_fullsized":"2024-09-14T11:49:53.918260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:45.729260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037984+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:48:59.037984+0000","last_peered":"2024-09-14T11:48:59.037984+0000","last_clean":"2024-09-14T11:48:59.037984+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:48:59.037984+0000","last_undegraded":"2024-09-14T11:48:59.037984+0000","last_fullsized":"2024-09-14T11:48:59.037984+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:52.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915712+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:48:43.915712+0000","last_peered":"2024-09-14T11:48:43.915712+0000","last_clean":"2024-09-14T11:48:43.915712+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:48:43.915712+0000","last_undegraded":"2024-09-14T11:48:43.915712+0000","last_fullsized":"2024-09-14T11:48:43.915712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052459+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:50:39.052459+0000","last_peered":"2024-09-14T11:50:39.052459+0000","last_clean":"2024-09-14T11:50:39.052459+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:50:39.052459+0000","last_undegraded":"2024-09-14T11:50:39.052459+0000","last_fullsized":"2024-09-14T11:50:39.052459+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10258,"num_write":6,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042361+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:48:59.042361+0000","last_peered":"2024-09-14T11:48:59.042361+0000","last_clean":"2024-09-14T11:48:59.042361+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:48:59.042361+0000","last_undegraded":"2024-09-14T11:48:59.042361+0000","last_fullsized":"2024-09-14T11:48:59.042361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:40.838198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914723+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:48:38.914723+0000","last_peered":"2024-09-14T11:48:38.914723+0000","last_clean":"2024-09-14T11:48:38.914723+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:48:38.914723+0000","last_undegraded":"2024-09-14T11:48:38.914723+0000","last_fullsized":"2024-09-14T11:48:38.914723+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036469+0000","last_change":"2024-09-14T11:27:43.842571+0000","last_active":"2024-09-14T11:50:39.036469+0000","last_peered":"2024-09-14T11:50:39.036469+0000","last_clean":"2024-09-14T11:50:39.036469+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:50:39.036469+0000","last_undegraded":"2024-09-14T11:50:39.036469+0000","last_fullsized":"2024-09-14T11:50:39.036469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:54.316859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137297,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":9,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918333+0000","last_change":"2024-09-14T11:26:02.017925+0000","last_active":"2024-09-14T11:49:53.918333+0000","last_peered":"2024-09-14T11:49:53.918333+0000","last_clean":"2024-09-14T11:49:53.918333+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:49:53.918333+0000","last_undegraded":"2024-09-14T11:49:53.918333+0000","last_fullsized":"2024-09-14T11:49:53.918333+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:08.536746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920684+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:49:23.920684+0000","last_peered":"2024-09-14T11:49:23.920684+0000","last_clean":"2024-09-14T11:49:23.920684+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:49:23.920684+0000","last_undegraded":"2024-09-14T11:49:23.920684+0000","last_fullsized":"2024-09-14T11:49:23.920684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:13.953562+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:49:13.953562+0000","last_peered":"2024-09-14T11:49:13.953562+0000","last_clean":"2024-09-14T11:49:13.953562+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:49:13.953562+0000","last_undegraded":"2024-09-14T11:49:13.953562+0000","last_fullsized":"2024-09-14T11:49:13.953562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:55.854911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.917107+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:48:58.917107+0000","last_peered":"2024-09-14T11:48:58.917107+0000","last_clean":"2024-09-14T11:48:58.917107+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:48:58.917107+0000","last_undegraded":"2024-09-14T11:48:58.917107+0000","last_fullsized":"2024-09-14T11:48:58.917107+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:10.571334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'1","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921390+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:49:28.921390+0000","last_peered":"2024-09-14T11:49:28.921390+0000","last_clean":"2024-09-14T11:49:28.921390+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:49:28.921390+0000","last_undegraded":"2024-09-14T11:49:28.921390+0000","last_fullsized":"2024-09-14T11:49:28.921390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041365+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:49:24.041365+0000","last_peered":"2024-09-14T11:49:24.041365+0000","last_clean":"2024-09-14T11:49:24.041365+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:49:24.041365+0000","last_undegraded":"2024-09-14T11:49:24.041365+0000","last_fullsized":"2024-09-14T11:49:24.041365+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918208+0000","last_change":"2024-09-14T11:26:02.017129+0000","last_active":"2024-09-14T11:48:58.918208+0000","last_peered":"2024-09-14T11:48:58.918208+0000","last_clean":"2024-09-14T11:48:58.918208+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:48:58.918208+0000","last_undegraded":"2024-09-14T11:48:58.918208+0000","last_fullsized":"2024-09-14T11:48:58.918208+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:31.419402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027265+0000","last_change":"2024-09-14T11:38:32.849590+0000","last_active":"2024-09-14T11:49:24.027265+0000","last_peered":"2024-09-14T11:49:24.027265+0000","last_clean":"2024-09-14T11:49:24.027265+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:49:24.027265+0000","last_undegraded":"2024-09-14T11:49:24.027265+0000","last_fullsized":"2024-09-14T11:49:24.027265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:47.728058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914584+0000","last_change":"2024-09-14T11:27:46.881829+0000","last_active":"2024-09-14T11:48:38.914584+0000","last_peered":"2024-09-14T11:48:38.914584+0000","last_clean":"2024-09-14T11:48:38.914584+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:48:38.914584+0000","last_undegraded":"2024-09-14T11:48:38.914584+0000","last_fullsized":"2024-09-14T11:48:38.914584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:28.272707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":8,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.043981+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:49:44.043981+0000","last_peered":"2024-09-14T11:49:44.043981+0000","last_clean":"2024-09-14T11:49:44.043981+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:49:44.043981+0000","last_undegraded":"2024-09-14T11:49:44.043981+0000","last_fullsized":"2024-09-14T11:49:44.043981+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042401+0000","last_change":"2024-09-14T11:26:02.004701+0000","last_active":"2024-09-14T11:48:59.042401+0000","last_peered":"2024-09-14T11:48:59.042401+0000","last_clean":"2024-09-14T11:48:59.042401+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:48:59.042401+0000","last_undegraded":"2024-09-14T11:48:59.042401+0000","last_fullsized":"2024-09-14T11:48:59.042401+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:25.708478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052376+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:50:39.052376+0000","last_peered":"2024-09-14T11:50:39.052376+0000","last_clean":"2024-09-14T11:50:39.052376+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:50:39.052376+0000","last_undegraded":"2024-09-14T11:50:39.052376+0000","last_fullsized":"2024-09-14T11:50:39.052376+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:32.268368+0000","last_change":"2024-09-14T11:26:02.017353+0000","last_active":"2024-09-14T11:49:32.268368+0000","last_peered":"2024-09-14T11:49:32.268368+0000","last_clean":"2024-09-14T11:49:32.268368+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:49:32.268368+0000","last_undegraded":"2024-09-14T11:49:32.268368+0000","last_fullsized":"2024-09-14T11:49:32.268368+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:27.288411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918234+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:48:58.918234+0000","last_peered":"2024-09-14T11:48:58.918234+0000","last_clean":"2024-09-14T11:48:58.918234+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:48:58.918234+0000","last_undegraded":"2024-09-14T11:48:58.918234+0000","last_fullsized":"2024-09-14T11:48:58.918234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:40.224008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908230+0000","last_change":"2024-09-14T11:27:46.880908+0000","last_active":"2024-09-14T11:48:38.908230+0000","last_peered":"2024-09-14T11:48:38.908230+0000","last_clean":"2024-09-14T11:48:38.908230+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:48:38.908230+0000","last_undegraded":"2024-09-14T11:48:38.908230+0000","last_fullsized":"2024-09-14T11:48:38.908230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:28.300991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932313+0000","last_change":"2024-09-14T11:27:43.841331+0000","last_active":"2024-09-14T11:50:38.932313+0000","last_peered":"2024-09-14T11:50:38.932313+0000","last_clean":"2024-09-14T11:50:38.932313+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:50:38.932313+0000","last_undegraded":"2024-09-14T11:50:38.932313+0000","last_fullsized":"2024-09-14T11:50:38.932313+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:03.837930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.911190+0000","last_change":"2024-09-14T11:26:02.017191+0000","last_active":"2024-09-14T11:48:58.911190+0000","last_peered":"2024-09-14T11:48:58.911190+0000","last_clean":"2024-09-14T11:48:58.911190+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:48:58.911190+0000","last_undegraded":"2024-09-14T11:48:58.911190+0000","last_fullsized":"2024-09-14T11:48:58.911190+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:53.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.038037+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:48:59.038037+0000","last_peered":"2024-09-14T11:48:59.038037+0000","last_clean":"2024-09-14T11:48:59.038037+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:48:59.038037+0000","last_undegraded":"2024-09-14T11:48:59.038037+0000","last_fullsized":"2024-09-14T11:48:59.038037+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:26.761199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914041+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:48:38.914041+0000","last_peered":"2024-09-14T11:48:38.914041+0000","last_clean":"2024-09-14T11:48:38.914041+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:48:38.914041+0000","last_undegraded":"2024-09-14T11:48:38.914041+0000","last_fullsized":"2024-09-14T11:48:38.914041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.924861+0000","last_change":"2024-09-14T11:27:43.841443+0000","last_active":"2024-09-14T11:50:38.924861+0000","last_peered":"2024-09-14T11:50:38.924861+0000","last_clean":"2024-09-14T11:50:38.924861+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:50:38.924861+0000","last_undegraded":"2024-09-14T11:50:38.924861+0000","last_fullsized":"2024-09-14T11:50:38.924861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10252,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.046775+0000","last_change":"2024-09-14T11:26:02.020510+0000","last_active":"2024-09-14T11:50:04.046775+0000","last_peered":"2024-09-14T11:50:04.046775+0000","last_clean":"2024-09-14T11:50:04.046775+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:50:04.046775+0000","last_undegraded":"2024-09-14T11:50:04.046775+0000","last_fullsized":"2024-09-14T11:50:04.046775+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'209","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052524+0000","last_change":"2024-09-14T11:11:04.667841+0000","last_active":"2024-09-14T11:50:39.052524+0000","last_peered":"2024-09-14T11:50:39.052524+0000","last_clean":"2024-09-14T11:50:39.052524+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:50:39.052524+0000","last_undegraded":"2024-09-14T11:50:39.052524+0000","last_fullsized":"2024-09-14T11:50:39.052524+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:30.918136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8431804,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":26846,"num_write":995,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1170","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.942831+0000","last_change":"2024-09-14T11:11:06.652913+0000","last_active":"2024-09-14T11:50:47.942831+0000","last_peered":"2024-09-14T11:50:47.942831+0000","last_clean":"2024-09-14T11:50:47.942831+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:50:47.942831+0000","last_undegraded":"2024-09-14T11:50:47.942831+0000","last_fullsized":"2024-09-14T11:50:47.942831+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:14.129052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'193","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932374+0000","last_change":"2024-09-14T11:11:04.654208+0000","last_active":"2024-09-14T11:50:38.932374+0000","last_peered":"2024-09-14T11:50:38.932374+0000","last_clean":"2024-09-14T11:50:38.932374+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:50:38.932374+0000","last_undegraded":"2024-09-14T11:50:38.932374+0000","last_fullsized":"2024-09-14T11:50:38.932374+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:33.758275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2139742,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":7476,"num_write":911,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'449","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.437450+0000","last_change":"2024-09-14T11:11:06.659297+0000","last_active":"2024-09-14T11:52:36.437450+0000","last_peered":"2024-09-14T11:52:36.437450+0000","last_clean":"2024-09-14T11:52:36.437450+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:52:36.437450+0000","last_undegraded":"2024-09-14T11:52:36.437450+0000","last_fullsized":"2024-09-14T11:52:36.437450+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:11.366968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'217","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932471+0000","last_change":"2024-09-14T11:11:04.651404+0000","last_active":"2024-09-14T11:50:38.932471+0000","last_peered":"2024-09-14T11:50:38.932471+0000","last_clean":"2024-09-14T11:50:38.932471+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:50:38.932471+0000","last_undegraded":"2024-09-14T11:50:38.932471+0000","last_fullsized":"2024-09-14T11:50:38.932471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:30.338647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8827718,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":593,"num_read_kb":30059,"num_write":1068,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'879","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892231+0000","last_change":"2024-09-14T11:11:06.647529+0000","last_active":"2024-09-14T11:51:03.892231+0000","last_peered":"2024-09-14T11:51:03.892231+0000","last_clean":"2024-09-14T11:51:03.892231+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:51:03.892231+0000","last_undegraded":"2024-09-14T11:51:03.892231+0000","last_fullsized":"2024-09-14T11:51:03.892231+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:50.451539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'211","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.160046+0000","last_change":"2024-09-14T11:11:04.655250+0000","last_active":"2024-09-14T11:50:56.160046+0000","last_peered":"2024-09-14T11:50:56.160046+0000","last_clean":"2024-09-14T11:50:56.160046+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:50:56.160046+0000","last_undegraded":"2024-09-14T11:50:56.160046+0000","last_fullsized":"2024-09-14T11:50:56.160046+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:56.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6603918,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":721,"num_read_kb":74662,"num_write":884,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'393","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884504+0000","last_change":"2024-09-14T11:11:06.651444+0000","last_active":"2024-09-14T11:51:07.884504+0000","last_peered":"2024-09-14T11:51:07.884504+0000","last_clean":"2024-09-14T11:51:07.884504+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:51:07.884504+0000","last_undegraded":"2024-09-14T11:51:07.884504+0000","last_fullsized":"2024-09-14T11:51:07.884504+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:10.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'240","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.369693+0000","last_change":"2024-09-14T11:11:04.668428+0000","last_active":"2024-09-14T11:51:06.369693+0000","last_peered":"2024-09-14T11:51:06.369693+0000","last_clean":"2024-09-14T11:51:06.369693+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:51:06.369693+0000","last_undegraded":"2024-09-14T11:51:06.369693+0000","last_fullsized":"2024-09-14T11:51:06.369693+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:29.887388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10515237,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":17405,"num_write":1112,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'821","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172559+0000","last_change":"2024-09-14T11:11:06.657319+0000","last_active":"2024-09-14T11:51:07.172559+0000","last_peered":"2024-09-14T11:51:07.172559+0000","last_clean":"2024-09-14T11:51:07.172559+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:51:07.172559+0000","last_undegraded":"2024-09-14T11:51:07.172559+0000","last_fullsized":"2024-09-14T11:51:07.172559+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:34.511950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'208","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.190600+0000","last_change":"2024-09-14T11:11:04.664423+0000","last_active":"2024-09-14T11:51:18.190600+0000","last_peered":"2024-09-14T11:51:18.190600+0000","last_clean":"2024-09-14T11:51:18.190600+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:51:18.190600+0000","last_undegraded":"2024-09-14T11:51:18.190600+0000","last_fullsized":"2024-09-14T11:51:18.190600+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.472044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18938362,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":70473,"num_write":971,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'495","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.163975+0000","last_change":"2024-09-14T11:11:06.646675+0000","last_active":"2024-09-14T11:51:07.163975+0000","last_peered":"2024-09-14T11:51:07.163975+0000","last_clean":"2024-09-14T11:51:07.163975+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:51:07.163975+0000","last_undegraded":"2024-09-14T11:51:07.163975+0000","last_fullsized":"2024-09-14T11:51:07.163975+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:56.132334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'220","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.200016+0000","last_change":"2024-09-14T11:11:04.667849+0000","last_active":"2024-09-14T11:50:43.200016+0000","last_peered":"2024-09-14T11:50:43.200016+0000","last_clean":"2024-09-14T11:50:43.200016+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:50:43.200016+0000","last_undegraded":"2024-09-14T11:50:43.200016+0000","last_fullsized":"2024-09-14T11:50:43.200016+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:54.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385564,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":10772,"num_write":1046,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'701","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.166203+0000","last_change":"2024-09-14T11:11:06.661372+0000","last_active":"2024-09-14T11:51:07.166203+0000","last_peered":"2024-09-14T11:51:07.166203+0000","last_clean":"2024-09-14T11:51:07.166203+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:51:07.166203+0000","last_undegraded":"2024-09-14T11:51:07.166203+0000","last_fullsized":"2024-09-14T11:51:07.166203+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:52.380188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'228","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:36.642723+0000","last_change":"2024-09-14T11:11:04.640592+0000","last_active":"2024-09-14T11:50:36.642723+0000","last_peered":"2024-09-14T11:50:36.642723+0000","last_clean":"2024-09-14T11:50:36.642723+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:50:36.642723+0000","last_undegraded":"2024-09-14T11:50:36.642723+0000","last_fullsized":"2024-09-14T11:50:36.642723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13670080,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1294,"num_read_kb":98345,"num_write":1089,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'780","reported_seq":2329,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.839282+0000","last_change":"2024-09-14T11:11:06.661394+0000","last_active":"2024-09-14T11:51:21.839282+0000","last_peered":"2024-09-14T11:51:21.839282+0000","last_clean":"2024-09-14T11:51:21.839282+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:51:21.839282+0000","last_undegraded":"2024-09-14T11:51:21.839282+0000","last_fullsized":"2024-09-14T11:51:21.839282+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'845","reported_seq":2375,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444047+0000","last_change":"2024-09-14T11:11:06.647432+0000","last_active":"2024-09-14T11:52:36.444047+0000","last_peered":"2024-09-14T11:52:36.444047+0000","last_clean":"2024-09-14T11:52:36.444047+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:52:36.444047+0000","last_undegraded":"2024-09-14T11:52:36.444047+0000","last_fullsized":"2024-09-14T11:52:36.444047+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:37.920539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'233","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044684+0000","last_change":"2024-09-14T11:11:04.664149+0000","last_active":"2024-09-14T11:49:49.044684+0000","last_peered":"2024-09-14T11:49:49.044684+0000","last_clean":"2024-09-14T11:49:49.044684+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:49:49.044684+0000","last_undegraded":"2024-09-14T11:49:49.044684+0000","last_fullsized":"2024-09-14T11:49:49.044684+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:28.501517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213754,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":29179,"num_write":1116,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884906+0000","last_change":"2024-09-14T11:11:06.659339+0000","last_active":"2024-09-14T11:51:07.884906+0000","last_peered":"2024-09-14T11:51:07.884906+0000","last_clean":"2024-09-14T11:51:07.884906+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:51:07.884906+0000","last_undegraded":"2024-09-14T11:51:07.884906+0000","last_fullsized":"2024-09-14T11:51:07.884906+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:19.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'226","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.473221+0000","last_change":"2024-09-14T11:11:04.664561+0000","last_active":"2024-09-14T11:50:28.473221+0000","last_peered":"2024-09-14T11:50:28.473221+0000","last_clean":"2024-09-14T11:50:28.473221+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:50:28.473221+0000","last_undegraded":"2024-09-14T11:50:28.473221+0000","last_fullsized":"2024-09-14T11:50:28.473221+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.906199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13997357,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":811,"num_read_kb":241766,"num_write":931,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'516","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.877314+0000","last_change":"2024-09-14T11:11:06.656279+0000","last_active":"2024-09-14T11:51:07.877314+0000","last_peered":"2024-09-14T11:51:07.877314+0000","last_clean":"2024-09-14T11:51:07.877314+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:51:07.877314+0000","last_undegraded":"2024-09-14T11:51:07.877314+0000","last_fullsized":"2024-09-14T11:51:07.877314+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:24.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'264","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.379755+0000","last_change":"2024-09-14T11:11:04.661546+0000","last_active":"2024-09-14T11:50:29.379755+0000","last_peered":"2024-09-14T11:50:29.379755+0000","last_clean":"2024-09-14T11:50:29.379755+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:50:29.379755+0000","last_undegraded":"2024-09-14T11:50:29.379755+0000","last_fullsized":"2024-09-14T11:50:29.379755+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:24.019669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116413,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":32322,"num_write":1000,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'857","reported_seq":2392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316678+0000","last_change":"2024-09-14T11:11:06.659835+0000","last_active":"2024-09-14T11:51:21.316678+0000","last_peered":"2024-09-14T11:51:21.316678+0000","last_clean":"2024-09-14T11:51:21.316678+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:51:21.316678+0000","last_undegraded":"2024-09-14T11:51:21.316678+0000","last_fullsized":"2024-09-14T11:51:21.316678+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.436038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'229","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.321356+0000","last_change":"2024-09-14T11:11:04.651670+0000","last_active":"2024-09-14T11:51:18.321356+0000","last_peered":"2024-09-14T11:51:18.321356+0000","last_clean":"2024-09-14T11:51:18.321356+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:51:18.321356+0000","last_undegraded":"2024-09-14T11:51:18.321356+0000","last_fullsized":"2024-09-14T11:51:18.321356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:12.731774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747755,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":708,"num_read_kb":18423,"num_write":1031,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1027","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746607+0000","last_change":"2024-09-14T11:11:06.659366+0000","last_active":"2024-09-14T11:51:08.746607+0000","last_peered":"2024-09-14T11:51:08.746607+0000","last_clean":"2024-09-14T11:51:08.746607+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:51:08.746607+0000","last_undegraded":"2024-09-14T11:51:08.746607+0000","last_fullsized":"2024-09-14T11:51:08.746607+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:22.893626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'206","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.383060+0000","last_change":"2024-09-14T11:11:04.656617+0000","last_active":"2024-09-14T11:51:01.383060+0000","last_peered":"2024-09-14T11:51:01.383060+0000","last_clean":"2024-09-14T11:51:01.383060+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:51:01.383060+0000","last_undegraded":"2024-09-14T11:51:01.383060+0000","last_fullsized":"2024-09-14T11:51:01.383060+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242894,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":19801,"num_write":943,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'477","reported_seq":2041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172995+0000","last_change":"2024-09-14T11:11:06.651961+0000","last_active":"2024-09-14T11:51:07.172995+0000","last_peered":"2024-09-14T11:51:07.172995+0000","last_clean":"2024-09-14T11:51:07.172995+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:51:07.172995+0000","last_undegraded":"2024-09-14T11:51:07.172995+0000","last_fullsized":"2024-09-14T11:51:07.172995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:22.258915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'228","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:41.967486+0000","last_change":"2024-09-14T11:11:04.655697+0000","last_active":"2024-09-14T11:50:41.967486+0000","last_peered":"2024-09-14T11:50:41.967486+0000","last_clean":"2024-09-14T11:50:41.967486+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:50:41.967486+0000","last_undegraded":"2024-09-14T11:50:41.967486+0000","last_fullsized":"2024-09-14T11:50:41.967486+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:15.626721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512993,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1263,"num_read_kb":11303,"num_write":1120,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'134","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.905769+0000","last_change":"2024-09-14T11:11:14.694441+0000","last_active":"2024-09-14T11:51:21.905769+0000","last_peered":"2024-09-14T11:51:21.905769+0000","last_clean":"2024-09-14T11:51:21.905769+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:51:21.905769+0000","last_undegraded":"2024-09-14T11:51:21.905769+0000","last_fullsized":"2024-09-14T11:51:21.905769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:00.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'942","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.164829+0000","last_change":"2024-09-14T11:11:06.652516+0000","last_active":"2024-09-14T11:51:07.164829+0000","last_peered":"2024-09-14T11:51:07.164829+0000","last_clean":"2024-09-14T11:51:07.164829+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:51:07.164829+0000","last_undegraded":"2024-09-14T11:51:07.164829+0000","last_fullsized":"2024-09-14T11:51:07.164829+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":900,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:57.934785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'231","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:46.126009+0000","last_change":"2024-09-14T11:11:04.656642+0000","last_active":"2024-09-14T11:50:46.126009+0000","last_peered":"2024-09-14T11:50:46.126009+0000","last_clean":"2024-09-14T11:50:46.126009+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:50:46.126009+0000","last_undegraded":"2024-09-14T11:50:46.126009+0000","last_fullsized":"2024-09-14T11:50:46.126009+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:50.939065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":730,"num_read_kb":7795,"num_write":1211,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.266018+0000","last_change":"2024-09-14T11:11:08.656138+0000","last_active":"2024-09-14T11:52:37.266018+0000","last_peered":"2024-09-14T11:52:37.266018+0000","last_clean":"2024-09-14T11:52:37.266018+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:52:37.266018+0000","last_undegraded":"2024-09-14T11:52:37.266018+0000","last_fullsized":"2024-09-14T11:52:37.266018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:46.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'187","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945861+0000","last_change":"2024-09-14T11:11:10.669375+0000","last_active":"2024-09-14T11:52:18.945861+0000","last_peered":"2024-09-14T11:52:18.945861+0000","last_clean":"2024-09-14T11:52:18.945861+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:52:18.945861+0000","last_undegraded":"2024-09-14T11:52:18.945861+0000","last_fullsized":"2024-09-14T11:52:18.945861+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:40.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19747,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":326,"num_write":148,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045436+0000","last_change":"2024-09-14T11:11:12.678656+0000","last_active":"2024-09-14T11:49:54.045436+0000","last_peered":"2024-09-14T11:49:54.045436+0000","last_clean":"2024-09-14T11:49:54.045436+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:49:54.045436+0000","last_undegraded":"2024-09-14T11:49:54.045436+0000","last_fullsized":"2024-09-14T11:49:54.045436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:17.903974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2494","reported_seq":4314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.904000+0000","last_change":"2024-09-14T11:11:14.691811+0000","last_active":"2024-09-14T11:51:21.904000+0000","last_peered":"2024-09-14T11:51:21.904000+0000","last_clean":"2024-09-14T11:51:21.904000+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:51:21.904000+0000","last_undegraded":"2024-09-14T11:51:21.904000+0000","last_fullsized":"2024-09-14T11:51:21.904000+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.391799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'506","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845475+0000","last_change":"2024-09-14T11:11:06.653951+0000","last_active":"2024-09-14T11:51:21.845475+0000","last_peered":"2024-09-14T11:51:21.845475+0000","last_clean":"2024-09-14T11:51:21.845475+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:51:21.845475+0000","last_undegraded":"2024-09-14T11:51:21.845475+0000","last_fullsized":"2024-09-14T11:51:21.845475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:23.277940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'187","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.054338+0000","last_change":"2024-09-14T11:11:04.658016+0000","last_active":"2024-09-14T11:51:03.054338+0000","last_peered":"2024-09-14T11:51:03.054338+0000","last_clean":"2024-09-14T11:51:03.054338+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:51:03.054338+0000","last_undegraded":"2024-09-14T11:51:03.054338+0000","last_fullsized":"2024-09-14T11:51:03.054338+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.325176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075352,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":11633,"num_write":912,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915492+0000","last_change":"2024-09-14T11:11:08.651536+0000","last_active":"2024-09-14T11:48:38.915492+0000","last_peered":"2024-09-14T11:48:38.915492+0000","last_clean":"2024-09-14T11:48:38.915492+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:48:38.915492+0000","last_undegraded":"2024-09-14T11:48:38.915492+0000","last_fullsized":"2024-09-14T11:48:38.915492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:53.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'91","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.281938+0000","last_change":"2024-09-14T11:11:10.665667+0000","last_active":"2024-09-14T11:51:19.281938+0000","last_peered":"2024-09-14T11:51:19.281938+0000","last_clean":"2024-09-14T11:51:19.281938+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:51:19.281938+0000","last_undegraded":"2024-09-14T11:51:19.281938+0000","last_fullsized":"2024-09-14T11:51:19.281938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924491+0000","last_change":"2024-09-14T11:11:12.680761+0000","last_active":"2024-09-14T11:49:53.924491+0000","last_peered":"2024-09-14T11:49:53.924491+0000","last_clean":"2024-09-14T11:49:53.924491+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:49:53.924491+0000","last_undegraded":"2024-09-14T11:49:53.924491+0000","last_fullsized":"2024-09-14T11:49:53.924491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:43.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'123","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.339329+0000","last_change":"2024-09-14T11:11:14.689043+0000","last_active":"2024-09-14T11:50:55.339329+0000","last_peered":"2024-09-14T11:50:55.339329+0000","last_clean":"2024-09-14T11:50:55.339329+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:50:55.339329+0000","last_undegraded":"2024-09-14T11:50:55.339329+0000","last_fullsized":"2024-09-14T11:50:55.339329+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:04.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845324+0000","last_change":"2024-09-14T11:11:06.647241+0000","last_active":"2024-09-14T11:51:21.845324+0000","last_peered":"2024-09-14T11:51:21.845324+0000","last_clean":"2024-09-14T11:51:21.845324+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:51:21.845324+0000","last_undegraded":"2024-09-14T11:51:21.845324+0000","last_fullsized":"2024-09-14T11:51:21.845324+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'181","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:51.690075+0000","last_change":"2024-09-14T11:11:04.664751+0000","last_active":"2024-09-14T11:49:51.690075+0000","last_peered":"2024-09-14T11:49:51.690075+0000","last_clean":"2024-09-14T11:49:51.690075+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:49:51.690075+0000","last_undegraded":"2024-09-14T11:49:51.690075+0000","last_fullsized":"2024-09-14T11:49:51.690075+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.450319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5390582,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":25054,"num_write":823,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925536+0000","last_change":"2024-09-14T11:11:08.651600+0000","last_active":"2024-09-14T11:49:48.925536+0000","last_peered":"2024-09-14T11:49:48.925536+0000","last_clean":"2024-09-14T11:49:48.925536+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:49:48.925536+0000","last_undegraded":"2024-09-14T11:49:48.925536+0000","last_fullsized":"2024-09-14T11:49:48.925536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.328934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'113","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.299521+0000","last_change":"2024-09-14T11:11:10.667489+0000","last_active":"2024-09-14T11:51:19.299521+0000","last_peered":"2024-09-14T11:51:19.299521+0000","last_clean":"2024-09-14T11:51:19.299521+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:51:19.299521+0000","last_undegraded":"2024-09-14T11:51:19.299521+0000","last_fullsized":"2024-09-14T11:51:19.299521+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:08.313976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.559155+0000","last_change":"2024-09-14T11:11:12.682478+0000","last_active":"2024-09-14T11:52:37.559155+0000","last_peered":"2024-09-14T11:52:37.559155+0000","last_clean":"2024-09-14T11:52:37.559155+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:52:37.559155+0000","last_undegraded":"2024-09-14T11:52:37.559155+0000","last_fullsized":"2024-09-14T11:52:37.559155+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:25.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'257","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.373071+0000","last_change":"2024-09-14T11:11:14.886604+0000","last_active":"2024-09-14T11:51:21.373071+0000","last_peered":"2024-09-14T11:51:21.373071+0000","last_clean":"2024-09-14T11:51:21.373071+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:51:21.373071+0000","last_undegraded":"2024-09-14T11:51:21.373071+0000","last_fullsized":"2024-09-14T11:51:21.373071+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:17.055065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'608","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845477+0000","last_change":"2024-09-14T11:11:06.655177+0000","last_active":"2024-09-14T11:51:21.845477+0000","last_peered":"2024-09-14T11:51:21.845477+0000","last_clean":"2024-09-14T11:51:21.845477+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:51:21.845477+0000","last_undegraded":"2024-09-14T11:51:21.845477+0000","last_fullsized":"2024-09-14T11:51:21.845477+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.592691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'252","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.034403+0000","last_change":"2024-09-14T11:11:04.660596+0000","last_active":"2024-09-14T11:50:59.034403+0000","last_peered":"2024-09-14T11:50:59.034403+0000","last_clean":"2024-09-14T11:50:59.034403+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:50:59.034403+0000","last_undegraded":"2024-09-14T11:50:59.034403+0000","last_fullsized":"2024-09-14T11:50:59.034403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:08.025245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305578,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1218,"num_read_kb":9329,"num_write":1108,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.924083+0000","last_change":"2024-09-14T11:11:08.658911+0000","last_active":"2024-09-14T11:49:48.924083+0000","last_peered":"2024-09-14T11:49:48.924083+0000","last_clean":"2024-09-14T11:49:48.924083+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:49:48.924083+0000","last_undegraded":"2024-09-14T11:49:48.924083+0000","last_fullsized":"2024-09-14T11:49:48.924083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:43.590217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'112","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.068059+0000","last_change":"2024-09-14T11:11:10.883531+0000","last_active":"2024-09-14T11:52:19.068059+0000","last_peered":"2024-09-14T11:52:19.068059+0000","last_clean":"2024-09-14T11:52:19.068059+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:52:19.068059+0000","last_undegraded":"2024-09-14T11:52:19.068059+0000","last_fullsized":"2024-09-14T11:52:19.068059+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:37.652994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":149,"num_read_kb":192,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'816","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.563054+0000","last_change":"2024-09-14T11:11:12.683537+0000","last_active":"2024-09-14T11:52:37.563054+0000","last_peered":"2024-09-14T11:52:37.563054+0000","last_clean":"2024-09-14T11:52:37.563054+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:52:37.563054+0000","last_undegraded":"2024-09-14T11:52:37.563054+0000","last_fullsized":"2024-09-14T11:52:37.563054+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:38.308562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'475","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316625+0000","last_change":"2024-09-14T11:11:06.651830+0000","last_active":"2024-09-14T11:51:21.316625+0000","last_peered":"2024-09-14T11:51:21.316625+0000","last_clean":"2024-09-14T11:51:21.316625+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:51:21.316625+0000","last_undegraded":"2024-09-14T11:51:21.316625+0000","last_fullsized":"2024-09-14T11:51:21.316625+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:55.868674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'218","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.175726+0000","last_change":"2024-09-14T11:11:04.665193+0000","last_active":"2024-09-14T11:50:54.175726+0000","last_peered":"2024-09-14T11:50:54.175726+0000","last_clean":"2024-09-14T11:50:54.175726+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:50:54.175726+0000","last_undegraded":"2024-09-14T11:50:54.175726+0000","last_fullsized":"2024-09-14T11:50:54.175726+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:01.335563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10562869,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":75141,"num_write":983,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.047547+0000","last_change":"2024-09-14T11:11:08.659594+0000","last_active":"2024-09-14T11:50:09.047547+0000","last_peered":"2024-09-14T11:50:09.047547+0000","last_clean":"2024-09-14T11:50:09.047547+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:50:09.047547+0000","last_undegraded":"2024-09-14T11:50:09.047547+0000","last_fullsized":"2024-09-14T11:50:09.047547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:14.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'199","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.947343+0000","last_change":"2024-09-14T11:11:10.883185+0000","last_active":"2024-09-14T11:52:33.947343+0000","last_peered":"2024-09-14T11:52:33.947343+0000","last_clean":"2024-09-14T11:52:33.947343+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:52:33.947343+0000","last_undegraded":"2024-09-14T11:52:33.947343+0000","last_fullsized":"2024-09-14T11:52:33.947343+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:41.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14491,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":272,"num_read_kb":340,"num_write":158,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922914+0000","last_change":"2024-09-14T11:11:12.678507+0000","last_active":"2024-09-14T11:49:28.922914+0000","last_peered":"2024-09-14T11:49:28.922914+0000","last_clean":"2024-09-14T11:49:28.922914+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:49:28.922914+0000","last_undegraded":"2024-09-14T11:49:28.922914+0000","last_fullsized":"2024-09-14T11:49:28.922914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:11.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'544","reported_seq":1345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546676+0000","last_change":"2024-09-14T11:11:14.691810+0000","last_active":"2024-09-14T11:52:37.546676+0000","last_peered":"2024-09-14T11:52:37.546676+0000","last_clean":"2024-09-14T11:52:37.546676+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:52:37.546676+0000","last_undegraded":"2024-09-14T11:52:37.546676+0000","last_fullsized":"2024-09-14T11:52:37.546676+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:33.081563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892238+0000","last_change":"2024-09-14T11:11:06.650970+0000","last_active":"2024-09-14T11:51:03.892238+0000","last_peered":"2024-09-14T11:51:03.892238+0000","last_clean":"2024-09-14T11:51:03.892238+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:51:03.892238+0000","last_undegraded":"2024-09-14T11:51:03.892238+0000","last_fullsized":"2024-09-14T11:51:03.892238+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:08.200982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'221","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.223936+0000","last_change":"2024-09-14T11:11:04.653785+0000","last_active":"2024-09-14T11:52:32.223936+0000","last_peered":"2024-09-14T11:52:32.223936+0000","last_clean":"2024-09-14T11:52:32.223936+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:32.223936+0000","last_undegraded":"2024-09-14T11:52:32.223936+0000","last_fullsized":"2024-09-14T11:52:32.223936+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:13.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272073,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":64064,"num_write":1009,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032486+0000","last_change":"2024-09-14T11:11:08.650799+0000","last_active":"2024-09-14T11:50:09.032486+0000","last_peered":"2024-09-14T11:50:09.032486+0000","last_clean":"2024-09-14T11:50:09.032486+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:50:09.032486+0000","last_undegraded":"2024-09-14T11:50:09.032486+0000","last_fullsized":"2024-09-14T11:50:09.032486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:34.338293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'134","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.941199+0000","last_change":"2024-09-14T11:11:10.669181+0000","last_active":"2024-09-14T11:51:43.941199+0000","last_peered":"2024-09-14T11:51:43.941199+0000","last_clean":"2024-09-14T11:51:43.941199+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:51:43.941199+0000","last_undegraded":"2024-09-14T11:51:43.941199+0000","last_fullsized":"2024-09-14T11:51:43.941199+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:51.810244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":196,"num_write":80,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930561+0000","last_change":"2024-09-14T11:11:12.677186+0000","last_active":"2024-09-14T11:50:23.930561+0000","last_peered":"2024-09-14T11:50:23.930561+0000","last_clean":"2024-09-14T11:50:23.930561+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:50:23.930561+0000","last_undegraded":"2024-09-14T11:50:23.930561+0000","last_fullsized":"2024-09-14T11:50:23.930561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:15.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'120","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217471+0000","last_change":"2024-09-14T11:11:14.693436+0000","last_active":"2024-09-14T11:51:19.217471+0000","last_peered":"2024-09-14T11:51:19.217471+0000","last_clean":"2024-09-14T11:51:19.217471+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:51:19.217471+0000","last_undegraded":"2024-09-14T11:51:19.217471+0000","last_fullsized":"2024-09-14T11:51:19.217471+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:36.190584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'378","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220246+0000","last_change":"2024-09-14T11:11:06.660214+0000","last_active":"2024-09-14T11:51:19.220246+0000","last_peered":"2024-09-14T11:51:19.220246+0000","last_clean":"2024-09-14T11:51:19.220246+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:51:19.220246+0000","last_undegraded":"2024-09-14T11:51:19.220246+0000","last_fullsized":"2024-09-14T11:51:19.220246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:34.858894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'210","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.434739+0000","last_change":"2024-09-14T11:11:04.668094+0000","last_active":"2024-09-14T11:50:30.434739+0000","last_peered":"2024-09-14T11:50:30.434739+0000","last_clean":"2024-09-14T11:50:30.434739+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:50:30.434739+0000","last_undegraded":"2024-09-14T11:50:30.434739+0000","last_fullsized":"2024-09-14T11:50:30.434739+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:01.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11916459,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":527,"num_read_kb":106187,"num_write":922,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027228+0000","last_change":"2024-09-14T11:11:08.655858+0000","last_active":"2024-09-14T11:49:24.027228+0000","last_peered":"2024-09-14T11:49:24.027228+0000","last_clean":"2024-09-14T11:49:24.027228+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:49:24.027228+0000","last_undegraded":"2024-09-14T11:49:24.027228+0000","last_fullsized":"2024-09-14T11:49:24.027228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.623644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'155","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.068936+0000","last_change":"2024-09-14T11:11:10.670978+0000","last_active":"2024-09-14T11:52:24.068936+0000","last_peered":"2024-09-14T11:52:24.068936+0000","last_clean":"2024-09-14T11:52:24.068936+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:52:24.068936+0000","last_undegraded":"2024-09-14T11:52:24.068936+0000","last_fullsized":"2024-09-14T11:52:24.068936+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:50.765426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13443,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":191,"num_read_kb":234,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'771","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.564067+0000","last_change":"2024-09-14T11:11:12.682806+0000","last_active":"2024-09-14T11:52:37.564067+0000","last_peered":"2024-09-14T11:52:37.564067+0000","last_clean":"2024-09-14T11:52:37.564067+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:52:37.564067+0000","last_undegraded":"2024-09-14T11:52:37.564067+0000","last_fullsized":"2024-09-14T11:52:37.564067+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:25.160041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.385498+0000","last_change":"2024-09-14T11:11:14.691211+0000","last_active":"2024-09-14T11:52:36.385498+0000","last_peered":"2024-09-14T11:52:36.385498+0000","last_clean":"2024-09-14T11:52:36.385498+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:52:36.385498+0000","last_undegraded":"2024-09-14T11:52:36.385498+0000","last_fullsized":"2024-09-14T11:52:36.385498+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:53.737487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'567","reported_seq":2331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746198+0000","last_change":"2024-09-14T11:11:06.650873+0000","last_active":"2024-09-14T11:51:08.746198+0000","last_peered":"2024-09-14T11:51:08.746198+0000","last_clean":"2024-09-14T11:51:08.746198+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:51:08.746198+0000","last_undegraded":"2024-09-14T11:51:08.746198+0000","last_fullsized":"2024-09-14T11:51:08.746198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:08.434480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'196","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.339362+0000","last_change":"2024-09-14T11:11:04.660578+0000","last_active":"2024-09-14T11:51:18.339362+0000","last_peered":"2024-09-14T11:51:18.339362+0000","last_clean":"2024-09-14T11:51:18.339362+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:51:18.339362+0000","last_undegraded":"2024-09-14T11:51:18.339362+0000","last_fullsized":"2024-09-14T11:51:18.339362+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:17.074637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19961458,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":448,"num_read_kb":32213,"num_write":864,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033264+0000","last_change":"2024-09-14T11:11:08.657835+0000","last_active":"2024-09-14T11:50:14.033264+0000","last_peered":"2024-09-14T11:50:14.033264+0000","last_clean":"2024-09-14T11:50:14.033264+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:50:14.033264+0000","last_undegraded":"2024-09-14T11:50:14.033264+0000","last_fullsized":"2024-09-14T11:50:14.033264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:05.975239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.513319+0000","last_change":"2024-09-14T11:11:10.668579+0000","last_active":"2024-09-14T11:52:37.513319+0000","last_peered":"2024-09-14T11:52:37.513319+0000","last_clean":"2024-09-14T11:52:37.513319+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:52:37.513319+0000","last_undegraded":"2024-09-14T11:52:37.513319+0000","last_fullsized":"2024-09-14T11:52:37.513319+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:33.675356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":342,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033234+0000","last_change":"2024-09-14T11:11:12.682825+0000","last_active":"2024-09-14T11:50:14.033234+0000","last_peered":"2024-09-14T11:50:14.033234+0000","last_clean":"2024-09-14T11:50:14.033234+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:50:14.033234+0000","last_undegraded":"2024-09-14T11:50:14.033234+0000","last_fullsized":"2024-09-14T11:50:14.033234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.085965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'136","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.046297+0000","last_change":"2024-09-14T11:11:14.694759+0000","last_active":"2024-09-14T11:51:20.046297+0000","last_peered":"2024-09-14T11:51:20.046297+0000","last_clean":"2024-09-14T11:51:20.046297+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:51:20.046297+0000","last_undegraded":"2024-09-14T11:51:20.046297+0000","last_fullsized":"2024-09-14T11:51:20.046297+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:34.568185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'810","reported_seq":2363,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892524+0000","last_change":"2024-09-14T11:11:06.652129+0000","last_active":"2024-09-14T11:51:03.892524+0000","last_peered":"2024-09-14T11:51:03.892524+0000","last_clean":"2024-09-14T11:51:03.892524+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:51:03.892524+0000","last_undegraded":"2024-09-14T11:51:03.892524+0000","last_fullsized":"2024-09-14T11:51:03.892524+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.890024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'183","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.874736+0000","last_change":"2024-09-14T11:11:37.865182+0000","last_active":"2024-09-14T11:50:56.874736+0000","last_peered":"2024-09-14T11:50:56.874736+0000","last_clean":"2024-09-14T11:50:56.874736+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:50:56.874736+0000","last_undegraded":"2024-09-14T11:50:56.874736+0000","last_fullsized":"2024-09-14T11:50:56.874736+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:29.726878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623312,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":54806,"num_write":888,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027253+0000","last_change":"2024-09-14T11:11:08.653918+0000","last_active":"2024-09-14T11:49:24.027253+0000","last_peered":"2024-09-14T11:49:24.027253+0000","last_clean":"2024-09-14T11:49:24.027253+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:49:24.027253+0000","last_undegraded":"2024-09-14T11:49:24.027253+0000","last_fullsized":"2024-09-14T11:49:24.027253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:12.531488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'134","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.939981+0000","last_change":"2024-09-14T11:11:10.665945+0000","last_active":"2024-09-14T11:51:43.939981+0000","last_peered":"2024-09-14T11:51:43.939981+0000","last_clean":"2024-09-14T11:51:43.939981+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:51:43.939981+0000","last_undegraded":"2024-09-14T11:51:43.939981+0000","last_fullsized":"2024-09-14T11:51:43.939981+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8529,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":213,"num_write":158,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.924548+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:49:38.924548+0000","last_peered":"2024-09-14T11:49:38.924548+0000","last_clean":"2024-09-14T11:49:38.924548+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:49:38.924548+0000","last_undegraded":"2024-09-14T11:49:38.924548+0000","last_fullsized":"2024-09-14T11:49:38.924548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:21.465336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938149+0000","last_change":"2024-09-14T11:11:14.690952+0000","last_active":"2024-09-14T11:51:23.938149+0000","last_peered":"2024-09-14T11:51:23.938149+0000","last_clean":"2024-09-14T11:51:23.938149+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:51:23.938149+0000","last_undegraded":"2024-09-14T11:51:23.938149+0000","last_fullsized":"2024-09-14T11:51:23.938149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:31.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'616","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444129+0000","last_change":"2024-09-14T11:11:06.651982+0000","last_active":"2024-09-14T11:52:36.444129+0000","last_peered":"2024-09-14T11:52:36.444129+0000","last_clean":"2024-09-14T11:52:36.444129+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:36.444129+0000","last_undegraded":"2024-09-14T11:52:36.444129+0000","last_fullsized":"2024-09-14T11:52:36.444129+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:10.685569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'216","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.024934+0000","last_change":"2024-09-14T11:11:37.866224+0000","last_active":"2024-09-14T11:50:17.024934+0000","last_peered":"2024-09-14T11:50:17.024934+0000","last_clean":"2024-09-14T11:50:17.024934+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:50:17.024934+0000","last_undegraded":"2024-09-14T11:50:17.024934+0000","last_fullsized":"2024-09-14T11:50:17.024934+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:52.787000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102567,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1165,"num_read_kb":81327,"num_write":1107,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922198+0000","last_change":"2024-09-14T11:11:08.657858+0000","last_active":"2024-09-14T11:49:23.922198+0000","last_peered":"2024-09-14T11:49:23.922198+0000","last_clean":"2024-09-14T11:49:23.922198+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:49:23.922198+0000","last_undegraded":"2024-09-14T11:49:23.922198+0000","last_fullsized":"2024-09-14T11:49:23.922198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:46.337725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'185","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.045239+0000","last_change":"2024-09-14T11:11:10.669699+0000","last_active":"2024-09-14T11:51:49.045239+0000","last_peered":"2024-09-14T11:51:49.045239+0000","last_clean":"2024-09-14T11:51:49.045239+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:51:49.045239+0000","last_undegraded":"2024-09-14T11:51:49.045239+0000","last_fullsized":"2024-09-14T11:51:49.045239+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:05.013360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10070,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":240,"num_write":126,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.560250+0000","last_change":"2024-09-14T11:11:12.680262+0000","last_active":"2024-09-14T11:52:37.560250+0000","last_peered":"2024-09-14T11:52:37.560250+0000","last_clean":"2024-09-14T11:52:37.560250+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:52:37.560250+0000","last_undegraded":"2024-09-14T11:52:37.560250+0000","last_fullsized":"2024-09-14T11:52:37.560250+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:15.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'112","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.672032+0000","last_change":"2024-09-14T11:11:14.694188+0000","last_active":"2024-09-14T11:51:21.672032+0000","last_peered":"2024-09-14T11:51:21.672032+0000","last_clean":"2024-09-14T11:51:21.672032+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:51:21.672032+0000","last_undegraded":"2024-09-14T11:51:21.672032+0000","last_fullsized":"2024-09-14T11:51:21.672032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:45.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438948+0000","last_change":"2024-09-14T11:11:06.655465+0000","last_active":"2024-09-14T11:52:36.438948+0000","last_peered":"2024-09-14T11:52:36.438948+0000","last_clean":"2024-09-14T11:52:36.438948+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:52:36.438948+0000","last_undegraded":"2024-09-14T11:52:36.438948+0000","last_fullsized":"2024-09-14T11:52:36.438948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:40.046089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'211","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.828145+0000","last_change":"2024-09-14T11:11:04.650554+0000","last_active":"2024-09-14T11:51:03.828145+0000","last_peered":"2024-09-14T11:51:03.828145+0000","last_clean":"2024-09-14T11:51:03.828145+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:51:03.828145+0000","last_undegraded":"2024-09-14T11:51:03.828145+0000","last_fullsized":"2024-09-14T11:51:03.828145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:21.487349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159355,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":779,"num_read_kb":15229,"num_write":1051,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.278236+0000","last_change":"2024-09-14T11:11:08.657746+0000","last_active":"2024-09-14T11:52:37.278236+0000","last_peered":"2024-09-14T11:52:37.278236+0000","last_clean":"2024-09-14T11:52:37.278236+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:52:37.278236+0000","last_undegraded":"2024-09-14T11:52:37.278236+0000","last_fullsized":"2024-09-14T11:52:37.278236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:46.646901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'65","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.268760+0000","last_change":"2024-09-14T11:11:10.883189+0000","last_active":"2024-09-14T11:51:19.268760+0000","last_peered":"2024-09-14T11:51:19.268760+0000","last_clean":"2024-09-14T11:51:19.268760+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:51:19.268760+0000","last_undegraded":"2024-09-14T11:51:19.268760+0000","last_fullsized":"2024-09-14T11:51:19.268760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:23.532287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'765","reported_seq":2415,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.561158+0000","last_change":"2024-09-14T11:11:12.682993+0000","last_active":"2024-09-14T11:52:37.561158+0000","last_peered":"2024-09-14T11:52:37.561158+0000","last_clean":"2024-09-14T11:52:37.561158+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:52:37.561158+0000","last_undegraded":"2024-09-14T11:52:37.561158+0000","last_fullsized":"2024-09-14T11:52:37.561158+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:56.550659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.800307+0000","last_change":"2024-09-14T11:11:14.697448+0000","last_active":"2024-09-14T11:50:57.800307+0000","last_peered":"2024-09-14T11:50:57.800307+0000","last_clean":"2024-09-14T11:50:57.800307+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:50:57.800307+0000","last_undegraded":"2024-09-14T11:50:57.800307+0000","last_fullsized":"2024-09-14T11:50:57.800307+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220492+0000","last_change":"2024-09-14T11:11:06.661084+0000","last_active":"2024-09-14T11:51:19.220492+0000","last_peered":"2024-09-14T11:51:19.220492+0000","last_clean":"2024-09-14T11:51:19.220492+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:51:19.220492+0000","last_undegraded":"2024-09-14T11:51:19.220492+0000","last_fullsized":"2024-09-14T11:51:19.220492+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:51.729421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'196","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.343430+0000","last_change":"2024-09-14T11:11:04.652428+0000","last_active":"2024-09-14T11:51:18.343430+0000","last_peered":"2024-09-14T11:51:18.343430+0000","last_clean":"2024-09-14T11:51:18.343430+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:51:18.343430+0000","last_undegraded":"2024-09-14T11:51:18.343430+0000","last_fullsized":"2024-09-14T11:51:18.343430+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:16.387464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13627420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":47606,"num_write":834,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920747+0000","last_change":"2024-09-14T11:11:08.651170+0000","last_active":"2024-09-14T11:49:23.920747+0000","last_peered":"2024-09-14T11:49:23.920747+0000","last_clean":"2024-09-14T11:49:23.920747+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:49:23.920747+0000","last_undegraded":"2024-09-14T11:49:23.920747+0000","last_fullsized":"2024-09-14T11:49:23.920747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'219","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:47.928636+0000","last_change":"2024-09-14T11:11:10.671679+0000","last_active":"2024-09-14T11:51:47.928636+0000","last_peered":"2024-09-14T11:51:47.928636+0000","last_clean":"2024-09-14T11:51:47.928636+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:51:47.928636+0000","last_undegraded":"2024-09-14T11:51:47.928636+0000","last_fullsized":"2024-09-14T11:51:47.928636+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":905,"num_read_kb":1011,"num_write":1432,"num_write_kb":1317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.915519+0000","last_change":"2024-09-14T11:11:12.685335+0000","last_active":"2024-09-14T11:49:28.915519+0000","last_peered":"2024-09-14T11:49:28.915519+0000","last_clean":"2024-09-14T11:49:28.915519+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:49:28.915519+0000","last_undegraded":"2024-09-14T11:49:28.915519+0000","last_fullsized":"2024-09-14T11:49:28.915519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:34.384085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'111","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.714149+0000","last_change":"2024-09-14T11:11:14.691254+0000","last_active":"2024-09-14T11:50:29.714149+0000","last_peered":"2024-09-14T11:50:29.714149+0000","last_clean":"2024-09-14T11:50:29.714149+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:50:29.714149+0000","last_undegraded":"2024-09-14T11:50:29.714149+0000","last_fullsized":"2024-09-14T11:50:29.714149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:56.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.216524+0000","last_change":"2024-09-14T11:11:06.652040+0000","last_active":"2024-09-14T11:51:02.216524+0000","last_peered":"2024-09-14T11:51:02.216524+0000","last_clean":"2024-09-14T11:51:02.216524+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:51:02.216524+0000","last_undegraded":"2024-09-14T11:51:02.216524+0000","last_fullsized":"2024-09-14T11:51:02.216524+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:46.498291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:54.037135+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:48:54.037135+0000","last_peered":"2024-09-14T11:48:54.037135+0000","last_clean":"2024-09-14T11:48:54.037135+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:48:54.037135+0000","last_undegraded":"2024-09-14T11:48:54.037135+0000","last_fullsized":"2024-09-14T11:48:54.037135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929313+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:50:28.929313+0000","last_peered":"2024-09-14T11:50:28.929313+0000","last_clean":"2024-09-14T11:50:28.929313+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:50:28.929313+0000","last_undegraded":"2024-09-14T11:50:28.929313+0000","last_fullsized":"2024-09-14T11:50:28.929313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.842569+0000","last_change":"2024-09-14T11:11:04.653542+0000","last_active":"2024-09-14T11:50:59.842569+0000","last_peered":"2024-09-14T11:50:59.842569+0000","last_clean":"2024-09-14T11:50:59.842569+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:50:59.842569+0000","last_undegraded":"2024-09-14T11:50:59.842569+0000","last_fullsized":"2024-09-14T11:50:59.842569+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.899497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294246,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1040,"num_read_kb":764,"num_write":1135,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034878+0000","last_change":"2024-09-14T11:11:08.651808+0000","last_active":"2024-09-14T11:48:39.034878+0000","last_peered":"2024-09-14T11:48:39.034878+0000","last_clean":"2024-09-14T11:48:39.034878+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:48:39.034878+0000","last_undegraded":"2024-09-14T11:48:39.034878+0000","last_fullsized":"2024-09-14T11:48:39.034878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:02.176317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'312","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.531968+0000","last_change":"2024-09-14T11:11:10.671108+0000","last_active":"2024-09-14T11:52:37.531968+0000","last_peered":"2024-09-14T11:52:37.531968+0000","last_clean":"2024-09-14T11:52:37.531968+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:52:37.531968+0000","last_undegraded":"2024-09-14T11:52:37.531968+0000","last_fullsized":"2024-09-14T11:52:37.531968+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:12.563174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138600,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":1025,"num_write":532,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929432+0000","last_change":"2024-09-14T11:11:12.679614+0000","last_active":"2024-09-14T11:50:13.929432+0000","last_peered":"2024-09-14T11:50:13.929432+0000","last_clean":"2024-09-14T11:50:13.929432+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:50:13.929432+0000","last_undegraded":"2024-09-14T11:50:13.929432+0000","last_fullsized":"2024-09-14T11:50:13.929432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:26.539650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'194","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.853045+0000","last_change":"2024-09-14T11:11:14.691705+0000","last_active":"2024-09-14T11:51:21.853045+0000","last_peered":"2024-09-14T11:51:21.853045+0000","last_clean":"2024-09-14T11:51:21.853045+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:51:21.853045+0000","last_undegraded":"2024-09-14T11:51:21.853045+0000","last_fullsized":"2024-09-14T11:51:21.853045+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:32.101457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'446","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316797+0000","last_change":"2024-09-14T11:11:06.653878+0000","last_active":"2024-09-14T11:51:21.316797+0000","last_peered":"2024-09-14T11:51:21.316797+0000","last_clean":"2024-09-14T11:51:21.316797+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:51:21.316797+0000","last_undegraded":"2024-09-14T11:51:21.316797+0000","last_fullsized":"2024-09-14T11:51:21.316797+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:53.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037939+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:48:59.037939+0000","last_peered":"2024-09-14T11:48:59.037939+0000","last_clean":"2024-09-14T11:48:59.037939+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:48:59.037939+0000","last_undegraded":"2024-09-14T11:48:59.037939+0000","last_fullsized":"2024-09-14T11:48:59.037939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'225","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:31.663831+0000","last_change":"2024-09-14T11:11:04.647226+0000","last_active":"2024-09-14T11:52:31.663831+0000","last_peered":"2024-09-14T11:52:31.663831+0000","last_clean":"2024-09-14T11:52:31.663831+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:31.663831+0000","last_undegraded":"2024-09-14T11:52:31.663831+0000","last_fullsized":"2024-09-14T11:52:31.663831+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:42.012243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437198,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":5636,"num_write":1045,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.926741+0000","last_change":"2024-09-14T11:11:08.653354+0000","last_active":"2024-09-14T11:50:08.926741+0000","last_peered":"2024-09-14T11:50:08.926741+0000","last_clean":"2024-09-14T11:50:08.926741+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:50:08.926741+0000","last_undegraded":"2024-09-14T11:50:08.926741+0000","last_fullsized":"2024-09-14T11:50:08.926741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:02.387161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'846","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.556076+0000","last_change":"2024-09-14T11:11:10.668218+0000","last_active":"2024-09-14T11:52:37.556076+0000","last_peered":"2024-09-14T11:52:37.556076+0000","last_clean":"2024-09-14T11:52:37.556076+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:52:37.556076+0000","last_undegraded":"2024-09-14T11:52:37.556076+0000","last_fullsized":"2024-09-14T11:52:37.556076+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:48.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34713,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1137,"num_read_kb":1303,"num_write":260,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:49.036418+0000","last_change":"2024-09-14T11:11:12.677600+0000","last_active":"2024-09-14T11:48:49.036418+0000","last_peered":"2024-09-14T11:48:49.036418+0000","last_clean":"2024-09-14T11:48:49.036418+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:48:49.036418+0000","last_undegraded":"2024-09-14T11:48:49.036418+0000","last_fullsized":"2024-09-14T11:48:49.036418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.483584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'130","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.325684+0000","last_change":"2024-09-14T11:11:14.883766+0000","last_active":"2024-09-14T11:51:21.325684+0000","last_peered":"2024-09-14T11:51:21.325684+0000","last_clean":"2024-09-14T11:51:21.325684+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:51:21.325684+0000","last_undegraded":"2024-09-14T11:51:21.325684+0000","last_fullsized":"2024-09-14T11:51:21.325684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:47.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'426","reported_seq":1905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179728+0000","last_change":"2024-09-14T11:11:06.661418+0000","last_active":"2024-09-14T11:51:05.179728+0000","last_peered":"2024-09-14T11:51:05.179728+0000","last_clean":"2024-09-14T11:51:05.179728+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:51:05.179728+0000","last_undegraded":"2024-09-14T11:51:05.179728+0000","last_fullsized":"2024-09-14T11:51:05.179728+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.916202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.035176+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:50:29.035176+0000","last_peered":"2024-09-14T11:50:29.035176+0000","last_clean":"2024-09-14T11:50:29.035176+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:50:29.035176+0000","last_undegraded":"2024-09-14T11:50:29.035176+0000","last_fullsized":"2024-09-14T11:50:29.035176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'202","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:45.647851+0000","last_change":"2024-09-14T11:11:04.650254+0000","last_active":"2024-09-14T11:50:45.647851+0000","last_peered":"2024-09-14T11:50:45.647851+0000","last_clean":"2024-09-14T11:50:45.647851+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:50:45.647851+0000","last_undegraded":"2024-09-14T11:50:45.647851+0000","last_fullsized":"2024-09-14T11:50:45.647851+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:24.467276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":697,"num_read_kb":52749,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032552+0000","last_change":"2024-09-14T11:11:08.653735+0000","last_active":"2024-09-14T11:50:09.032552+0000","last_peered":"2024-09-14T11:50:09.032552+0000","last_clean":"2024-09-14T11:50:09.032552+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:50:09.032552+0000","last_undegraded":"2024-09-14T11:50:09.032552+0000","last_fullsized":"2024-09-14T11:50:09.032552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:27.550107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'219","reported_seq":1256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.446104+0000","last_change":"2024-09-14T11:11:10.885665+0000","last_active":"2024-09-14T11:52:36.446104+0000","last_peered":"2024-09-14T11:52:36.446104+0000","last_clean":"2024-09-14T11:52:36.446104+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:52:36.446104+0000","last_undegraded":"2024-09-14T11:52:36.446104+0000","last_fullsized":"2024-09-14T11:52:36.446104+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:53.645745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915668+0000","last_change":"2024-09-14T11:11:12.679585+0000","last_active":"2024-09-14T11:48:43.915668+0000","last_peered":"2024-09-14T11:48:43.915668+0000","last_clean":"2024-09-14T11:48:43.915668+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:48:43.915668+0000","last_undegraded":"2024-09-14T11:48:43.915668+0000","last_fullsized":"2024-09-14T11:48:43.915668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:37.689890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'250","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.995575+0000","last_change":"2024-09-14T11:11:14.691912+0000","last_active":"2024-09-14T11:51:21.995575+0000","last_peered":"2024-09-14T11:51:21.995575+0000","last_clean":"2024-09-14T11:51:21.995575+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:51:21.995575+0000","last_undegraded":"2024-09-14T11:51:21.995575+0000","last_fullsized":"2024-09-14T11:51:21.995575+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:38.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'458","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.436141+0000","last_change":"2024-09-14T11:11:06.652932+0000","last_active":"2024-09-14T11:51:01.436141+0000","last_peered":"2024-09-14T11:51:01.436141+0000","last_clean":"2024-09-14T11:51:01.436141+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:51:01.436141+0000","last_undegraded":"2024-09-14T11:51:01.436141+0000","last_fullsized":"2024-09-14T11:51:01.436141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:11.789080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929286+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:50:28.929286+0000","last_peered":"2024-09-14T11:50:28.929286+0000","last_clean":"2024-09-14T11:50:28.929286+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:50:28.929286+0000","last_undegraded":"2024-09-14T11:50:28.929286+0000","last_fullsized":"2024-09-14T11:50:28.929286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'182","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.682880+0000","last_change":"2024-09-14T11:11:04.652412+0000","last_active":"2024-09-14T11:51:08.682880+0000","last_peered":"2024-09-14T11:51:08.682880+0000","last_clean":"2024-09-14T11:51:08.682880+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:51:08.682880+0000","last_undegraded":"2024-09-14T11:51:08.682880+0000","last_fullsized":"2024-09-14T11:51:08.682880+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:20.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":11748,"num_write":872,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916639+0000","last_change":"2024-09-14T11:11:08.656266+0000","last_active":"2024-09-14T11:48:48.916639+0000","last_peered":"2024-09-14T11:48:48.916639+0000","last_clean":"2024-09-14T11:48:48.916639+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:48:48.916639+0000","last_undegraded":"2024-09-14T11:48:48.916639+0000","last_fullsized":"2024-09-14T11:48:48.916639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.330377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'126","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.946961+0000","last_change":"2024-09-14T11:11:10.668058+0000","last_active":"2024-09-14T11:52:23.946961+0000","last_peered":"2024-09-14T11:52:23.946961+0000","last_clean":"2024-09-14T11:52:23.946961+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:52:23.946961+0000","last_undegraded":"2024-09-14T11:52:23.946961+0000","last_fullsized":"2024-09-14T11:52:23.946961+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:05.286724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.921295+0000","last_change":"2024-09-14T11:11:12.681877+0000","last_active":"2024-09-14T11:50:13.921295+0000","last_peered":"2024-09-14T11:50:13.921295+0000","last_clean":"2024-09-14T11:50:13.921295+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:50:13.921295+0000","last_undegraded":"2024-09-14T11:50:13.921295+0000","last_fullsized":"2024-09-14T11:50:13.921295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.120129+0000","last_change":"2024-09-14T11:11:14.692245+0000","last_active":"2024-09-14T11:51:03.120129+0000","last_peered":"2024-09-14T11:51:03.120129+0000","last_clean":"2024-09-14T11:51:03.120129+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:51:03.120129+0000","last_undegraded":"2024-09-14T11:51:03.120129+0000","last_fullsized":"2024-09-14T11:51:03.120129+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:24.950841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.122816+0000","last_change":"2024-09-14T11:11:06.661346+0000","last_active":"2024-09-14T11:51:03.122816+0000","last_peered":"2024-09-14T11:51:03.122816+0000","last_clean":"2024-09-14T11:51:03.122816+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:51:03.122816+0000","last_undegraded":"2024-09-14T11:51:03.122816+0000","last_fullsized":"2024-09-14T11:51:03.122816+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:19.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'222","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.159868+0000","last_change":"2024-09-14T11:11:04.657514+0000","last_active":"2024-09-14T11:51:02.159868+0000","last_peered":"2024-09-14T11:51:02.159868+0000","last_clean":"2024-09-14T11:51:02.159868+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:51:02.159868+0000","last_undegraded":"2024-09-14T11:51:02.159868+0000","last_fullsized":"2024-09-14T11:51:02.159868+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:47.332379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8451677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":613,"num_read_kb":15435,"num_write":879,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.931026+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:50:28.931026+0000","last_peered":"2024-09-14T11:50:28.931026+0000","last_clean":"2024-09-14T11:50:28.931026+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:50:28.931026+0000","last_undegraded":"2024-09-14T11:50:28.931026+0000","last_fullsized":"2024-09-14T11:50:28.931026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914647+0000","last_change":"2024-09-14T11:11:08.653119+0000","last_active":"2024-09-14T11:48:38.914647+0000","last_peered":"2024-09-14T11:48:38.914647+0000","last_clean":"2024-09-14T11:48:38.914647+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:48:38.914647+0000","last_undegraded":"2024-09-14T11:48:38.914647+0000","last_fullsized":"2024-09-14T11:48:38.914647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:46.444354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'286","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.522282+0000","last_change":"2024-09-14T11:11:10.670087+0000","last_active":"2024-09-14T11:52:37.522282+0000","last_peered":"2024-09-14T11:52:37.522282+0000","last_clean":"2024-09-14T11:52:37.522282+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:52:37.522282+0000","last_undegraded":"2024-09-14T11:52:37.522282+0000","last_fullsized":"2024-09-14T11:52:37.522282+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:50.318692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36366,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":405,"num_read_kb":567,"num_write":274,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914988+0000","last_change":"2024-09-14T11:11:12.679038+0000","last_active":"2024-09-14T11:48:43.914988+0000","last_peered":"2024-09-14T11:48:43.914988+0000","last_clean":"2024-09-14T11:48:43.914988+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:48:43.914988+0000","last_undegraded":"2024-09-14T11:48:43.914988+0000","last_fullsized":"2024-09-14T11:48:43.914988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:12.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'209","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.215679+0000","last_change":"2024-09-14T11:11:14.886549+0000","last_active":"2024-09-14T11:51:19.215679+0000","last_peered":"2024-09-14T11:51:19.215679+0000","last_clean":"2024-09-14T11:51:19.215679+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:51:19.215679+0000","last_undegraded":"2024-09-14T11:51:19.215679+0000","last_fullsized":"2024-09-14T11:51:19.215679+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:17.379453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'431","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434777+0000","last_change":"2024-09-14T11:11:06.654715+0000","last_active":"2024-09-14T11:52:36.434777+0000","last_peered":"2024-09-14T11:52:36.434777+0000","last_clean":"2024-09-14T11:52:36.434777+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:36.434777+0000","last_undegraded":"2024-09-14T11:52:36.434777+0000","last_fullsized":"2024-09-14T11:52:36.434777+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.183803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'213","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932340+0000","last_change":"2024-09-14T11:11:04.642737+0000","last_active":"2024-09-14T11:50:38.932340+0000","last_peered":"2024-09-14T11:50:38.932340+0000","last_clean":"2024-09-14T11:50:38.932340+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:50:38.932340+0000","last_undegraded":"2024-09-14T11:50:38.932340+0000","last_fullsized":"2024-09-14T11:50:38.932340+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.508714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":599,"num_read_kb":78521,"num_write":1028,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.051572+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:50:34.051572+0000","last_peered":"2024-09-14T11:50:34.051572+0000","last_clean":"2024-09-14T11:50:34.051572+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:50:34.051572+0000","last_undegraded":"2024-09-14T11:50:34.051572+0000","last_fullsized":"2024-09-14T11:50:34.051572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908212+0000","last_change":"2024-09-14T11:11:08.650994+0000","last_active":"2024-09-14T11:48:38.908212+0000","last_peered":"2024-09-14T11:48:38.908212+0000","last_clean":"2024-09-14T11:48:38.908212+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:48:38.908212+0000","last_undegraded":"2024-09-14T11:48:38.908212+0000","last_fullsized":"2024-09-14T11:48:38.908212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.962646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'156","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.318854+0000","last_change":"2024-09-14T11:11:10.883309+0000","last_active":"2024-09-14T11:51:19.318854+0000","last_peered":"2024-09-14T11:51:19.318854+0000","last_clean":"2024-09-14T11:51:19.318854+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:51:19.318854+0000","last_undegraded":"2024-09-14T11:51:19.318854+0000","last_fullsized":"2024-09-14T11:51:19.318854+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:14.780666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'799","reported_seq":4884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.558169+0000","last_change":"2024-09-14T11:11:12.682874+0000","last_active":"2024-09-14T11:52:37.558169+0000","last_peered":"2024-09-14T11:52:37.558169+0000","last_clean":"2024-09-14T11:52:37.558169+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:52:37.558169+0000","last_undegraded":"2024-09-14T11:52:37.558169+0000","last_fullsized":"2024-09-14T11:52:37.558169+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.028768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'341","reported_seq":1706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179290+0000","last_change":"2024-09-14T11:11:37.864782+0000","last_active":"2024-09-14T11:51:05.179290+0000","last_peered":"2024-09-14T11:51:05.179290+0000","last_clean":"2024-09-14T11:51:05.179290+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:51:05.179290+0000","last_undegraded":"2024-09-14T11:51:05.179290+0000","last_fullsized":"2024-09-14T11:51:05.179290+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.779073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'290","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.641781+0000","last_change":"2024-09-14T11:11:04.646682+0000","last_active":"2024-09-14T11:50:29.641781+0000","last_peered":"2024-09-14T11:50:29.641781+0000","last_clean":"2024-09-14T11:50:29.641781+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:50:29.641781+0000","last_undegraded":"2024-09-14T11:50:29.641781+0000","last_fullsized":"2024-09-14T11:50:29.641781+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:31.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18192632,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1178,"num_read_kb":53005,"num_write":1232,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926354+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:49:53.926354+0000","last_peered":"2024-09-14T11:49:53.926354+0000","last_clean":"2024-09-14T11:49:53.926354+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:49:53.926354+0000","last_undegraded":"2024-09-14T11:49:53.926354+0000","last_fullsized":"2024-09-14T11:49:53.926354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.913999+0000","last_change":"2024-09-14T11:11:08.649058+0000","last_active":"2024-09-14T11:48:38.913999+0000","last_peered":"2024-09-14T11:48:38.913999+0000","last_clean":"2024-09-14T11:48:38.913999+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:48:38.913999+0000","last_undegraded":"2024-09-14T11:48:38.913999+0000","last_fullsized":"2024-09-14T11:48:38.913999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:32.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.304291+0000","last_change":"2024-09-14T11:11:10.671331+0000","last_active":"2024-09-14T11:51:19.304291+0000","last_peered":"2024-09-14T11:51:19.304291+0000","last_clean":"2024-09-14T11:51:19.304291+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:51:19.304291+0000","last_undegraded":"2024-09-14T11:51:19.304291+0000","last_fullsized":"2024-09-14T11:51:19.304291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:52.798905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'817","reported_seq":4183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.562184+0000","last_change":"2024-09-14T11:11:12.678672+0000","last_active":"2024-09-14T11:52:37.562184+0000","last_peered":"2024-09-14T11:52:37.562184+0000","last_clean":"2024-09-14T11:52:37.562184+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:52:37.562184+0000","last_undegraded":"2024-09-14T11:52:37.562184+0000","last_fullsized":"2024-09-14T11:52:37.562184+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:12.941981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'298","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.901850+0000","last_change":"2024-09-14T11:11:14.686960+0000","last_active":"2024-09-14T11:51:21.901850+0000","last_peered":"2024-09-14T11:51:21.901850+0000","last_clean":"2024-09-14T11:51:21.901850+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:51:21.901850+0000","last_undegraded":"2024-09-14T11:51:21.901850+0000","last_fullsized":"2024-09-14T11:51:21.901850+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'544","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.929778+0000","last_change":"2024-09-14T11:11:06.655767+0000","last_active":"2024-09-14T11:50:56.929778+0000","last_peered":"2024-09-14T11:50:56.929778+0000","last_clean":"2024-09-14T11:50:56.929778+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:50:56.929778+0000","last_undegraded":"2024-09-14T11:50:56.929778+0000","last_fullsized":"2024-09-14T11:50:56.929778+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:44.124270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.107941+0000","last_change":"2024-09-14T11:11:04.656471+0000","last_active":"2024-09-14T11:51:07.107941+0000","last_peered":"2024-09-14T11:51:07.107941+0000","last_clean":"2024-09-14T11:51:07.107941+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:51:07.107941+0000","last_undegraded":"2024-09-14T11:51:07.107941+0000","last_fullsized":"2024-09-14T11:51:07.107941+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:48.156669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14274652,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59716,"num_write":947,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918354+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:49:53.918354+0000","last_peered":"2024-09-14T11:49:53.918354+0000","last_clean":"2024-09-14T11:49:53.918354+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:49:53.918354+0000","last_undegraded":"2024-09-14T11:49:53.918354+0000","last_fullsized":"2024-09-14T11:49:53.918354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921314+0000","last_change":"2024-09-14T11:11:08.656366+0000","last_active":"2024-09-14T11:49:18.921314+0000","last_peered":"2024-09-14T11:49:18.921314+0000","last_clean":"2024-09-14T11:49:18.921314+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:49:18.921314+0000","last_undegraded":"2024-09-14T11:49:18.921314+0000","last_fullsized":"2024-09-14T11:49:18.921314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:14.566083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.518869+0000","last_change":"2024-09-14T11:11:10.883247+0000","last_active":"2024-09-14T11:52:37.518869+0000","last_peered":"2024-09-14T11:52:37.518869+0000","last_clean":"2024-09-14T11:52:37.518869+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:52:37.518869+0000","last_undegraded":"2024-09-14T11:52:37.518869+0000","last_fullsized":"2024-09-14T11:52:37.518869+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:02.820687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":633,"num_write":226,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916205+0000","last_change":"2024-09-14T11:11:12.682882+0000","last_active":"2024-09-14T11:48:43.916205+0000","last_peered":"2024-09-14T11:48:43.916205+0000","last_clean":"2024-09-14T11:48:43.916205+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:48:43.916205+0000","last_undegraded":"2024-09-14T11:48:43.916205+0000","last_fullsized":"2024-09-14T11:48:43.916205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:35.551263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'120","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.820332+0000","last_change":"2024-09-14T11:11:14.692652+0000","last_active":"2024-09-14T11:51:20.820332+0000","last_peered":"2024-09-14T11:51:20.820332+0000","last_clean":"2024-09-14T11:51:20.820332+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:51:20.820332+0000","last_undegraded":"2024-09-14T11:51:20.820332+0000","last_fullsized":"2024-09-14T11:51:20.820332+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:49.033241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.375702+0000","last_change":"2024-09-14T11:11:14.691282+0000","last_active":"2024-09-14T11:51:21.375702+0000","last_peered":"2024-09-14T11:51:21.375702+0000","last_clean":"2024-09-14T11:51:21.375702+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:51:21.375702+0000","last_undegraded":"2024-09-14T11:51:21.375702+0000","last_fullsized":"2024-09-14T11:51:21.375702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.621120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'729","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.436271+0000","last_change":"2024-09-14T11:11:06.653550+0000","last_active":"2024-09-14T11:52:36.436271+0000","last_peered":"2024-09-14T11:52:36.436271+0000","last_clean":"2024-09-14T11:52:36.436271+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:36.436271+0000","last_undegraded":"2024-09-14T11:52:36.436271+0000","last_fullsized":"2024-09-14T11:52:36.436271+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:16.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'229","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:50.685402+0000","last_change":"2024-09-14T11:11:38.680906+0000","last_active":"2024-09-14T11:49:50.685402+0000","last_peered":"2024-09-14T11:49:50.685402+0000","last_clean":"2024-09-14T11:49:50.685402+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:49:50.685402+0000","last_undegraded":"2024-09-14T11:49:50.685402+0000","last_fullsized":"2024-09-14T11:49:50.685402+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:40.878361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11588317,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":661,"num_read_kb":19030,"num_write":1053,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.912602+0000","last_change":"2024-09-14T11:11:08.653208+0000","last_active":"2024-09-14T11:48:28.912602+0000","last_peered":"2024-09-14T11:48:28.912602+0000","last_clean":"2024-09-14T11:48:28.912602+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:48:28.912602+0000","last_undegraded":"2024-09-14T11:48:28.912602+0000","last_fullsized":"2024-09-14T11:48:28.912602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.990347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.322211+0000","last_change":"2024-09-14T11:11:10.670870+0000","last_active":"2024-09-14T11:51:19.322211+0000","last_peered":"2024-09-14T11:51:19.322211+0000","last_clean":"2024-09-14T11:51:19.322211+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:51:19.322211+0000","last_undegraded":"2024-09-14T11:51:19.322211+0000","last_fullsized":"2024-09-14T11:51:19.322211+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:25.995412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":230,"num_write":94,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914699+0000","last_change":"2024-09-14T11:11:12.679809+0000","last_active":"2024-09-14T11:48:33.914699+0000","last_peered":"2024-09-14T11:48:33.914699+0000","last_clean":"2024-09-14T11:48:33.914699+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:48:33.914699+0000","last_undegraded":"2024-09-14T11:48:33.914699+0000","last_fullsized":"2024-09-14T11:48:33.914699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:59.317292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.176366+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:05.176366+0000","last_peered":"2024-09-14T11:51:05.176366+0000","last_clean":"2024-09-14T11:51:05.176366+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:05.176366+0000","last_undegraded":"2024-09-14T11:51:05.176366+0000","last_fullsized":"2024-09-14T11:51:05.176366+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:48.809610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'712","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308610+0000","last_change":"2024-09-14T11:11:06.656572+0000","last_active":"2024-09-14T11:51:21.308610+0000","last_peered":"2024-09-14T11:51:21.308610+0000","last_clean":"2024-09-14T11:51:21.308610+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:51:21.308610+0000","last_undegraded":"2024-09-14T11:51:21.308610+0000","last_fullsized":"2024-09-14T11:51:21.308610+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:32.091729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'184","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.047526+0000","last_change":"2024-09-14T11:11:04.662627+0000","last_active":"2024-09-14T11:50:18.047526+0000","last_peered":"2024-09-14T11:50:18.047526+0000","last_clean":"2024-09-14T11:50:18.047526+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:50:18.047526+0000","last_undegraded":"2024-09-14T11:50:18.047526+0000","last_fullsized":"2024-09-14T11:50:18.047526+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:25.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8407655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":26239,"num_write":891,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.914104+0000","last_change":"2024-09-14T11:11:08.649769+0000","last_active":"2024-09-14T11:48:28.914104+0000","last_peered":"2024-09-14T11:48:28.914104+0000","last_clean":"2024-09-14T11:48:28.914104+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:48:28.914104+0000","last_undegraded":"2024-09-14T11:48:28.914104+0000","last_fullsized":"2024-09-14T11:48:28.914104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.869183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'53","reported_seq":548,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.138152+0000","last_change":"2024-09-14T11:11:10.669313+0000","last_active":"2024-09-14T11:51:19.138152+0000","last_peered":"2024-09-14T11:51:19.138152+0000","last_clean":"2024-09-14T11:51:19.138152+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:51:19.138152+0000","last_undegraded":"2024-09-14T11:51:19.138152+0000","last_fullsized":"2024-09-14T11:51:19.138152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:59.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034011+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:48:34.034011+0000","last_peered":"2024-09-14T11:48:34.034011+0000","last_clean":"2024-09-14T11:48:34.034011+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:48:34.034011+0000","last_undegraded":"2024-09-14T11:48:34.034011+0000","last_fullsized":"2024-09-14T11:48:34.034011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:34.408102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'195","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.441751+0000","last_change":"2024-09-14T11:11:14.692367+0000","last_active":"2024-09-14T11:52:36.441751+0000","last_peered":"2024-09-14T11:52:36.441751+0000","last_clean":"2024-09-14T11:52:36.441751+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:52:36.441751+0000","last_undegraded":"2024-09-14T11:52:36.441751+0000","last_fullsized":"2024-09-14T11:52:36.441751+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.861427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'486","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310927+0000","last_change":"2024-09-14T11:11:06.656240+0000","last_active":"2024-09-14T11:51:21.310927+0000","last_peered":"2024-09-14T11:51:21.310927+0000","last_clean":"2024-09-14T11:51:21.310927+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:51:21.310927+0000","last_undegraded":"2024-09-14T11:51:21.310927+0000","last_fullsized":"2024-09-14T11:51:21.310927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.647919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'201","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.923286+0000","last_change":"2024-09-14T11:11:04.661433+0000","last_active":"2024-09-14T11:49:43.923286+0000","last_peered":"2024-09-14T11:49:43.923286+0000","last_clean":"2024-09-14T11:49:43.923286+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:49:43.923286+0000","last_undegraded":"2024-09-14T11:49:43.923286+0000","last_fullsized":"2024-09-14T11:49:43.923286+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.817478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319969,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":470,"num_read_kb":67081,"num_write":923,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:29.033082+0000","last_change":"2024-09-14T11:11:08.654324+0000","last_active":"2024-09-14T11:48:29.033082+0000","last_peered":"2024-09-14T11:48:29.033082+0000","last_clean":"2024-09-14T11:48:29.033082+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:48:29.033082+0000","last_undegraded":"2024-09-14T11:48:29.033082+0000","last_fullsized":"2024-09-14T11:48:29.033082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:57.708332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'158","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.318332+0000","last_change":"2024-09-14T11:11:10.672080+0000","last_active":"2024-09-14T11:51:21.318332+0000","last_peered":"2024-09-14T11:51:21.318332+0000","last_clean":"2024-09-14T11:51:21.318332+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:51:21.318332+0000","last_undegraded":"2024-09-14T11:51:21.318332+0000","last_fullsized":"2024-09-14T11:51:21.318332+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:19.936617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":255,"num_write":112,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907458+0000","last_change":"2024-09-14T11:11:12.680936+0000","last_active":"2024-09-14T11:48:33.907458+0000","last_peered":"2024-09-14T11:48:33.907458+0000","last_clean":"2024-09-14T11:48:33.907458+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:48:33.907458+0000","last_undegraded":"2024-09-14T11:48:33.907458+0000","last_fullsized":"2024-09-14T11:48:33.907458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:51.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'159","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.741928+0000","last_change":"2024-09-14T11:11:14.690690+0000","last_active":"2024-09-14T11:51:08.741928+0000","last_peered":"2024-09-14T11:51:08.741928+0000","last_clean":"2024-09-14T11:51:08.741928+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:51:08.741928+0000","last_undegraded":"2024-09-14T11:51:08.741928+0000","last_fullsized":"2024-09-14T11:51:08.741928+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:02.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1177","reported_seq":2918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310166+0000","last_change":"2024-09-14T11:11:06.652306+0000","last_active":"2024-09-14T11:51:21.310166+0000","last_peered":"2024-09-14T11:51:21.310166+0000","last_clean":"2024-09-14T11:51:21.310166+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:51:21.310166+0000","last_undegraded":"2024-09-14T11:51:21.310166+0000","last_fullsized":"2024-09-14T11:51:21.310166+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:10.911326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'181","reported_seq":780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.880317+0000","last_change":"2024-09-14T11:11:04.663210+0000","last_active":"2024-09-14T11:50:47.880317+0000","last_peered":"2024-09-14T11:50:47.880317+0000","last_clean":"2024-09-14T11:50:47.880317+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:50:47.880317+0000","last_undegraded":"2024-09-14T11:50:47.880317+0000","last_fullsized":"2024-09-14T11:50:47.880317+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:37.285836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594761,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":13203,"num_write":821,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.906630+0000","last_change":"2024-09-14T11:11:08.653546+0000","last_active":"2024-09-14T11:48:28.906630+0000","last_peered":"2024-09-14T11:48:28.906630+0000","last_clean":"2024-09-14T11:48:28.906630+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:48:28.906630+0000","last_undegraded":"2024-09-14T11:48:28.906630+0000","last_fullsized":"2024-09-14T11:48:28.906630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.193897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'120","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217492+0000","last_change":"2024-09-14T11:11:10.670918+0000","last_active":"2024-09-14T11:51:19.217492+0000","last_peered":"2024-09-14T11:51:19.217492+0000","last_clean":"2024-09-14T11:51:19.217492+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:51:19.217492+0000","last_undegraded":"2024-09-14T11:51:19.217492+0000","last_fullsized":"2024-09-14T11:51:19.217492+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:05.847749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9545,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":189,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913655+0000","last_change":"2024-09-14T11:11:12.682390+0000","last_active":"2024-09-14T11:48:33.913655+0000","last_peered":"2024-09-14T11:48:33.913655+0000","last_clean":"2024-09-14T11:48:33.913655+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:48:33.913655+0000","last_undegraded":"2024-09-14T11:48:33.913655+0000","last_fullsized":"2024-09-14T11:48:33.913655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:05.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1627","reported_seq":3326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.112689+0000","last_change":"2024-09-14T11:11:06.654317+0000","last_active":"2024-09-14T11:51:03.112689+0000","last_peered":"2024-09-14T11:51:03.112689+0000","last_clean":"2024-09-14T11:51:03.112689+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:51:03.112689+0000","last_undegraded":"2024-09-14T11:51:03.112689+0000","last_fullsized":"2024-09-14T11:51:03.112689+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.474698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'226","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.242660+0000","last_change":"2024-09-14T11:11:04.645419+0000","last_active":"2024-09-14T11:52:29.242660+0000","last_peered":"2024-09-14T11:52:29.242660+0000","last_clean":"2024-09-14T11:52:29.242660+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:29.242660+0000","last_undegraded":"2024-09-14T11:52:29.242660+0000","last_fullsized":"2024-09-14T11:52:29.242660+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:57.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13625374,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":62996,"num_write":1110,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921634+0000","last_change":"2024-09-14T11:11:08.650958+0000","last_active":"2024-09-14T11:49:18.921634+0000","last_peered":"2024-09-14T11:49:18.921634+0000","last_clean":"2024-09-14T11:49:18.921634+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:49:18.921634+0000","last_undegraded":"2024-09-14T11:49:18.921634+0000","last_fullsized":"2024-09-14T11:49:18.921634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:09.330791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'199","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.515439+0000","last_change":"2024-09-14T11:11:10.670001+0000","last_active":"2024-09-14T11:52:37.515439+0000","last_peered":"2024-09-14T11:52:37.515439+0000","last_clean":"2024-09-14T11:52:37.515439+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:52:37.515439+0000","last_undegraded":"2024-09-14T11:52:37.515439+0000","last_fullsized":"2024-09-14T11:52:37.515439+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:12.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":299,"num_read_kb":444,"num_write":196,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040316+0000","last_change":"2024-09-14T11:11:12.683170+0000","last_active":"2024-09-14T11:48:44.040316+0000","last_peered":"2024-09-14T11:48:44.040316+0000","last_clean":"2024-09-14T11:48:44.040316+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:48:44.040316+0000","last_undegraded":"2024-09-14T11:48:44.040316+0000","last_fullsized":"2024-09-14T11:48:44.040316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.360262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.306430+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.306430+0000","last_peered":"2024-09-14T11:51:21.306430+0000","last_clean":"2024-09-14T11:51:21.306430+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.306430+0000","last_undegraded":"2024-09-14T11:51:21.306430+0000","last_fullsized":"2024-09-14T11:51:21.306430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'422","reported_seq":2027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172836+0000","last_change":"2024-09-14T11:11:06.650905+0000","last_active":"2024-09-14T11:51:07.172836+0000","last_peered":"2024-09-14T11:51:07.172836+0000","last_clean":"2024-09-14T11:51:07.172836+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:51:07.172836+0000","last_undegraded":"2024-09-14T11:51:07.172836+0000","last_fullsized":"2024-09-14T11:51:07.172836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:45.627603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'177","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.318053+0000","last_change":"2024-09-14T11:11:04.650203+0000","last_active":"2024-09-14T11:51:18.318053+0000","last_peered":"2024-09-14T11:51:18.318053+0000","last_clean":"2024-09-14T11:51:18.318053+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:51:18.318053+0000","last_undegraded":"2024-09-14T11:51:18.318053+0000","last_fullsized":"2024-09-14T11:51:18.318053+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8743742,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":12441,"num_write":902,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.265290+0000","last_change":"2024-09-14T11:11:08.653366+0000","last_active":"2024-09-14T11:52:37.265290+0000","last_peered":"2024-09-14T11:52:37.265290+0000","last_clean":"2024-09-14T11:52:37.265290+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:52:37.265290+0000","last_undegraded":"2024-09-14T11:52:37.265290+0000","last_fullsized":"2024-09-14T11:52:37.265290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:44.850713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":1189,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'159","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.259129+0000","last_change":"2024-09-14T11:11:10.668831+0000","last_active":"2024-09-14T11:51:19.259129+0000","last_peered":"2024-09-14T11:51:19.259129+0000","last_clean":"2024-09-14T11:51:19.259129+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:51:19.259129+0000","last_undegraded":"2024-09-14T11:51:19.259129+0000","last_fullsized":"2024-09-14T11:51:19.259129+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:09.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":282,"num_write":144,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915697+0000","last_change":"2024-09-14T11:11:12.681008+0000","last_active":"2024-09-14T11:48:43.915697+0000","last_peered":"2024-09-14T11:48:43.915697+0000","last_clean":"2024-09-14T11:48:43.915697+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:48:43.915697+0000","last_undegraded":"2024-09-14T11:48:43.915697+0000","last_fullsized":"2024-09-14T11:48:43.915697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:58.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'173","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:07.089853+0000","last_change":"2024-09-14T11:11:14.690312+0000","last_active":"2024-09-14T11:50:07.089853+0000","last_peered":"2024-09-14T11:50:07.089853+0000","last_clean":"2024-09-14T11:50:07.089853+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:50:07.089853+0000","last_undegraded":"2024-09-14T11:50:07.089853+0000","last_fullsized":"2024-09-14T11:50:07.089853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.026241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'376","reported_seq":1780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.226513+0000","last_change":"2024-09-14T11:11:06.651125+0000","last_active":"2024-09-14T11:51:02.226513+0000","last_peered":"2024-09-14T11:51:02.226513+0000","last_clean":"2024-09-14T11:51:02.226513+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:51:02.226513+0000","last_undegraded":"2024-09-14T11:51:02.226513+0000","last_fullsized":"2024-09-14T11:51:02.226513+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:57.162983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:42.471759+0000","last_change":"2024-09-14T11:11:04.647959+0000","last_active":"2024-09-14T11:50:42.471759+0000","last_peered":"2024-09-14T11:50:42.471759+0000","last_clean":"2024-09-14T11:50:42.471759+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:50:42.471759+0000","last_undegraded":"2024-09-14T11:50:42.471759+0000","last_fullsized":"2024-09-14T11:50:42.471759+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:50.954784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206736,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":545,"num_read_kb":23729,"num_write":1064,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914129+0000","last_change":"2024-09-14T11:11:08.651803+0000","last_active":"2024-09-14T11:48:38.914129+0000","last_peered":"2024-09-14T11:48:38.914129+0000","last_clean":"2024-09-14T11:48:38.914129+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:48:38.914129+0000","last_undegraded":"2024-09-14T11:48:38.914129+0000","last_fullsized":"2024-09-14T11:48:38.914129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:43.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'142","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.324251+0000","last_change":"2024-09-14T11:11:10.883223+0000","last_active":"2024-09-14T11:51:19.324251+0000","last_peered":"2024-09-14T11:51:19.324251+0000","last_clean":"2024-09-14T11:51:19.324251+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:51:19.324251+0000","last_undegraded":"2024-09-14T11:51:19.324251+0000","last_fullsized":"2024-09-14T11:51:19.324251+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:29.696874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39965,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":290,"num_write":96,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921566+0000","last_change":"2024-09-14T11:11:12.681509+0000","last_active":"2024-09-14T11:49:18.921566+0000","last_peered":"2024-09-14T11:49:18.921566+0000","last_clean":"2024-09-14T11:49:18.921566+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:49:18.921566+0000","last_undegraded":"2024-09-14T11:49:18.921566+0000","last_fullsized":"2024-09-14T11:49:18.921566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:59.776741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'122","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546132+0000","last_change":"2024-09-14T11:11:14.691723+0000","last_active":"2024-09-14T11:52:37.546132+0000","last_peered":"2024-09-14T11:52:37.546132+0000","last_clean":"2024-09-14T11:52:37.546132+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:52:37.546132+0000","last_undegraded":"2024-09-14T11:52:37.546132+0000","last_fullsized":"2024-09-14T11:52:37.546132+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:16.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'480","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219612+0000","last_change":"2024-09-14T11:11:37.748529+0000","last_active":"2024-09-14T11:51:19.219612+0000","last_peered":"2024-09-14T11:51:19.219612+0000","last_clean":"2024-09-14T11:51:19.219612+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:51:19.219612+0000","last_undegraded":"2024-09-14T11:51:19.219612+0000","last_fullsized":"2024-09-14T11:51:19.219612+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:31.281473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'290","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:50.085422+0000","last_change":"2024-09-14T11:11:04.649863+0000","last_active":"2024-09-14T11:50:50.085422+0000","last_peered":"2024-09-14T11:50:50.085422+0000","last_clean":"2024-09-14T11:50:50.085422+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:50:50.085422+0000","last_undegraded":"2024-09-14T11:50:50.085422+0000","last_fullsized":"2024-09-14T11:50:50.085422+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.369405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9472693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":27321,"num_write":1070,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914708+0000","last_change":"2024-09-14T11:11:08.657837+0000","last_active":"2024-09-14T11:48:38.914708+0000","last_peered":"2024-09-14T11:48:38.914708+0000","last_clean":"2024-09-14T11:48:38.914708+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:48:38.914708+0000","last_undegraded":"2024-09-14T11:48:38.914708+0000","last_fullsized":"2024-09-14T11:48:38.914708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'70","reported_seq":582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.316786+0000","last_change":"2024-09-14T11:11:10.883222+0000","last_active":"2024-09-14T11:51:19.316786+0000","last_peered":"2024-09-14T11:51:19.316786+0000","last_clean":"2024-09-14T11:51:19.316786+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:51:19.316786+0000","last_undegraded":"2024-09-14T11:51:19.316786+0000","last_fullsized":"2024-09-14T11:51:19.316786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:29.226087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'764","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.557166+0000","last_change":"2024-09-14T11:11:12.679582+0000","last_active":"2024-09-14T11:52:37.557166+0000","last_peered":"2024-09-14T11:52:37.557166+0000","last_clean":"2024-09-14T11:52:37.557166+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:52:37.557166+0000","last_undegraded":"2024-09-14T11:52:37.557166+0000","last_fullsized":"2024-09-14T11:52:37.557166+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:59.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.781791+0000","last_change":"2024-09-14T11:11:14.693282+0000","last_active":"2024-09-14T11:50:48.781791+0000","last_peered":"2024-09-14T11:50:48.781791+0000","last_clean":"2024-09-14T11:50:48.781791+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:50:48.781791+0000","last_undegraded":"2024-09-14T11:50:48.781791+0000","last_fullsized":"2024-09-14T11:50:48.781791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:09.483259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.836272+0000","last_change":"2024-09-14T11:11:06.652140+0000","last_active":"2024-09-14T11:51:21.836272+0000","last_peered":"2024-09-14T11:51:21.836272+0000","last_clean":"2024-09-14T11:51:21.836272+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:51:21.836272+0000","last_undegraded":"2024-09-14T11:51:21.836272+0000","last_fullsized":"2024-09-14T11:51:21.836272+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.172703+0000","last_change":"2024-09-14T11:11:04.661487+0000","last_active":"2024-09-14T11:51:18.172703+0000","last_peered":"2024-09-14T11:51:18.172703+0000","last_clean":"2024-09-14T11:51:18.172703+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:51:18.172703+0000","last_undegraded":"2024-09-14T11:51:18.172703+0000","last_fullsized":"2024-09-14T11:51:18.172703+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:20.676205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545915,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":12794,"num_write":1045,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034846+0000","last_change":"2024-09-14T11:11:08.653717+0000","last_active":"2024-09-14T11:48:39.034846+0000","last_peered":"2024-09-14T11:48:39.034846+0000","last_clean":"2024-09-14T11:48:39.034846+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:48:39.034846+0000","last_undegraded":"2024-09-14T11:48:39.034846+0000","last_fullsized":"2024-09-14T11:48:39.034846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:32.879931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'165","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.946447+0000","last_change":"2024-09-14T11:11:10.669599+0000","last_active":"2024-09-14T11:52:28.946447+0000","last_peered":"2024-09-14T11:52:28.946447+0000","last_clean":"2024-09-14T11:52:28.946447+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:52:28.946447+0000","last_undegraded":"2024-09-14T11:52:28.946447+0000","last_fullsized":"2024-09-14T11:52:28.946447+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:43.348380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":273,"num_write":118,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926374+0000","last_change":"2024-09-14T11:11:12.681246+0000","last_active":"2024-09-14T11:49:53.926374+0000","last_peered":"2024-09-14T11:49:53.926374+0000","last_clean":"2024-09-14T11:49:53.926374+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:49:53.926374+0000","last_undegraded":"2024-09-14T11:49:53.926374+0000","last_fullsized":"2024-09-14T11:49:53.926374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:07.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'115","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.880410+0000","last_change":"2024-09-14T11:11:14.697190+0000","last_active":"2024-09-14T11:51:07.880410+0000","last_peered":"2024-09-14T11:51:07.880410+0000","last_clean":"2024-09-14T11:51:07.880410+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:51:07.880410+0000","last_undegraded":"2024-09-14T11:51:07.880410+0000","last_fullsized":"2024-09-14T11:51:07.880410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:51.323211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1156","reported_seq":2809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.337919+0000","last_change":"2024-09-14T11:11:06.642481+0000","last_active":"2024-09-14T11:50:58.337919+0000","last_peered":"2024-09-14T11:50:58.337919+0000","last_clean":"2024-09-14T11:50:58.337919+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:50:58.337919+0000","last_undegraded":"2024-09-14T11:50:58.337919+0000","last_fullsized":"2024-09-14T11:50:58.337919+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.677463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:51.208702+0000","last_change":"2024-09-14T11:11:04.662351+0000","last_active":"2024-09-14T11:50:51.208702+0000","last_peered":"2024-09-14T11:50:51.208702+0000","last_clean":"2024-09-14T11:50:51.208702+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:50:51.208702+0000","last_undegraded":"2024-09-14T11:50:51.208702+0000","last_fullsized":"2024-09-14T11:50:51.208702+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:07.797389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5955950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":655,"num_read_kb":26583,"num_write":933,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039639+0000","last_change":"2024-09-14T11:11:08.655874+0000","last_active":"2024-09-14T11:48:39.039639+0000","last_peered":"2024-09-14T11:48:39.039639+0000","last_clean":"2024-09-14T11:48:39.039639+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:48:39.039639+0000","last_undegraded":"2024-09-14T11:48:39.039639+0000","last_fullsized":"2024-09-14T11:48:39.039639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:09.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945761+0000","last_change":"2024-09-14T11:11:10.673119+0000","last_active":"2024-09-14T11:52:18.945761+0000","last_peered":"2024-09-14T11:52:18.945761+0000","last_clean":"2024-09-14T11:52:18.945761+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:52:18.945761+0000","last_undegraded":"2024-09-14T11:52:18.945761+0000","last_fullsized":"2024-09-14T11:52:18.945761+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.182477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":215,"num_write":86,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:03.919674+0000","last_change":"2024-09-14T11:11:12.680784+0000","last_active":"2024-09-14T11:50:03.919674+0000","last_peered":"2024-09-14T11:50:03.919674+0000","last_clean":"2024-09-14T11:50:03.919674+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:50:03.919674+0000","last_undegraded":"2024-09-14T11:50:03.919674+0000","last_fullsized":"2024-09-14T11:50:03.919674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:59.544800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'508","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.436715+0000","last_change":"2024-09-14T11:11:06.653662+0000","last_active":"2024-09-14T11:51:06.436715+0000","last_peered":"2024-09-14T11:51:06.436715+0000","last_clean":"2024-09-14T11:51:06.436715+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:51:06.436715+0000","last_undegraded":"2024-09-14T11:51:06.436715+0000","last_fullsized":"2024-09-14T11:51:06.436715+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:06.494569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'216","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.094191+0000","last_change":"2024-09-14T11:11:04.650685+0000","last_active":"2024-09-14T11:49:48.094191+0000","last_peered":"2024-09-14T11:49:48.094191+0000","last_clean":"2024-09-14T11:49:48.094191+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:49:48.094191+0000","last_undegraded":"2024-09-14T11:49:48.094191+0000","last_fullsized":"2024-09-14T11:49:48.094191+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.078217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404555,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":512,"num_read_kb":7926,"num_write":970,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.923902+0000","last_change":"2024-09-14T11:11:08.654095+0000","last_active":"2024-09-14T11:49:48.923902+0000","last_peered":"2024-09-14T11:49:48.923902+0000","last_clean":"2024-09-14T11:49:48.923902+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:49:48.923902+0000","last_undegraded":"2024-09-14T11:49:48.923902+0000","last_fullsized":"2024-09-14T11:49:48.923902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:24.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'103","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.201792+0000","last_change":"2024-09-14T11:11:10.669556+0000","last_active":"2024-09-14T11:51:19.201792+0000","last_peered":"2024-09-14T11:51:19.201792+0000","last_clean":"2024-09-14T11:51:19.201792+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:51:19.201792+0000","last_undegraded":"2024-09-14T11:51:19.201792+0000","last_fullsized":"2024-09-14T11:51:19.201792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:15.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":185,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915062+0000","last_change":"2024-09-14T11:11:12.682253+0000","last_active":"2024-09-14T11:48:43.915062+0000","last_peered":"2024-09-14T11:48:43.915062+0000","last_clean":"2024-09-14T11:48:43.915062+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:48:43.915062+0000","last_undegraded":"2024-09-14T11:48:43.915062+0000","last_fullsized":"2024-09-14T11:48:43.915062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:58.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'186","reported_seq":1636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.774324+0000","last_change":"2024-09-14T11:11:14.690239+0000","last_active":"2024-09-14T11:51:19.774324+0000","last_peered":"2024-09-14T11:51:19.774324+0000","last_clean":"2024-09-14T11:51:19.774324+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:51:19.774324+0000","last_undegraded":"2024-09-14T11:51:19.774324+0000","last_fullsized":"2024-09-14T11:51:19.774324+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:45.377535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219526+0000","last_change":"2024-09-14T11:11:06.656585+0000","last_active":"2024-09-14T11:51:19.219526+0000","last_peered":"2024-09-14T11:51:19.219526+0000","last_clean":"2024-09-14T11:51:19.219526+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:51:19.219526+0000","last_undegraded":"2024-09-14T11:51:19.219526+0000","last_fullsized":"2024-09-14T11:51:19.219526+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:33.246710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'223","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.276658+0000","last_change":"2024-09-14T11:11:04.658553+0000","last_active":"2024-09-14T11:50:55.276658+0000","last_peered":"2024-09-14T11:50:55.276658+0000","last_clean":"2024-09-14T11:50:55.276658+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:50:55.276658+0000","last_undegraded":"2024-09-14T11:50:55.276658+0000","last_fullsized":"2024-09-14T11:50:55.276658+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:55.574919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489935,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1050,"num_read_kb":144594,"num_write":1038,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926285+0000","last_change":"2024-09-14T11:11:08.653002+0000","last_active":"2024-09-14T11:49:53.926285+0000","last_peered":"2024-09-14T11:49:53.926285+0000","last_clean":"2024-09-14T11:49:53.926285+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:49:53.926285+0000","last_undegraded":"2024-09-14T11:49:53.926285+0000","last_fullsized":"2024-09-14T11:49:53.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:11.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.225139+0000","last_change":"2024-09-14T11:11:10.668336+0000","last_active":"2024-09-14T11:51:19.225139+0000","last_peered":"2024-09-14T11:51:19.225139+0000","last_clean":"2024-09-14T11:51:19.225139+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:51:19.225139+0000","last_undegraded":"2024-09-14T11:51:19.225139+0000","last_fullsized":"2024-09-14T11:51:19.225139+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:48.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6768,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":189,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915597+0000","last_change":"2024-09-14T11:11:12.681192+0000","last_active":"2024-09-14T11:48:43.915597+0000","last_peered":"2024-09-14T11:48:43.915597+0000","last_clean":"2024-09-14T11:48:43.915597+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:48:43.915597+0000","last_undegraded":"2024-09-14T11:48:43.915597+0000","last_fullsized":"2024-09-14T11:48:43.915597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'131","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434001+0000","last_change":"2024-09-14T11:11:14.697156+0000","last_active":"2024-09-14T11:52:36.434001+0000","last_peered":"2024-09-14T11:52:36.434001+0000","last_clean":"2024-09-14T11:52:36.434001+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:52:36.434001+0000","last_undegraded":"2024-09-14T11:52:36.434001+0000","last_fullsized":"2024-09-14T11:52:36.434001+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.319859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'851","reported_seq":2569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179734+0000","last_change":"2024-09-14T11:11:06.655238+0000","last_active":"2024-09-14T11:51:05.179734+0000","last_peered":"2024-09-14T11:51:05.179734+0000","last_clean":"2024-09-14T11:51:05.179734+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:51:05.179734+0000","last_undegraded":"2024-09-14T11:51:05.179734+0000","last_fullsized":"2024-09-14T11:51:05.179734+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:38.378965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'242","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.431900+0000","last_change":"2024-09-14T11:11:04.666811+0000","last_active":"2024-09-14T11:50:44.431900+0000","last_peered":"2024-09-14T11:50:44.431900+0000","last_clean":"2024-09-14T11:50:44.431900+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:50:44.431900+0000","last_undegraded":"2024-09-14T11:50:44.431900+0000","last_fullsized":"2024-09-14T11:50:44.431900+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5492619,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":42950,"num_write":1086,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'565","reported_seq":2225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844932+0000","last_change":"2024-09-14T11:11:06.651614+0000","last_active":"2024-09-14T11:51:21.844932+0000","last_peered":"2024-09-14T11:51:21.844932+0000","last_clean":"2024-09-14T11:51:21.844932+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:51:21.844932+0000","last_undegraded":"2024-09-14T11:51:21.844932+0000","last_fullsized":"2024-09-14T11:51:21.844932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:03.537283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'177","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036406+0000","last_change":"2024-09-14T11:11:38.680106+0000","last_active":"2024-09-14T11:50:39.036406+0000","last_peered":"2024-09-14T11:50:39.036406+0000","last_clean":"2024-09-14T11:50:39.036406+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:50:39.036406+0000","last_undegraded":"2024-09-14T11:50:39.036406+0000","last_fullsized":"2024-09-14T11:50:39.036406+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:36.864373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399983,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":43631,"num_write":869,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'524","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845111+0000","last_change":"2024-09-14T11:11:06.653770+0000","last_active":"2024-09-14T11:51:21.845111+0000","last_peered":"2024-09-14T11:51:21.845111+0000","last_clean":"2024-09-14T11:51:21.845111+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:51:21.845111+0000","last_undegraded":"2024-09-14T11:51:21.845111+0000","last_fullsized":"2024-09-14T11:51:21.845111+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'211","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930676+0000","last_change":"2024-09-14T11:11:04.659611+0000","last_active":"2024-09-14T11:50:38.930676+0000","last_peered":"2024-09-14T11:50:38.930676+0000","last_clean":"2024-09-14T11:50:38.930676+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:50:38.930676+0000","last_undegraded":"2024-09-14T11:50:38.930676+0000","last_fullsized":"2024-09-14T11:50:38.930676+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.810419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8880526,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":22878,"num_write":1004,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'803","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435453+0000","last_change":"2024-09-14T11:11:06.651188+0000","last_active":"2024-09-14T11:52:36.435453+0000","last_peered":"2024-09-14T11:52:36.435453+0000","last_clean":"2024-09-14T11:52:36.435453+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:52:36.435453+0000","last_undegraded":"2024-09-14T11:52:36.435453+0000","last_fullsized":"2024-09-14T11:52:36.435453+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:08.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'189","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.242403+0000","last_change":"2024-09-14T11:11:04.650789+0000","last_active":"2024-09-14T11:51:18.242403+0000","last_peered":"2024-09-14T11:51:18.242403+0000","last_clean":"2024-09-14T11:51:18.242403+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:51:18.242403+0000","last_undegraded":"2024-09-14T11:51:18.242403+0000","last_fullsized":"2024-09-14T11:51:18.242403+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.442954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15769276,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":47732,"num_write":870,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1006","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.837526+0000","last_change":"2024-09-14T11:11:06.654587+0000","last_active":"2024-09-14T11:51:21.837526+0000","last_peered":"2024-09-14T11:51:21.837526+0000","last_clean":"2024-09-14T11:51:21.837526+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:51:21.837526+0000","last_undegraded":"2024-09-14T11:51:21.837526+0000","last_fullsized":"2024-09-14T11:51:21.837526+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:08.260560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'274","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.432091+0000","last_change":"2024-09-14T11:11:38.149249+0000","last_active":"2024-09-14T11:52:27.432091+0000","last_peered":"2024-09-14T11:52:27.432091+0000","last_clean":"2024-09-14T11:52:27.432091+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:27.432091+0000","last_undegraded":"2024-09-14T11:52:27.432091+0000","last_fullsized":"2024-09-14T11:52:27.432091+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:11.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8423062,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":714,"num_read_kb":31338,"num_write":1100,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'442","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.878230+0000","last_change":"2024-09-14T11:11:06.653604+0000","last_active":"2024-09-14T11:51:07.878230+0000","last_peered":"2024-09-14T11:51:07.878230+0000","last_clean":"2024-09-14T11:51:07.878230+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:51:07.878230+0000","last_undegraded":"2024-09-14T11:51:07.878230+0000","last_fullsized":"2024-09-14T11:51:07.878230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:35.321390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'248","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.028817+0000","last_change":"2024-09-14T11:11:04.642725+0000","last_active":"2024-09-14T11:50:17.028817+0000","last_peered":"2024-09-14T11:50:17.028817+0000","last_clean":"2024-09-14T11:50:17.028817+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:50:17.028817+0000","last_undegraded":"2024-09-14T11:50:17.028817+0000","last_fullsized":"2024-09-14T11:50:17.028817+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:47.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670221,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1014,"num_read_kb":155037,"num_write":1111,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1175","reported_seq":2833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438627+0000","last_change":"2024-09-14T11:11:06.651627+0000","last_active":"2024-09-14T11:52:36.438627+0000","last_peered":"2024-09-14T11:52:36.438627+0000","last_clean":"2024-09-14T11:52:36.438627+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:52:36.438627+0000","last_undegraded":"2024-09-14T11:52:36.438627+0000","last_fullsized":"2024-09-14T11:52:36.438627+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:01.008892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'237","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.325344+0000","last_change":"2024-09-14T11:11:04.657109+0000","last_active":"2024-09-14T11:51:18.325344+0000","last_peered":"2024-09-14T11:51:18.325344+0000","last_clean":"2024-09-14T11:51:18.325344+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:51:18.325344+0000","last_undegraded":"2024-09-14T11:51:18.325344+0000","last_fullsized":"2024-09-14T11:51:18.325344+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.402916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10919282,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":17781,"num_write":1111,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'425","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.875685+0000","last_change":"2024-09-14T11:11:06.654109+0000","last_active":"2024-09-14T11:51:07.875685+0000","last_peered":"2024-09-14T11:51:07.875685+0000","last_clean":"2024-09-14T11:51:07.875685+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:51:07.875685+0000","last_undegraded":"2024-09-14T11:51:07.875685+0000","last_fullsized":"2024-09-14T11:51:07.875685+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:48.495731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'181","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.472986+0000","last_change":"2024-09-14T11:11:04.654477+0000","last_active":"2024-09-14T11:50:57.472986+0000","last_peered":"2024-09-14T11:50:57.472986+0000","last_clean":"2024-09-14T11:50:57.472986+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:50:57.472986+0000","last_undegraded":"2024-09-14T11:50:57.472986+0000","last_fullsized":"2024-09-14T11:50:57.472986+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:01.338332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404304,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":12452,"num_write":856,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1179","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308328+0000","last_change":"2024-09-14T11:11:06.652958+0000","last_active":"2024-09-14T11:51:21.308328+0000","last_peered":"2024-09-14T11:51:21.308328+0000","last_clean":"2024-09-14T11:51:21.308328+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:51:21.308328+0000","last_undegraded":"2024-09-14T11:51:21.308328+0000","last_fullsized":"2024-09-14T11:51:21.308328+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:24.552197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'243","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.680131+0000","last_change":"2024-09-14T11:11:04.657280+0000","last_active":"2024-09-14T11:52:35.680131+0000","last_peered":"2024-09-14T11:52:35.680131+0000","last_clean":"2024-09-14T11:52:35.680131+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:52:35.680131+0000","last_undegraded":"2024-09-14T11:52:35.680131+0000","last_fullsized":"2024-09-14T11:52:35.680131+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:41.400680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4514884,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":3825,"num_write":1014,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'758","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435815+0000","last_change":"2024-09-14T11:11:06.651996+0000","last_active":"2024-09-14T11:52:36.435815+0000","last_peered":"2024-09-14T11:52:36.435815+0000","last_clean":"2024-09-14T11:52:36.435815+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:52:36.435815+0000","last_undegraded":"2024-09-14T11:52:36.435815+0000","last_fullsized":"2024-09-14T11:52:36.435815+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:06.359659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'239","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.342127+0000","last_change":"2024-09-14T11:11:04.651232+0000","last_active":"2024-09-14T11:51:18.342127+0000","last_peered":"2024-09-14T11:51:18.342127+0000","last_clean":"2024-09-14T11:51:18.342127+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:51:18.342127+0000","last_undegraded":"2024-09-14T11:51:18.342127+0000","last_fullsized":"2024-09-14T11:51:18.342127+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:16.752449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283448,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":9466,"num_write":1102,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.437393+0000","last_change":"2024-09-14T11:11:06.656624+0000","last_active":"2024-09-14T11:51:06.437393+0000","last_peered":"2024-09-14T11:51:06.437393+0000","last_clean":"2024-09-14T11:51:06.437393+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:51:06.437393+0000","last_undegraded":"2024-09-14T11:51:06.437393+0000","last_fullsized":"2024-09-14T11:51:06.437393+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'225","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.819833+0000","last_change":"2024-09-14T11:11:38.680828+0000","last_active":"2024-09-14T11:51:07.819833+0000","last_peered":"2024-09-14T11:51:07.819833+0000","last_clean":"2024-09-14T11:51:07.819833+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:51:07.819833+0000","last_undegraded":"2024-09-14T11:51:07.819833+0000","last_fullsized":"2024-09-14T11:51:07.819833+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:19.072768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439893,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":20654,"num_write":1081,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'570","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.123272+0000","last_change":"2024-09-14T11:11:06.655967+0000","last_active":"2024-09-14T11:51:03.123272+0000","last_peered":"2024-09-14T11:51:03.123272+0000","last_clean":"2024-09-14T11:51:03.123272+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:51:03.123272+0000","last_undegraded":"2024-09-14T11:51:03.123272+0000","last_fullsized":"2024-09-14T11:51:03.123272+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:20.387986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'175","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.177437+0000","last_change":"2024-09-14T11:11:04.663147+0000","last_active":"2024-09-14T11:50:44.177437+0000","last_peered":"2024-09-14T11:50:44.177437+0000","last_clean":"2024-09-14T11:50:44.177437+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:50:44.177437+0000","last_undegraded":"2024-09-14T11:50:44.177437+0000","last_fullsized":"2024-09-14T11:50:44.177437+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:33.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9689661,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":19362,"num_write":815,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'501","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746597+0000","last_change":"2024-09-14T11:11:06.659368+0000","last_active":"2024-09-14T11:51:08.746597+0000","last_peered":"2024-09-14T11:51:08.746597+0000","last_clean":"2024-09-14T11:51:08.746597+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:51:08.746597+0000","last_undegraded":"2024-09-14T11:51:08.746597+0000","last_fullsized":"2024-09-14T11:51:08.746597+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:58.840799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'214","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:56.211247+0000","last_change":"2024-09-14T11:11:04.663046+0000","last_active":"2024-09-14T11:49:56.211247+0000","last_peered":"2024-09-14T11:49:56.211247+0000","last_clean":"2024-09-14T11:49:56.211247+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:49:56.211247+0000","last_undegraded":"2024-09-14T11:49:56.211247+0000","last_fullsized":"2024-09-14T11:49:56.211247+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:13.422693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11883891,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":490,"num_read_kb":22963,"num_write":990,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1725","reported_seq":3529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220305+0000","last_change":"2024-09-14T11:11:06.649254+0000","last_active":"2024-09-14T11:51:19.220305+0000","last_peered":"2024-09-14T11:51:19.220305+0000","last_clean":"2024-09-14T11:51:19.220305+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:51:19.220305+0000","last_undegraded":"2024-09-14T11:51:19.220305+0000","last_fullsized":"2024-09-14T11:51:19.220305+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:09.019220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:47.550503+0000","last_change":"2024-09-14T11:11:04.667994+0000","last_active":"2024-09-14T11:49:47.550503+0000","last_peered":"2024-09-14T11:49:47.550503+0000","last_clean":"2024-09-14T11:49:47.550503+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:49:47.550503+0000","last_undegraded":"2024-09-14T11:49:47.550503+0000","last_fullsized":"2024-09-14T11:49:47.550503+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:02.592974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193762,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":9299,"num_write":1024,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'390","reported_seq":1862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316772+0000","last_change":"2024-09-14T11:11:06.646168+0000","last_active":"2024-09-14T11:51:21.316772+0000","last_peered":"2024-09-14T11:51:21.316772+0000","last_clean":"2024-09-14T11:51:21.316772+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:51:21.316772+0000","last_undegraded":"2024-09-14T11:51:21.316772+0000","last_fullsized":"2024-09-14T11:51:21.316772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:16.898215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'218","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.895001+0000","last_change":"2024-09-14T11:11:04.651268+0000","last_active":"2024-09-14T11:50:25.895001+0000","last_peered":"2024-09-14T11:50:25.895001+0000","last_clean":"2024-09-14T11:50:25.895001+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:50:25.895001+0000","last_undegraded":"2024-09-14T11:50:25.895001+0000","last_fullsized":"2024-09-14T11:50:25.895001+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:23.982692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":67022,"num_write":1008,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845379+0000","last_change":"2024-09-14T11:11:06.659988+0000","last_active":"2024-09-14T11:51:21.845379+0000","last_peered":"2024-09-14T11:51:21.845379+0000","last_clean":"2024-09-14T11:51:21.845379+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:51:21.845379+0000","last_undegraded":"2024-09-14T11:51:21.845379+0000","last_fullsized":"2024-09-14T11:51:21.845379+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:38.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'203","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.533851+0000","last_change":"2024-09-14T11:11:38.680954+0000","last_active":"2024-09-14T11:50:25.533851+0000","last_peered":"2024-09-14T11:50:25.533851+0000","last_clean":"2024-09-14T11:50:25.533851+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:50:25.533851+0000","last_undegraded":"2024-09-14T11:50:25.533851+0000","last_fullsized":"2024-09-14T11:50:25.533851+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:16.743206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646946,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":636,"num_read_kb":27752,"num_write":881,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'205","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:55.508425+0000","last_change":"2024-09-14T11:11:04.661066+0000","last_active":"2024-09-14T11:49:55.508425+0000","last_peered":"2024-09-14T11:49:55.508425+0000","last_clean":"2024-09-14T11:49:55.508425+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:49:55.508425+0000","last_undegraded":"2024-09-14T11:49:55.508425+0000","last_fullsized":"2024-09-14T11:49:55.508425+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:37.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105464,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":450,"num_read_kb":2089,"num_write":992,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'473","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179160+0000","last_change":"2024-09-14T11:11:06.654014+0000","last_active":"2024-09-14T11:51:05.179160+0000","last_peered":"2024-09-14T11:51:05.179160+0000","last_clean":"2024-09-14T11:51:05.179160+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:51:05.179160+0000","last_undegraded":"2024-09-14T11:51:05.179160+0000","last_fullsized":"2024-09-14T11:51:05.179160+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.254011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'257","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.156014+0000","last_change":"2024-09-14T11:11:04.647071+0000","last_active":"2024-09-14T11:51:19.156014+0000","last_peered":"2024-09-14T11:51:19.156014+0000","last_clean":"2024-09-14T11:51:19.156014+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:51:19.156014+0000","last_undegraded":"2024-09-14T11:51:19.156014+0000","last_fullsized":"2024-09-14T11:51:19.156014+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:36.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":738,"num_read_kb":42624,"num_write":1177,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'381","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844858+0000","last_change":"2024-09-14T11:11:06.651474+0000","last_active":"2024-09-14T11:51:21.844858+0000","last_peered":"2024-09-14T11:51:21.844858+0000","last_clean":"2024-09-14T11:51:21.844858+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:51:21.844858+0000","last_undegraded":"2024-09-14T11:51:21.844858+0000","last_fullsized":"2024-09-14T11:51:21.844858+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:12.583169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1586,"ondisk_log_size":1586,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":441,"ondisk_log_size":441,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":549287,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8076,"num_read_kb":10163,"num_write":5523,"num_write_kb":2827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":246138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1822,"ondisk_log_size":1822,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2859,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4062,"ondisk_log_size":4062,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":516365168,"num_objects":497,"num_object_clones":0,"num_object_copies":1988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42119,"num_read_kb":2539582,"num_write":63965,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":692436992,"data_stored":692436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3581,"ondisk_log_size":3581,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":132,"num_read_kb":168157,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":181387,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542654,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363936,"kb_used_data":125904,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94007904,"statfs":{"total":96636764160,"available":96264093696,"internally_reserved":0,"allocated":128925696,"data_stored":126882893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542654,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348908,"kb_used_data":110876,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94022932,"statfs":{"total":96636764160,"available":96279482368,"internally_reserved":0,"allocated":113537024,"data_stored":111570785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542652,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244012,"kb_used_data":132316,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94127828,"statfs":{"total":96636764160,"available":96386895872,"internally_reserved":0,"allocated":135491584,"data_stored":133446387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542652,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239172,"kb_used_data":127476,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94132668,"statfs":{"total":96636764160,"available":96391852032,"internally_reserved":0,"allocated":130535424,"data_stored":128601245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542651,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394872,"kb_used_data":138792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93976968,"statfs":{"total":96636764160,"available":96232415232,"internally_reserved":0,"allocated":142123008,"data_stored":140103253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542652,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188868,"kb_used_data":103540,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94182972,"statfs":{"total":96636764160,"available":96443363328,"internally_reserved":0,"allocated":106024960,"data_stored":104085158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542652,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267800,"kb_used_data":128392,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94104040,"statfs":{"total":96636764160,"available":96362536960,"internally_reserved":0,"allocated":131473408,"data_stored":129466388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542653,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396440,"kb_used_data":126536,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93975400,"statfs":{"total":96636764160,"available":96230809600,"internally_reserved":0,"allocated":129572864,"data_stored":127542267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95223808,"data_stored":95223808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91357184,"data_stored":91357184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62988288,"data_stored":62988288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86421504,"data_stored":86421504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92721152,"data_stored":92721152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93364224,"data_stored":93364224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83079168,"data_stored":83079168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":87281664,"data_stored":87281664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":37449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":36402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":37213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":24241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":50688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16814080,"data_stored":16812382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14746907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14708736,"data_stored":14707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22016000,"data_stored":22015117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19977499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26210304,"data_stored":26210304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10489856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19931136,"data_stored":19931136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12621083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21073920,"data_stored":21069433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24121344,"data_stored":24121344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29372416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13639680,"data_stored":13639680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":15719565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16773120,"data_stored":16773120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:52:46.836 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:52:46.837 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:52:47.161 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:52:47.174 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:52:47.176 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1518,"stamp":"2024-09-14T11:52:47.072244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662413282,"num_objects":1017,"num_object_clones":0,"num_object_copies":3028,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1017,"num_whiteouts":0,"num_read":298782,"num_read_kb":3127342,"num_write":145881,"num_write_kb":2544918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12789,"ondisk_log_size":12789,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2444008,"kb_used_data":993832,"kb_used_omap":12,"kb_used_meta":1450035,"kb_avail":752530712,"statfs":{"total":773094113280,"available":770591449088,"internally_reserved":0,"allocated":1017683968,"data_stored":1001698376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1484836401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1160,"num_objects":-18,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":257,"num_read_kb":258,"num_write":43,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005413"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:49.032072+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:47:49.032072+0000","last_peered":"2024-09-14T11:47:49.032072+0000","last_clean":"2024-09-14T11:47:49.032072+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:47:49.032072+0000","last_undegraded":"2024-09-14T11:47:49.032072+0000","last_fullsized":"2024-09-14T11:47:49.032072+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":80,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929194+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:50:13.929194+0000","last_peered":"2024-09-14T11:50:13.929194+0000","last_clean":"2024-09-14T11:50:13.929194+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:50:13.929194+0000","last_undegraded":"2024-09-14T11:50:13.929194+0000","last_fullsized":"2024-09-14T11:50:13.929194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":7172,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.491129+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:50:29.491129+0000","last_peered":"2024-09-14T11:50:29.491129+0000","last_clean":"2024-09-14T11:50:29.491129+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:50:29.491129+0000","last_undegraded":"2024-09-14T11:50:29.491129+0000","last_fullsized":"2024-09-14T11:50:29.491129+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.932210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.020550+0000","last_change":"2024-09-14T11:38:32.849060+0000","last_active":"2024-09-14T11:48:34.020550+0000","last_peered":"2024-09-14T11:48:34.020550+0000","last_clean":"2024-09-14T11:48:34.020550+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:48:34.020550+0000","last_undegraded":"2024-09-14T11:48:34.020550+0000","last_fullsized":"2024-09-14T11:48:34.020550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:37.543006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.906147+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:47:48.906147+0000","last_peered":"2024-09-14T11:47:48.906147+0000","last_clean":"2024-09-14T11:47:48.906147+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:47:48.906147+0000","last_undegraded":"2024-09-14T11:47:48.906147+0000","last_fullsized":"2024-09-14T11:47:48.906147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929084+0000","last_change":"2024-09-14T11:27:43.844600+0000","last_active":"2024-09-14T11:50:13.929084+0000","last_peered":"2024-09-14T11:50:13.929084+0000","last_clean":"2024-09-14T11:50:13.929084+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:50:13.929084+0000","last_undegraded":"2024-09-14T11:50:13.929084+0000","last_fullsized":"2024-09-14T11:50:13.929084+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:40.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.031874+0000","last_change":"2024-09-14T11:26:02.011475+0000","last_active":"2024-09-14T11:50:04.031874+0000","last_peered":"2024-09-14T11:50:04.031874+0000","last_clean":"2024-09-14T11:50:04.031874+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:50:04.031874+0000","last_undegraded":"2024-09-14T11:50:04.031874+0000","last_fullsized":"2024-09-14T11:50:04.031874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:06.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.904430+0000","last_change":"2024-09-14T11:38:32.844854+0000","last_active":"2024-09-14T11:48:13.904430+0000","last_peered":"2024-09-14T11:48:13.904430+0000","last_clean":"2024-09-14T11:48:13.904430+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:48:13.904430+0000","last_undegraded":"2024-09-14T11:48:13.904430+0000","last_fullsized":"2024-09-14T11:48:13.904430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:24.240149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'8","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914798+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:48:38.914798+0000","last_peered":"2024-09-14T11:48:38.914798+0000","last_clean":"2024-09-14T11:48:38.914798+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:48:38.914798+0000","last_undegraded":"2024-09-14T11:48:38.914798+0000","last_fullsized":"2024-09-14T11:48:38.914798+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":15373,"num_write":8,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.029442+0000","last_change":"2024-09-14T11:27:43.839478+0000","last_active":"2024-09-14T11:49:44.029442+0000","last_peered":"2024-09-14T11:49:44.029442+0000","last_clean":"2024-09-14T11:49:44.029442+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:49:44.029442+0000","last_undegraded":"2024-09-14T11:49:44.029442+0000","last_fullsized":"2024-09-14T11:49:44.029442+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:44.742446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:18.912574+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:48:18.912574+0000","last_peered":"2024-09-14T11:48:18.912574+0000","last_clean":"2024-09-14T11:48:18.912574+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:48:18.912574+0000","last_undegraded":"2024-09-14T11:48:18.912574+0000","last_fullsized":"2024-09-14T11:48:18.912574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:25.443932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930348+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:50:38.930348+0000","last_peered":"2024-09-14T11:50:38.930348+0000","last_clean":"2024-09-14T11:50:38.930348+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:50:38.930348+0000","last_undegraded":"2024-09-14T11:50:38.930348+0000","last_fullsized":"2024-09-14T11:50:38.930348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.922656+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:49:38.922656+0000","last_peered":"2024-09-14T11:49:38.922656+0000","last_clean":"2024-09-14T11:49:38.922656+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:49:38.922656+0000","last_undegraded":"2024-09-14T11:49:38.922656+0000","last_fullsized":"2024-09-14T11:49:38.922656+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918289+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:48:58.918289+0000","last_peered":"2024-09-14T11:48:58.918289+0000","last_clean":"2024-09-14T11:48:58.918289+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:48:58.918289+0000","last_undegraded":"2024-09-14T11:48:58.918289+0000","last_fullsized":"2024-09-14T11:48:58.918289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.194975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.916014+0000","last_change":"2024-09-14T11:27:46.877556+0000","last_active":"2024-09-14T11:49:33.916014+0000","last_peered":"2024-09-14T11:49:33.916014+0000","last_clean":"2024-09-14T11:49:33.916014+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:49:33.916014+0000","last_undegraded":"2024-09-14T11:49:33.916014+0000","last_fullsized":"2024-09-14T11:49:33.916014+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:18.433716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.921935+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:49:33.921935+0000","last_peered":"2024-09-14T11:49:33.921935+0000","last_clean":"2024-09-14T11:49:33.921935+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:49:33.921935+0000","last_undegraded":"2024-09-14T11:49:33.921935+0000","last_fullsized":"2024-09-14T11:49:33.921935+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907414+0000","last_change":"2024-09-14T11:26:02.016774+0000","last_active":"2024-09-14T11:48:33.907414+0000","last_peered":"2024-09-14T11:48:33.907414+0000","last_clean":"2024-09-14T11:48:33.907414+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:48:33.907414+0000","last_undegraded":"2024-09-14T11:48:33.907414+0000","last_fullsized":"2024-09-14T11:48:33.907414+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:07.106001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'13","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:47:48.901076+0000","last_change":"2024-09-14T11:27:46.886470+0000","last_active":"2024-09-14T11:47:48.901076+0000","last_peered":"2024-09-14T11:47:48.901076+0000","last_clean":"2024-09-14T11:47:48.901076+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:47:48.901076+0000","last_undegraded":"2024-09-14T11:47:48.901076+0000","last_fullsized":"2024-09-14T11:47:48.901076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:31.966694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19456,"num_write":23,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927162+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:50:13.927162+0000","last_peered":"2024-09-14T11:50:13.927162+0000","last_clean":"2024-09-14T11:50:13.927162+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:50:13.927162+0000","last_undegraded":"2024-09-14T11:50:13.927162+0000","last_fullsized":"2024-09-14T11:50:13.927162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301531,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5174,"num_write":11,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929327+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:50:13.929327+0000","last_peered":"2024-09-14T11:50:13.929327+0000","last_clean":"2024-09-14T11:50:13.929327+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:50:13.929327+0000","last_undegraded":"2024-09-14T11:50:13.929327+0000","last_fullsized":"2024-09-14T11:50:13.929327+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":12280,"num_write":4,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.928980+0000","last_change":"2024-09-14T11:26:02.018044+0000","last_active":"2024-09-14T11:50:13.928980+0000","last_peered":"2024-09-14T11:50:13.928980+0000","last_clean":"2024-09-14T11:50:13.928980+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:50:13.928980+0000","last_undegraded":"2024-09-14T11:50:13.928980+0000","last_fullsized":"2024-09-14T11:50:13.928980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:20.434831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923623+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:49:33.923623+0000","last_peered":"2024-09-14T11:49:33.923623+0000","last_clean":"2024-09-14T11:49:33.923623+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:49:33.923623+0000","last_undegraded":"2024-09-14T11:49:33.923623+0000","last_fullsized":"2024-09-14T11:49:33.923623+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040301+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:48:44.040301+0000","last_peered":"2024-09-14T11:48:44.040301+0000","last_clean":"2024-09-14T11:48:44.040301+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:48:44.040301+0000","last_undegraded":"2024-09-14T11:48:44.040301+0000","last_fullsized":"2024-09-14T11:48:44.040301+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:57.988895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5124,"num_write":2,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033275+0000","last_change":"2024-09-14T11:38:32.848295+0000","last_active":"2024-09-14T11:50:14.033275+0000","last_peered":"2024-09-14T11:50:14.033275+0000","last_clean":"2024-09-14T11:50:14.033275+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:50:14.033275+0000","last_undegraded":"2024-09-14T11:50:14.033275+0000","last_fullsized":"2024-09-14T11:50:14.033275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:48.994528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:53.917687+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:48:53.917687+0000","last_peered":"2024-09-14T11:48:53.917687+0000","last_clean":"2024-09-14T11:48:53.917687+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:48:53.917687+0000","last_undegraded":"2024-09-14T11:48:53.917687+0000","last_fullsized":"2024-09-14T11:48:53.917687+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042145+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:49:29.042145+0000","last_peered":"2024-09-14T11:49:29.042145+0000","last_clean":"2024-09-14T11:49:29.042145+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:49:29.042145+0000","last_undegraded":"2024-09-14T11:49:29.042145+0000","last_fullsized":"2024-09-14T11:49:29.042145+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5122,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.923673+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:49:33.923673+0000","last_peered":"2024-09-14T11:49:33.923673+0000","last_clean":"2024-09-14T11:49:33.923673+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:49:33.923673+0000","last_undegraded":"2024-09-14T11:49:33.923673+0000","last_fullsized":"2024-09-14T11:49:33.923673+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.027786+0000","last_change":"2024-09-14T11:27:43.833928+0000","last_active":"2024-09-14T11:49:29.027786+0000","last_peered":"2024-09-14T11:49:29.027786+0000","last_clean":"2024-09-14T11:49:29.027786+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:49:29.027786+0000","last_undegraded":"2024-09-14T11:49:29.027786+0000","last_fullsized":"2024-09-14T11:49:29.027786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:18.568174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033312+0000","last_change":"2024-09-14T11:26:02.016653+0000","last_active":"2024-09-14T11:50:14.033312+0000","last_peered":"2024-09-14T11:50:14.033312+0000","last_clean":"2024-09-14T11:50:14.033312+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:50:14.033312+0000","last_undegraded":"2024-09-14T11:50:14.033312+0000","last_fullsized":"2024-09-14T11:50:14.033312+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:16.371317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'1","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:33.922005+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:49:33.922005+0000","last_peered":"2024-09-14T11:49:33.922005+0000","last_clean":"2024-09-14T11:49:33.922005+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:49:33.922005+0000","last_undegraded":"2024-09-14T11:49:33.922005+0000","last_fullsized":"2024-09-14T11:49:33.922005+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911902+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:48:13.911902+0000","last_peered":"2024-09-14T11:48:13.911902+0000","last_clean":"2024-09-14T11:48:13.911902+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:48:13.911902+0000","last_undegraded":"2024-09-14T11:48:13.911902+0000","last_fullsized":"2024-09-14T11:48:13.911902+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:00.999425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916585+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:48:48.916585+0000","last_peered":"2024-09-14T11:48:48.916585+0000","last_clean":"2024-09-14T11:48:48.916585+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:48:48.916585+0000","last_undegraded":"2024-09-14T11:48:48.916585+0000","last_fullsized":"2024-09-14T11:48:48.916585+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:19.871430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3076,"num_write":3,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914944+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:48:43.914944+0000","last_peered":"2024-09-14T11:48:43.914944+0000","last_clean":"2024-09-14T11:48:43.914944+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:48:43.914944+0000","last_undegraded":"2024-09-14T11:48:43.914944+0000","last_fullsized":"2024-09-14T11:48:43.914944+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:16.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.909890+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:48:13.909890+0000","last_peered":"2024-09-14T11:48:13.909890+0000","last_clean":"2024-09-14T11:48:13.909890+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:48:13.909890+0000","last_undegraded":"2024-09-14T11:48:13.909890+0000","last_fullsized":"2024-09-14T11:48:13.909890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:42.939970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916531+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:48:48.916531+0000","last_peered":"2024-09-14T11:48:48.916531+0000","last_clean":"2024-09-14T11:48:48.916531+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:48:48.916531+0000","last_undegraded":"2024-09-14T11:48:48.916531+0000","last_fullsized":"2024-09-14T11:48:48.916531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:11.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916162+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:48:43.916162+0000","last_peered":"2024-09-14T11:48:43.916162+0000","last_clean":"2024-09-14T11:48:43.916162+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:48:43.916162+0000","last_undegraded":"2024-09-14T11:48:43.916162+0000","last_fullsized":"2024-09-14T11:48:43.916162+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":9,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916982+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:48:48.916982+0000","last_peered":"2024-09-14T11:48:48.916982+0000","last_clean":"2024-09-14T11:48:48.916982+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:48:48.916982+0000","last_undegraded":"2024-09-14T11:48:48.916982+0000","last_fullsized":"2024-09-14T11:48:48.916982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:18.041265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.909029+0000","last_change":"2024-09-14T11:27:43.841798+0000","last_active":"2024-09-14T11:48:43.909029+0000","last_peered":"2024-09-14T11:48:43.909029+0000","last_clean":"2024-09-14T11:48:43.909029+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:48:43.909029+0000","last_undegraded":"2024-09-14T11:48:43.909029+0000","last_fullsized":"2024-09-14T11:48:43.909029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920603+0000","last_change":"2024-09-14T11:26:02.017294+0000","last_active":"2024-09-14T11:49:23.920603+0000","last_peered":"2024-09-14T11:49:23.920603+0000","last_clean":"2024-09-14T11:49:23.920603+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:49:23.920603+0000","last_undegraded":"2024-09-14T11:49:23.920603+0000","last_fullsized":"2024-09-14T11:49:23.920603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.763964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911882+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:48:13.911882+0000","last_peered":"2024-09-14T11:48:13.911882+0000","last_clean":"2024-09-14T11:48:13.911882+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:48:13.911882+0000","last_undegraded":"2024-09-14T11:48:13.911882+0000","last_fullsized":"2024-09-14T11:48:13.911882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.077724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.909728+0000","last_change":"2024-09-14T11:27:46.878156+0000","last_active":"2024-09-14T11:48:48.909728+0000","last_peered":"2024-09-14T11:48:48.909728+0000","last_clean":"2024-09-14T11:48:48.909728+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:48:48.909728+0000","last_undegraded":"2024-09-14T11:48:48.909728+0000","last_fullsized":"2024-09-14T11:48:48.909728+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:16.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9432205,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":8188,"num_write":4,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040261+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:48:44.040261+0000","last_peered":"2024-09-14T11:48:44.040261+0000","last_clean":"2024-09-14T11:48:44.040261+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:48:44.040261+0000","last_undegraded":"2024-09-14T11:48:44.040261+0000","last_fullsized":"2024-09-14T11:48:44.040261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:04.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027203+0000","last_change":"2024-09-14T11:38:32.848761+0000","last_active":"2024-09-14T11:49:24.027203+0000","last_peered":"2024-09-14T11:49:24.027203+0000","last_clean":"2024-09-14T11:49:24.027203+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:49:24.027203+0000","last_undegraded":"2024-09-14T11:49:24.027203+0000","last_fullsized":"2024-09-14T11:49:24.027203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.405538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930037+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:50:18.930037+0000","last_peered":"2024-09-14T11:50:18.930037+0000","last_clean":"2024-09-14T11:50:18.930037+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:50:18.930037+0000","last_undegraded":"2024-09-14T11:50:18.930037+0000","last_fullsized":"2024-09-14T11:50:18.930037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048504+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:50:14.048504+0000","last_peered":"2024-09-14T11:50:14.048504+0000","last_clean":"2024-09-14T11:50:14.048504+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:50:14.048504+0000","last_undegraded":"2024-09-14T11:50:14.048504+0000","last_fullsized":"2024-09-14T11:50:14.048504+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":21510,"num_write":19,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915562+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:48:38.915562+0000","last_peered":"2024-09-14T11:48:38.915562+0000","last_clean":"2024-09-14T11:48:38.915562+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:48:38.915562+0000","last_undegraded":"2024-09-14T11:48:38.915562+0000","last_fullsized":"2024-09-14T11:48:38.915562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:22.557110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033300+0000","last_change":"2024-09-14T11:27:43.841930+0000","last_active":"2024-09-14T11:50:14.033300+0000","last_peered":"2024-09-14T11:50:14.033300+0000","last_clean":"2024-09-14T11:50:14.033300+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:50:14.033300+0000","last_undegraded":"2024-09-14T11:50:14.033300+0000","last_fullsized":"2024-09-14T11:50:14.033300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:26.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.039040+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:48:34.039040+0000","last_peered":"2024-09-14T11:48:34.039040+0000","last_clean":"2024-09-14T11:48:34.039040+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:48:34.039040+0000","last_undegraded":"2024-09-14T11:48:34.039040+0000","last_fullsized":"2024-09-14T11:48:34.039040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:32.266973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.914592+0000","last_change":"2024-09-14T11:38:32.850327+0000","last_active":"2024-09-14T11:49:23.914592+0000","last_peered":"2024-09-14T11:49:23.914592+0000","last_clean":"2024-09-14T11:49:23.914592+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:49:23.914592+0000","last_undegraded":"2024-09-14T11:49:23.914592+0000","last_fullsized":"2024-09-14T11:49:23.914592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930485+0000","last_change":"2024-09-14T11:27:47.189562+0000","last_active":"2024-09-14T11:50:23.930485+0000","last_peered":"2024-09-14T11:50:23.930485+0000","last_clean":"2024-09-14T11:50:23.930485+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:50:23.930485+0000","last_undegraded":"2024-09-14T11:50:23.930485+0000","last_fullsized":"2024-09-14T11:50:23.930485+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:40.247709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":3,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929405+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:50:13.929405+0000","last_peered":"2024-09-14T11:50:13.929405+0000","last_clean":"2024-09-14T11:50:13.929405+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:50:13.929405+0000","last_undegraded":"2024-09-14T11:50:13.929405+0000","last_fullsized":"2024-09-14T11:50:13.929405+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907514+0000","last_change":"2024-09-14T11:26:02.014516+0000","last_active":"2024-09-14T11:48:33.907514+0000","last_peered":"2024-09-14T11:48:33.907514+0000","last_clean":"2024-09-14T11:48:33.907514+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:48:33.907514+0000","last_undegraded":"2024-09-14T11:48:33.907514+0000","last_fullsized":"2024-09-14T11:48:33.907514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:24.171152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930066+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:50:18.930066+0000","last_peered":"2024-09-14T11:50:18.930066+0000","last_clean":"2024-09-14T11:50:18.930066+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:50:18.930066+0000","last_undegraded":"2024-09-14T11:50:18.930066+0000","last_fullsized":"2024-09-14T11:50:18.930066+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4112,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929898+0000","last_change":"2024-09-14T11:27:43.842788+0000","last_active":"2024-09-14T11:50:18.929898+0000","last_peered":"2024-09-14T11:50:18.929898+0000","last_clean":"2024-09-14T11:50:18.929898+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:50:18.929898+0000","last_undegraded":"2024-09-14T11:50:18.929898+0000","last_fullsized":"2024-09-14T11:50:18.929898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.953106+0000","last_change":"2024-09-14T11:26:02.009131+0000","last_active":"2024-09-14T11:50:25.953106+0000","last_peered":"2024-09-14T11:50:25.953106+0000","last_clean":"2024-09-14T11:50:25.953106+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:50:25.953106+0000","last_undegraded":"2024-09-14T11:50:25.953106+0000","last_fullsized":"2024-09-14T11:50:25.953106+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921298+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:49:28.921298+0000","last_peered":"2024-09-14T11:49:28.921298+0000","last_clean":"2024-09-14T11:49:28.921298+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:49:28.921298+0000","last_undegraded":"2024-09-14T11:49:28.921298+0000","last_fullsized":"2024-09-14T11:49:28.921298+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":6166,"num_write":5,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.698490+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:29.698490+0000","last_peered":"2024-09-14T11:50:29.698490+0000","last_clean":"2024-09-14T11:50:29.698490+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:29.698490+0000","last_undegraded":"2024-09-14T11:50:29.698490+0000","last_fullsized":"2024-09-14T11:50:29.698490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:46.261351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042041+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:49:29.042041+0000","last_peered":"2024-09-14T11:49:29.042041+0000","last_clean":"2024-09-14T11:49:29.042041+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:49:29.042041+0000","last_undegraded":"2024-09-14T11:49:29.042041+0000","last_fullsized":"2024-09-14T11:49:29.042041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922127+0000","last_change":"2024-09-14T11:27:43.843512+0000","last_active":"2024-09-14T11:49:23.922127+0000","last_peered":"2024-09-14T11:49:23.922127+0000","last_clean":"2024-09-14T11:49:23.922127+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:49:23.922127+0000","last_undegraded":"2024-09-14T11:49:23.922127+0000","last_fullsized":"2024-09-14T11:49:23.922127+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":4143,"num_write":12,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929860+0000","last_change":"2024-09-14T11:27:46.881654+0000","last_active":"2024-09-14T11:50:18.929860+0000","last_peered":"2024-09-14T11:50:18.929860+0000","last_clean":"2024-09-14T11:50:18.929860+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:50:18.929860+0000","last_undegraded":"2024-09-14T11:50:18.929860+0000","last_fullsized":"2024-09-14T11:50:18.929860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:09.752180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'5","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042090+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:49:29.042090+0000","last_peered":"2024-09-14T11:49:29.042090+0000","last_clean":"2024-09-14T11:49:29.042090+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:49:29.042090+0000","last_undegraded":"2024-09-14T11:49:29.042090+0000","last_fullsized":"2024-09-14T11:49:29.042090+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":15,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918260+0000","last_change":"2024-09-14T11:26:02.015867+0000","last_active":"2024-09-14T11:49:53.918260+0000","last_peered":"2024-09-14T11:49:53.918260+0000","last_clean":"2024-09-14T11:49:53.918260+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:49:53.918260+0000","last_undegraded":"2024-09-14T11:49:53.918260+0000","last_fullsized":"2024-09-14T11:49:53.918260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:45.729260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037984+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:48:59.037984+0000","last_peered":"2024-09-14T11:48:59.037984+0000","last_clean":"2024-09-14T11:48:59.037984+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:48:59.037984+0000","last_undegraded":"2024-09-14T11:48:59.037984+0000","last_fullsized":"2024-09-14T11:48:59.037984+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:52.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915712+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:48:43.915712+0000","last_peered":"2024-09-14T11:48:43.915712+0000","last_clean":"2024-09-14T11:48:43.915712+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:48:43.915712+0000","last_undegraded":"2024-09-14T11:48:43.915712+0000","last_fullsized":"2024-09-14T11:48:43.915712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":12378,"num_write":5,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052459+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:50:39.052459+0000","last_peered":"2024-09-14T11:50:39.052459+0000","last_clean":"2024-09-14T11:50:39.052459+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:50:39.052459+0000","last_undegraded":"2024-09-14T11:50:39.052459+0000","last_fullsized":"2024-09-14T11:50:39.052459+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7344128,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10258,"num_write":6,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042361+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:48:59.042361+0000","last_peered":"2024-09-14T11:48:59.042361+0000","last_clean":"2024-09-14T11:48:59.042361+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:48:59.042361+0000","last_undegraded":"2024-09-14T11:48:59.042361+0000","last_fullsized":"2024-09-14T11:48:59.042361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:40.838198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914723+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:48:38.914723+0000","last_peered":"2024-09-14T11:48:38.914723+0000","last_clean":"2024-09-14T11:48:38.914723+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:48:38.914723+0000","last_undegraded":"2024-09-14T11:48:38.914723+0000","last_fullsized":"2024-09-14T11:48:38.914723+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036469+0000","last_change":"2024-09-14T11:27:43.842571+0000","last_active":"2024-09-14T11:50:39.036469+0000","last_peered":"2024-09-14T11:50:39.036469+0000","last_clean":"2024-09-14T11:50:39.036469+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:50:39.036469+0000","last_undegraded":"2024-09-14T11:50:39.036469+0000","last_fullsized":"2024-09-14T11:50:39.036469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:54.316859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2137297,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":9,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918333+0000","last_change":"2024-09-14T11:26:02.017925+0000","last_active":"2024-09-14T11:49:53.918333+0000","last_peered":"2024-09-14T11:49:53.918333+0000","last_clean":"2024-09-14T11:49:53.918333+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:49:53.918333+0000","last_undegraded":"2024-09-14T11:49:53.918333+0000","last_fullsized":"2024-09-14T11:49:53.918333+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:08.536746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'1","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920684+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:49:23.920684+0000","last_peered":"2024-09-14T11:49:23.920684+0000","last_clean":"2024-09-14T11:49:23.920684+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:49:23.920684+0000","last_undegraded":"2024-09-14T11:49:23.920684+0000","last_fullsized":"2024-09-14T11:49:23.920684+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:13.953562+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:49:13.953562+0000","last_peered":"2024-09-14T11:49:13.953562+0000","last_clean":"2024-09-14T11:49:13.953562+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:49:13.953562+0000","last_undegraded":"2024-09-14T11:49:13.953562+0000","last_fullsized":"2024-09-14T11:49:13.953562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:55.854911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.917107+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:48:58.917107+0000","last_peered":"2024-09-14T11:48:58.917107+0000","last_clean":"2024-09-14T11:48:58.917107+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:48:58.917107+0000","last_undegraded":"2024-09-14T11:48:58.917107+0000","last_fullsized":"2024-09-14T11:48:58.917107+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:10.571334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'1","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.921390+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:49:28.921390+0000","last_peered":"2024-09-14T11:49:28.921390+0000","last_clean":"2024-09-14T11:49:28.921390+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:49:28.921390+0000","last_undegraded":"2024-09-14T11:49:28.921390+0000","last_fullsized":"2024-09-14T11:49:28.921390+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041365+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:49:24.041365+0000","last_peered":"2024-09-14T11:49:24.041365+0000","last_clean":"2024-09-14T11:49:24.041365+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:49:24.041365+0000","last_undegraded":"2024-09-14T11:49:24.041365+0000","last_fullsized":"2024-09-14T11:49:24.041365+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918208+0000","last_change":"2024-09-14T11:26:02.017129+0000","last_active":"2024-09-14T11:48:58.918208+0000","last_peered":"2024-09-14T11:48:58.918208+0000","last_clean":"2024-09-14T11:48:58.918208+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:48:58.918208+0000","last_undegraded":"2024-09-14T11:48:58.918208+0000","last_fullsized":"2024-09-14T11:48:58.918208+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:31.419402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027265+0000","last_change":"2024-09-14T11:38:32.849590+0000","last_active":"2024-09-14T11:49:24.027265+0000","last_peered":"2024-09-14T11:49:24.027265+0000","last_clean":"2024-09-14T11:49:24.027265+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:49:24.027265+0000","last_undegraded":"2024-09-14T11:49:24.027265+0000","last_fullsized":"2024-09-14T11:49:24.027265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:47.728058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'3","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914584+0000","last_change":"2024-09-14T11:27:46.881829+0000","last_active":"2024-09-14T11:48:38.914584+0000","last_peered":"2024-09-14T11:48:38.914584+0000","last_clean":"2024-09-14T11:48:38.914584+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:48:38.914584+0000","last_undegraded":"2024-09-14T11:48:38.914584+0000","last_fullsized":"2024-09-14T11:48:38.914584+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:28.272707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":8,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'3","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.043981+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:49:44.043981+0000","last_peered":"2024-09-14T11:49:44.043981+0000","last_clean":"2024-09-14T11:49:44.043981+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:49:44.043981+0000","last_undegraded":"2024-09-14T11:49:44.043981+0000","last_fullsized":"2024-09-14T11:49:44.043981+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042401+0000","last_change":"2024-09-14T11:26:02.004701+0000","last_active":"2024-09-14T11:48:59.042401+0000","last_peered":"2024-09-14T11:48:59.042401+0000","last_clean":"2024-09-14T11:48:59.042401+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:48:59.042401+0000","last_undegraded":"2024-09-14T11:48:59.042401+0000","last_fullsized":"2024-09-14T11:48:59.042401+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:25.708478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052376+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:50:39.052376+0000","last_peered":"2024-09-14T11:50:39.052376+0000","last_clean":"2024-09-14T11:50:39.052376+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:50:39.052376+0000","last_undegraded":"2024-09-14T11:50:39.052376+0000","last_fullsized":"2024-09-14T11:50:39.052376+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:32.268368+0000","last_change":"2024-09-14T11:26:02.017353+0000","last_active":"2024-09-14T11:49:32.268368+0000","last_peered":"2024-09-14T11:49:32.268368+0000","last_clean":"2024-09-14T11:49:32.268368+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:49:32.268368+0000","last_undegraded":"2024-09-14T11:49:32.268368+0000","last_fullsized":"2024-09-14T11:49:32.268368+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:27.288411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918234+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:48:58.918234+0000","last_peered":"2024-09-14T11:48:58.918234+0000","last_clean":"2024-09-14T11:48:58.918234+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:48:58.918234+0000","last_undegraded":"2024-09-14T11:48:58.918234+0000","last_fullsized":"2024-09-14T11:48:58.918234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:40.224008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908230+0000","last_change":"2024-09-14T11:27:46.880908+0000","last_active":"2024-09-14T11:48:38.908230+0000","last_peered":"2024-09-14T11:48:38.908230+0000","last_clean":"2024-09-14T11:48:38.908230+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:48:38.908230+0000","last_undegraded":"2024-09-14T11:48:38.908230+0000","last_fullsized":"2024-09-14T11:48:38.908230+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:28.300991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932313+0000","last_change":"2024-09-14T11:27:43.841331+0000","last_active":"2024-09-14T11:50:38.932313+0000","last_peered":"2024-09-14T11:50:38.932313+0000","last_clean":"2024-09-14T11:50:38.932313+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:50:38.932313+0000","last_undegraded":"2024-09-14T11:50:38.932313+0000","last_fullsized":"2024-09-14T11:50:38.932313+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:03.837930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.911190+0000","last_change":"2024-09-14T11:26:02.017191+0000","last_active":"2024-09-14T11:48:58.911190+0000","last_peered":"2024-09-14T11:48:58.911190+0000","last_clean":"2024-09-14T11:48:58.911190+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:48:58.911190+0000","last_undegraded":"2024-09-14T11:48:58.911190+0000","last_fullsized":"2024-09-14T11:48:58.911190+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:53.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.038037+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:48:59.038037+0000","last_peered":"2024-09-14T11:48:59.038037+0000","last_clean":"2024-09-14T11:48:59.038037+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:48:59.038037+0000","last_undegraded":"2024-09-14T11:48:59.038037+0000","last_fullsized":"2024-09-14T11:48:59.038037+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:26.761199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914041+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:48:38.914041+0000","last_peered":"2024-09-14T11:48:38.914041+0000","last_clean":"2024-09-14T11:48:38.914041+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:48:38.914041+0000","last_undegraded":"2024-09-14T11:48:38.914041+0000","last_fullsized":"2024-09-14T11:48:38.914041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.924861+0000","last_change":"2024-09-14T11:27:43.841443+0000","last_active":"2024-09-14T11:50:38.924861+0000","last_peered":"2024-09-14T11:50:38.924861+0000","last_clean":"2024-09-14T11:50:38.924861+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:50:38.924861+0000","last_undegraded":"2024-09-14T11:50:38.924861+0000","last_fullsized":"2024-09-14T11:50:38.924861+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10252,"num_write":3,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.046775+0000","last_change":"2024-09-14T11:26:02.020510+0000","last_active":"2024-09-14T11:50:04.046775+0000","last_peered":"2024-09-14T11:50:04.046775+0000","last_clean":"2024-09-14T11:50:04.046775+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:50:04.046775+0000","last_undegraded":"2024-09-14T11:50:04.046775+0000","last_fullsized":"2024-09-14T11:50:04.046775+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'209","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.052524+0000","last_change":"2024-09-14T11:11:04.667841+0000","last_active":"2024-09-14T11:50:39.052524+0000","last_peered":"2024-09-14T11:50:39.052524+0000","last_clean":"2024-09-14T11:50:39.052524+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:50:39.052524+0000","last_undegraded":"2024-09-14T11:50:39.052524+0000","last_fullsized":"2024-09-14T11:50:39.052524+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:30.918136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8431804,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":555,"num_read_kb":26846,"num_write":995,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1170","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.942831+0000","last_change":"2024-09-14T11:11:06.652913+0000","last_active":"2024-09-14T11:50:47.942831+0000","last_peered":"2024-09-14T11:50:47.942831+0000","last_clean":"2024-09-14T11:50:47.942831+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:50:47.942831+0000","last_undegraded":"2024-09-14T11:50:47.942831+0000","last_fullsized":"2024-09-14T11:50:47.942831+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:14.129052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'193","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932374+0000","last_change":"2024-09-14T11:11:04.654208+0000","last_active":"2024-09-14T11:50:38.932374+0000","last_peered":"2024-09-14T11:50:38.932374+0000","last_clean":"2024-09-14T11:50:38.932374+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:50:38.932374+0000","last_undegraded":"2024-09-14T11:50:38.932374+0000","last_fullsized":"2024-09-14T11:50:38.932374+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:33.758275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2139742,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":487,"num_read_kb":7476,"num_write":911,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'449","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.437450+0000","last_change":"2024-09-14T11:11:06.659297+0000","last_active":"2024-09-14T11:52:36.437450+0000","last_peered":"2024-09-14T11:52:36.437450+0000","last_clean":"2024-09-14T11:52:36.437450+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:52:36.437450+0000","last_undegraded":"2024-09-14T11:52:36.437450+0000","last_fullsized":"2024-09-14T11:52:36.437450+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:11.366968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'217","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932471+0000","last_change":"2024-09-14T11:11:04.651404+0000","last_active":"2024-09-14T11:50:38.932471+0000","last_peered":"2024-09-14T11:50:38.932471+0000","last_clean":"2024-09-14T11:50:38.932471+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:50:38.932471+0000","last_undegraded":"2024-09-14T11:50:38.932471+0000","last_fullsized":"2024-09-14T11:50:38.932471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:30.338647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8827718,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":593,"num_read_kb":30059,"num_write":1068,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'879","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892231+0000","last_change":"2024-09-14T11:11:06.647529+0000","last_active":"2024-09-14T11:51:03.892231+0000","last_peered":"2024-09-14T11:51:03.892231+0000","last_clean":"2024-09-14T11:51:03.892231+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:51:03.892231+0000","last_undegraded":"2024-09-14T11:51:03.892231+0000","last_fullsized":"2024-09-14T11:51:03.892231+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:50.451539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'211","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.160046+0000","last_change":"2024-09-14T11:11:04.655250+0000","last_active":"2024-09-14T11:50:56.160046+0000","last_peered":"2024-09-14T11:50:56.160046+0000","last_clean":"2024-09-14T11:50:56.160046+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:50:56.160046+0000","last_undegraded":"2024-09-14T11:50:56.160046+0000","last_fullsized":"2024-09-14T11:50:56.160046+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:56.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6603918,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":721,"num_read_kb":74662,"num_write":884,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'393","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884504+0000","last_change":"2024-09-14T11:11:06.651444+0000","last_active":"2024-09-14T11:51:07.884504+0000","last_peered":"2024-09-14T11:51:07.884504+0000","last_clean":"2024-09-14T11:51:07.884504+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:51:07.884504+0000","last_undegraded":"2024-09-14T11:51:07.884504+0000","last_fullsized":"2024-09-14T11:51:07.884504+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:10.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'240","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.369693+0000","last_change":"2024-09-14T11:11:04.668428+0000","last_active":"2024-09-14T11:51:06.369693+0000","last_peered":"2024-09-14T11:51:06.369693+0000","last_clean":"2024-09-14T11:51:06.369693+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:51:06.369693+0000","last_undegraded":"2024-09-14T11:51:06.369693+0000","last_fullsized":"2024-09-14T11:51:06.369693+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:29.887388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10515237,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":626,"num_read_kb":17405,"num_write":1112,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'821","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172559+0000","last_change":"2024-09-14T11:11:06.657319+0000","last_active":"2024-09-14T11:51:07.172559+0000","last_peered":"2024-09-14T11:51:07.172559+0000","last_clean":"2024-09-14T11:51:07.172559+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:51:07.172559+0000","last_undegraded":"2024-09-14T11:51:07.172559+0000","last_fullsized":"2024-09-14T11:51:07.172559+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:34.511950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'208","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.190600+0000","last_change":"2024-09-14T11:11:04.664423+0000","last_active":"2024-09-14T11:51:18.190600+0000","last_peered":"2024-09-14T11:51:18.190600+0000","last_clean":"2024-09-14T11:51:18.190600+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:51:18.190600+0000","last_undegraded":"2024-09-14T11:51:18.190600+0000","last_fullsized":"2024-09-14T11:51:18.190600+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.472044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18938362,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":70473,"num_write":971,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'495","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.163975+0000","last_change":"2024-09-14T11:11:06.646675+0000","last_active":"2024-09-14T11:51:07.163975+0000","last_peered":"2024-09-14T11:51:07.163975+0000","last_clean":"2024-09-14T11:51:07.163975+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:51:07.163975+0000","last_undegraded":"2024-09-14T11:51:07.163975+0000","last_fullsized":"2024-09-14T11:51:07.163975+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:56.132334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'220","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.200016+0000","last_change":"2024-09-14T11:11:04.667849+0000","last_active":"2024-09-14T11:50:43.200016+0000","last_peered":"2024-09-14T11:50:43.200016+0000","last_clean":"2024-09-14T11:50:43.200016+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:50:43.200016+0000","last_undegraded":"2024-09-14T11:50:43.200016+0000","last_fullsized":"2024-09-14T11:50:43.200016+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:54.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385564,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":10772,"num_write":1046,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'701","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.166203+0000","last_change":"2024-09-14T11:11:06.661372+0000","last_active":"2024-09-14T11:51:07.166203+0000","last_peered":"2024-09-14T11:51:07.166203+0000","last_clean":"2024-09-14T11:51:07.166203+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:51:07.166203+0000","last_undegraded":"2024-09-14T11:51:07.166203+0000","last_fullsized":"2024-09-14T11:51:07.166203+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:52.380188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'228","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:36.642723+0000","last_change":"2024-09-14T11:11:04.640592+0000","last_active":"2024-09-14T11:50:36.642723+0000","last_peered":"2024-09-14T11:50:36.642723+0000","last_clean":"2024-09-14T11:50:36.642723+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:50:36.642723+0000","last_undegraded":"2024-09-14T11:50:36.642723+0000","last_fullsized":"2024-09-14T11:50:36.642723+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13670080,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1294,"num_read_kb":98345,"num_write":1089,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'780","reported_seq":2329,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.839282+0000","last_change":"2024-09-14T11:11:06.661394+0000","last_active":"2024-09-14T11:51:21.839282+0000","last_peered":"2024-09-14T11:51:21.839282+0000","last_clean":"2024-09-14T11:51:21.839282+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:51:21.839282+0000","last_undegraded":"2024-09-14T11:51:21.839282+0000","last_fullsized":"2024-09-14T11:51:21.839282+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'845","reported_seq":2375,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444047+0000","last_change":"2024-09-14T11:11:06.647432+0000","last_active":"2024-09-14T11:52:36.444047+0000","last_peered":"2024-09-14T11:52:36.444047+0000","last_clean":"2024-09-14T11:52:36.444047+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:52:36.444047+0000","last_undegraded":"2024-09-14T11:52:36.444047+0000","last_fullsized":"2024-09-14T11:52:36.444047+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:37.920539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'233","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044684+0000","last_change":"2024-09-14T11:11:04.664149+0000","last_active":"2024-09-14T11:49:49.044684+0000","last_peered":"2024-09-14T11:49:49.044684+0000","last_clean":"2024-09-14T11:49:49.044684+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:49:49.044684+0000","last_undegraded":"2024-09-14T11:49:49.044684+0000","last_fullsized":"2024-09-14T11:49:49.044684+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:28.501517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4213754,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":608,"num_read_kb":29179,"num_write":1116,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884906+0000","last_change":"2024-09-14T11:11:06.659339+0000","last_active":"2024-09-14T11:51:07.884906+0000","last_peered":"2024-09-14T11:51:07.884906+0000","last_clean":"2024-09-14T11:51:07.884906+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:51:07.884906+0000","last_undegraded":"2024-09-14T11:51:07.884906+0000","last_fullsized":"2024-09-14T11:51:07.884906+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:19.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'226","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.473221+0000","last_change":"2024-09-14T11:11:04.664561+0000","last_active":"2024-09-14T11:50:28.473221+0000","last_peered":"2024-09-14T11:50:28.473221+0000","last_clean":"2024-09-14T11:50:28.473221+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:50:28.473221+0000","last_undegraded":"2024-09-14T11:50:28.473221+0000","last_fullsized":"2024-09-14T11:50:28.473221+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.906199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13997357,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":811,"num_read_kb":241766,"num_write":931,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'516","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.877314+0000","last_change":"2024-09-14T11:11:06.656279+0000","last_active":"2024-09-14T11:51:07.877314+0000","last_peered":"2024-09-14T11:51:07.877314+0000","last_clean":"2024-09-14T11:51:07.877314+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:51:07.877314+0000","last_undegraded":"2024-09-14T11:51:07.877314+0000","last_fullsized":"2024-09-14T11:51:07.877314+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:24.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'264","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.379755+0000","last_change":"2024-09-14T11:11:04.661546+0000","last_active":"2024-09-14T11:50:29.379755+0000","last_peered":"2024-09-14T11:50:29.379755+0000","last_clean":"2024-09-14T11:50:29.379755+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:50:29.379755+0000","last_undegraded":"2024-09-14T11:50:29.379755+0000","last_fullsized":"2024-09-14T11:50:29.379755+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:24.019669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116413,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":670,"num_read_kb":32322,"num_write":1000,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'857","reported_seq":2392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316678+0000","last_change":"2024-09-14T11:11:06.659835+0000","last_active":"2024-09-14T11:51:21.316678+0000","last_peered":"2024-09-14T11:51:21.316678+0000","last_clean":"2024-09-14T11:51:21.316678+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:51:21.316678+0000","last_undegraded":"2024-09-14T11:51:21.316678+0000","last_fullsized":"2024-09-14T11:51:21.316678+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.436038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'229","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.321356+0000","last_change":"2024-09-14T11:11:04.651670+0000","last_active":"2024-09-14T11:51:18.321356+0000","last_peered":"2024-09-14T11:51:18.321356+0000","last_clean":"2024-09-14T11:51:18.321356+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:51:18.321356+0000","last_undegraded":"2024-09-14T11:51:18.321356+0000","last_fullsized":"2024-09-14T11:51:18.321356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:12.731774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13747755,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":708,"num_read_kb":18423,"num_write":1031,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1027","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746607+0000","last_change":"2024-09-14T11:11:06.659366+0000","last_active":"2024-09-14T11:51:08.746607+0000","last_peered":"2024-09-14T11:51:08.746607+0000","last_clean":"2024-09-14T11:51:08.746607+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:51:08.746607+0000","last_undegraded":"2024-09-14T11:51:08.746607+0000","last_fullsized":"2024-09-14T11:51:08.746607+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:22.893626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'206","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.383060+0000","last_change":"2024-09-14T11:11:04.656617+0000","last_active":"2024-09-14T11:51:01.383060+0000","last_peered":"2024-09-14T11:51:01.383060+0000","last_clean":"2024-09-14T11:51:01.383060+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:51:01.383060+0000","last_undegraded":"2024-09-14T11:51:01.383060+0000","last_fullsized":"2024-09-14T11:51:01.383060+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242894,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":19801,"num_write":943,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'477","reported_seq":2041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172995+0000","last_change":"2024-09-14T11:11:06.651961+0000","last_active":"2024-09-14T11:51:07.172995+0000","last_peered":"2024-09-14T11:51:07.172995+0000","last_clean":"2024-09-14T11:51:07.172995+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:51:07.172995+0000","last_undegraded":"2024-09-14T11:51:07.172995+0000","last_fullsized":"2024-09-14T11:51:07.172995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:22.258915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'228","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:41.967486+0000","last_change":"2024-09-14T11:11:04.655697+0000","last_active":"2024-09-14T11:50:41.967486+0000","last_peered":"2024-09-14T11:50:41.967486+0000","last_clean":"2024-09-14T11:50:41.967486+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:50:41.967486+0000","last_undegraded":"2024-09-14T11:50:41.967486+0000","last_fullsized":"2024-09-14T11:50:41.967486+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:15.626721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512993,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1263,"num_read_kb":11303,"num_write":1120,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'134","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.905769+0000","last_change":"2024-09-14T11:11:14.694441+0000","last_active":"2024-09-14T11:51:21.905769+0000","last_peered":"2024-09-14T11:51:21.905769+0000","last_clean":"2024-09-14T11:51:21.905769+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:51:21.905769+0000","last_undegraded":"2024-09-14T11:51:21.905769+0000","last_fullsized":"2024-09-14T11:51:21.905769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:00.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'942","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.164829+0000","last_change":"2024-09-14T11:11:06.652516+0000","last_active":"2024-09-14T11:51:07.164829+0000","last_peered":"2024-09-14T11:51:07.164829+0000","last_clean":"2024-09-14T11:51:07.164829+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:51:07.164829+0000","last_undegraded":"2024-09-14T11:51:07.164829+0000","last_fullsized":"2024-09-14T11:51:07.164829+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":900,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:57.934785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'231","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:46.126009+0000","last_change":"2024-09-14T11:11:04.656642+0000","last_active":"2024-09-14T11:50:46.126009+0000","last_peered":"2024-09-14T11:50:46.126009+0000","last_clean":"2024-09-14T11:50:46.126009+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:50:46.126009+0000","last_undegraded":"2024-09-14T11:50:46.126009+0000","last_fullsized":"2024-09-14T11:50:46.126009+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:50.939065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":730,"num_read_kb":7795,"num_write":1211,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.266018+0000","last_change":"2024-09-14T11:11:08.656138+0000","last_active":"2024-09-14T11:52:37.266018+0000","last_peered":"2024-09-14T11:52:37.266018+0000","last_clean":"2024-09-14T11:52:37.266018+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:52:37.266018+0000","last_undegraded":"2024-09-14T11:52:37.266018+0000","last_fullsized":"2024-09-14T11:52:37.266018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:46.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'187","reported_seq":777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945861+0000","last_change":"2024-09-14T11:11:10.669375+0000","last_active":"2024-09-14T11:52:18.945861+0000","last_peered":"2024-09-14T11:52:18.945861+0000","last_clean":"2024-09-14T11:52:18.945861+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:52:18.945861+0000","last_undegraded":"2024-09-14T11:52:18.945861+0000","last_fullsized":"2024-09-14T11:52:18.945861+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:40.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19747,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":251,"num_read_kb":326,"num_write":148,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045436+0000","last_change":"2024-09-14T11:11:12.678656+0000","last_active":"2024-09-14T11:49:54.045436+0000","last_peered":"2024-09-14T11:49:54.045436+0000","last_clean":"2024-09-14T11:49:54.045436+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:49:54.045436+0000","last_undegraded":"2024-09-14T11:49:54.045436+0000","last_fullsized":"2024-09-14T11:49:54.045436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:17.903974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2494","reported_seq":4314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.904000+0000","last_change":"2024-09-14T11:11:14.691811+0000","last_active":"2024-09-14T11:51:21.904000+0000","last_peered":"2024-09-14T11:51:21.904000+0000","last_clean":"2024-09-14T11:51:21.904000+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:51:21.904000+0000","last_undegraded":"2024-09-14T11:51:21.904000+0000","last_fullsized":"2024-09-14T11:51:21.904000+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.391799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'506","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845475+0000","last_change":"2024-09-14T11:11:06.653951+0000","last_active":"2024-09-14T11:51:21.845475+0000","last_peered":"2024-09-14T11:51:21.845475+0000","last_clean":"2024-09-14T11:51:21.845475+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:51:21.845475+0000","last_undegraded":"2024-09-14T11:51:21.845475+0000","last_fullsized":"2024-09-14T11:51:21.845475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:23.277940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'187","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.054338+0000","last_change":"2024-09-14T11:11:04.658016+0000","last_active":"2024-09-14T11:51:03.054338+0000","last_peered":"2024-09-14T11:51:03.054338+0000","last_clean":"2024-09-14T11:51:03.054338+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:51:03.054338+0000","last_undegraded":"2024-09-14T11:51:03.054338+0000","last_fullsized":"2024-09-14T11:51:03.054338+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.325176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075352,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":11633,"num_write":912,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915492+0000","last_change":"2024-09-14T11:11:08.651536+0000","last_active":"2024-09-14T11:48:38.915492+0000","last_peered":"2024-09-14T11:48:38.915492+0000","last_clean":"2024-09-14T11:48:38.915492+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:48:38.915492+0000","last_undegraded":"2024-09-14T11:48:38.915492+0000","last_fullsized":"2024-09-14T11:48:38.915492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:53.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'91","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.281938+0000","last_change":"2024-09-14T11:11:10.665667+0000","last_active":"2024-09-14T11:51:19.281938+0000","last_peered":"2024-09-14T11:51:19.281938+0000","last_clean":"2024-09-14T11:51:19.281938+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:51:19.281938+0000","last_undegraded":"2024-09-14T11:51:19.281938+0000","last_fullsized":"2024-09-14T11:51:19.281938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924491+0000","last_change":"2024-09-14T11:11:12.680761+0000","last_active":"2024-09-14T11:49:53.924491+0000","last_peered":"2024-09-14T11:49:53.924491+0000","last_clean":"2024-09-14T11:49:53.924491+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:49:53.924491+0000","last_undegraded":"2024-09-14T11:49:53.924491+0000","last_fullsized":"2024-09-14T11:49:53.924491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:43.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'123","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.339329+0000","last_change":"2024-09-14T11:11:14.689043+0000","last_active":"2024-09-14T11:50:55.339329+0000","last_peered":"2024-09-14T11:50:55.339329+0000","last_clean":"2024-09-14T11:50:55.339329+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:50:55.339329+0000","last_undegraded":"2024-09-14T11:50:55.339329+0000","last_fullsized":"2024-09-14T11:50:55.339329+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:04.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845324+0000","last_change":"2024-09-14T11:11:06.647241+0000","last_active":"2024-09-14T11:51:21.845324+0000","last_peered":"2024-09-14T11:51:21.845324+0000","last_clean":"2024-09-14T11:51:21.845324+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:51:21.845324+0000","last_undegraded":"2024-09-14T11:51:21.845324+0000","last_fullsized":"2024-09-14T11:51:21.845324+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'181","reported_seq":771,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:51.690075+0000","last_change":"2024-09-14T11:11:04.664751+0000","last_active":"2024-09-14T11:49:51.690075+0000","last_peered":"2024-09-14T11:49:51.690075+0000","last_clean":"2024-09-14T11:49:51.690075+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:49:51.690075+0000","last_undegraded":"2024-09-14T11:49:51.690075+0000","last_fullsized":"2024-09-14T11:49:51.690075+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.450319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5390582,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":25054,"num_write":823,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925536+0000","last_change":"2024-09-14T11:11:08.651600+0000","last_active":"2024-09-14T11:49:48.925536+0000","last_peered":"2024-09-14T11:49:48.925536+0000","last_clean":"2024-09-14T11:49:48.925536+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:49:48.925536+0000","last_undegraded":"2024-09-14T11:49:48.925536+0000","last_fullsized":"2024-09-14T11:49:48.925536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.328934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'113","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.299521+0000","last_change":"2024-09-14T11:11:10.667489+0000","last_active":"2024-09-14T11:51:19.299521+0000","last_peered":"2024-09-14T11:51:19.299521+0000","last_clean":"2024-09-14T11:51:19.299521+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:51:19.299521+0000","last_undegraded":"2024-09-14T11:51:19.299521+0000","last_fullsized":"2024-09-14T11:51:19.299521+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:08.313976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'762","reported_seq":2148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.559155+0000","last_change":"2024-09-14T11:11:12.682478+0000","last_active":"2024-09-14T11:52:37.559155+0000","last_peered":"2024-09-14T11:52:37.559155+0000","last_clean":"2024-09-14T11:52:37.559155+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:52:37.559155+0000","last_undegraded":"2024-09-14T11:52:37.559155+0000","last_fullsized":"2024-09-14T11:52:37.559155+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:25.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'257","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.373071+0000","last_change":"2024-09-14T11:11:14.886604+0000","last_active":"2024-09-14T11:51:21.373071+0000","last_peered":"2024-09-14T11:51:21.373071+0000","last_clean":"2024-09-14T11:51:21.373071+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:51:21.373071+0000","last_undegraded":"2024-09-14T11:51:21.373071+0000","last_fullsized":"2024-09-14T11:51:21.373071+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:17.055065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'608","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845477+0000","last_change":"2024-09-14T11:11:06.655177+0000","last_active":"2024-09-14T11:51:21.845477+0000","last_peered":"2024-09-14T11:51:21.845477+0000","last_clean":"2024-09-14T11:51:21.845477+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:51:21.845477+0000","last_undegraded":"2024-09-14T11:51:21.845477+0000","last_fullsized":"2024-09-14T11:51:21.845477+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.592691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'252","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.034403+0000","last_change":"2024-09-14T11:11:04.660596+0000","last_active":"2024-09-14T11:50:59.034403+0000","last_peered":"2024-09-14T11:50:59.034403+0000","last_clean":"2024-09-14T11:50:59.034403+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:50:59.034403+0000","last_undegraded":"2024-09-14T11:50:59.034403+0000","last_fullsized":"2024-09-14T11:50:59.034403+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:08.025245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3305578,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1218,"num_read_kb":9329,"num_write":1108,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.924083+0000","last_change":"2024-09-14T11:11:08.658911+0000","last_active":"2024-09-14T11:49:48.924083+0000","last_peered":"2024-09-14T11:49:48.924083+0000","last_clean":"2024-09-14T11:49:48.924083+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:49:48.924083+0000","last_undegraded":"2024-09-14T11:49:48.924083+0000","last_fullsized":"2024-09-14T11:49:48.924083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:43.590217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'112","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:19.068059+0000","last_change":"2024-09-14T11:11:10.883531+0000","last_active":"2024-09-14T11:52:19.068059+0000","last_peered":"2024-09-14T11:52:19.068059+0000","last_clean":"2024-09-14T11:52:19.068059+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:52:19.068059+0000","last_undegraded":"2024-09-14T11:52:19.068059+0000","last_fullsized":"2024-09-14T11:52:19.068059+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:37.652994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10730,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":149,"num_read_kb":192,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'816","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.563054+0000","last_change":"2024-09-14T11:11:12.683537+0000","last_active":"2024-09-14T11:52:37.563054+0000","last_peered":"2024-09-14T11:52:37.563054+0000","last_clean":"2024-09-14T11:52:37.563054+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:52:37.563054+0000","last_undegraded":"2024-09-14T11:52:37.563054+0000","last_fullsized":"2024-09-14T11:52:37.563054+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:38.308562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'475","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316625+0000","last_change":"2024-09-14T11:11:06.651830+0000","last_active":"2024-09-14T11:51:21.316625+0000","last_peered":"2024-09-14T11:51:21.316625+0000","last_clean":"2024-09-14T11:51:21.316625+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:51:21.316625+0000","last_undegraded":"2024-09-14T11:51:21.316625+0000","last_fullsized":"2024-09-14T11:51:21.316625+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:55.868674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'218","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.175726+0000","last_change":"2024-09-14T11:11:04.665193+0000","last_active":"2024-09-14T11:50:54.175726+0000","last_peered":"2024-09-14T11:50:54.175726+0000","last_clean":"2024-09-14T11:50:54.175726+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:50:54.175726+0000","last_undegraded":"2024-09-14T11:50:54.175726+0000","last_fullsized":"2024-09-14T11:50:54.175726+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:01.335563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10562869,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":605,"num_read_kb":75141,"num_write":983,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.047547+0000","last_change":"2024-09-14T11:11:08.659594+0000","last_active":"2024-09-14T11:50:09.047547+0000","last_peered":"2024-09-14T11:50:09.047547+0000","last_clean":"2024-09-14T11:50:09.047547+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:50:09.047547+0000","last_undegraded":"2024-09-14T11:50:09.047547+0000","last_fullsized":"2024-09-14T11:50:09.047547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:14.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'199","reported_seq":799,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.947343+0000","last_change":"2024-09-14T11:11:10.883185+0000","last_active":"2024-09-14T11:52:33.947343+0000","last_peered":"2024-09-14T11:52:33.947343+0000","last_clean":"2024-09-14T11:52:33.947343+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:52:33.947343+0000","last_undegraded":"2024-09-14T11:52:33.947343+0000","last_fullsized":"2024-09-14T11:52:33.947343+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:41.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14491,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":272,"num_read_kb":340,"num_write":158,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922914+0000","last_change":"2024-09-14T11:11:12.678507+0000","last_active":"2024-09-14T11:49:28.922914+0000","last_peered":"2024-09-14T11:49:28.922914+0000","last_clean":"2024-09-14T11:49:28.922914+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:49:28.922914+0000","last_undegraded":"2024-09-14T11:49:28.922914+0000","last_fullsized":"2024-09-14T11:49:28.922914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:11.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'544","reported_seq":1345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546676+0000","last_change":"2024-09-14T11:11:14.691810+0000","last_active":"2024-09-14T11:52:37.546676+0000","last_peered":"2024-09-14T11:52:37.546676+0000","last_clean":"2024-09-14T11:52:37.546676+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:52:37.546676+0000","last_undegraded":"2024-09-14T11:52:37.546676+0000","last_fullsized":"2024-09-14T11:52:37.546676+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:33.081563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892238+0000","last_change":"2024-09-14T11:11:06.650970+0000","last_active":"2024-09-14T11:51:03.892238+0000","last_peered":"2024-09-14T11:51:03.892238+0000","last_clean":"2024-09-14T11:51:03.892238+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:51:03.892238+0000","last_undegraded":"2024-09-14T11:51:03.892238+0000","last_fullsized":"2024-09-14T11:51:03.892238+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:08.200982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'221","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:32.223936+0000","last_change":"2024-09-14T11:11:04.653785+0000","last_active":"2024-09-14T11:52:32.223936+0000","last_peered":"2024-09-14T11:52:32.223936+0000","last_clean":"2024-09-14T11:52:32.223936+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:32.223936+0000","last_undegraded":"2024-09-14T11:52:32.223936+0000","last_fullsized":"2024-09-14T11:52:32.223936+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:13.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5272073,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":64064,"num_write":1009,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032486+0000","last_change":"2024-09-14T11:11:08.650799+0000","last_active":"2024-09-14T11:50:09.032486+0000","last_peered":"2024-09-14T11:50:09.032486+0000","last_clean":"2024-09-14T11:50:09.032486+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:50:09.032486+0000","last_undegraded":"2024-09-14T11:50:09.032486+0000","last_fullsized":"2024-09-14T11:50:09.032486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:34.338293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'134","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.941199+0000","last_change":"2024-09-14T11:11:10.669181+0000","last_active":"2024-09-14T11:51:43.941199+0000","last_peered":"2024-09-14T11:51:43.941199+0000","last_clean":"2024-09-14T11:51:43.941199+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:51:43.941199+0000","last_undegraded":"2024-09-14T11:51:43.941199+0000","last_fullsized":"2024-09-14T11:51:43.941199+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:51.810244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7595,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":196,"num_write":80,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930561+0000","last_change":"2024-09-14T11:11:12.677186+0000","last_active":"2024-09-14T11:50:23.930561+0000","last_peered":"2024-09-14T11:50:23.930561+0000","last_clean":"2024-09-14T11:50:23.930561+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:50:23.930561+0000","last_undegraded":"2024-09-14T11:50:23.930561+0000","last_fullsized":"2024-09-14T11:50:23.930561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:15.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'120","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217471+0000","last_change":"2024-09-14T11:11:14.693436+0000","last_active":"2024-09-14T11:51:19.217471+0000","last_peered":"2024-09-14T11:51:19.217471+0000","last_clean":"2024-09-14T11:51:19.217471+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:51:19.217471+0000","last_undegraded":"2024-09-14T11:51:19.217471+0000","last_fullsized":"2024-09-14T11:51:19.217471+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:36.190584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'378","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220246+0000","last_change":"2024-09-14T11:11:06.660214+0000","last_active":"2024-09-14T11:51:19.220246+0000","last_peered":"2024-09-14T11:51:19.220246+0000","last_clean":"2024-09-14T11:51:19.220246+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:51:19.220246+0000","last_undegraded":"2024-09-14T11:51:19.220246+0000","last_fullsized":"2024-09-14T11:51:19.220246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:34.858894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'210","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.434739+0000","last_change":"2024-09-14T11:11:04.668094+0000","last_active":"2024-09-14T11:50:30.434739+0000","last_peered":"2024-09-14T11:50:30.434739+0000","last_clean":"2024-09-14T11:50:30.434739+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:50:30.434739+0000","last_undegraded":"2024-09-14T11:50:30.434739+0000","last_fullsized":"2024-09-14T11:50:30.434739+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:01.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11916459,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":527,"num_read_kb":106187,"num_write":922,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027228+0000","last_change":"2024-09-14T11:11:08.655858+0000","last_active":"2024-09-14T11:49:24.027228+0000","last_peered":"2024-09-14T11:49:24.027228+0000","last_clean":"2024-09-14T11:49:24.027228+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:49:24.027228+0000","last_undegraded":"2024-09-14T11:49:24.027228+0000","last_fullsized":"2024-09-14T11:49:24.027228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.623644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'155","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:24.068936+0000","last_change":"2024-09-14T11:11:10.670978+0000","last_active":"2024-09-14T11:52:24.068936+0000","last_peered":"2024-09-14T11:52:24.068936+0000","last_clean":"2024-09-14T11:52:24.068936+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:52:24.068936+0000","last_undegraded":"2024-09-14T11:52:24.068936+0000","last_fullsized":"2024-09-14T11:52:24.068936+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:50.765426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13443,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":191,"num_read_kb":234,"num_write":104,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'771","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.564067+0000","last_change":"2024-09-14T11:11:12.682806+0000","last_active":"2024-09-14T11:52:37.564067+0000","last_peered":"2024-09-14T11:52:37.564067+0000","last_clean":"2024-09-14T11:52:37.564067+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:52:37.564067+0000","last_undegraded":"2024-09-14T11:52:37.564067+0000","last_fullsized":"2024-09-14T11:52:37.564067+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:25.160041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.385498+0000","last_change":"2024-09-14T11:11:14.691211+0000","last_active":"2024-09-14T11:52:36.385498+0000","last_peered":"2024-09-14T11:52:36.385498+0000","last_clean":"2024-09-14T11:52:36.385498+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:52:36.385498+0000","last_undegraded":"2024-09-14T11:52:36.385498+0000","last_fullsized":"2024-09-14T11:52:36.385498+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:53.737487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'567","reported_seq":2331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746198+0000","last_change":"2024-09-14T11:11:06.650873+0000","last_active":"2024-09-14T11:51:08.746198+0000","last_peered":"2024-09-14T11:51:08.746198+0000","last_clean":"2024-09-14T11:51:08.746198+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:51:08.746198+0000","last_undegraded":"2024-09-14T11:51:08.746198+0000","last_fullsized":"2024-09-14T11:51:08.746198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:08.434480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'196","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.339362+0000","last_change":"2024-09-14T11:11:04.660578+0000","last_active":"2024-09-14T11:51:18.339362+0000","last_peered":"2024-09-14T11:51:18.339362+0000","last_clean":"2024-09-14T11:51:18.339362+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:51:18.339362+0000","last_undegraded":"2024-09-14T11:51:18.339362+0000","last_fullsized":"2024-09-14T11:51:18.339362+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:17.074637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19961458,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":448,"num_read_kb":32213,"num_write":864,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033264+0000","last_change":"2024-09-14T11:11:08.657835+0000","last_active":"2024-09-14T11:50:14.033264+0000","last_peered":"2024-09-14T11:50:14.033264+0000","last_clean":"2024-09-14T11:50:14.033264+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:50:14.033264+0000","last_undegraded":"2024-09-14T11:50:14.033264+0000","last_fullsized":"2024-09-14T11:50:14.033264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:05.975239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'182","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.513319+0000","last_change":"2024-09-14T11:11:10.668579+0000","last_active":"2024-09-14T11:52:37.513319+0000","last_peered":"2024-09-14T11:52:37.513319+0000","last_clean":"2024-09-14T11:52:37.513319+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:52:37.513319+0000","last_undegraded":"2024-09-14T11:52:37.513319+0000","last_fullsized":"2024-09-14T11:52:37.513319+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:33.675356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":255,"num_read_kb":342,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033234+0000","last_change":"2024-09-14T11:11:12.682825+0000","last_active":"2024-09-14T11:50:14.033234+0000","last_peered":"2024-09-14T11:50:14.033234+0000","last_clean":"2024-09-14T11:50:14.033234+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:50:14.033234+0000","last_undegraded":"2024-09-14T11:50:14.033234+0000","last_fullsized":"2024-09-14T11:50:14.033234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.085965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'136","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.046297+0000","last_change":"2024-09-14T11:11:14.694759+0000","last_active":"2024-09-14T11:51:20.046297+0000","last_peered":"2024-09-14T11:51:20.046297+0000","last_clean":"2024-09-14T11:51:20.046297+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:51:20.046297+0000","last_undegraded":"2024-09-14T11:51:20.046297+0000","last_fullsized":"2024-09-14T11:51:20.046297+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:34.568185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'810","reported_seq":2363,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892524+0000","last_change":"2024-09-14T11:11:06.652129+0000","last_active":"2024-09-14T11:51:03.892524+0000","last_peered":"2024-09-14T11:51:03.892524+0000","last_clean":"2024-09-14T11:51:03.892524+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:51:03.892524+0000","last_undegraded":"2024-09-14T11:51:03.892524+0000","last_fullsized":"2024-09-14T11:51:03.892524+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.890024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'183","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.874736+0000","last_change":"2024-09-14T11:11:37.865182+0000","last_active":"2024-09-14T11:50:56.874736+0000","last_peered":"2024-09-14T11:50:56.874736+0000","last_clean":"2024-09-14T11:50:56.874736+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:50:56.874736+0000","last_undegraded":"2024-09-14T11:50:56.874736+0000","last_fullsized":"2024-09-14T11:50:56.874736+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:29.726878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13623312,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":54806,"num_write":888,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027253+0000","last_change":"2024-09-14T11:11:08.653918+0000","last_active":"2024-09-14T11:49:24.027253+0000","last_peered":"2024-09-14T11:49:24.027253+0000","last_clean":"2024-09-14T11:49:24.027253+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:49:24.027253+0000","last_undegraded":"2024-09-14T11:49:24.027253+0000","last_fullsized":"2024-09-14T11:49:24.027253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:12.531488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'134","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:43.939981+0000","last_change":"2024-09-14T11:11:10.665945+0000","last_active":"2024-09-14T11:51:43.939981+0000","last_peered":"2024-09-14T11:51:43.939981+0000","last_clean":"2024-09-14T11:51:43.939981+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:51:43.939981+0000","last_undegraded":"2024-09-14T11:51:43.939981+0000","last_fullsized":"2024-09-14T11:51:43.939981+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8529,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":213,"num_write":158,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.924548+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:49:38.924548+0000","last_peered":"2024-09-14T11:49:38.924548+0000","last_clean":"2024-09-14T11:49:38.924548+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:49:38.924548+0000","last_undegraded":"2024-09-14T11:49:38.924548+0000","last_fullsized":"2024-09-14T11:49:38.924548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:21.465336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938149+0000","last_change":"2024-09-14T11:11:14.690952+0000","last_active":"2024-09-14T11:51:23.938149+0000","last_peered":"2024-09-14T11:51:23.938149+0000","last_clean":"2024-09-14T11:51:23.938149+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:51:23.938149+0000","last_undegraded":"2024-09-14T11:51:23.938149+0000","last_fullsized":"2024-09-14T11:51:23.938149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:31.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'616","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444129+0000","last_change":"2024-09-14T11:11:06.651982+0000","last_active":"2024-09-14T11:52:36.444129+0000","last_peered":"2024-09-14T11:52:36.444129+0000","last_clean":"2024-09-14T11:52:36.444129+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:36.444129+0000","last_undegraded":"2024-09-14T11:52:36.444129+0000","last_fullsized":"2024-09-14T11:52:36.444129+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:10.685569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'216","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.024934+0000","last_change":"2024-09-14T11:11:37.866224+0000","last_active":"2024-09-14T11:50:17.024934+0000","last_peered":"2024-09-14T11:50:17.024934+0000","last_clean":"2024-09-14T11:50:17.024934+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:50:17.024934+0000","last_undegraded":"2024-09-14T11:50:17.024934+0000","last_fullsized":"2024-09-14T11:50:17.024934+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:52.787000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1102567,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1165,"num_read_kb":81327,"num_write":1107,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922198+0000","last_change":"2024-09-14T11:11:08.657858+0000","last_active":"2024-09-14T11:49:23.922198+0000","last_peered":"2024-09-14T11:49:23.922198+0000","last_clean":"2024-09-14T11:49:23.922198+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:49:23.922198+0000","last_undegraded":"2024-09-14T11:49:23.922198+0000","last_fullsized":"2024-09-14T11:49:23.922198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:46.337725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'185","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:49.045239+0000","last_change":"2024-09-14T11:11:10.669699+0000","last_active":"2024-09-14T11:51:49.045239+0000","last_peered":"2024-09-14T11:51:49.045239+0000","last_clean":"2024-09-14T11:51:49.045239+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:51:49.045239+0000","last_undegraded":"2024-09-14T11:51:49.045239+0000","last_fullsized":"2024-09-14T11:51:49.045239+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:05.013360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10070,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":209,"num_read_kb":240,"num_write":126,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'747","reported_seq":2406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.560250+0000","last_change":"2024-09-14T11:11:12.680262+0000","last_active":"2024-09-14T11:52:37.560250+0000","last_peered":"2024-09-14T11:52:37.560250+0000","last_clean":"2024-09-14T11:52:37.560250+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:52:37.560250+0000","last_undegraded":"2024-09-14T11:52:37.560250+0000","last_fullsized":"2024-09-14T11:52:37.560250+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:15.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'112","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.672032+0000","last_change":"2024-09-14T11:11:14.694188+0000","last_active":"2024-09-14T11:51:21.672032+0000","last_peered":"2024-09-14T11:51:21.672032+0000","last_clean":"2024-09-14T11:51:21.672032+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:51:21.672032+0000","last_undegraded":"2024-09-14T11:51:21.672032+0000","last_fullsized":"2024-09-14T11:51:21.672032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:45.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438948+0000","last_change":"2024-09-14T11:11:06.655465+0000","last_active":"2024-09-14T11:52:36.438948+0000","last_peered":"2024-09-14T11:52:36.438948+0000","last_clean":"2024-09-14T11:52:36.438948+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:52:36.438948+0000","last_undegraded":"2024-09-14T11:52:36.438948+0000","last_fullsized":"2024-09-14T11:52:36.438948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:40.046089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'211","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.828145+0000","last_change":"2024-09-14T11:11:04.650554+0000","last_active":"2024-09-14T11:51:03.828145+0000","last_peered":"2024-09-14T11:51:03.828145+0000","last_clean":"2024-09-14T11:51:03.828145+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:51:03.828145+0000","last_undegraded":"2024-09-14T11:51:03.828145+0000","last_fullsized":"2024-09-14T11:51:03.828145+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:21.487349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159355,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":779,"num_read_kb":15229,"num_write":1051,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.278236+0000","last_change":"2024-09-14T11:11:08.657746+0000","last_active":"2024-09-14T11:52:37.278236+0000","last_peered":"2024-09-14T11:52:37.278236+0000","last_clean":"2024-09-14T11:52:37.278236+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:52:37.278236+0000","last_undegraded":"2024-09-14T11:52:37.278236+0000","last_fullsized":"2024-09-14T11:52:37.278236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:46.646901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":950,"num_read_kb":950,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'65","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.268760+0000","last_change":"2024-09-14T11:11:10.883189+0000","last_active":"2024-09-14T11:51:19.268760+0000","last_peered":"2024-09-14T11:51:19.268760+0000","last_clean":"2024-09-14T11:51:19.268760+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:51:19.268760+0000","last_undegraded":"2024-09-14T11:51:19.268760+0000","last_fullsized":"2024-09-14T11:51:19.268760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:23.532287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'765","reported_seq":2415,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.561158+0000","last_change":"2024-09-14T11:11:12.682993+0000","last_active":"2024-09-14T11:52:37.561158+0000","last_peered":"2024-09-14T11:52:37.561158+0000","last_clean":"2024-09-14T11:52:37.561158+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:52:37.561158+0000","last_undegraded":"2024-09-14T11:52:37.561158+0000","last_fullsized":"2024-09-14T11:52:37.561158+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:56.550659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.800307+0000","last_change":"2024-09-14T11:11:14.697448+0000","last_active":"2024-09-14T11:50:57.800307+0000","last_peered":"2024-09-14T11:50:57.800307+0000","last_clean":"2024-09-14T11:50:57.800307+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:50:57.800307+0000","last_undegraded":"2024-09-14T11:50:57.800307+0000","last_fullsized":"2024-09-14T11:50:57.800307+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220492+0000","last_change":"2024-09-14T11:11:06.661084+0000","last_active":"2024-09-14T11:51:19.220492+0000","last_peered":"2024-09-14T11:51:19.220492+0000","last_clean":"2024-09-14T11:51:19.220492+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:51:19.220492+0000","last_undegraded":"2024-09-14T11:51:19.220492+0000","last_fullsized":"2024-09-14T11:51:19.220492+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:51.729421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'196","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.343430+0000","last_change":"2024-09-14T11:11:04.652428+0000","last_active":"2024-09-14T11:51:18.343430+0000","last_peered":"2024-09-14T11:51:18.343430+0000","last_clean":"2024-09-14T11:51:18.343430+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:51:18.343430+0000","last_undegraded":"2024-09-14T11:51:18.343430+0000","last_fullsized":"2024-09-14T11:51:18.343430+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:16.387464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13627420,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":562,"num_read_kb":47606,"num_write":834,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920747+0000","last_change":"2024-09-14T11:11:08.651170+0000","last_active":"2024-09-14T11:49:23.920747+0000","last_peered":"2024-09-14T11:49:23.920747+0000","last_clean":"2024-09-14T11:49:23.920747+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:49:23.920747+0000","last_undegraded":"2024-09-14T11:49:23.920747+0000","last_fullsized":"2024-09-14T11:49:23.920747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'219","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:47.928636+0000","last_change":"2024-09-14T11:11:10.671679+0000","last_active":"2024-09-14T11:51:47.928636+0000","last_peered":"2024-09-14T11:51:47.928636+0000","last_clean":"2024-09-14T11:51:47.928636+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:51:47.928636+0000","last_undegraded":"2024-09-14T11:51:47.928636+0000","last_fullsized":"2024-09-14T11:51:47.928636+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":905,"num_read_kb":1011,"num_write":1432,"num_write_kb":1317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.915519+0000","last_change":"2024-09-14T11:11:12.685335+0000","last_active":"2024-09-14T11:49:28.915519+0000","last_peered":"2024-09-14T11:49:28.915519+0000","last_clean":"2024-09-14T11:49:28.915519+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:49:28.915519+0000","last_undegraded":"2024-09-14T11:49:28.915519+0000","last_fullsized":"2024-09-14T11:49:28.915519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:34.384085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'111","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.714149+0000","last_change":"2024-09-14T11:11:14.691254+0000","last_active":"2024-09-14T11:50:29.714149+0000","last_peered":"2024-09-14T11:50:29.714149+0000","last_clean":"2024-09-14T11:50:29.714149+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:50:29.714149+0000","last_undegraded":"2024-09-14T11:50:29.714149+0000","last_fullsized":"2024-09-14T11:50:29.714149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:56.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.216524+0000","last_change":"2024-09-14T11:11:06.652040+0000","last_active":"2024-09-14T11:51:02.216524+0000","last_peered":"2024-09-14T11:51:02.216524+0000","last_clean":"2024-09-14T11:51:02.216524+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:51:02.216524+0000","last_undegraded":"2024-09-14T11:51:02.216524+0000","last_fullsized":"2024-09-14T11:51:02.216524+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:46.498291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:54.037135+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:48:54.037135+0000","last_peered":"2024-09-14T11:48:54.037135+0000","last_clean":"2024-09-14T11:48:54.037135+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:48:54.037135+0000","last_undegraded":"2024-09-14T11:48:54.037135+0000","last_fullsized":"2024-09-14T11:48:54.037135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929313+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:50:28.929313+0000","last_peered":"2024-09-14T11:50:28.929313+0000","last_clean":"2024-09-14T11:50:28.929313+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:50:28.929313+0000","last_undegraded":"2024-09-14T11:50:28.929313+0000","last_fullsized":"2024-09-14T11:50:28.929313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'313","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:59.842569+0000","last_change":"2024-09-14T11:11:04.653542+0000","last_active":"2024-09-14T11:50:59.842569+0000","last_peered":"2024-09-14T11:50:59.842569+0000","last_clean":"2024-09-14T11:50:59.842569+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:50:59.842569+0000","last_undegraded":"2024-09-14T11:50:59.842569+0000","last_fullsized":"2024-09-14T11:50:59.842569+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.899497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5294246,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1040,"num_read_kb":764,"num_write":1135,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034878+0000","last_change":"2024-09-14T11:11:08.651808+0000","last_active":"2024-09-14T11:48:39.034878+0000","last_peered":"2024-09-14T11:48:39.034878+0000","last_clean":"2024-09-14T11:48:39.034878+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:48:39.034878+0000","last_undegraded":"2024-09-14T11:48:39.034878+0000","last_fullsized":"2024-09-14T11:48:39.034878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:02.176317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'312","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.531968+0000","last_change":"2024-09-14T11:11:10.671108+0000","last_active":"2024-09-14T11:52:37.531968+0000","last_peered":"2024-09-14T11:52:37.531968+0000","last_clean":"2024-09-14T11:52:37.531968+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:52:37.531968+0000","last_undegraded":"2024-09-14T11:52:37.531968+0000","last_fullsized":"2024-09-14T11:52:37.531968+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:12.563174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138600,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":1025,"num_write":532,"num_write_kb":489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929432+0000","last_change":"2024-09-14T11:11:12.679614+0000","last_active":"2024-09-14T11:50:13.929432+0000","last_peered":"2024-09-14T11:50:13.929432+0000","last_clean":"2024-09-14T11:50:13.929432+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:50:13.929432+0000","last_undegraded":"2024-09-14T11:50:13.929432+0000","last_fullsized":"2024-09-14T11:50:13.929432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:26.539650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'194","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.853045+0000","last_change":"2024-09-14T11:11:14.691705+0000","last_active":"2024-09-14T11:51:21.853045+0000","last_peered":"2024-09-14T11:51:21.853045+0000","last_clean":"2024-09-14T11:51:21.853045+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:51:21.853045+0000","last_undegraded":"2024-09-14T11:51:21.853045+0000","last_fullsized":"2024-09-14T11:51:21.853045+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:32.101457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'446","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316797+0000","last_change":"2024-09-14T11:11:06.653878+0000","last_active":"2024-09-14T11:51:21.316797+0000","last_peered":"2024-09-14T11:51:21.316797+0000","last_clean":"2024-09-14T11:51:21.316797+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:51:21.316797+0000","last_undegraded":"2024-09-14T11:51:21.316797+0000","last_fullsized":"2024-09-14T11:51:21.316797+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:53.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037939+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:48:59.037939+0000","last_peered":"2024-09-14T11:48:59.037939+0000","last_clean":"2024-09-14T11:48:59.037939+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:48:59.037939+0000","last_undegraded":"2024-09-14T11:48:59.037939+0000","last_fullsized":"2024-09-14T11:48:59.037939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'225","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:31.663831+0000","last_change":"2024-09-14T11:11:04.647226+0000","last_active":"2024-09-14T11:52:31.663831+0000","last_peered":"2024-09-14T11:52:31.663831+0000","last_clean":"2024-09-14T11:52:31.663831+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:31.663831+0000","last_undegraded":"2024-09-14T11:52:31.663831+0000","last_fullsized":"2024-09-14T11:52:31.663831+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:42.012243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437198,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":605,"num_read_kb":5636,"num_write":1045,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.926741+0000","last_change":"2024-09-14T11:11:08.653354+0000","last_active":"2024-09-14T11:50:08.926741+0000","last_peered":"2024-09-14T11:50:08.926741+0000","last_clean":"2024-09-14T11:50:08.926741+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:50:08.926741+0000","last_undegraded":"2024-09-14T11:50:08.926741+0000","last_fullsized":"2024-09-14T11:50:08.926741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:02.387161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'846","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.556076+0000","last_change":"2024-09-14T11:11:10.668218+0000","last_active":"2024-09-14T11:52:37.556076+0000","last_peered":"2024-09-14T11:52:37.556076+0000","last_clean":"2024-09-14T11:52:37.556076+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:52:37.556076+0000","last_undegraded":"2024-09-14T11:52:37.556076+0000","last_fullsized":"2024-09-14T11:52:37.556076+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:48.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34713,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1137,"num_read_kb":1303,"num_write":260,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:49.036418+0000","last_change":"2024-09-14T11:11:12.677600+0000","last_active":"2024-09-14T11:48:49.036418+0000","last_peered":"2024-09-14T11:48:49.036418+0000","last_clean":"2024-09-14T11:48:49.036418+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:48:49.036418+0000","last_undegraded":"2024-09-14T11:48:49.036418+0000","last_fullsized":"2024-09-14T11:48:49.036418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.483584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'130","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.325684+0000","last_change":"2024-09-14T11:11:14.883766+0000","last_active":"2024-09-14T11:51:21.325684+0000","last_peered":"2024-09-14T11:51:21.325684+0000","last_clean":"2024-09-14T11:51:21.325684+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:51:21.325684+0000","last_undegraded":"2024-09-14T11:51:21.325684+0000","last_fullsized":"2024-09-14T11:51:21.325684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:47.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'426","reported_seq":1905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179728+0000","last_change":"2024-09-14T11:11:06.661418+0000","last_active":"2024-09-14T11:51:05.179728+0000","last_peered":"2024-09-14T11:51:05.179728+0000","last_clean":"2024-09-14T11:51:05.179728+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:51:05.179728+0000","last_undegraded":"2024-09-14T11:51:05.179728+0000","last_fullsized":"2024-09-14T11:51:05.179728+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.916202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.035176+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:50:29.035176+0000","last_peered":"2024-09-14T11:50:29.035176+0000","last_clean":"2024-09-14T11:50:29.035176+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:50:29.035176+0000","last_undegraded":"2024-09-14T11:50:29.035176+0000","last_fullsized":"2024-09-14T11:50:29.035176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'202","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:45.647851+0000","last_change":"2024-09-14T11:11:04.650254+0000","last_active":"2024-09-14T11:50:45.647851+0000","last_peered":"2024-09-14T11:50:45.647851+0000","last_clean":"2024-09-14T11:50:45.647851+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:50:45.647851+0000","last_undegraded":"2024-09-14T11:50:45.647851+0000","last_fullsized":"2024-09-14T11:50:45.647851+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:24.467276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9763340,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":697,"num_read_kb":52749,"num_write":987,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032552+0000","last_change":"2024-09-14T11:11:08.653735+0000","last_active":"2024-09-14T11:50:09.032552+0000","last_peered":"2024-09-14T11:50:09.032552+0000","last_clean":"2024-09-14T11:50:09.032552+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:50:09.032552+0000","last_undegraded":"2024-09-14T11:50:09.032552+0000","last_fullsized":"2024-09-14T11:50:09.032552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:27.550107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'219","reported_seq":1256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.446104+0000","last_change":"2024-09-14T11:11:10.885665+0000","last_active":"2024-09-14T11:52:36.446104+0000","last_peered":"2024-09-14T11:52:36.446104+0000","last_clean":"2024-09-14T11:52:36.446104+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:52:36.446104+0000","last_undegraded":"2024-09-14T11:52:36.446104+0000","last_fullsized":"2024-09-14T11:52:36.446104+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:53.645745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915668+0000","last_change":"2024-09-14T11:11:12.679585+0000","last_active":"2024-09-14T11:48:43.915668+0000","last_peered":"2024-09-14T11:48:43.915668+0000","last_clean":"2024-09-14T11:48:43.915668+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:48:43.915668+0000","last_undegraded":"2024-09-14T11:48:43.915668+0000","last_fullsized":"2024-09-14T11:48:43.915668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:37.689890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'250","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.995575+0000","last_change":"2024-09-14T11:11:14.691912+0000","last_active":"2024-09-14T11:51:21.995575+0000","last_peered":"2024-09-14T11:51:21.995575+0000","last_clean":"2024-09-14T11:51:21.995575+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:51:21.995575+0000","last_undegraded":"2024-09-14T11:51:21.995575+0000","last_fullsized":"2024-09-14T11:51:21.995575+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:38.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'458","reported_seq":2042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.436141+0000","last_change":"2024-09-14T11:11:06.652932+0000","last_active":"2024-09-14T11:51:01.436141+0000","last_peered":"2024-09-14T11:51:01.436141+0000","last_clean":"2024-09-14T11:51:01.436141+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:51:01.436141+0000","last_undegraded":"2024-09-14T11:51:01.436141+0000","last_fullsized":"2024-09-14T11:51:01.436141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:11.789080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929286+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:50:28.929286+0000","last_peered":"2024-09-14T11:50:28.929286+0000","last_clean":"2024-09-14T11:50:28.929286+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:50:28.929286+0000","last_undegraded":"2024-09-14T11:50:28.929286+0000","last_fullsized":"2024-09-14T11:50:28.929286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'182","reported_seq":784,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.682880+0000","last_change":"2024-09-14T11:11:04.652412+0000","last_active":"2024-09-14T11:51:08.682880+0000","last_peered":"2024-09-14T11:51:08.682880+0000","last_clean":"2024-09-14T11:51:08.682880+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:51:08.682880+0000","last_undegraded":"2024-09-14T11:51:08.682880+0000","last_fullsized":"2024-09-14T11:51:08.682880+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:20.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190250,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":11748,"num_write":872,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916639+0000","last_change":"2024-09-14T11:11:08.656266+0000","last_active":"2024-09-14T11:48:48.916639+0000","last_peered":"2024-09-14T11:48:48.916639+0000","last_clean":"2024-09-14T11:48:48.916639+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:48:48.916639+0000","last_undegraded":"2024-09-14T11:48:48.916639+0000","last_fullsized":"2024-09-14T11:48:48.916639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.330377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'126","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.946961+0000","last_change":"2024-09-14T11:11:10.668058+0000","last_active":"2024-09-14T11:52:23.946961+0000","last_peered":"2024-09-14T11:52:23.946961+0000","last_clean":"2024-09-14T11:52:23.946961+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:52:23.946961+0000","last_undegraded":"2024-09-14T11:52:23.946961+0000","last_fullsized":"2024-09-14T11:52:23.946961+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:05.286724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.921295+0000","last_change":"2024-09-14T11:11:12.681877+0000","last_active":"2024-09-14T11:50:13.921295+0000","last_peered":"2024-09-14T11:50:13.921295+0000","last_clean":"2024-09-14T11:50:13.921295+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:50:13.921295+0000","last_undegraded":"2024-09-14T11:50:13.921295+0000","last_fullsized":"2024-09-14T11:50:13.921295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.120129+0000","last_change":"2024-09-14T11:11:14.692245+0000","last_active":"2024-09-14T11:51:03.120129+0000","last_peered":"2024-09-14T11:51:03.120129+0000","last_clean":"2024-09-14T11:51:03.120129+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:51:03.120129+0000","last_undegraded":"2024-09-14T11:51:03.120129+0000","last_fullsized":"2024-09-14T11:51:03.120129+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:24.950841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.122816+0000","last_change":"2024-09-14T11:11:06.661346+0000","last_active":"2024-09-14T11:51:03.122816+0000","last_peered":"2024-09-14T11:51:03.122816+0000","last_clean":"2024-09-14T11:51:03.122816+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:51:03.122816+0000","last_undegraded":"2024-09-14T11:51:03.122816+0000","last_fullsized":"2024-09-14T11:51:03.122816+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:19.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'222","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.159868+0000","last_change":"2024-09-14T11:11:04.657514+0000","last_active":"2024-09-14T11:51:02.159868+0000","last_peered":"2024-09-14T11:51:02.159868+0000","last_clean":"2024-09-14T11:51:02.159868+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:51:02.159868+0000","last_undegraded":"2024-09-14T11:51:02.159868+0000","last_fullsized":"2024-09-14T11:51:02.159868+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:47.332379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8451677,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":613,"num_read_kb":15435,"num_write":879,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.931026+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:50:28.931026+0000","last_peered":"2024-09-14T11:50:28.931026+0000","last_clean":"2024-09-14T11:50:28.931026+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:50:28.931026+0000","last_undegraded":"2024-09-14T11:50:28.931026+0000","last_fullsized":"2024-09-14T11:50:28.931026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914647+0000","last_change":"2024-09-14T11:11:08.653119+0000","last_active":"2024-09-14T11:48:38.914647+0000","last_peered":"2024-09-14T11:48:38.914647+0000","last_clean":"2024-09-14T11:48:38.914647+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:48:38.914647+0000","last_undegraded":"2024-09-14T11:48:38.914647+0000","last_fullsized":"2024-09-14T11:48:38.914647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:46.444354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'286","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.522282+0000","last_change":"2024-09-14T11:11:10.670087+0000","last_active":"2024-09-14T11:52:37.522282+0000","last_peered":"2024-09-14T11:52:37.522282+0000","last_clean":"2024-09-14T11:52:37.522282+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:52:37.522282+0000","last_undegraded":"2024-09-14T11:52:37.522282+0000","last_fullsized":"2024-09-14T11:52:37.522282+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:50.318692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36366,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":405,"num_read_kb":567,"num_write":274,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914988+0000","last_change":"2024-09-14T11:11:12.679038+0000","last_active":"2024-09-14T11:48:43.914988+0000","last_peered":"2024-09-14T11:48:43.914988+0000","last_clean":"2024-09-14T11:48:43.914988+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:48:43.914988+0000","last_undegraded":"2024-09-14T11:48:43.914988+0000","last_fullsized":"2024-09-14T11:48:43.914988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:12.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'209","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.215679+0000","last_change":"2024-09-14T11:11:14.886549+0000","last_active":"2024-09-14T11:51:19.215679+0000","last_peered":"2024-09-14T11:51:19.215679+0000","last_clean":"2024-09-14T11:51:19.215679+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:51:19.215679+0000","last_undegraded":"2024-09-14T11:51:19.215679+0000","last_fullsized":"2024-09-14T11:51:19.215679+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:17.379453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'431","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434777+0000","last_change":"2024-09-14T11:11:06.654715+0000","last_active":"2024-09-14T11:52:36.434777+0000","last_peered":"2024-09-14T11:52:36.434777+0000","last_clean":"2024-09-14T11:52:36.434777+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:36.434777+0000","last_undegraded":"2024-09-14T11:52:36.434777+0000","last_fullsized":"2024-09-14T11:52:36.434777+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.183803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'213","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932340+0000","last_change":"2024-09-14T11:11:04.642737+0000","last_active":"2024-09-14T11:50:38.932340+0000","last_peered":"2024-09-14T11:50:38.932340+0000","last_clean":"2024-09-14T11:50:38.932340+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:50:38.932340+0000","last_undegraded":"2024-09-14T11:50:38.932340+0000","last_fullsized":"2024-09-14T11:50:38.932340+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.508714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8481812,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":599,"num_read_kb":78521,"num_write":1028,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.051572+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:50:34.051572+0000","last_peered":"2024-09-14T11:50:34.051572+0000","last_clean":"2024-09-14T11:50:34.051572+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:50:34.051572+0000","last_undegraded":"2024-09-14T11:50:34.051572+0000","last_fullsized":"2024-09-14T11:50:34.051572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.908212+0000","last_change":"2024-09-14T11:11:08.650994+0000","last_active":"2024-09-14T11:48:38.908212+0000","last_peered":"2024-09-14T11:48:38.908212+0000","last_clean":"2024-09-14T11:48:38.908212+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:48:38.908212+0000","last_undegraded":"2024-09-14T11:48:38.908212+0000","last_fullsized":"2024-09-14T11:48:38.908212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.962646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'156","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.318854+0000","last_change":"2024-09-14T11:11:10.883309+0000","last_active":"2024-09-14T11:51:19.318854+0000","last_peered":"2024-09-14T11:51:19.318854+0000","last_clean":"2024-09-14T11:51:19.318854+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:51:19.318854+0000","last_undegraded":"2024-09-14T11:51:19.318854+0000","last_fullsized":"2024-09-14T11:51:19.318854+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:14.780666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'799","reported_seq":4884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.558169+0000","last_change":"2024-09-14T11:11:12.682874+0000","last_active":"2024-09-14T11:52:37.558169+0000","last_peered":"2024-09-14T11:52:37.558169+0000","last_clean":"2024-09-14T11:52:37.558169+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:52:37.558169+0000","last_undegraded":"2024-09-14T11:52:37.558169+0000","last_fullsized":"2024-09-14T11:52:37.558169+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.028768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'341","reported_seq":1706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179290+0000","last_change":"2024-09-14T11:11:37.864782+0000","last_active":"2024-09-14T11:51:05.179290+0000","last_peered":"2024-09-14T11:51:05.179290+0000","last_clean":"2024-09-14T11:51:05.179290+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:51:05.179290+0000","last_undegraded":"2024-09-14T11:51:05.179290+0000","last_fullsized":"2024-09-14T11:51:05.179290+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.779073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'290","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.641781+0000","last_change":"2024-09-14T11:11:04.646682+0000","last_active":"2024-09-14T11:50:29.641781+0000","last_peered":"2024-09-14T11:50:29.641781+0000","last_clean":"2024-09-14T11:50:29.641781+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:50:29.641781+0000","last_undegraded":"2024-09-14T11:50:29.641781+0000","last_fullsized":"2024-09-14T11:50:29.641781+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:31.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18192632,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1178,"num_read_kb":53005,"num_write":1232,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926354+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:49:53.926354+0000","last_peered":"2024-09-14T11:49:53.926354+0000","last_clean":"2024-09-14T11:49:53.926354+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:49:53.926354+0000","last_undegraded":"2024-09-14T11:49:53.926354+0000","last_fullsized":"2024-09-14T11:49:53.926354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.913999+0000","last_change":"2024-09-14T11:11:08.649058+0000","last_active":"2024-09-14T11:48:38.913999+0000","last_peered":"2024-09-14T11:48:38.913999+0000","last_clean":"2024-09-14T11:48:38.913999+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:48:38.913999+0000","last_undegraded":"2024-09-14T11:48:38.913999+0000","last_fullsized":"2024-09-14T11:48:38.913999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:32.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.304291+0000","last_change":"2024-09-14T11:11:10.671331+0000","last_active":"2024-09-14T11:51:19.304291+0000","last_peered":"2024-09-14T11:51:19.304291+0000","last_clean":"2024-09-14T11:51:19.304291+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:51:19.304291+0000","last_undegraded":"2024-09-14T11:51:19.304291+0000","last_fullsized":"2024-09-14T11:51:19.304291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:52.798905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'817","reported_seq":4183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.562184+0000","last_change":"2024-09-14T11:11:12.678672+0000","last_active":"2024-09-14T11:52:37.562184+0000","last_peered":"2024-09-14T11:52:37.562184+0000","last_clean":"2024-09-14T11:52:37.562184+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:52:37.562184+0000","last_undegraded":"2024-09-14T11:52:37.562184+0000","last_fullsized":"2024-09-14T11:52:37.562184+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:12.941981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'298","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.901850+0000","last_change":"2024-09-14T11:11:14.686960+0000","last_active":"2024-09-14T11:51:21.901850+0000","last_peered":"2024-09-14T11:51:21.901850+0000","last_clean":"2024-09-14T11:51:21.901850+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:51:21.901850+0000","last_undegraded":"2024-09-14T11:51:21.901850+0000","last_fullsized":"2024-09-14T11:51:21.901850+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'544","reported_seq":2460,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.929778+0000","last_change":"2024-09-14T11:11:06.655767+0000","last_active":"2024-09-14T11:50:56.929778+0000","last_peered":"2024-09-14T11:50:56.929778+0000","last_clean":"2024-09-14T11:50:56.929778+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:50:56.929778+0000","last_undegraded":"2024-09-14T11:50:56.929778+0000","last_fullsized":"2024-09-14T11:50:56.929778+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:44.124270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'200","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.107941+0000","last_change":"2024-09-14T11:11:04.656471+0000","last_active":"2024-09-14T11:51:07.107941+0000","last_peered":"2024-09-14T11:51:07.107941+0000","last_clean":"2024-09-14T11:51:07.107941+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:51:07.107941+0000","last_undegraded":"2024-09-14T11:51:07.107941+0000","last_fullsized":"2024-09-14T11:51:07.107941+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:48.156669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14274652,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":59716,"num_write":947,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918354+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:49:53.918354+0000","last_peered":"2024-09-14T11:49:53.918354+0000","last_clean":"2024-09-14T11:49:53.918354+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:49:53.918354+0000","last_undegraded":"2024-09-14T11:49:53.918354+0000","last_fullsized":"2024-09-14T11:49:53.918354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921314+0000","last_change":"2024-09-14T11:11:08.656366+0000","last_active":"2024-09-14T11:49:18.921314+0000","last_peered":"2024-09-14T11:49:18.921314+0000","last_clean":"2024-09-14T11:49:18.921314+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:49:18.921314+0000","last_undegraded":"2024-09-14T11:49:18.921314+0000","last_fullsized":"2024-09-14T11:49:18.921314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:14.566083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'308","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.518869+0000","last_change":"2024-09-14T11:11:10.883247+0000","last_active":"2024-09-14T11:52:37.518869+0000","last_peered":"2024-09-14T11:52:37.518869+0000","last_clean":"2024-09-14T11:52:37.518869+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:52:37.518869+0000","last_undegraded":"2024-09-14T11:52:37.518869+0000","last_fullsized":"2024-09-14T11:52:37.518869+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:02.820687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38872,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":633,"num_write":226,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916205+0000","last_change":"2024-09-14T11:11:12.682882+0000","last_active":"2024-09-14T11:48:43.916205+0000","last_peered":"2024-09-14T11:48:43.916205+0000","last_clean":"2024-09-14T11:48:43.916205+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:48:43.916205+0000","last_undegraded":"2024-09-14T11:48:43.916205+0000","last_fullsized":"2024-09-14T11:48:43.916205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:35.551263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'120","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.820332+0000","last_change":"2024-09-14T11:11:14.692652+0000","last_active":"2024-09-14T11:51:20.820332+0000","last_peered":"2024-09-14T11:51:20.820332+0000","last_clean":"2024-09-14T11:51:20.820332+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:51:20.820332+0000","last_undegraded":"2024-09-14T11:51:20.820332+0000","last_fullsized":"2024-09-14T11:51:20.820332+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:49.033241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.375702+0000","last_change":"2024-09-14T11:11:14.691282+0000","last_active":"2024-09-14T11:51:21.375702+0000","last_peered":"2024-09-14T11:51:21.375702+0000","last_clean":"2024-09-14T11:51:21.375702+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:51:21.375702+0000","last_undegraded":"2024-09-14T11:51:21.375702+0000","last_fullsized":"2024-09-14T11:51:21.375702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.621120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'729","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.436271+0000","last_change":"2024-09-14T11:11:06.653550+0000","last_active":"2024-09-14T11:52:36.436271+0000","last_peered":"2024-09-14T11:52:36.436271+0000","last_clean":"2024-09-14T11:52:36.436271+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:36.436271+0000","last_undegraded":"2024-09-14T11:52:36.436271+0000","last_fullsized":"2024-09-14T11:52:36.436271+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:16.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'229","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:50.685402+0000","last_change":"2024-09-14T11:11:38.680906+0000","last_active":"2024-09-14T11:49:50.685402+0000","last_peered":"2024-09-14T11:49:50.685402+0000","last_clean":"2024-09-14T11:49:50.685402+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:49:50.685402+0000","last_undegraded":"2024-09-14T11:49:50.685402+0000","last_fullsized":"2024-09-14T11:49:50.685402+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:40.878361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11588317,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":661,"num_read_kb":19030,"num_write":1053,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.912602+0000","last_change":"2024-09-14T11:11:08.653208+0000","last_active":"2024-09-14T11:48:28.912602+0000","last_peered":"2024-09-14T11:48:28.912602+0000","last_clean":"2024-09-14T11:48:28.912602+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:48:28.912602+0000","last_undegraded":"2024-09-14T11:48:28.912602+0000","last_fullsized":"2024-09-14T11:48:28.912602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.990347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'136","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.322211+0000","last_change":"2024-09-14T11:11:10.670870+0000","last_active":"2024-09-14T11:51:19.322211+0000","last_peered":"2024-09-14T11:51:19.322211+0000","last_clean":"2024-09-14T11:51:19.322211+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:51:19.322211+0000","last_undegraded":"2024-09-14T11:51:19.322211+0000","last_fullsized":"2024-09-14T11:51:19.322211+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:25.995412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":230,"num_write":94,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914699+0000","last_change":"2024-09-14T11:11:12.679809+0000","last_active":"2024-09-14T11:48:33.914699+0000","last_peered":"2024-09-14T11:48:33.914699+0000","last_clean":"2024-09-14T11:48:33.914699+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:48:33.914699+0000","last_undegraded":"2024-09-14T11:48:33.914699+0000","last_fullsized":"2024-09-14T11:48:33.914699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:59.317292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.176366+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:05.176366+0000","last_peered":"2024-09-14T11:51:05.176366+0000","last_clean":"2024-09-14T11:51:05.176366+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:05.176366+0000","last_undegraded":"2024-09-14T11:51:05.176366+0000","last_fullsized":"2024-09-14T11:51:05.176366+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:48.809610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'712","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308610+0000","last_change":"2024-09-14T11:11:06.656572+0000","last_active":"2024-09-14T11:51:21.308610+0000","last_peered":"2024-09-14T11:51:21.308610+0000","last_clean":"2024-09-14T11:51:21.308610+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:51:21.308610+0000","last_undegraded":"2024-09-14T11:51:21.308610+0000","last_fullsized":"2024-09-14T11:51:21.308610+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:32.091729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'184","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.047526+0000","last_change":"2024-09-14T11:11:04.662627+0000","last_active":"2024-09-14T11:50:18.047526+0000","last_peered":"2024-09-14T11:50:18.047526+0000","last_clean":"2024-09-14T11:50:18.047526+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:50:18.047526+0000","last_undegraded":"2024-09-14T11:50:18.047526+0000","last_fullsized":"2024-09-14T11:50:18.047526+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:25.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8407655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":26239,"num_write":891,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.914104+0000","last_change":"2024-09-14T11:11:08.649769+0000","last_active":"2024-09-14T11:48:28.914104+0000","last_peered":"2024-09-14T11:48:28.914104+0000","last_clean":"2024-09-14T11:48:28.914104+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:48:28.914104+0000","last_undegraded":"2024-09-14T11:48:28.914104+0000","last_fullsized":"2024-09-14T11:48:28.914104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.869183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'53","reported_seq":548,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.138152+0000","last_change":"2024-09-14T11:11:10.669313+0000","last_active":"2024-09-14T11:51:19.138152+0000","last_peered":"2024-09-14T11:51:19.138152+0000","last_clean":"2024-09-14T11:51:19.138152+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:51:19.138152+0000","last_undegraded":"2024-09-14T11:51:19.138152+0000","last_fullsized":"2024-09-14T11:51:19.138152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:59.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034011+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:48:34.034011+0000","last_peered":"2024-09-14T11:48:34.034011+0000","last_clean":"2024-09-14T11:48:34.034011+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:48:34.034011+0000","last_undegraded":"2024-09-14T11:48:34.034011+0000","last_fullsized":"2024-09-14T11:48:34.034011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:34.408102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'195","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.441751+0000","last_change":"2024-09-14T11:11:14.692367+0000","last_active":"2024-09-14T11:52:36.441751+0000","last_peered":"2024-09-14T11:52:36.441751+0000","last_clean":"2024-09-14T11:52:36.441751+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:52:36.441751+0000","last_undegraded":"2024-09-14T11:52:36.441751+0000","last_fullsized":"2024-09-14T11:52:36.441751+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.861427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'486","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310927+0000","last_change":"2024-09-14T11:11:06.656240+0000","last_active":"2024-09-14T11:51:21.310927+0000","last_peered":"2024-09-14T11:51:21.310927+0000","last_clean":"2024-09-14T11:51:21.310927+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:51:21.310927+0000","last_undegraded":"2024-09-14T11:51:21.310927+0000","last_fullsized":"2024-09-14T11:51:21.310927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.647919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'201","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:43.923286+0000","last_change":"2024-09-14T11:11:04.661433+0000","last_active":"2024-09-14T11:49:43.923286+0000","last_peered":"2024-09-14T11:49:43.923286+0000","last_clean":"2024-09-14T11:49:43.923286+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:49:43.923286+0000","last_undegraded":"2024-09-14T11:49:43.923286+0000","last_fullsized":"2024-09-14T11:49:43.923286+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.817478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5319969,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":470,"num_read_kb":67081,"num_write":923,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:29.033082+0000","last_change":"2024-09-14T11:11:08.654324+0000","last_active":"2024-09-14T11:48:29.033082+0000","last_peered":"2024-09-14T11:48:29.033082+0000","last_clean":"2024-09-14T11:48:29.033082+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:48:29.033082+0000","last_undegraded":"2024-09-14T11:48:29.033082+0000","last_fullsized":"2024-09-14T11:48:29.033082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:57.708332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'158","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.318332+0000","last_change":"2024-09-14T11:11:10.672080+0000","last_active":"2024-09-14T11:51:21.318332+0000","last_peered":"2024-09-14T11:51:21.318332+0000","last_clean":"2024-09-14T11:51:21.318332+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:51:21.318332+0000","last_undegraded":"2024-09-14T11:51:21.318332+0000","last_fullsized":"2024-09-14T11:51:21.318332+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:19.936617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":255,"num_write":112,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907458+0000","last_change":"2024-09-14T11:11:12.680936+0000","last_active":"2024-09-14T11:48:33.907458+0000","last_peered":"2024-09-14T11:48:33.907458+0000","last_clean":"2024-09-14T11:48:33.907458+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:48:33.907458+0000","last_undegraded":"2024-09-14T11:48:33.907458+0000","last_fullsized":"2024-09-14T11:48:33.907458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:51.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'159","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.741928+0000","last_change":"2024-09-14T11:11:14.690690+0000","last_active":"2024-09-14T11:51:08.741928+0000","last_peered":"2024-09-14T11:51:08.741928+0000","last_clean":"2024-09-14T11:51:08.741928+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:51:08.741928+0000","last_undegraded":"2024-09-14T11:51:08.741928+0000","last_fullsized":"2024-09-14T11:51:08.741928+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:02.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1177","reported_seq":2918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310166+0000","last_change":"2024-09-14T11:11:06.652306+0000","last_active":"2024-09-14T11:51:21.310166+0000","last_peered":"2024-09-14T11:51:21.310166+0000","last_clean":"2024-09-14T11:51:21.310166+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:51:21.310166+0000","last_undegraded":"2024-09-14T11:51:21.310166+0000","last_fullsized":"2024-09-14T11:51:21.310166+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:10.911326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'181","reported_seq":780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.880317+0000","last_change":"2024-09-14T11:11:04.663210+0000","last_active":"2024-09-14T11:50:47.880317+0000","last_peered":"2024-09-14T11:50:47.880317+0000","last_clean":"2024-09-14T11:50:47.880317+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:50:47.880317+0000","last_undegraded":"2024-09-14T11:50:47.880317+0000","last_fullsized":"2024-09-14T11:50:47.880317+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:37.285836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594761,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":478,"num_read_kb":13203,"num_write":821,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.906630+0000","last_change":"2024-09-14T11:11:08.653546+0000","last_active":"2024-09-14T11:48:28.906630+0000","last_peered":"2024-09-14T11:48:28.906630+0000","last_clean":"2024-09-14T11:48:28.906630+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:48:28.906630+0000","last_undegraded":"2024-09-14T11:48:28.906630+0000","last_fullsized":"2024-09-14T11:48:28.906630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.193897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'120","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217492+0000","last_change":"2024-09-14T11:11:10.670918+0000","last_active":"2024-09-14T11:51:19.217492+0000","last_peered":"2024-09-14T11:51:19.217492+0000","last_clean":"2024-09-14T11:51:19.217492+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:51:19.217492+0000","last_undegraded":"2024-09-14T11:51:19.217492+0000","last_fullsized":"2024-09-14T11:51:19.217492+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:05.847749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9545,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":189,"num_write":76,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913655+0000","last_change":"2024-09-14T11:11:12.682390+0000","last_active":"2024-09-14T11:48:33.913655+0000","last_peered":"2024-09-14T11:48:33.913655+0000","last_clean":"2024-09-14T11:48:33.913655+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:48:33.913655+0000","last_undegraded":"2024-09-14T11:48:33.913655+0000","last_fullsized":"2024-09-14T11:48:33.913655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:05.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1627","reported_seq":3326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.112689+0000","last_change":"2024-09-14T11:11:06.654317+0000","last_active":"2024-09-14T11:51:03.112689+0000","last_peered":"2024-09-14T11:51:03.112689+0000","last_clean":"2024-09-14T11:51:03.112689+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:51:03.112689+0000","last_undegraded":"2024-09-14T11:51:03.112689+0000","last_fullsized":"2024-09-14T11:51:03.112689+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.474698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'226","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.242660+0000","last_change":"2024-09-14T11:11:04.645419+0000","last_active":"2024-09-14T11:52:29.242660+0000","last_peered":"2024-09-14T11:52:29.242660+0000","last_clean":"2024-09-14T11:52:29.242660+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:29.242660+0000","last_undegraded":"2024-09-14T11:52:29.242660+0000","last_fullsized":"2024-09-14T11:52:29.242660+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:57.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13625374,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":571,"num_read_kb":62996,"num_write":1110,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921634+0000","last_change":"2024-09-14T11:11:08.650958+0000","last_active":"2024-09-14T11:49:18.921634+0000","last_peered":"2024-09-14T11:49:18.921634+0000","last_clean":"2024-09-14T11:49:18.921634+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:49:18.921634+0000","last_undegraded":"2024-09-14T11:49:18.921634+0000","last_fullsized":"2024-09-14T11:49:18.921634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:09.330791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'199","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.515439+0000","last_change":"2024-09-14T11:11:10.670001+0000","last_active":"2024-09-14T11:52:37.515439+0000","last_peered":"2024-09-14T11:52:37.515439+0000","last_clean":"2024-09-14T11:52:37.515439+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:52:37.515439+0000","last_undegraded":"2024-09-14T11:52:37.515439+0000","last_fullsized":"2024-09-14T11:52:37.515439+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:12.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":299,"num_read_kb":444,"num_write":196,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040316+0000","last_change":"2024-09-14T11:11:12.683170+0000","last_active":"2024-09-14T11:48:44.040316+0000","last_peered":"2024-09-14T11:48:44.040316+0000","last_clean":"2024-09-14T11:48:44.040316+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:48:44.040316+0000","last_undegraded":"2024-09-14T11:48:44.040316+0000","last_fullsized":"2024-09-14T11:48:44.040316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.360262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.306430+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.306430+0000","last_peered":"2024-09-14T11:51:21.306430+0000","last_clean":"2024-09-14T11:51:21.306430+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.306430+0000","last_undegraded":"2024-09-14T11:51:21.306430+0000","last_fullsized":"2024-09-14T11:51:21.306430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'422","reported_seq":2027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172836+0000","last_change":"2024-09-14T11:11:06.650905+0000","last_active":"2024-09-14T11:51:07.172836+0000","last_peered":"2024-09-14T11:51:07.172836+0000","last_clean":"2024-09-14T11:51:07.172836+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:51:07.172836+0000","last_undegraded":"2024-09-14T11:51:07.172836+0000","last_fullsized":"2024-09-14T11:51:07.172836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:45.627603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'177","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.318053+0000","last_change":"2024-09-14T11:11:04.650203+0000","last_active":"2024-09-14T11:51:18.318053+0000","last_peered":"2024-09-14T11:51:18.318053+0000","last_clean":"2024-09-14T11:51:18.318053+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:51:18.318053+0000","last_undegraded":"2024-09-14T11:51:18.318053+0000","last_fullsized":"2024-09-14T11:51:18.318053+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8743742,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":12441,"num_write":902,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.265290+0000","last_change":"2024-09-14T11:11:08.653366+0000","last_active":"2024-09-14T11:52:37.265290+0000","last_peered":"2024-09-14T11:52:37.265290+0000","last_clean":"2024-09-14T11:52:37.265290+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:52:37.265290+0000","last_undegraded":"2024-09-14T11:52:37.265290+0000","last_fullsized":"2024-09-14T11:52:37.265290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:44.850713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":1189,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'159","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.259129+0000","last_change":"2024-09-14T11:11:10.668831+0000","last_active":"2024-09-14T11:51:19.259129+0000","last_peered":"2024-09-14T11:51:19.259129+0000","last_clean":"2024-09-14T11:51:19.259129+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:51:19.259129+0000","last_undegraded":"2024-09-14T11:51:19.259129+0000","last_fullsized":"2024-09-14T11:51:19.259129+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:09.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13353,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":282,"num_write":144,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915697+0000","last_change":"2024-09-14T11:11:12.681008+0000","last_active":"2024-09-14T11:48:43.915697+0000","last_peered":"2024-09-14T11:48:43.915697+0000","last_clean":"2024-09-14T11:48:43.915697+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:48:43.915697+0000","last_undegraded":"2024-09-14T11:48:43.915697+0000","last_fullsized":"2024-09-14T11:48:43.915697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:58.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'173","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:07.089853+0000","last_change":"2024-09-14T11:11:14.690312+0000","last_active":"2024-09-14T11:50:07.089853+0000","last_peered":"2024-09-14T11:50:07.089853+0000","last_clean":"2024-09-14T11:50:07.089853+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:50:07.089853+0000","last_undegraded":"2024-09-14T11:50:07.089853+0000","last_fullsized":"2024-09-14T11:50:07.089853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.026241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'376","reported_seq":1780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.226513+0000","last_change":"2024-09-14T11:11:06.651125+0000","last_active":"2024-09-14T11:51:02.226513+0000","last_peered":"2024-09-14T11:51:02.226513+0000","last_clean":"2024-09-14T11:51:02.226513+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:51:02.226513+0000","last_undegraded":"2024-09-14T11:51:02.226513+0000","last_fullsized":"2024-09-14T11:51:02.226513+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:57.162983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'238","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:42.471759+0000","last_change":"2024-09-14T11:11:04.647959+0000","last_active":"2024-09-14T11:50:42.471759+0000","last_peered":"2024-09-14T11:50:42.471759+0000","last_clean":"2024-09-14T11:50:42.471759+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:50:42.471759+0000","last_undegraded":"2024-09-14T11:50:42.471759+0000","last_fullsized":"2024-09-14T11:50:42.471759+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:50.954784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206736,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":545,"num_read_kb":23729,"num_write":1064,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914129+0000","last_change":"2024-09-14T11:11:08.651803+0000","last_active":"2024-09-14T11:48:38.914129+0000","last_peered":"2024-09-14T11:48:38.914129+0000","last_clean":"2024-09-14T11:48:38.914129+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:48:38.914129+0000","last_undegraded":"2024-09-14T11:48:38.914129+0000","last_fullsized":"2024-09-14T11:48:38.914129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:43.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'142","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.324251+0000","last_change":"2024-09-14T11:11:10.883223+0000","last_active":"2024-09-14T11:51:19.324251+0000","last_peered":"2024-09-14T11:51:19.324251+0000","last_clean":"2024-09-14T11:51:19.324251+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:51:19.324251+0000","last_undegraded":"2024-09-14T11:51:19.324251+0000","last_fullsized":"2024-09-14T11:51:19.324251+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:29.696874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39965,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":175,"num_read_kb":290,"num_write":96,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921566+0000","last_change":"2024-09-14T11:11:12.681509+0000","last_active":"2024-09-14T11:49:18.921566+0000","last_peered":"2024-09-14T11:49:18.921566+0000","last_clean":"2024-09-14T11:49:18.921566+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:49:18.921566+0000","last_undegraded":"2024-09-14T11:49:18.921566+0000","last_fullsized":"2024-09-14T11:49:18.921566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:59.776741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'122","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546132+0000","last_change":"2024-09-14T11:11:14.691723+0000","last_active":"2024-09-14T11:52:37.546132+0000","last_peered":"2024-09-14T11:52:37.546132+0000","last_clean":"2024-09-14T11:52:37.546132+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:52:37.546132+0000","last_undegraded":"2024-09-14T11:52:37.546132+0000","last_fullsized":"2024-09-14T11:52:37.546132+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:16.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'480","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219612+0000","last_change":"2024-09-14T11:11:37.748529+0000","last_active":"2024-09-14T11:51:19.219612+0000","last_peered":"2024-09-14T11:51:19.219612+0000","last_clean":"2024-09-14T11:51:19.219612+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:51:19.219612+0000","last_undegraded":"2024-09-14T11:51:19.219612+0000","last_fullsized":"2024-09-14T11:51:19.219612+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:31.281473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'290","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:50.085422+0000","last_change":"2024-09-14T11:11:04.649863+0000","last_active":"2024-09-14T11:50:50.085422+0000","last_peered":"2024-09-14T11:50:50.085422+0000","last_clean":"2024-09-14T11:50:50.085422+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:50:50.085422+0000","last_undegraded":"2024-09-14T11:50:50.085422+0000","last_fullsized":"2024-09-14T11:50:50.085422+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.369405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9472693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":817,"num_read_kb":27321,"num_write":1070,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914708+0000","last_change":"2024-09-14T11:11:08.657837+0000","last_active":"2024-09-14T11:48:38.914708+0000","last_peered":"2024-09-14T11:48:38.914708+0000","last_clean":"2024-09-14T11:48:38.914708+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:48:38.914708+0000","last_undegraded":"2024-09-14T11:48:38.914708+0000","last_fullsized":"2024-09-14T11:48:38.914708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'70","reported_seq":582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.316786+0000","last_change":"2024-09-14T11:11:10.883222+0000","last_active":"2024-09-14T11:51:19.316786+0000","last_peered":"2024-09-14T11:51:19.316786+0000","last_clean":"2024-09-14T11:51:19.316786+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:51:19.316786+0000","last_undegraded":"2024-09-14T11:51:19.316786+0000","last_fullsized":"2024-09-14T11:51:19.316786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:29.226087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'764","reported_seq":2321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.557166+0000","last_change":"2024-09-14T11:11:12.679582+0000","last_active":"2024-09-14T11:52:37.557166+0000","last_peered":"2024-09-14T11:52:37.557166+0000","last_clean":"2024-09-14T11:52:37.557166+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:52:37.557166+0000","last_undegraded":"2024-09-14T11:52:37.557166+0000","last_fullsized":"2024-09-14T11:52:37.557166+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:59.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.781791+0000","last_change":"2024-09-14T11:11:14.693282+0000","last_active":"2024-09-14T11:50:48.781791+0000","last_peered":"2024-09-14T11:50:48.781791+0000","last_clean":"2024-09-14T11:50:48.781791+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:50:48.781791+0000","last_undegraded":"2024-09-14T11:50:48.781791+0000","last_fullsized":"2024-09-14T11:50:48.781791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:09.483259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.836272+0000","last_change":"2024-09-14T11:11:06.652140+0000","last_active":"2024-09-14T11:51:21.836272+0000","last_peered":"2024-09-14T11:51:21.836272+0000","last_clean":"2024-09-14T11:51:21.836272+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:51:21.836272+0000","last_undegraded":"2024-09-14T11:51:21.836272+0000","last_fullsized":"2024-09-14T11:51:21.836272+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'210","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.172703+0000","last_change":"2024-09-14T11:11:04.661487+0000","last_active":"2024-09-14T11:51:18.172703+0000","last_peered":"2024-09-14T11:51:18.172703+0000","last_clean":"2024-09-14T11:51:18.172703+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:51:18.172703+0000","last_undegraded":"2024-09-14T11:51:18.172703+0000","last_fullsized":"2024-09-14T11:51:18.172703+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:20.676205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10545915,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":12794,"num_write":1045,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034846+0000","last_change":"2024-09-14T11:11:08.653717+0000","last_active":"2024-09-14T11:48:39.034846+0000","last_peered":"2024-09-14T11:48:39.034846+0000","last_clean":"2024-09-14T11:48:39.034846+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:48:39.034846+0000","last_undegraded":"2024-09-14T11:48:39.034846+0000","last_fullsized":"2024-09-14T11:48:39.034846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:32.879931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'165","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.946447+0000","last_change":"2024-09-14T11:11:10.669599+0000","last_active":"2024-09-14T11:52:28.946447+0000","last_peered":"2024-09-14T11:52:28.946447+0000","last_clean":"2024-09-14T11:52:28.946447+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:52:28.946447+0000","last_undegraded":"2024-09-14T11:52:28.946447+0000","last_fullsized":"2024-09-14T11:52:28.946447+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:43.348380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":204,"num_read_kb":273,"num_write":118,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926374+0000","last_change":"2024-09-14T11:11:12.681246+0000","last_active":"2024-09-14T11:49:53.926374+0000","last_peered":"2024-09-14T11:49:53.926374+0000","last_clean":"2024-09-14T11:49:53.926374+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:49:53.926374+0000","last_undegraded":"2024-09-14T11:49:53.926374+0000","last_fullsized":"2024-09-14T11:49:53.926374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:07.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'115","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.880410+0000","last_change":"2024-09-14T11:11:14.697190+0000","last_active":"2024-09-14T11:51:07.880410+0000","last_peered":"2024-09-14T11:51:07.880410+0000","last_clean":"2024-09-14T11:51:07.880410+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:51:07.880410+0000","last_undegraded":"2024-09-14T11:51:07.880410+0000","last_fullsized":"2024-09-14T11:51:07.880410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:51.323211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1156","reported_seq":2809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.337919+0000","last_change":"2024-09-14T11:11:06.642481+0000","last_active":"2024-09-14T11:50:58.337919+0000","last_peered":"2024-09-14T11:50:58.337919+0000","last_clean":"2024-09-14T11:50:58.337919+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:50:58.337919+0000","last_undegraded":"2024-09-14T11:50:58.337919+0000","last_fullsized":"2024-09-14T11:50:58.337919+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.677463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'189","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:51.208702+0000","last_change":"2024-09-14T11:11:04.662351+0000","last_active":"2024-09-14T11:50:51.208702+0000","last_peered":"2024-09-14T11:50:51.208702+0000","last_clean":"2024-09-14T11:50:51.208702+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:50:51.208702+0000","last_undegraded":"2024-09-14T11:50:51.208702+0000","last_fullsized":"2024-09-14T11:50:51.208702+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:07.797389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5955950,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":655,"num_read_kb":26583,"num_write":933,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039639+0000","last_change":"2024-09-14T11:11:08.655874+0000","last_active":"2024-09-14T11:48:39.039639+0000","last_peered":"2024-09-14T11:48:39.039639+0000","last_clean":"2024-09-14T11:48:39.039639+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:48:39.039639+0000","last_undegraded":"2024-09-14T11:48:39.039639+0000","last_fullsized":"2024-09-14T11:48:39.039639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:09.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'127","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:18.945761+0000","last_change":"2024-09-14T11:11:10.673119+0000","last_active":"2024-09-14T11:52:18.945761+0000","last_peered":"2024-09-14T11:52:18.945761+0000","last_clean":"2024-09-14T11:52:18.945761+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:52:18.945761+0000","last_undegraded":"2024-09-14T11:52:18.945761+0000","last_fullsized":"2024-09-14T11:52:18.945761+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.182477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":156,"num_read_kb":215,"num_write":86,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:03.919674+0000","last_change":"2024-09-14T11:11:12.680784+0000","last_active":"2024-09-14T11:50:03.919674+0000","last_peered":"2024-09-14T11:50:03.919674+0000","last_clean":"2024-09-14T11:50:03.919674+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:50:03.919674+0000","last_undegraded":"2024-09-14T11:50:03.919674+0000","last_fullsized":"2024-09-14T11:50:03.919674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:59.544800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'508","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.436715+0000","last_change":"2024-09-14T11:11:06.653662+0000","last_active":"2024-09-14T11:51:06.436715+0000","last_peered":"2024-09-14T11:51:06.436715+0000","last_clean":"2024-09-14T11:51:06.436715+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:51:06.436715+0000","last_undegraded":"2024-09-14T11:51:06.436715+0000","last_fullsized":"2024-09-14T11:51:06.436715+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:06.494569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'216","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.094191+0000","last_change":"2024-09-14T11:11:04.650685+0000","last_active":"2024-09-14T11:49:48.094191+0000","last_peered":"2024-09-14T11:49:48.094191+0000","last_clean":"2024-09-14T11:49:48.094191+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:49:48.094191+0000","last_undegraded":"2024-09-14T11:49:48.094191+0000","last_fullsized":"2024-09-14T11:49:48.094191+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.078217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404555,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":512,"num_read_kb":7926,"num_write":970,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.923902+0000","last_change":"2024-09-14T11:11:08.654095+0000","last_active":"2024-09-14T11:49:48.923902+0000","last_peered":"2024-09-14T11:49:48.923902+0000","last_clean":"2024-09-14T11:49:48.923902+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:49:48.923902+0000","last_undegraded":"2024-09-14T11:49:48.923902+0000","last_fullsized":"2024-09-14T11:49:48.923902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:24.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'103","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.201792+0000","last_change":"2024-09-14T11:11:10.669556+0000","last_active":"2024-09-14T11:51:19.201792+0000","last_peered":"2024-09-14T11:51:19.201792+0000","last_clean":"2024-09-14T11:51:19.201792+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:51:19.201792+0000","last_undegraded":"2024-09-14T11:51:19.201792+0000","last_fullsized":"2024-09-14T11:51:19.201792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:15.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":185,"num_write":62,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915062+0000","last_change":"2024-09-14T11:11:12.682253+0000","last_active":"2024-09-14T11:48:43.915062+0000","last_peered":"2024-09-14T11:48:43.915062+0000","last_clean":"2024-09-14T11:48:43.915062+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:48:43.915062+0000","last_undegraded":"2024-09-14T11:48:43.915062+0000","last_fullsized":"2024-09-14T11:48:43.915062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:58.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'186","reported_seq":1636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.774324+0000","last_change":"2024-09-14T11:11:14.690239+0000","last_active":"2024-09-14T11:51:19.774324+0000","last_peered":"2024-09-14T11:51:19.774324+0000","last_clean":"2024-09-14T11:51:19.774324+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:51:19.774324+0000","last_undegraded":"2024-09-14T11:51:19.774324+0000","last_fullsized":"2024-09-14T11:51:19.774324+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:45.377535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219526+0000","last_change":"2024-09-14T11:11:06.656585+0000","last_active":"2024-09-14T11:51:19.219526+0000","last_peered":"2024-09-14T11:51:19.219526+0000","last_clean":"2024-09-14T11:51:19.219526+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:51:19.219526+0000","last_undegraded":"2024-09-14T11:51:19.219526+0000","last_fullsized":"2024-09-14T11:51:19.219526+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:33.246710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'223","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.276658+0000","last_change":"2024-09-14T11:11:04.658553+0000","last_active":"2024-09-14T11:50:55.276658+0000","last_peered":"2024-09-14T11:50:55.276658+0000","last_clean":"2024-09-14T11:50:55.276658+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:50:55.276658+0000","last_undegraded":"2024-09-14T11:50:55.276658+0000","last_fullsized":"2024-09-14T11:50:55.276658+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:55.574919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489935,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1050,"num_read_kb":144594,"num_write":1038,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926285+0000","last_change":"2024-09-14T11:11:08.653002+0000","last_active":"2024-09-14T11:49:53.926285+0000","last_peered":"2024-09-14T11:49:53.926285+0000","last_clean":"2024-09-14T11:49:53.926285+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:49:53.926285+0000","last_undegraded":"2024-09-14T11:49:53.926285+0000","last_fullsized":"2024-09-14T11:49:53.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:11.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'152","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.225139+0000","last_change":"2024-09-14T11:11:10.668336+0000","last_active":"2024-09-14T11:51:19.225139+0000","last_peered":"2024-09-14T11:51:19.225139+0000","last_clean":"2024-09-14T11:51:19.225139+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:51:19.225139+0000","last_undegraded":"2024-09-14T11:51:19.225139+0000","last_fullsized":"2024-09-14T11:51:19.225139+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:48.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6768,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":187,"num_read_kb":189,"num_write":102,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915597+0000","last_change":"2024-09-14T11:11:12.681192+0000","last_active":"2024-09-14T11:48:43.915597+0000","last_peered":"2024-09-14T11:48:43.915597+0000","last_clean":"2024-09-14T11:48:43.915597+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:48:43.915597+0000","last_undegraded":"2024-09-14T11:48:43.915597+0000","last_fullsized":"2024-09-14T11:48:43.915597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'131","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434001+0000","last_change":"2024-09-14T11:11:14.697156+0000","last_active":"2024-09-14T11:52:36.434001+0000","last_peered":"2024-09-14T11:52:36.434001+0000","last_clean":"2024-09-14T11:52:36.434001+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:52:36.434001+0000","last_undegraded":"2024-09-14T11:52:36.434001+0000","last_fullsized":"2024-09-14T11:52:36.434001+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.319859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'851","reported_seq":2569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179734+0000","last_change":"2024-09-14T11:11:06.655238+0000","last_active":"2024-09-14T11:51:05.179734+0000","last_peered":"2024-09-14T11:51:05.179734+0000","last_clean":"2024-09-14T11:51:05.179734+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:51:05.179734+0000","last_undegraded":"2024-09-14T11:51:05.179734+0000","last_fullsized":"2024-09-14T11:51:05.179734+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:38.378965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'242","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.431900+0000","last_change":"2024-09-14T11:11:04.666811+0000","last_active":"2024-09-14T11:50:44.431900+0000","last_peered":"2024-09-14T11:50:44.431900+0000","last_clean":"2024-09-14T11:50:44.431900+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:50:44.431900+0000","last_undegraded":"2024-09-14T11:50:44.431900+0000","last_fullsized":"2024-09-14T11:50:44.431900+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5492619,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":731,"num_read_kb":42950,"num_write":1086,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'565","reported_seq":2225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844932+0000","last_change":"2024-09-14T11:11:06.651614+0000","last_active":"2024-09-14T11:51:21.844932+0000","last_peered":"2024-09-14T11:51:21.844932+0000","last_clean":"2024-09-14T11:51:21.844932+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:51:21.844932+0000","last_undegraded":"2024-09-14T11:51:21.844932+0000","last_fullsized":"2024-09-14T11:51:21.844932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:03.537283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'177","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:39.036406+0000","last_change":"2024-09-14T11:11:38.680106+0000","last_active":"2024-09-14T11:50:39.036406+0000","last_peered":"2024-09-14T11:50:39.036406+0000","last_clean":"2024-09-14T11:50:39.036406+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:50:39.036406+0000","last_undegraded":"2024-09-14T11:50:39.036406+0000","last_fullsized":"2024-09-14T11:50:39.036406+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:36.864373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399983,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":43631,"num_write":869,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'524","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845111+0000","last_change":"2024-09-14T11:11:06.653770+0000","last_active":"2024-09-14T11:51:21.845111+0000","last_peered":"2024-09-14T11:51:21.845111+0000","last_clean":"2024-09-14T11:51:21.845111+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:51:21.845111+0000","last_undegraded":"2024-09-14T11:51:21.845111+0000","last_fullsized":"2024-09-14T11:51:21.845111+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'211","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.930676+0000","last_change":"2024-09-14T11:11:04.659611+0000","last_active":"2024-09-14T11:50:38.930676+0000","last_peered":"2024-09-14T11:50:38.930676+0000","last_clean":"2024-09-14T11:50:38.930676+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:50:38.930676+0000","last_undegraded":"2024-09-14T11:50:38.930676+0000","last_fullsized":"2024-09-14T11:50:38.930676+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.810419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8880526,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":490,"num_read_kb":22878,"num_write":1004,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'803","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435453+0000","last_change":"2024-09-14T11:11:06.651188+0000","last_active":"2024-09-14T11:52:36.435453+0000","last_peered":"2024-09-14T11:52:36.435453+0000","last_clean":"2024-09-14T11:52:36.435453+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:52:36.435453+0000","last_undegraded":"2024-09-14T11:52:36.435453+0000","last_fullsized":"2024-09-14T11:52:36.435453+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:08.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'189","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.242403+0000","last_change":"2024-09-14T11:11:04.650789+0000","last_active":"2024-09-14T11:51:18.242403+0000","last_peered":"2024-09-14T11:51:18.242403+0000","last_clean":"2024-09-14T11:51:18.242403+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:51:18.242403+0000","last_undegraded":"2024-09-14T11:51:18.242403+0000","last_fullsized":"2024-09-14T11:51:18.242403+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.442954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15769276,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":455,"num_read_kb":47732,"num_write":870,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1006","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.837526+0000","last_change":"2024-09-14T11:11:06.654587+0000","last_active":"2024-09-14T11:51:21.837526+0000","last_peered":"2024-09-14T11:51:21.837526+0000","last_clean":"2024-09-14T11:51:21.837526+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:51:21.837526+0000","last_undegraded":"2024-09-14T11:51:21.837526+0000","last_fullsized":"2024-09-14T11:51:21.837526+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:08.260560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'274","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.432091+0000","last_change":"2024-09-14T11:11:38.149249+0000","last_active":"2024-09-14T11:52:27.432091+0000","last_peered":"2024-09-14T11:52:27.432091+0000","last_clean":"2024-09-14T11:52:27.432091+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:27.432091+0000","last_undegraded":"2024-09-14T11:52:27.432091+0000","last_fullsized":"2024-09-14T11:52:27.432091+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:11.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8423062,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":714,"num_read_kb":31338,"num_write":1100,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'442","reported_seq":1980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.878230+0000","last_change":"2024-09-14T11:11:06.653604+0000","last_active":"2024-09-14T11:51:07.878230+0000","last_peered":"2024-09-14T11:51:07.878230+0000","last_clean":"2024-09-14T11:51:07.878230+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:51:07.878230+0000","last_undegraded":"2024-09-14T11:51:07.878230+0000","last_fullsized":"2024-09-14T11:51:07.878230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:35.321390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'248","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:17.028817+0000","last_change":"2024-09-14T11:11:04.642725+0000","last_active":"2024-09-14T11:50:17.028817+0000","last_peered":"2024-09-14T11:50:17.028817+0000","last_clean":"2024-09-14T11:50:17.028817+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:50:17.028817+0000","last_undegraded":"2024-09-14T11:50:17.028817+0000","last_fullsized":"2024-09-14T11:50:17.028817+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:47.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12670221,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1014,"num_read_kb":155037,"num_write":1111,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1175","reported_seq":2833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438627+0000","last_change":"2024-09-14T11:11:06.651627+0000","last_active":"2024-09-14T11:52:36.438627+0000","last_peered":"2024-09-14T11:52:36.438627+0000","last_clean":"2024-09-14T11:52:36.438627+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:52:36.438627+0000","last_undegraded":"2024-09-14T11:52:36.438627+0000","last_fullsized":"2024-09-14T11:52:36.438627+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:01.008892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'237","reported_seq":861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.325344+0000","last_change":"2024-09-14T11:11:04.657109+0000","last_active":"2024-09-14T11:51:18.325344+0000","last_peered":"2024-09-14T11:51:18.325344+0000","last_clean":"2024-09-14T11:51:18.325344+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:51:18.325344+0000","last_undegraded":"2024-09-14T11:51:18.325344+0000","last_fullsized":"2024-09-14T11:51:18.325344+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.402916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10919282,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":17781,"num_write":1111,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'425","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.875685+0000","last_change":"2024-09-14T11:11:06.654109+0000","last_active":"2024-09-14T11:51:07.875685+0000","last_peered":"2024-09-14T11:51:07.875685+0000","last_clean":"2024-09-14T11:51:07.875685+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:51:07.875685+0000","last_undegraded":"2024-09-14T11:51:07.875685+0000","last_fullsized":"2024-09-14T11:51:07.875685+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:48.495731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'181","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.472986+0000","last_change":"2024-09-14T11:11:04.654477+0000","last_active":"2024-09-14T11:50:57.472986+0000","last_peered":"2024-09-14T11:50:57.472986+0000","last_clean":"2024-09-14T11:50:57.472986+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:50:57.472986+0000","last_undegraded":"2024-09-14T11:50:57.472986+0000","last_fullsized":"2024-09-14T11:50:57.472986+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:01.338332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404304,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":12452,"num_write":856,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1179","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308328+0000","last_change":"2024-09-14T11:11:06.652958+0000","last_active":"2024-09-14T11:51:21.308328+0000","last_peered":"2024-09-14T11:51:21.308328+0000","last_clean":"2024-09-14T11:51:21.308328+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:51:21.308328+0000","last_undegraded":"2024-09-14T11:51:21.308328+0000","last_fullsized":"2024-09-14T11:51:21.308328+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:24.552197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'243","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:35.680131+0000","last_change":"2024-09-14T11:11:04.657280+0000","last_active":"2024-09-14T11:52:35.680131+0000","last_peered":"2024-09-14T11:52:35.680131+0000","last_clean":"2024-09-14T11:52:35.680131+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:52:35.680131+0000","last_undegraded":"2024-09-14T11:52:35.680131+0000","last_fullsized":"2024-09-14T11:52:35.680131+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:41.400680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4514884,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":3825,"num_write":1014,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'758","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435815+0000","last_change":"2024-09-14T11:11:06.651996+0000","last_active":"2024-09-14T11:52:36.435815+0000","last_peered":"2024-09-14T11:52:36.435815+0000","last_clean":"2024-09-14T11:52:36.435815+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:52:36.435815+0000","last_undegraded":"2024-09-14T11:52:36.435815+0000","last_fullsized":"2024-09-14T11:52:36.435815+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:06.359659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'239","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:18.342127+0000","last_change":"2024-09-14T11:11:04.651232+0000","last_active":"2024-09-14T11:51:18.342127+0000","last_peered":"2024-09-14T11:51:18.342127+0000","last_clean":"2024-09-14T11:51:18.342127+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:51:18.342127+0000","last_undegraded":"2024-09-14T11:51:18.342127+0000","last_fullsized":"2024-09-14T11:51:18.342127+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:16.752449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3283448,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":596,"num_read_kb":9466,"num_write":1102,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.437393+0000","last_change":"2024-09-14T11:11:06.656624+0000","last_active":"2024-09-14T11:51:06.437393+0000","last_peered":"2024-09-14T11:51:06.437393+0000","last_clean":"2024-09-14T11:51:06.437393+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:51:06.437393+0000","last_undegraded":"2024-09-14T11:51:06.437393+0000","last_fullsized":"2024-09-14T11:51:06.437393+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'225","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.819833+0000","last_change":"2024-09-14T11:11:38.680828+0000","last_active":"2024-09-14T11:51:07.819833+0000","last_peered":"2024-09-14T11:51:07.819833+0000","last_clean":"2024-09-14T11:51:07.819833+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:51:07.819833+0000","last_undegraded":"2024-09-14T11:51:07.819833+0000","last_fullsized":"2024-09-14T11:51:07.819833+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:19.072768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439893,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":20654,"num_write":1081,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'570","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.123272+0000","last_change":"2024-09-14T11:11:06.655967+0000","last_active":"2024-09-14T11:51:03.123272+0000","last_peered":"2024-09-14T11:51:03.123272+0000","last_clean":"2024-09-14T11:51:03.123272+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:51:03.123272+0000","last_undegraded":"2024-09-14T11:51:03.123272+0000","last_fullsized":"2024-09-14T11:51:03.123272+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:20.387986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'175","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.177437+0000","last_change":"2024-09-14T11:11:04.663147+0000","last_active":"2024-09-14T11:50:44.177437+0000","last_peered":"2024-09-14T11:50:44.177437+0000","last_clean":"2024-09-14T11:50:44.177437+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:50:44.177437+0000","last_undegraded":"2024-09-14T11:50:44.177437+0000","last_fullsized":"2024-09-14T11:50:44.177437+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:33.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9689661,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":19362,"num_write":815,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'501","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746597+0000","last_change":"2024-09-14T11:11:06.659368+0000","last_active":"2024-09-14T11:51:08.746597+0000","last_peered":"2024-09-14T11:51:08.746597+0000","last_clean":"2024-09-14T11:51:08.746597+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:51:08.746597+0000","last_undegraded":"2024-09-14T11:51:08.746597+0000","last_fullsized":"2024-09-14T11:51:08.746597+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:58.840799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'214","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:56.211247+0000","last_change":"2024-09-14T11:11:04.663046+0000","last_active":"2024-09-14T11:49:56.211247+0000","last_peered":"2024-09-14T11:49:56.211247+0000","last_clean":"2024-09-14T11:49:56.211247+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:49:56.211247+0000","last_undegraded":"2024-09-14T11:49:56.211247+0000","last_fullsized":"2024-09-14T11:49:56.211247+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:13.422693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11883891,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":490,"num_read_kb":22963,"num_write":990,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1725","reported_seq":3529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220305+0000","last_change":"2024-09-14T11:11:06.649254+0000","last_active":"2024-09-14T11:51:19.220305+0000","last_peered":"2024-09-14T11:51:19.220305+0000","last_clean":"2024-09-14T11:51:19.220305+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:51:19.220305+0000","last_undegraded":"2024-09-14T11:51:19.220305+0000","last_fullsized":"2024-09-14T11:51:19.220305+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:09.019220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'218","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:47.550503+0000","last_change":"2024-09-14T11:11:04.667994+0000","last_active":"2024-09-14T11:49:47.550503+0000","last_peered":"2024-09-14T11:49:47.550503+0000","last_clean":"2024-09-14T11:49:47.550503+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:49:47.550503+0000","last_undegraded":"2024-09-14T11:49:47.550503+0000","last_fullsized":"2024-09-14T11:49:47.550503+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:02.592974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4193762,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":501,"num_read_kb":9299,"num_write":1024,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'390","reported_seq":1862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316772+0000","last_change":"2024-09-14T11:11:06.646168+0000","last_active":"2024-09-14T11:51:21.316772+0000","last_peered":"2024-09-14T11:51:21.316772+0000","last_clean":"2024-09-14T11:51:21.316772+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:51:21.316772+0000","last_undegraded":"2024-09-14T11:51:21.316772+0000","last_fullsized":"2024-09-14T11:51:21.316772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:16.898215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'218","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.895001+0000","last_change":"2024-09-14T11:11:04.651268+0000","last_active":"2024-09-14T11:50:25.895001+0000","last_peered":"2024-09-14T11:50:25.895001+0000","last_clean":"2024-09-14T11:50:25.895001+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:50:25.895001+0000","last_undegraded":"2024-09-14T11:50:25.895001+0000","last_fullsized":"2024-09-14T11:50:25.895001+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:23.982692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45332,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":67022,"num_write":1008,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845379+0000","last_change":"2024-09-14T11:11:06.659988+0000","last_active":"2024-09-14T11:51:21.845379+0000","last_peered":"2024-09-14T11:51:21.845379+0000","last_clean":"2024-09-14T11:51:21.845379+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:51:21.845379+0000","last_undegraded":"2024-09-14T11:51:21.845379+0000","last_fullsized":"2024-09-14T11:51:21.845379+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:38.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'203","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.533851+0000","last_change":"2024-09-14T11:11:38.680954+0000","last_active":"2024-09-14T11:50:25.533851+0000","last_peered":"2024-09-14T11:50:25.533851+0000","last_clean":"2024-09-14T11:50:25.533851+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:50:25.533851+0000","last_undegraded":"2024-09-14T11:50:25.533851+0000","last_fullsized":"2024-09-14T11:50:25.533851+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:16.743206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6646946,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":636,"num_read_kb":27752,"num_write":881,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'205","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:55.508425+0000","last_change":"2024-09-14T11:11:04.661066+0000","last_active":"2024-09-14T11:49:55.508425+0000","last_peered":"2024-09-14T11:49:55.508425+0000","last_clean":"2024-09-14T11:49:55.508425+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:49:55.508425+0000","last_undegraded":"2024-09-14T11:49:55.508425+0000","last_fullsized":"2024-09-14T11:49:55.508425+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:37.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105464,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":450,"num_read_kb":2089,"num_write":992,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'473","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179160+0000","last_change":"2024-09-14T11:11:06.654014+0000","last_active":"2024-09-14T11:51:05.179160+0000","last_peered":"2024-09-14T11:51:05.179160+0000","last_clean":"2024-09-14T11:51:05.179160+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:51:05.179160+0000","last_undegraded":"2024-09-14T11:51:05.179160+0000","last_fullsized":"2024-09-14T11:51:05.179160+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.254011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'257","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.156014+0000","last_change":"2024-09-14T11:11:04.647071+0000","last_active":"2024-09-14T11:51:19.156014+0000","last_peered":"2024-09-14T11:51:19.156014+0000","last_clean":"2024-09-14T11:51:19.156014+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:51:19.156014+0000","last_undegraded":"2024-09-14T11:51:19.156014+0000","last_fullsized":"2024-09-14T11:51:19.156014+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:36.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9446249,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":738,"num_read_kb":42624,"num_write":1177,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'381","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844858+0000","last_change":"2024-09-14T11:11:06.651474+0000","last_active":"2024-09-14T11:51:21.844858+0000","last_peered":"2024-09-14T11:51:21.844858+0000","last_clean":"2024-09-14T11:51:21.844858+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:51:21.844858+0000","last_undegraded":"2024-09-14T11:51:21.844858+0000","last_fullsized":"2024-09-14T11:51:21.844858+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:12.583169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1586,"ondisk_log_size":1586,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":441,"ondisk_log_size":441,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":549287,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8076,"num_read_kb":10163,"num_write":5523,"num_write_kb":2827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":761856,"data_stored":246138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1822,"ondisk_log_size":1822,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2394,"num_read_kb":2859,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4062,"ondisk_log_size":4062,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":516365168,"num_objects":497,"num_object_clones":0,"num_object_copies":1988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42119,"num_read_kb":2539582,"num_write":63965,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":692436992,"data_stored":692436992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3581,"ondisk_log_size":3581,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":132,"num_read_kb":168157,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":72445561,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":139,"num_read_kb":181387,"num_write":162,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144900096,"data_stored":144891122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542654,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":363936,"kb_used_data":125904,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94007904,"statfs":{"total":96636764160,"available":96264093696,"internally_reserved":0,"allocated":128925696,"data_stored":126882893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542654,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":348908,"kb_used_data":110876,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94022932,"statfs":{"total":96636764160,"available":96279482368,"internally_reserved":0,"allocated":113537024,"data_stored":111570785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542652,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244012,"kb_used_data":132316,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94127828,"statfs":{"total":96636764160,"available":96386895872,"internally_reserved":0,"allocated":135491584,"data_stored":133446387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542652,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239172,"kb_used_data":127476,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94132668,"statfs":{"total":96636764160,"available":96391852032,"internally_reserved":0,"allocated":130535424,"data_stored":128601245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542651,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":394872,"kb_used_data":138792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":93976968,"statfs":{"total":96636764160,"available":96232415232,"internally_reserved":0,"allocated":142123008,"data_stored":140103253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542652,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188868,"kb_used_data":103540,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94182972,"statfs":{"total":96636764160,"available":96443363328,"internally_reserved":0,"allocated":106024960,"data_stored":104085158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542652,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267800,"kb_used_data":128392,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94104040,"statfs":{"total":96636764160,"available":96362536960,"internally_reserved":0,"allocated":131473408,"data_stored":129466388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542653,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396440,"kb_used_data":126536,"kb_used_omap":1,"kb_used_meta":269886,"kb_avail":93975400,"statfs":{"total":96636764160,"available":96230809600,"internally_reserved":0,"allocated":129572864,"data_stored":127542267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276363717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95223808,"data_stored":95223808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":91357184,"data_stored":91357184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":62988288,"data_stored":62988288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86421504,"data_stored":86421504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":92721152,"data_stored":92721152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93364224,"data_stored":93364224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":83079168,"data_stored":83079168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":87281664,"data_stored":87281664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":37449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":36402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":12030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":37213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":42041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":24241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":50688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16814080,"data_stored":16812382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14749696,"data_stored":14746907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14708736,"data_stored":14707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":22016000,"data_stored":22015117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19980288,"data_stored":19977499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26210304,"data_stored":26210304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10489856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19931136,"data_stored":19931136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12621083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21073920,"data_stored":21069433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24121344,"data_stored":24121344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29372416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13639680,"data_stored":13639680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15720448,"data_stored":15719565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16773120,"data_stored":16773120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:52:47.188 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:52:47.513 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:52:47.513 INFO:teuthology.orchestra.run.smithi130.stdout:{"epoch":263,"fsid":"96e8008b-f06f-4b4a-864e-50e587612172","created":"2024-09-14T11:10:31.811825+0000","modified":"2024-09-14T11:38:33.842689+0000","last_up_change":"2024-09-14T11:10:43.292404+0000","last_in_change":"2024-09-14T11:10:34.175220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:10:44.122857+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:10:50.102524+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:11:02.620424+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:11:04.969730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:11:06.809357+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:11:09.119674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:11:10.677380+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:11:12.741818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:26:00.736208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:27:42.426884+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:27:44.913892+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:38:31.089055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"238b3c2d-4100-4b07-8495-bfdcdfeba19f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6809","nonce":4246152659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6811","nonce":4246152659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6815","nonce":4246152659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":4246152659},{"type":"v1","addr":"172.21.15.130:6813","nonce":4246152659}]},"public_addr":"172.21.15.130:6809/4246152659","cluster_addr":"172.21.15.130:6811/4246152659","heartbeat_back_addr":"172.21.15.130:6815/4246152659","heartbeat_front_addr":"172.21.15.130:6813/4246152659","state":["exists","up"]},{"osd":1,"uuid":"7ceff183-4838-418a-9c2a-f163f9e3865b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6817","nonce":3369137395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6819","nonce":3369137395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6823","nonce":3369137395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":3369137395},{"type":"v1","addr":"172.21.15.130:6821","nonce":3369137395}]},"public_addr":"172.21.15.130:6817/3369137395","cluster_addr":"172.21.15.130:6819/3369137395","heartbeat_back_addr":"172.21.15.130:6823/3369137395","heartbeat_front_addr":"172.21.15.130:6821/3369137395","state":["exists","up"]},{"osd":2,"uuid":"c1f7f0d6-3654-44f6-95f6-4f6a89aea033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6825","nonce":1425785084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6827","nonce":1425785084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6831","nonce":1425785084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1425785084},{"type":"v1","addr":"172.21.15.130:6829","nonce":1425785084}]},"public_addr":"172.21.15.130:6825/1425785084","cluster_addr":"172.21.15.130:6827/1425785084","heartbeat_back_addr":"172.21.15.130:6831/1425785084","heartbeat_front_addr":"172.21.15.130:6829/1425785084","state":["exists","up"]},{"osd":3,"uuid":"e9b8dbc9-aefb-4e4e-8fa0-8d70c38317a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6801","nonce":4189242858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6803","nonce":4189242858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6807","nonce":4189242858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4189242858},{"type":"v1","addr":"172.21.15.130:6805","nonce":4189242858}]},"public_addr":"172.21.15.130:6801/4189242858","cluster_addr":"172.21.15.130:6803/4189242858","heartbeat_back_addr":"172.21.15.130:6807/4189242858","heartbeat_front_addr":"172.21.15.130:6805/4189242858","state":["exists","up"]},{"osd":4,"uuid":"05ca818d-004d-4052-9216-428dfc8b1486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6817","nonce":2608434775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6819","nonce":2608434775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6823","nonce":2608434775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":2608434775},{"type":"v1","addr":"172.21.15.171:6821","nonce":2608434775}]},"public_addr":"172.21.15.171:6817/2608434775","cluster_addr":"172.21.15.171:6819/2608434775","heartbeat_back_addr":"172.21.15.171:6823/2608434775","heartbeat_front_addr":"172.21.15.171:6821/2608434775","state":["exists","up"]},{"osd":5,"uuid":"a143b896-1099-4cd9-953e-8b1055d763ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6827","nonce":803554996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6829","nonce":803554996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6833","nonce":803554996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":803554996},{"type":"v1","addr":"172.21.15.171:6831","nonce":803554996}]},"public_addr":"172.21.15.171:6827/803554996","cluster_addr":"172.21.15.171:6829/803554996","heartbeat_back_addr":"172.21.15.171:6833/803554996","heartbeat_front_addr":"172.21.15.171:6831/803554996","state":["exists","up"]},{"osd":6,"uuid":"0c8bf135-7a18-423d-84ac-75d120df2472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6809","nonce":3699648391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6811","nonce":3699648391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6815","nonce":3699648391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3699648391},{"type":"v1","addr":"172.21.15.171:6813","nonce":3699648391}]},"public_addr":"172.21.15.171:6809/3699648391","cluster_addr":"172.21.15.171:6811/3699648391","heartbeat_back_addr":"172.21.15.171:6815/3699648391","heartbeat_front_addr":"172.21.15.171:6813/3699648391","state":["exists","up"]},{"osd":7,"uuid":"1d28866b-395a-40cf-805d-2d28c635d16b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6801","nonce":1745960304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6803","nonce":1745960304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6807","nonce":1745960304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1745960304},{"type":"v1","addr":"172.21.15.171:6805","nonce":1745960304}]},"public_addr":"172.21.15.171:6801/1745960304","cluster_addr":"172.21.15.171:6803/1745960304","heartbeat_back_addr":"172.21.15.171:6807/1745960304","heartbeat_front_addr":"172.21.15.171:6805/1745960304","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.827708+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.270700+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.539300+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.490460+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:41.447498+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.917574+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:40.456600+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:10:39.964918+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.a","mappings":[{"from":6,"to":2}]},{"pgid":"3.b","mappings":[{"from":0,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":3}]},{"pgid":"3.24","mappings":[{"from":4,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]},{"pgid":"67.1a","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:52:48.527 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:52:48.527 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:48.666 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:48.666 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:48.666 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:48.677 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:52:48.981 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:52:48.995 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:52:48.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:49.132 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:49.132 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:49.133 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:49.144 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:52:49.443 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:52:49.456 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:52:49.456 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:49.592 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:49.592 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:49.592 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:49.603 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:52:49.902 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:52:49.915 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:52:49.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:50.053 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:50.054 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:50.054 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:50.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:52:50.368 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:52:50.382 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:52:50.382 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:50.520 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:50.520 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:50.520 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:50.531 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:52:50.835 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:52:50.848 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:52:50.848 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:50.987 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:50.987 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:50.987 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:50.998 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:52:51.302 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:52:51.316 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:52:51.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:51.453 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:51.454 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:51.454 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:51.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:52:51.767 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:52:51.780 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:52:51.780 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:52:51.919 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-09-14T11:52:51.919 INFO:teuthology.orchestra.run.smithi130.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:52:51.919 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-09-14T11:52:51.930 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:52:52.235 INFO:teuthology.orchestra.run.smithi130.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:52:52.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:52:52.567 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:52:52.578 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:52:52.580 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1520,"stamp":"2024-09-14T11:52:51.073822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30522513,"num_objects":632,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":299502,"num_read_kb":3128085,"num_write":146428,"num_write_kb":2544950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12763,"ondisk_log_size":12763,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1540296,"kb_used_data":74352,"kb_used_omap":12,"kb_used_meta":1465331,"kb_avail":753434424,"statfs":{"total":773094113280,"available":771516850176,"internally_reserved":0,"allocated":76136448,"data_stored":60413398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1500499505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-631890769,"num_objects":-386,"num_object_clones":0,"num_object_copies":-1430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-386,"num_whiteouts":0,"num_read":737,"num_read_kb":760,"num_write":548,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.697419+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:52:44.697419+0000","last_peered":"2024-09-14T11:52:44.697419+0000","last_clean":"2024-09-14T11:52:44.697419+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:52:44.697419+0000","last_undegraded":"2024-09-14T11:52:44.697419+0000","last_fullsized":"2024-09-14T11:52:44.697419+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.949783+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:52:43.949783+0000","last_peered":"2024-09-14T11:52:43.949783+0000","last_clean":"2024-09-14T11:52:43.949783+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:52:43.949783+0000","last_undegraded":"2024-09-14T11:52:43.949783+0000","last_fullsized":"2024-09-14T11:52:43.949783+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.491129+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:50:29.491129+0000","last_peered":"2024-09-14T11:50:29.491129+0000","last_clean":"2024-09-14T11:50:29.491129+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:50:29.491129+0000","last_undegraded":"2024-09-14T11:50:29.491129+0000","last_fullsized":"2024-09-14T11:50:29.491129+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.932210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.020550+0000","last_change":"2024-09-14T11:38:32.849060+0000","last_active":"2024-09-14T11:48:34.020550+0000","last_peered":"2024-09-14T11:48:34.020550+0000","last_clean":"2024-09-14T11:48:34.020550+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:48:34.020550+0000","last_undegraded":"2024-09-14T11:48:34.020550+0000","last_fullsized":"2024-09-14T11:48:34.020550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:37.543006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.529195+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:52:44.529195+0000","last_peered":"2024-09-14T11:52:44.529195+0000","last_clean":"2024-09-14T11:52:44.529195+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:52:44.529195+0000","last_undegraded":"2024-09-14T11:52:44.529195+0000","last_fullsized":"2024-09-14T11:52:44.529195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.950140+0000","last_change":"2024-09-14T11:27:43.844600+0000","last_active":"2024-09-14T11:52:43.950140+0000","last_peered":"2024-09-14T11:52:43.950140+0000","last_clean":"2024-09-14T11:52:43.950140+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:52:43.950140+0000","last_undegraded":"2024-09-14T11:52:43.950140+0000","last_fullsized":"2024-09-14T11:52:43.950140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:40.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.031874+0000","last_change":"2024-09-14T11:26:02.011475+0000","last_active":"2024-09-14T11:50:04.031874+0000","last_peered":"2024-09-14T11:50:04.031874+0000","last_clean":"2024-09-14T11:50:04.031874+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:50:04.031874+0000","last_undegraded":"2024-09-14T11:50:04.031874+0000","last_fullsized":"2024-09-14T11:50:04.031874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:06.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.904430+0000","last_change":"2024-09-14T11:38:32.844854+0000","last_active":"2024-09-14T11:48:13.904430+0000","last_peered":"2024-09-14T11:48:13.904430+0000","last_clean":"2024-09-14T11:48:13.904430+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:48:13.904430+0000","last_undegraded":"2024-09-14T11:48:13.904430+0000","last_fullsized":"2024-09-14T11:48:13.904430+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:24.240149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'10","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528901+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:52:44.528901+0000","last_peered":"2024-09-14T11:52:44.528901+0000","last_clean":"2024-09-14T11:52:44.528901+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:52:44.528901+0000","last_undegraded":"2024-09-14T11:52:44.528901+0000","last_fullsized":"2024-09-14T11:52:44.528901+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":15373,"num_write":10,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.029442+0000","last_change":"2024-09-14T11:27:43.839478+0000","last_active":"2024-09-14T11:49:44.029442+0000","last_peered":"2024-09-14T11:49:44.029442+0000","last_clean":"2024-09-14T11:49:44.029442+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:49:44.029442+0000","last_undegraded":"2024-09-14T11:49:44.029442+0000","last_fullsized":"2024-09-14T11:49:44.029442+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:44.742446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:18.912574+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:48:18.912574+0000","last_peered":"2024-09-14T11:48:18.912574+0000","last_clean":"2024-09-14T11:48:18.912574+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:48:18.912574+0000","last_undegraded":"2024-09-14T11:48:18.912574+0000","last_fullsized":"2024-09-14T11:48:18.912574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:25.443932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.948585+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:52:43.948585+0000","last_peered":"2024-09-14T11:52:43.948585+0000","last_clean":"2024-09-14T11:52:43.948585+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:52:43.948585+0000","last_undegraded":"2024-09-14T11:52:43.948585+0000","last_fullsized":"2024-09-14T11:52:43.948585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.942732+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:52:03.942732+0000","last_peered":"2024-09-14T11:52:03.942732+0000","last_clean":"2024-09-14T11:52:03.942732+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:52:03.942732+0000","last_undegraded":"2024-09-14T11:52:03.942732+0000","last_fullsized":"2024-09-14T11:52:03.942732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918289+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:48:58.918289+0000","last_peered":"2024-09-14T11:48:58.918289+0000","last_clean":"2024-09-14T11:48:58.918289+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:48:58.918289+0000","last_undegraded":"2024-09-14T11:48:58.918289+0000","last_fullsized":"2024-09-14T11:48:58.918289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:24.194975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.936054+0000","last_change":"2024-09-14T11:27:46.877556+0000","last_active":"2024-09-14T11:51:58.936054+0000","last_peered":"2024-09-14T11:51:58.936054+0000","last_clean":"2024-09-14T11:51:58.936054+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:51:58.936054+0000","last_undegraded":"2024-09-14T11:51:58.936054+0000","last_fullsized":"2024-09-14T11:51:58.936054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:18.433716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941850+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:51:58.941850+0000","last_peered":"2024-09-14T11:51:58.941850+0000","last_clean":"2024-09-14T11:51:58.941850+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:51:58.941850+0000","last_undegraded":"2024-09-14T11:51:58.941850+0000","last_fullsized":"2024-09-14T11:51:58.941850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907414+0000","last_change":"2024-09-14T11:26:02.016774+0000","last_active":"2024-09-14T11:48:33.907414+0000","last_peered":"2024-09-14T11:48:33.907414+0000","last_clean":"2024-09-14T11:48:33.907414+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:48:33.907414+0000","last_undegraded":"2024-09-14T11:48:33.907414+0000","last_fullsized":"2024-09-14T11:48:33.907414+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:07.106001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'14","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.380641+0000","last_change":"2024-09-14T11:27:46.886470+0000","last_active":"2024-09-14T11:52:44.380641+0000","last_peered":"2024-09-14T11:52:44.380641+0000","last_clean":"2024-09-14T11:52:44.380641+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:52:44.380641+0000","last_undegraded":"2024-09-14T11:52:44.380641+0000","last_fullsized":"2024-09-14T11:52:44.380641+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:31.966694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19456,"num_write":24,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.546348+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:52:44.546348+0000","last_peered":"2024-09-14T11:52:44.546348+0000","last_clean":"2024-09-14T11:52:44.546348+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:52:44.546348+0000","last_undegraded":"2024-09-14T11:52:44.546348+0000","last_fullsized":"2024-09-14T11:52:44.546348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5174,"num_write":14,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.574307+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:52:44.574307+0000","last_peered":"2024-09-14T11:52:44.574307+0000","last_clean":"2024-09-14T11:52:44.574307+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:52:44.574307+0000","last_undegraded":"2024-09-14T11:52:44.574307+0000","last_fullsized":"2024-09-14T11:52:44.574307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12280,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.928980+0000","last_change":"2024-09-14T11:26:02.018044+0000","last_active":"2024-09-14T11:50:13.928980+0000","last_peered":"2024-09-14T11:50:13.928980+0000","last_clean":"2024-09-14T11:50:13.928980+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:50:13.928980+0000","last_undegraded":"2024-09-14T11:50:13.928980+0000","last_fullsized":"2024-09-14T11:50:13.928980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:20.434831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943383+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:51:58.943383+0000","last_peered":"2024-09-14T11:51:58.943383+0000","last_clean":"2024-09-14T11:51:58.943383+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:51:58.943383+0000","last_undegraded":"2024-09-14T11:51:58.943383+0000","last_fullsized":"2024-09-14T11:51:58.943383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.445655+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:52:44.445655+0000","last_peered":"2024-09-14T11:52:44.445655+0000","last_clean":"2024-09-14T11:52:44.445655+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:52:44.445655+0000","last_undegraded":"2024-09-14T11:52:44.445655+0000","last_fullsized":"2024-09-14T11:52:44.445655+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:57.988895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033275+0000","last_change":"2024-09-14T11:38:32.848295+0000","last_active":"2024-09-14T11:50:14.033275+0000","last_peered":"2024-09-14T11:50:14.033275+0000","last_clean":"2024-09-14T11:50:14.033275+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:50:14.033275+0000","last_undegraded":"2024-09-14T11:50:14.033275+0000","last_fullsized":"2024-09-14T11:50:14.033275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:48.994528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.380627+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:52:44.380627+0000","last_peered":"2024-09-14T11:52:44.380627+0000","last_clean":"2024-09-14T11:52:44.380627+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:52:44.380627+0000","last_undegraded":"2024-09-14T11:52:44.380627+0000","last_fullsized":"2024-09-14T11:52:44.380627+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.064017+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:51:54.064017+0000","last_peered":"2024-09-14T11:51:54.064017+0000","last_clean":"2024-09-14T11:51:54.064017+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:51:54.064017+0000","last_undegraded":"2024-09-14T11:51:54.064017+0000","last_fullsized":"2024-09-14T11:51:54.064017+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943433+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:51:58.943433+0000","last_peered":"2024-09-14T11:51:58.943433+0000","last_clean":"2024-09-14T11:51:58.943433+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:51:58.943433+0000","last_undegraded":"2024-09-14T11:51:58.943433+0000","last_fullsized":"2024-09-14T11:51:58.943433+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.027786+0000","last_change":"2024-09-14T11:27:43.833928+0000","last_active":"2024-09-14T11:49:29.027786+0000","last_peered":"2024-09-14T11:49:29.027786+0000","last_clean":"2024-09-14T11:49:29.027786+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:49:29.027786+0000","last_undegraded":"2024-09-14T11:49:29.027786+0000","last_fullsized":"2024-09-14T11:49:29.027786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:18.568174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033312+0000","last_change":"2024-09-14T11:26:02.016653+0000","last_active":"2024-09-14T11:50:14.033312+0000","last_peered":"2024-09-14T11:50:14.033312+0000","last_clean":"2024-09-14T11:50:14.033312+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:50:14.033312+0000","last_undegraded":"2024-09-14T11:50:14.033312+0000","last_fullsized":"2024-09-14T11:50:14.033312+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:16.371317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941930+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:51:58.941930+0000","last_peered":"2024-09-14T11:51:58.941930+0000","last_clean":"2024-09-14T11:51:58.941930+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:51:58.941930+0000","last_undegraded":"2024-09-14T11:51:58.941930+0000","last_fullsized":"2024-09-14T11:51:58.941930+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911902+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:48:13.911902+0000","last_peered":"2024-09-14T11:48:13.911902+0000","last_clean":"2024-09-14T11:48:13.911902+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:48:13.911902+0000","last_undegraded":"2024-09-14T11:48:13.911902+0000","last_fullsized":"2024-09-14T11:48:13.911902+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:00.999425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.935782+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:51:08.935782+0000","last_peered":"2024-09-14T11:51:08.935782+0000","last_clean":"2024-09-14T11:51:08.935782+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:51:08.935782+0000","last_undegraded":"2024-09-14T11:51:08.935782+0000","last_fullsized":"2024-09-14T11:51:08.935782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:19.871430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3076,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914944+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:48:43.914944+0000","last_peered":"2024-09-14T11:48:43.914944+0000","last_clean":"2024-09-14T11:48:43.914944+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:48:43.914944+0000","last_undegraded":"2024-09-14T11:48:43.914944+0000","last_fullsized":"2024-09-14T11:48:43.914944+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:16.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.909890+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:48:13.909890+0000","last_peered":"2024-09-14T11:48:13.909890+0000","last_clean":"2024-09-14T11:48:13.909890+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:48:13.909890+0000","last_undegraded":"2024-09-14T11:48:13.909890+0000","last_fullsized":"2024-09-14T11:48:13.909890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:42.939970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916531+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:48:48.916531+0000","last_peered":"2024-09-14T11:48:48.916531+0000","last_clean":"2024-09-14T11:48:48.916531+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:48:48.916531+0000","last_undegraded":"2024-09-14T11:48:48.916531+0000","last_fullsized":"2024-09-14T11:48:48.916531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:11.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935589+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:51:03.935589+0000","last_peered":"2024-09-14T11:51:03.935589+0000","last_clean":"2024-09-14T11:51:03.935589+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:51:03.935589+0000","last_undegraded":"2024-09-14T11:51:03.935589+0000","last_fullsized":"2024-09-14T11:51:03.935589+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916982+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:48:48.916982+0000","last_peered":"2024-09-14T11:48:48.916982+0000","last_clean":"2024-09-14T11:48:48.916982+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:48:48.916982+0000","last_undegraded":"2024-09-14T11:48:48.916982+0000","last_fullsized":"2024-09-14T11:48:48.916982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:18.041265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.909029+0000","last_change":"2024-09-14T11:27:43.841798+0000","last_active":"2024-09-14T11:48:43.909029+0000","last_peered":"2024-09-14T11:48:43.909029+0000","last_clean":"2024-09-14T11:48:43.909029+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:48:43.909029+0000","last_undegraded":"2024-09-14T11:48:43.909029+0000","last_fullsized":"2024-09-14T11:48:43.909029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920603+0000","last_change":"2024-09-14T11:26:02.017294+0000","last_active":"2024-09-14T11:49:23.920603+0000","last_peered":"2024-09-14T11:49:23.920603+0000","last_clean":"2024-09-14T11:49:23.920603+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:49:23.920603+0000","last_undegraded":"2024-09-14T11:49:23.920603+0000","last_fullsized":"2024-09-14T11:49:23.920603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.763964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:13.911882+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:48:13.911882+0000","last_peered":"2024-09-14T11:48:13.911882+0000","last_clean":"2024-09-14T11:48:13.911882+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:48:13.911882+0000","last_undegraded":"2024-09-14T11:48:13.911882+0000","last_fullsized":"2024-09-14T11:48:13.911882+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.077724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'8","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.489272+0000","last_change":"2024-09-14T11:27:46.878156+0000","last_active":"2024-09-14T11:52:44.489272+0000","last_peered":"2024-09-14T11:52:44.489272+0000","last_clean":"2024-09-14T11:52:44.489272+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:52:44.489272+0000","last_undegraded":"2024-09-14T11:52:44.489272+0000","last_fullsized":"2024-09-14T11:52:44.489272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:16.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":8,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040261+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:48:44.040261+0000","last_peered":"2024-09-14T11:48:44.040261+0000","last_clean":"2024-09-14T11:48:44.040261+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:48:44.040261+0000","last_undegraded":"2024-09-14T11:48:44.040261+0000","last_fullsized":"2024-09-14T11:48:44.040261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:04.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027203+0000","last_change":"2024-09-14T11:38:32.848761+0000","last_active":"2024-09-14T11:49:24.027203+0000","last_peered":"2024-09-14T11:49:24.027203+0000","last_clean":"2024-09-14T11:49:24.027203+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:49:24.027203+0000","last_undegraded":"2024-09-14T11:49:24.027203+0000","last_fullsized":"2024-09-14T11:49:24.027203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.405538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.948450+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:52:33.948450+0000","last_peered":"2024-09-14T11:52:33.948450+0000","last_clean":"2024-09-14T11:52:33.948450+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:52:33.948450+0000","last_undegraded":"2024-09-14T11:52:33.948450+0000","last_fullsized":"2024-09-14T11:52:33.948450+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'10","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069792+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:52:29.069792+0000","last_peered":"2024-09-14T11:52:29.069792+0000","last_clean":"2024-09-14T11:52:29.069792+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:52:29.069792+0000","last_undegraded":"2024-09-14T11:52:29.069792+0000","last_fullsized":"2024-09-14T11:52:29.069792+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21510,"num_write":20,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":79,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915562+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:48:38.915562+0000","last_peered":"2024-09-14T11:48:38.915562+0000","last_clean":"2024-09-14T11:48:38.915562+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:48:38.915562+0000","last_undegraded":"2024-09-14T11:48:38.915562+0000","last_fullsized":"2024-09-14T11:48:38.915562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:22.557110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033300+0000","last_change":"2024-09-14T11:27:43.841930+0000","last_active":"2024-09-14T11:50:14.033300+0000","last_peered":"2024-09-14T11:50:14.033300+0000","last_clean":"2024-09-14T11:50:14.033300+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:50:14.033300+0000","last_undegraded":"2024-09-14T11:50:14.033300+0000","last_fullsized":"2024-09-14T11:50:14.033300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:26.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.039040+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:48:34.039040+0000","last_peered":"2024-09-14T11:48:34.039040+0000","last_clean":"2024-09-14T11:48:34.039040+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:48:34.039040+0000","last_undegraded":"2024-09-14T11:48:34.039040+0000","last_fullsized":"2024-09-14T11:48:34.039040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:32.266973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.914592+0000","last_change":"2024-09-14T11:38:32.850327+0000","last_active":"2024-09-14T11:49:23.914592+0000","last_peered":"2024-09-14T11:49:23.914592+0000","last_clean":"2024-09-14T11:49:23.914592+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:49:23.914592+0000","last_undegraded":"2024-09-14T11:49:23.914592+0000","last_fullsized":"2024-09-14T11:49:23.914592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.949517+0000","last_change":"2024-09-14T11:27:47.189562+0000","last_active":"2024-09-14T11:52:38.949517+0000","last_peered":"2024-09-14T11:52:38.949517+0000","last_clean":"2024-09-14T11:52:38.949517+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:52:38.949517+0000","last_undegraded":"2024-09-14T11:52:38.949517+0000","last_fullsized":"2024-09-14T11:52:38.949517+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:40.247709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.947353+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:52:28.947353+0000","last_peered":"2024-09-14T11:52:28.947353+0000","last_clean":"2024-09-14T11:52:28.947353+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:52:28.947353+0000","last_undegraded":"2024-09-14T11:52:28.947353+0000","last_fullsized":"2024-09-14T11:52:28.947353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":148,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907514+0000","last_change":"2024-09-14T11:26:02.014516+0000","last_active":"2024-09-14T11:48:33.907514+0000","last_peered":"2024-09-14T11:48:33.907514+0000","last_clean":"2024-09-14T11:48:33.907514+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:48:33.907514+0000","last_undegraded":"2024-09-14T11:48:33.907514+0000","last_fullsized":"2024-09-14T11:48:33.907514+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:24.171152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528715+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:52:44.528715+0000","last_peered":"2024-09-14T11:52:44.528715+0000","last_clean":"2024-09-14T11:52:44.528715+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:52:44.528715+0000","last_undegraded":"2024-09-14T11:52:44.528715+0000","last_fullsized":"2024-09-14T11:52:44.528715+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929898+0000","last_change":"2024-09-14T11:27:43.842788+0000","last_active":"2024-09-14T11:50:18.929898+0000","last_peered":"2024-09-14T11:50:18.929898+0000","last_clean":"2024-09-14T11:50:18.929898+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:50:18.929898+0000","last_undegraded":"2024-09-14T11:50:18.929898+0000","last_fullsized":"2024-09-14T11:50:18.929898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:25.953106+0000","last_change":"2024-09-14T11:26:02.009131+0000","last_active":"2024-09-14T11:50:25.953106+0000","last_peered":"2024-09-14T11:50:25.953106+0000","last_clean":"2024-09-14T11:50:25.953106+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:50:25.953106+0000","last_undegraded":"2024-09-14T11:50:25.953106+0000","last_fullsized":"2024-09-14T11:50:25.953106+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:23.370888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939031+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:51:38.939031+0000","last_peered":"2024-09-14T11:51:38.939031+0000","last_clean":"2024-09-14T11:51:38.939031+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:51:38.939031+0000","last_undegraded":"2024-09-14T11:51:38.939031+0000","last_fullsized":"2024-09-14T11:51:38.939031+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6166,"num_write":6,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":91,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.698490+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:29.698490+0000","last_peered":"2024-09-14T11:50:29.698490+0000","last_clean":"2024-09-14T11:50:29.698490+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:29.698490+0000","last_undegraded":"2024-09-14T11:50:29.698490+0000","last_fullsized":"2024-09-14T11:50:29.698490+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:46.261351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061553+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:51:39.061553+0000","last_peered":"2024-09-14T11:51:39.061553+0000","last_clean":"2024-09-14T11:51:39.061553+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:51:39.061553+0000","last_undegraded":"2024-09-14T11:51:39.061553+0000","last_fullsized":"2024-09-14T11:51:39.061553+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.529065+0000","last_change":"2024-09-14T11:27:43.843512+0000","last_active":"2024-09-14T11:52:44.529065+0000","last_peered":"2024-09-14T11:52:44.529065+0000","last_clean":"2024-09-14T11:52:44.529065+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:52:44.529065+0000","last_undegraded":"2024-09-14T11:52:44.529065+0000","last_fullsized":"2024-09-14T11:52:44.529065+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4143,"num_write":14,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929860+0000","last_change":"2024-09-14T11:27:46.881654+0000","last_active":"2024-09-14T11:50:18.929860+0000","last_peered":"2024-09-14T11:50:18.929860+0000","last_clean":"2024-09-14T11:50:18.929860+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:50:18.929860+0000","last_undegraded":"2024-09-14T11:50:18.929860+0000","last_fullsized":"2024-09-14T11:50:18.929860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:09.752180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061607+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:51:39.061607+0000","last_peered":"2024-09-14T11:51:39.061607+0000","last_clean":"2024-09-14T11:51:39.061607+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:51:39.061607+0000","last_undegraded":"2024-09-14T11:51:39.061607+0000","last_fullsized":"2024-09-14T11:51:39.061607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918260+0000","last_change":"2024-09-14T11:26:02.015867+0000","last_active":"2024-09-14T11:49:53.918260+0000","last_peered":"2024-09-14T11:49:53.918260+0000","last_clean":"2024-09-14T11:49:53.918260+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:49:53.918260+0000","last_undegraded":"2024-09-14T11:49:53.918260+0000","last_fullsized":"2024-09-14T11:49:53.918260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:45.729260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037984+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:48:59.037984+0000","last_peered":"2024-09-14T11:48:59.037984+0000","last_clean":"2024-09-14T11:48:59.037984+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:48:59.037984+0000","last_undegraded":"2024-09-14T11:48:59.037984+0000","last_fullsized":"2024-09-14T11:48:59.037984+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:52.311696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933823+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:50:48.933823+0000","last_peered":"2024-09-14T11:50:48.933823+0000","last_clean":"2024-09-14T11:50:48.933823+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:50:48.933823+0000","last_undegraded":"2024-09-14T11:50:48.933823+0000","last_fullsized":"2024-09-14T11:50:48.933823+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.987363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.650184+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:52:44.650184+0000","last_peered":"2024-09-14T11:52:44.650184+0000","last_clean":"2024-09-14T11:52:44.650184+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:52:44.650184+0000","last_undegraded":"2024-09-14T11:52:44.650184+0000","last_fullsized":"2024-09-14T11:52:44.650184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10258,"num_write":8,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042361+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:48:59.042361+0000","last_peered":"2024-09-14T11:48:59.042361+0000","last_clean":"2024-09-14T11:48:59.042361+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:48:59.042361+0000","last_undegraded":"2024-09-14T11:48:59.042361+0000","last_fullsized":"2024-09-14T11:48:59.042361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:40.838198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933194+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:50:43.933194+0000","last_peered":"2024-09-14T11:50:43.933194+0000","last_clean":"2024-09-14T11:50:43.933194+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:50:43.933194+0000","last_undegraded":"2024-09-14T11:50:43.933194+0000","last_fullsized":"2024-09-14T11:50:43.933194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.648469+0000","last_change":"2024-09-14T11:27:43.842571+0000","last_active":"2024-09-14T11:52:44.648469+0000","last_peered":"2024-09-14T11:52:44.648469+0000","last_clean":"2024-09-14T11:52:44.648469+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:52:44.648469+0000","last_undegraded":"2024-09-14T11:52:44.648469+0000","last_fullsized":"2024-09-14T11:52:44.648469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:54.316859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4136,"num_write":12,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918333+0000","last_change":"2024-09-14T11:26:02.017925+0000","last_active":"2024-09-14T11:49:53.918333+0000","last_peered":"2024-09-14T11:49:53.918333+0000","last_clean":"2024-09-14T11:49:53.918333+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:49:53.918333+0000","last_undegraded":"2024-09-14T11:49:53.918333+0000","last_fullsized":"2024-09-14T11:49:53.918333+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:08.536746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.938534+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:51:33.938534+0000","last_peered":"2024-09-14T11:51:33.938534+0000","last_clean":"2024-09-14T11:51:33.938534+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:51:33.938534+0000","last_undegraded":"2024-09-14T11:51:33.938534+0000","last_fullsized":"2024-09-14T11:51:33.938534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:13.953562+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:49:13.953562+0000","last_peered":"2024-09-14T11:49:13.953562+0000","last_clean":"2024-09-14T11:49:13.953562+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:49:13.953562+0000","last_undegraded":"2024-09-14T11:49:13.953562+0000","last_fullsized":"2024-09-14T11:49:13.953562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:55.854911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.917107+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:48:58.917107+0000","last_peered":"2024-09-14T11:48:58.917107+0000","last_clean":"2024-09-14T11:48:58.917107+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:48:58.917107+0000","last_undegraded":"2024-09-14T11:48:58.917107+0000","last_fullsized":"2024-09-14T11:48:58.917107+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:10.571334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939147+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:51:38.939147+0000","last_peered":"2024-09-14T11:51:38.939147+0000","last_clean":"2024-09-14T11:51:38.939147+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:51:38.939147+0000","last_undegraded":"2024-09-14T11:51:38.939147+0000","last_fullsized":"2024-09-14T11:51:38.939147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.060905+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:51:34.060905+0000","last_peered":"2024-09-14T11:51:34.060905+0000","last_clean":"2024-09-14T11:51:34.060905+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:51:34.060905+0000","last_undegraded":"2024-09-14T11:51:34.060905+0000","last_fullsized":"2024-09-14T11:51:34.060905+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":77,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918208+0000","last_change":"2024-09-14T11:26:02.017129+0000","last_active":"2024-09-14T11:48:58.918208+0000","last_peered":"2024-09-14T11:48:58.918208+0000","last_clean":"2024-09-14T11:48:58.918208+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:48:58.918208+0000","last_undegraded":"2024-09-14T11:48:58.918208+0000","last_fullsized":"2024-09-14T11:48:58.918208+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:31.419402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027265+0000","last_change":"2024-09-14T11:38:32.849590+0000","last_active":"2024-09-14T11:49:24.027265+0000","last_peered":"2024-09-14T11:49:24.027265+0000","last_clean":"2024-09-14T11:49:24.027265+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:49:24.027265+0000","last_undegraded":"2024-09-14T11:49:24.027265+0000","last_fullsized":"2024-09-14T11:49:24.027265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:47.728058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528783+0000","last_change":"2024-09-14T11:27:46.881829+0000","last_active":"2024-09-14T11:52:44.528783+0000","last_peered":"2024-09-14T11:52:44.528783+0000","last_clean":"2024-09-14T11:52:44.528783+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:52:44.528783+0000","last_undegraded":"2024-09-14T11:52:44.528783+0000","last_fullsized":"2024-09-14T11:52:44.528783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:28.272707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528818+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:52:44.528818+0000","last_peered":"2024-09-14T11:52:44.528818+0000","last_clean":"2024-09-14T11:52:44.528818+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:52:44.528818+0000","last_undegraded":"2024-09-14T11:52:44.528818+0000","last_fullsized":"2024-09-14T11:52:44.528818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.042401+0000","last_change":"2024-09-14T11:26:02.004701+0000","last_active":"2024-09-14T11:48:59.042401+0000","last_peered":"2024-09-14T11:48:59.042401+0000","last_clean":"2024-09-14T11:48:59.042401+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:48:59.042401+0000","last_undegraded":"2024-09-14T11:48:59.042401+0000","last_fullsized":"2024-09-14T11:48:59.042401+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:25.708478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.072123+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:52:44.072123+0000","last_peered":"2024-09-14T11:52:44.072123+0000","last_clean":"2024-09-14T11:52:44.072123+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:52:44.072123+0000","last_undegraded":"2024-09-14T11:52:44.072123+0000","last_fullsized":"2024-09-14T11:52:44.072123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:32.268368+0000","last_change":"2024-09-14T11:26:02.017353+0000","last_active":"2024-09-14T11:49:32.268368+0000","last_peered":"2024-09-14T11:49:32.268368+0000","last_clean":"2024-09-14T11:49:32.268368+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:49:32.268368+0000","last_undegraded":"2024-09-14T11:49:32.268368+0000","last_fullsized":"2024-09-14T11:49:32.268368+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:27.288411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.918234+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:48:58.918234+0000","last_peered":"2024-09-14T11:48:58.918234+0000","last_clean":"2024-09-14T11:48:58.918234+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:48:58.918234+0000","last_undegraded":"2024-09-14T11:48:58.918234+0000","last_fullsized":"2024-09-14T11:48:58.918234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:40.224008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.925650+0000","last_change":"2024-09-14T11:27:46.880908+0000","last_active":"2024-09-14T11:50:43.925650+0000","last_peered":"2024-09-14T11:50:43.925650+0000","last_clean":"2024-09-14T11:50:43.925650+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:50:43.925650+0000","last_undegraded":"2024-09-14T11:50:43.925650+0000","last_fullsized":"2024-09-14T11:50:43.925650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:28.300991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932313+0000","last_change":"2024-09-14T11:27:43.841331+0000","last_active":"2024-09-14T11:50:38.932313+0000","last_peered":"2024-09-14T11:50:38.932313+0000","last_clean":"2024-09-14T11:50:38.932313+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:50:38.932313+0000","last_undegraded":"2024-09-14T11:50:38.932313+0000","last_fullsized":"2024-09-14T11:50:38.932313+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:03.837930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":126,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:58.911190+0000","last_change":"2024-09-14T11:26:02.017191+0000","last_active":"2024-09-14T11:48:58.911190+0000","last_peered":"2024-09-14T11:48:58.911190+0000","last_clean":"2024-09-14T11:48:58.911190+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:48:58.911190+0000","last_undegraded":"2024-09-14T11:48:58.911190+0000","last_fullsized":"2024-09-14T11:48:58.911190+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:53.535825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.038037+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:48:59.038037+0000","last_peered":"2024-09-14T11:48:59.038037+0000","last_clean":"2024-09-14T11:48:59.038037+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:48:59.038037+0000","last_undegraded":"2024-09-14T11:48:59.038037+0000","last_fullsized":"2024-09-14T11:48:59.038037+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:26.761199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.930926+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:50:43.930926+0000","last_peered":"2024-09-14T11:50:43.930926+0000","last_clean":"2024-09-14T11:50:43.930926+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:50:43.930926+0000","last_undegraded":"2024-09-14T11:50:43.930926+0000","last_fullsized":"2024-09-14T11:50:43.930926+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.942657+0000","last_change":"2024-09-14T11:27:43.841443+0000","last_active":"2024-09-14T11:52:43.942657+0000","last_peered":"2024-09-14T11:52:43.942657+0000","last_clean":"2024-09-14T11:52:43.942657+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:52:43.942657+0000","last_undegraded":"2024-09-14T11:52:43.942657+0000","last_fullsized":"2024-09-14T11:52:43.942657+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10252,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.046775+0000","last_change":"2024-09-14T11:26:02.020510+0000","last_active":"2024-09-14T11:50:04.046775+0000","last_peered":"2024-09-14T11:50:04.046775+0000","last_clean":"2024-09-14T11:50:04.046775+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:50:04.046775+0000","last_undegraded":"2024-09-14T11:50:04.046775+0000","last_fullsized":"2024-09-14T11:50:04.046775+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'219","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.684112+0000","last_change":"2024-09-14T11:11:04.667841+0000","last_active":"2024-09-14T11:52:44.684112+0000","last_peered":"2024-09-14T11:52:44.684112+0000","last_clean":"2024-09-14T11:52:44.684112+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:52:44.684112+0000","last_undegraded":"2024-09-14T11:52:44.684112+0000","last_fullsized":"2024-09-14T11:52:44.684112+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:30.918136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":26852,"num_write":1005,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1170","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.942831+0000","last_change":"2024-09-14T11:11:06.652913+0000","last_active":"2024-09-14T11:50:47.942831+0000","last_peered":"2024-09-14T11:50:47.942831+0000","last_clean":"2024-09-14T11:50:47.942831+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:50:47.942831+0000","last_undegraded":"2024-09-14T11:50:47.942831+0000","last_fullsized":"2024-09-14T11:50:47.942831+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:14.129052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'198","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.637663+0000","last_change":"2024-09-14T11:11:04.654208+0000","last_active":"2024-09-14T11:52:44.637663+0000","last_peered":"2024-09-14T11:52:44.637663+0000","last_clean":"2024-09-14T11:52:44.637663+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:52:44.637663+0000","last_undegraded":"2024-09-14T11:52:44.637663+0000","last_fullsized":"2024-09-14T11:52:44.637663+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:33.758275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":7476,"num_write":916,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'449","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.437450+0000","last_change":"2024-09-14T11:11:06.659297+0000","last_active":"2024-09-14T11:52:36.437450+0000","last_peered":"2024-09-14T11:52:36.437450+0000","last_clean":"2024-09-14T11:52:36.437450+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:52:36.437450+0000","last_undegraded":"2024-09-14T11:52:36.437450+0000","last_fullsized":"2024-09-14T11:52:36.437450+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:11.366968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'223","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.550790+0000","last_change":"2024-09-14T11:11:04.651404+0000","last_active":"2024-09-14T11:52:44.550790+0000","last_peered":"2024-09-14T11:52:44.550790+0000","last_clean":"2024-09-14T11:52:44.550790+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:52:44.550790+0000","last_undegraded":"2024-09-14T11:52:44.550790+0000","last_fullsized":"2024-09-14T11:52:44.550790+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:30.338647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":599,"num_read_kb":30059,"num_write":1074,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'879","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892231+0000","last_change":"2024-09-14T11:11:06.647529+0000","last_active":"2024-09-14T11:51:03.892231+0000","last_peered":"2024-09-14T11:51:03.892231+0000","last_clean":"2024-09-14T11:51:03.892231+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:51:03.892231+0000","last_undegraded":"2024-09-14T11:51:03.892231+0000","last_fullsized":"2024-09-14T11:51:03.892231+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:50.451539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'228","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.699831+0000","last_change":"2024-09-14T11:11:04.655250+0000","last_active":"2024-09-14T11:52:44.699831+0000","last_peered":"2024-09-14T11:52:44.699831+0000","last_clean":"2024-09-14T11:52:44.699831+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:52:44.699831+0000","last_undegraded":"2024-09-14T11:52:44.699831+0000","last_fullsized":"2024-09-14T11:52:44.699831+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:56.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":74674,"num_write":901,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'393","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884504+0000","last_change":"2024-09-14T11:11:06.651444+0000","last_active":"2024-09-14T11:51:07.884504+0000","last_peered":"2024-09-14T11:51:07.884504+0000","last_clean":"2024-09-14T11:51:07.884504+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:51:07.884504+0000","last_undegraded":"2024-09-14T11:51:07.884504+0000","last_fullsized":"2024-09-14T11:51:07.884504+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:10.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'244","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.661251+0000","last_change":"2024-09-14T11:11:04.668428+0000","last_active":"2024-09-14T11:52:44.661251+0000","last_peered":"2024-09-14T11:52:44.661251+0000","last_clean":"2024-09-14T11:52:44.661251+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:52:44.661251+0000","last_undegraded":"2024-09-14T11:52:44.661251+0000","last_fullsized":"2024-09-14T11:52:44.661251+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:29.887388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":17405,"num_write":1116,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'821","reported_seq":2482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172559+0000","last_change":"2024-09-14T11:11:06.657319+0000","last_active":"2024-09-14T11:51:07.172559+0000","last_peered":"2024-09-14T11:51:07.172559+0000","last_clean":"2024-09-14T11:51:07.172559+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:51:07.172559+0000","last_undegraded":"2024-09-14T11:51:07.172559+0000","last_fullsized":"2024-09-14T11:51:07.172559+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:34.511950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'217","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.660601+0000","last_change":"2024-09-14T11:11:04.664423+0000","last_active":"2024-09-14T11:52:44.660601+0000","last_peered":"2024-09-14T11:52:44.660601+0000","last_clean":"2024-09-14T11:52:44.660601+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:52:44.660601+0000","last_undegraded":"2024-09-14T11:52:44.660601+0000","last_fullsized":"2024-09-14T11:52:44.660601+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:00.472044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":70473,"num_write":980,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'495","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172878+0000","last_change":"2024-09-14T11:11:06.646675+0000","last_active":"2024-09-14T11:51:07.172878+0000","last_peered":"2024-09-14T11:51:07.172878+0000","last_clean":"2024-09-14T11:51:07.172878+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:51:07.172878+0000","last_undegraded":"2024-09-14T11:51:07.172878+0000","last_fullsized":"2024-09-14T11:51:07.172878+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:56.132334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'224","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.489379+0000","last_change":"2024-09-14T11:11:04.667849+0000","last_active":"2024-09-14T11:52:44.489379+0000","last_peered":"2024-09-14T11:52:44.489379+0000","last_clean":"2024-09-14T11:52:44.489379+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:52:44.489379+0000","last_undegraded":"2024-09-14T11:52:44.489379+0000","last_fullsized":"2024-09-14T11:52:44.489379+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:54.984709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":632,"num_read_kb":10774,"num_write":1050,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'701","reported_seq":2124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172528+0000","last_change":"2024-09-14T11:11:06.661372+0000","last_active":"2024-09-14T11:51:07.172528+0000","last_peered":"2024-09-14T11:51:07.172528+0000","last_clean":"2024-09-14T11:51:07.172528+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:51:07.172528+0000","last_undegraded":"2024-09-14T11:51:07.172528+0000","last_fullsized":"2024-09-14T11:51:07.172528+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:52.380188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'235","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.617597+0000","last_change":"2024-09-14T11:11:04.640592+0000","last_active":"2024-09-14T11:52:44.617597+0000","last_peered":"2024-09-14T11:52:44.617597+0000","last_clean":"2024-09-14T11:52:44.617597+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:52:44.617597+0000","last_undegraded":"2024-09-14T11:52:44.617597+0000","last_fullsized":"2024-09-14T11:52:44.617597+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:02.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1301,"num_read_kb":98345,"num_write":1096,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'780","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845369+0000","last_change":"2024-09-14T11:11:06.661394+0000","last_active":"2024-09-14T11:51:21.845369+0000","last_peered":"2024-09-14T11:51:21.845369+0000","last_clean":"2024-09-14T11:51:21.845369+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:51:21.845369+0000","last_undegraded":"2024-09-14T11:51:21.845369+0000","last_fullsized":"2024-09-14T11:51:21.845369+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.407677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'845","reported_seq":2375,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444047+0000","last_change":"2024-09-14T11:11:06.647432+0000","last_active":"2024-09-14T11:52:36.444047+0000","last_peered":"2024-09-14T11:52:36.444047+0000","last_clean":"2024-09-14T11:52:36.444047+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:52:36.444047+0000","last_undegraded":"2024-09-14T11:52:36.444047+0000","last_fullsized":"2024-09-14T11:52:36.444047+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:37.920539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'237","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.637737+0000","last_change":"2024-09-14T11:11:04.664149+0000","last_active":"2024-09-14T11:52:44.637737+0000","last_peered":"2024-09-14T11:52:44.637737+0000","last_clean":"2024-09-14T11:52:44.637737+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:52:44.637737+0000","last_undegraded":"2024-09-14T11:52:44.637737+0000","last_fullsized":"2024-09-14T11:52:44.637737+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:28.501517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":29179,"num_write":1120,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.884906+0000","last_change":"2024-09-14T11:11:06.659339+0000","last_active":"2024-09-14T11:51:07.884906+0000","last_peered":"2024-09-14T11:51:07.884906+0000","last_clean":"2024-09-14T11:51:07.884906+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:51:07.884906+0000","last_undegraded":"2024-09-14T11:51:07.884906+0000","last_fullsized":"2024-09-14T11:51:07.884906+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:19.866507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.712248+0000","last_change":"2024-09-14T11:11:04.664561+0000","last_active":"2024-09-14T11:52:44.712248+0000","last_peered":"2024-09-14T11:52:44.712248+0000","last_clean":"2024-09-14T11:52:44.712248+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:52:44.712248+0000","last_undegraded":"2024-09-14T11:52:44.712248+0000","last_fullsized":"2024-09-14T11:52:44.712248+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:18.906199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":818,"num_read_kb":241766,"num_write":938,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'516","reported_seq":2216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.877314+0000","last_change":"2024-09-14T11:11:06.656279+0000","last_active":"2024-09-14T11:51:07.877314+0000","last_peered":"2024-09-14T11:51:07.877314+0000","last_clean":"2024-09-14T11:51:07.877314+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:51:07.877314+0000","last_undegraded":"2024-09-14T11:51:07.877314+0000","last_fullsized":"2024-09-14T11:51:07.877314+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:24.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'271","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.603349+0000","last_change":"2024-09-14T11:11:04.661546+0000","last_active":"2024-09-14T11:52:44.603349+0000","last_peered":"2024-09-14T11:52:44.603349+0000","last_clean":"2024-09-14T11:52:44.603349+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:52:44.603349+0000","last_undegraded":"2024-09-14T11:52:44.603349+0000","last_fullsized":"2024-09-14T11:52:44.603349+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:24.019669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":32324,"num_write":1007,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'857","reported_seq":2392,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316678+0000","last_change":"2024-09-14T11:11:06.659835+0000","last_active":"2024-09-14T11:51:21.316678+0000","last_peered":"2024-09-14T11:51:21.316678+0000","last_clean":"2024-09-14T11:51:21.316678+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:51:21.316678+0000","last_undegraded":"2024-09-14T11:51:21.316678+0000","last_fullsized":"2024-09-14T11:51:21.316678+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.436038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'237","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.610258+0000","last_change":"2024-09-14T11:11:04.651670+0000","last_active":"2024-09-14T11:52:44.610258+0000","last_peered":"2024-09-14T11:52:44.610258+0000","last_clean":"2024-09-14T11:52:44.610258+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:52:44.610258+0000","last_undegraded":"2024-09-14T11:52:44.610258+0000","last_fullsized":"2024-09-14T11:52:44.610258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:12.731774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":18423,"num_write":1039,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1027","reported_seq":2679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746607+0000","last_change":"2024-09-14T11:11:06.659366+0000","last_active":"2024-09-14T11:51:08.746607+0000","last_peered":"2024-09-14T11:51:08.746607+0000","last_clean":"2024-09-14T11:51:08.746607+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:51:08.746607+0000","last_undegraded":"2024-09-14T11:51:08.746607+0000","last_fullsized":"2024-09-14T11:51:08.746607+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1000,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:22.893626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'208","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.413211+0000","last_change":"2024-09-14T11:11:04.656617+0000","last_active":"2024-09-14T11:52:44.413211+0000","last_peered":"2024-09-14T11:52:44.413211+0000","last_clean":"2024-09-14T11:52:44.413211+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:52:44.413211+0000","last_undegraded":"2024-09-14T11:52:44.413211+0000","last_fullsized":"2024-09-14T11:52:44.413211+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":19801,"num_write":945,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'477","reported_seq":2041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172995+0000","last_change":"2024-09-14T11:11:06.651961+0000","last_active":"2024-09-14T11:51:07.172995+0000","last_peered":"2024-09-14T11:51:07.172995+0000","last_clean":"2024-09-14T11:51:07.172995+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:51:07.172995+0000","last_undegraded":"2024-09-14T11:51:07.172995+0000","last_fullsized":"2024-09-14T11:51:07.172995+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:22.258915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'231","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.394813+0000","last_change":"2024-09-14T11:11:04.655697+0000","last_active":"2024-09-14T11:52:44.394813+0000","last_peered":"2024-09-14T11:52:44.394813+0000","last_clean":"2024-09-14T11:52:44.394813+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:52:44.394813+0000","last_undegraded":"2024-09-14T11:52:44.394813+0000","last_fullsized":"2024-09-14T11:52:44.394813+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:15.626721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1266,"num_read_kb":11303,"num_write":1123,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'134","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.905769+0000","last_change":"2024-09-14T11:11:14.694441+0000","last_active":"2024-09-14T11:51:21.905769+0000","last_peered":"2024-09-14T11:51:21.905769+0000","last_clean":"2024-09-14T11:51:21.905769+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:51:21.905769+0000","last_undegraded":"2024-09-14T11:51:21.905769+0000","last_fullsized":"2024-09-14T11:51:21.905769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:00.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'942","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.164829+0000","last_change":"2024-09-14T11:11:06.652516+0000","last_active":"2024-09-14T11:51:07.164829+0000","last_peered":"2024-09-14T11:51:07.164829+0000","last_clean":"2024-09-14T11:51:07.164829+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:51:07.164829+0000","last_undegraded":"2024-09-14T11:51:07.164829+0000","last_fullsized":"2024-09-14T11:51:07.164829+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":900,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:57.934785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'233","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.457968+0000","last_change":"2024-09-14T11:11:04.656642+0000","last_active":"2024-09-14T11:52:44.457968+0000","last_peered":"2024-09-14T11:52:44.457968+0000","last_clean":"2024-09-14T11:52:44.457968+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:52:44.457968+0000","last_undegraded":"2024-09-14T11:52:44.457968+0000","last_fullsized":"2024-09-14T11:52:44.457968+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:50.939065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368206,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":732,"num_read_kb":7795,"num_write":1213,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.089256+0000","last_change":"2024-09-14T11:11:08.656138+0000","last_active":"2024-09-14T11:52:44.089256+0000","last_peered":"2024-09-14T11:52:44.089256+0000","last_clean":"2024-09-14T11:52:44.089256+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:52:44.089256+0000","last_undegraded":"2024-09-14T11:52:44.089256+0000","last_fullsized":"2024-09-14T11:52:44.089256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:46.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'191","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.590375+0000","last_change":"2024-09-14T11:11:10.669375+0000","last_active":"2024-09-14T11:52:44.590375+0000","last_peered":"2024-09-14T11:52:44.590375+0000","last_clean":"2024-09-14T11:52:44.590375+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:52:44.590375+0000","last_undegraded":"2024-09-14T11:52:44.590375+0000","last_fullsized":"2024-09-14T11:52:44.590375+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:40.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":349,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045436+0000","last_change":"2024-09-14T11:11:12.678656+0000","last_active":"2024-09-14T11:49:54.045436+0000","last_peered":"2024-09-14T11:49:54.045436+0000","last_clean":"2024-09-14T11:49:54.045436+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:49:54.045436+0000","last_undegraded":"2024-09-14T11:49:54.045436+0000","last_fullsized":"2024-09-14T11:49:54.045436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:17.903974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2494","reported_seq":4314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.904000+0000","last_change":"2024-09-14T11:11:14.691811+0000","last_active":"2024-09-14T11:51:21.904000+0000","last_peered":"2024-09-14T11:51:21.904000+0000","last_clean":"2024-09-14T11:51:21.904000+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:51:21.904000+0000","last_undegraded":"2024-09-14T11:51:21.904000+0000","last_fullsized":"2024-09-14T11:51:21.904000+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.391799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'506","reported_seq":2070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845475+0000","last_change":"2024-09-14T11:11:06.653951+0000","last_active":"2024-09-14T11:51:21.845475+0000","last_peered":"2024-09-14T11:51:21.845475+0000","last_clean":"2024-09-14T11:51:21.845475+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:51:21.845475+0000","last_undegraded":"2024-09-14T11:51:21.845475+0000","last_fullsized":"2024-09-14T11:51:21.845475+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:23.277940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'190","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.519608+0000","last_change":"2024-09-14T11:11:04.658016+0000","last_active":"2024-09-14T11:52:44.519608+0000","last_peered":"2024-09-14T11:52:44.519608+0000","last_clean":"2024-09-14T11:52:44.519608+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:52:44.519608+0000","last_undegraded":"2024-09-14T11:52:44.519608+0000","last_fullsized":"2024-09-14T11:52:44.519608+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.325176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":11633,"num_write":915,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915492+0000","last_change":"2024-09-14T11:11:08.651536+0000","last_active":"2024-09-14T11:48:38.915492+0000","last_peered":"2024-09-14T11:48:38.915492+0000","last_clean":"2024-09-14T11:48:38.915492+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:48:38.915492+0000","last_undegraded":"2024-09-14T11:48:38.915492+0000","last_fullsized":"2024-09-14T11:48:38.915492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:53.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'91","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.281938+0000","last_change":"2024-09-14T11:11:10.665667+0000","last_active":"2024-09-14T11:51:19.281938+0000","last_peered":"2024-09-14T11:51:19.281938+0000","last_clean":"2024-09-14T11:51:19.281938+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:51:19.281938+0000","last_undegraded":"2024-09-14T11:51:19.281938+0000","last_fullsized":"2024-09-14T11:51:19.281938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924491+0000","last_change":"2024-09-14T11:11:12.680761+0000","last_active":"2024-09-14T11:49:53.924491+0000","last_peered":"2024-09-14T11:49:53.924491+0000","last_clean":"2024-09-14T11:49:53.924491+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:49:53.924491+0000","last_undegraded":"2024-09-14T11:49:53.924491+0000","last_fullsized":"2024-09-14T11:49:53.924491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:43.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'123","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.339329+0000","last_change":"2024-09-14T11:11:14.689043+0000","last_active":"2024-09-14T11:50:55.339329+0000","last_peered":"2024-09-14T11:50:55.339329+0000","last_clean":"2024-09-14T11:50:55.339329+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:50:55.339329+0000","last_undegraded":"2024-09-14T11:50:55.339329+0000","last_fullsized":"2024-09-14T11:50:55.339329+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:04.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'391","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845324+0000","last_change":"2024-09-14T11:11:06.647241+0000","last_active":"2024-09-14T11:51:21.845324+0000","last_peered":"2024-09-14T11:51:21.845324+0000","last_clean":"2024-09-14T11:51:21.845324+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:51:21.845324+0000","last_undegraded":"2024-09-14T11:51:21.845324+0000","last_fullsized":"2024-09-14T11:51:21.845324+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:30.702772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":776,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.561003+0000","last_change":"2024-09-14T11:11:04.664751+0000","last_active":"2024-09-14T11:52:44.561003+0000","last_peered":"2024-09-14T11:52:44.561003+0000","last_clean":"2024-09-14T11:52:44.561003+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:52:44.561003+0000","last_undegraded":"2024-09-14T11:52:44.561003+0000","last_fullsized":"2024-09-14T11:52:44.561003+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:21.450319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":25054,"num_write":828,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925536+0000","last_change":"2024-09-14T11:11:08.651600+0000","last_active":"2024-09-14T11:49:48.925536+0000","last_peered":"2024-09-14T11:49:48.925536+0000","last_clean":"2024-09-14T11:49:48.925536+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:49:48.925536+0000","last_undegraded":"2024-09-14T11:49:48.925536+0000","last_fullsized":"2024-09-14T11:49:48.925536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.328934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'113","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.299521+0000","last_change":"2024-09-14T11:11:10.667489+0000","last_active":"2024-09-14T11:51:19.299521+0000","last_peered":"2024-09-14T11:51:19.299521+0000","last_clean":"2024-09-14T11:51:19.299521+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:51:19.299521+0000","last_undegraded":"2024-09-14T11:51:19.299521+0000","last_fullsized":"2024-09-14T11:51:19.299521+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:08.313976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'765","reported_seq":2151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.320355+0000","last_change":"2024-09-14T11:11:12.682478+0000","last_active":"2024-09-14T11:52:44.320355+0000","last_peered":"2024-09-14T11:52:44.320355+0000","last_clean":"2024-09-14T11:52:44.320355+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:52:44.320355+0000","last_undegraded":"2024-09-14T11:52:44.320355+0000","last_fullsized":"2024-09-14T11:52:44.320355+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:25.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'257","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.373071+0000","last_change":"2024-09-14T11:11:14.886604+0000","last_active":"2024-09-14T11:51:21.373071+0000","last_peered":"2024-09-14T11:51:21.373071+0000","last_clean":"2024-09-14T11:51:21.373071+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:51:21.373071+0000","last_undegraded":"2024-09-14T11:51:21.373071+0000","last_fullsized":"2024-09-14T11:51:21.373071+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:17.055065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'608","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845477+0000","last_change":"2024-09-14T11:11:06.655177+0000","last_active":"2024-09-14T11:51:21.845477+0000","last_peered":"2024-09-14T11:51:21.845477+0000","last_clean":"2024-09-14T11:51:21.845477+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:51:21.845477+0000","last_undegraded":"2024-09-14T11:51:21.845477+0000","last_fullsized":"2024-09-14T11:51:21.845477+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":500,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:23.592691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'257","reported_seq":969,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.661039+0000","last_change":"2024-09-14T11:11:04.660596+0000","last_active":"2024-09-14T11:52:44.661039+0000","last_peered":"2024-09-14T11:52:44.661039+0000","last_clean":"2024-09-14T11:52:44.661039+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:52:44.661039+0000","last_undegraded":"2024-09-14T11:52:44.661039+0000","last_fullsized":"2024-09-14T11:52:44.661039+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:08.025245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1223,"num_read_kb":9329,"num_write":1113,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.924083+0000","last_change":"2024-09-14T11:11:08.658911+0000","last_active":"2024-09-14T11:49:48.924083+0000","last_peered":"2024-09-14T11:49:48.924083+0000","last_clean":"2024-09-14T11:49:48.924083+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:49:48.924083+0000","last_undegraded":"2024-09-14T11:49:48.924083+0000","last_fullsized":"2024-09-14T11:49:48.924083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:43.590217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'116","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.522536+0000","last_change":"2024-09-14T11:11:10.883531+0000","last_active":"2024-09-14T11:52:44.522536+0000","last_peered":"2024-09-14T11:52:44.522536+0000","last_clean":"2024-09-14T11:52:44.522536+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:52:44.522536+0000","last_undegraded":"2024-09-14T11:52:44.522536+0000","last_fullsized":"2024-09-14T11:52:44.522536+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:37.652994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8244,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":211,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'819","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.324541+0000","last_change":"2024-09-14T11:11:12.683537+0000","last_active":"2024-09-14T11:52:44.324541+0000","last_peered":"2024-09-14T11:52:44.324541+0000","last_clean":"2024-09-14T11:52:44.324541+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:52:44.324541+0000","last_undegraded":"2024-09-14T11:52:44.324541+0000","last_fullsized":"2024-09-14T11:52:44.324541+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:38.308562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'475","reported_seq":2078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316625+0000","last_change":"2024-09-14T11:11:06.651830+0000","last_active":"2024-09-14T11:51:21.316625+0000","last_peered":"2024-09-14T11:51:21.316625+0000","last_clean":"2024-09-14T11:51:21.316625+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:51:21.316625+0000","last_undegraded":"2024-09-14T11:51:21.316625+0000","last_fullsized":"2024-09-14T11:51:21.316625+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:55.868674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'224","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.633371+0000","last_change":"2024-09-14T11:11:04.665193+0000","last_active":"2024-09-14T11:52:44.633371+0000","last_peered":"2024-09-14T11:52:44.633371+0000","last_clean":"2024-09-14T11:52:44.633371+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:52:44.633371+0000","last_undegraded":"2024-09-14T11:52:44.633371+0000","last_fullsized":"2024-09-14T11:52:44.633371+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:01.335563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079921,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":75141,"num_write":989,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.047547+0000","last_change":"2024-09-14T11:11:08.659594+0000","last_active":"2024-09-14T11:50:09.047547+0000","last_peered":"2024-09-14T11:50:09.047547+0000","last_clean":"2024-09-14T11:50:09.047547+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:50:09.047547+0000","last_undegraded":"2024-09-14T11:50:09.047547+0000","last_fullsized":"2024-09-14T11:50:09.047547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:14.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'203","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.619250+0000","last_change":"2024-09-14T11:11:10.883185+0000","last_active":"2024-09-14T11:52:44.619250+0000","last_peered":"2024-09-14T11:52:44.619250+0000","last_clean":"2024-09-14T11:52:44.619250+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:52:44.619250+0000","last_undegraded":"2024-09-14T11:52:44.619250+0000","last_fullsized":"2024-09-14T11:52:44.619250+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:41.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":357,"num_write":162,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922914+0000","last_change":"2024-09-14T11:11:12.678507+0000","last_active":"2024-09-14T11:49:28.922914+0000","last_peered":"2024-09-14T11:49:28.922914+0000","last_clean":"2024-09-14T11:49:28.922914+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:49:28.922914+0000","last_undegraded":"2024-09-14T11:49:28.922914+0000","last_fullsized":"2024-09-14T11:49:28.922914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:11.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'544","reported_seq":1345,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546676+0000","last_change":"2024-09-14T11:11:14.691810+0000","last_active":"2024-09-14T11:52:37.546676+0000","last_peered":"2024-09-14T11:52:37.546676+0000","last_clean":"2024-09-14T11:52:37.546676+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:52:37.546676+0000","last_undegraded":"2024-09-14T11:52:37.546676+0000","last_fullsized":"2024-09-14T11:52:37.546676+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:33.081563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'469","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892238+0000","last_change":"2024-09-14T11:11:06.650970+0000","last_active":"2024-09-14T11:51:03.892238+0000","last_peered":"2024-09-14T11:51:03.892238+0000","last_clean":"2024-09-14T11:51:03.892238+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:51:03.892238+0000","last_undegraded":"2024-09-14T11:51:03.892238+0000","last_fullsized":"2024-09-14T11:51:03.892238+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:08.200982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'226","reported_seq":889,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.616984+0000","last_change":"2024-09-14T11:11:04.653785+0000","last_active":"2024-09-14T11:52:44.616984+0000","last_peered":"2024-09-14T11:52:44.616984+0000","last_clean":"2024-09-14T11:52:44.616984+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:44.616984+0000","last_undegraded":"2024-09-14T11:52:44.616984+0000","last_fullsized":"2024-09-14T11:52:44.616984+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:13.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":64064,"num_write":1014,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032486+0000","last_change":"2024-09-14T11:11:08.650799+0000","last_active":"2024-09-14T11:50:09.032486+0000","last_peered":"2024-09-14T11:50:09.032486+0000","last_clean":"2024-09-14T11:50:09.032486+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:50:09.032486+0000","last_undegraded":"2024-09-14T11:50:09.032486+0000","last_fullsized":"2024-09-14T11:50:09.032486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:34.338293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'138","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.415386+0000","last_change":"2024-09-14T11:11:10.669181+0000","last_active":"2024-09-14T11:52:44.415386+0000","last_peered":"2024-09-14T11:52:44.415386+0000","last_clean":"2024-09-14T11:52:44.415386+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:52:44.415386+0000","last_undegraded":"2024-09-14T11:52:44.415386+0000","last_fullsized":"2024-09-14T11:52:44.415386+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:51.810244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":213,"num_write":84,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930561+0000","last_change":"2024-09-14T11:11:12.677186+0000","last_active":"2024-09-14T11:50:23.930561+0000","last_peered":"2024-09-14T11:50:23.930561+0000","last_clean":"2024-09-14T11:50:23.930561+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:50:23.930561+0000","last_undegraded":"2024-09-14T11:50:23.930561+0000","last_fullsized":"2024-09-14T11:50:23.930561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:15.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'120","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.217471+0000","last_change":"2024-09-14T11:11:14.693436+0000","last_active":"2024-09-14T11:51:19.217471+0000","last_peered":"2024-09-14T11:51:19.217471+0000","last_clean":"2024-09-14T11:51:19.217471+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:51:19.217471+0000","last_undegraded":"2024-09-14T11:51:19.217471+0000","last_fullsized":"2024-09-14T11:51:19.217471+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:36.190584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'378","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220246+0000","last_change":"2024-09-14T11:11:06.660214+0000","last_active":"2024-09-14T11:51:19.220246+0000","last_peered":"2024-09-14T11:51:19.220246+0000","last_clean":"2024-09-14T11:51:19.220246+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:51:19.220246+0000","last_undegraded":"2024-09-14T11:51:19.220246+0000","last_fullsized":"2024-09-14T11:51:19.220246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:34.858894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'225","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.698795+0000","last_change":"2024-09-14T11:11:04.668094+0000","last_active":"2024-09-14T11:52:44.698795+0000","last_peered":"2024-09-14T11:52:44.698795+0000","last_clean":"2024-09-14T11:52:44.698795+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:52:44.698795+0000","last_undegraded":"2024-09-14T11:52:44.698795+0000","last_fullsized":"2024-09-14T11:52:44.698795+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:01.155828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":542,"num_read_kb":106193,"num_write":937,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027228+0000","last_change":"2024-09-14T11:11:08.655858+0000","last_active":"2024-09-14T11:49:24.027228+0000","last_peered":"2024-09-14T11:49:24.027228+0000","last_clean":"2024-09-14T11:49:24.027228+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:49:24.027228+0000","last_undegraded":"2024-09-14T11:49:24.027228+0000","last_fullsized":"2024-09-14T11:49:24.027228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.623644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'159","reported_seq":734,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.643588+0000","last_change":"2024-09-14T11:11:10.670978+0000","last_active":"2024-09-14T11:52:44.643588+0000","last_peered":"2024-09-14T11:52:44.643588+0000","last_clean":"2024-09-14T11:52:44.643588+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:52:44.643588+0000","last_undegraded":"2024-09-14T11:52:44.643588+0000","last_fullsized":"2024-09-14T11:52:44.643588+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:50.765426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":261,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'774","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.325789+0000","last_change":"2024-09-14T11:11:12.682806+0000","last_active":"2024-09-14T11:52:44.325789+0000","last_peered":"2024-09-14T11:52:44.325789+0000","last_clean":"2024-09-14T11:52:44.325789+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:52:44.325789+0000","last_undegraded":"2024-09-14T11:52:44.325789+0000","last_fullsized":"2024-09-14T11:52:44.325789+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:25.160041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.385498+0000","last_change":"2024-09-14T11:11:14.691211+0000","last_active":"2024-09-14T11:52:36.385498+0000","last_peered":"2024-09-14T11:52:36.385498+0000","last_clean":"2024-09-14T11:52:36.385498+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:52:36.385498+0000","last_undegraded":"2024-09-14T11:52:36.385498+0000","last_fullsized":"2024-09-14T11:52:36.385498+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:53.737487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'567","reported_seq":2331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746198+0000","last_change":"2024-09-14T11:11:06.650873+0000","last_active":"2024-09-14T11:51:08.746198+0000","last_peered":"2024-09-14T11:51:08.746198+0000","last_clean":"2024-09-14T11:51:08.746198+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:51:08.746198+0000","last_undegraded":"2024-09-14T11:51:08.746198+0000","last_fullsized":"2024-09-14T11:51:08.746198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:08.434480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'207","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.641792+0000","last_change":"2024-09-14T11:11:04.660578+0000","last_active":"2024-09-14T11:52:44.641792+0000","last_peered":"2024-09-14T11:52:44.641792+0000","last_clean":"2024-09-14T11:52:44.641792+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:52:44.641792+0000","last_undegraded":"2024-09-14T11:52:44.641792+0000","last_fullsized":"2024-09-14T11:52:44.641792+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:17.074637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":32215,"num_write":875,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033264+0000","last_change":"2024-09-14T11:11:08.657835+0000","last_active":"2024-09-14T11:50:14.033264+0000","last_peered":"2024-09-14T11:50:14.033264+0000","last_clean":"2024-09-14T11:50:14.033264+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:50:14.033264+0000","last_undegraded":"2024-09-14T11:50:14.033264+0000","last_fullsized":"2024-09-14T11:50:14.033264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:05.975239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'190","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.676102+0000","last_change":"2024-09-14T11:11:10.668579+0000","last_active":"2024-09-14T11:52:44.676102+0000","last_peered":"2024-09-14T11:52:44.676102+0000","last_clean":"2024-09-14T11:52:44.676102+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:52:44.676102+0000","last_undegraded":"2024-09-14T11:52:44.676102+0000","last_fullsized":"2024-09-14T11:52:44.676102+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:33.675356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13546,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":273,"num_read_kb":390,"num_write":132,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033234+0000","last_change":"2024-09-14T11:11:12.682825+0000","last_active":"2024-09-14T11:50:14.033234+0000","last_peered":"2024-09-14T11:50:14.033234+0000","last_clean":"2024-09-14T11:50:14.033234+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:50:14.033234+0000","last_undegraded":"2024-09-14T11:50:14.033234+0000","last_fullsized":"2024-09-14T11:50:14.033234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.085965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'136","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.046297+0000","last_change":"2024-09-14T11:11:14.694759+0000","last_active":"2024-09-14T11:51:20.046297+0000","last_peered":"2024-09-14T11:51:20.046297+0000","last_clean":"2024-09-14T11:51:20.046297+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:51:20.046297+0000","last_undegraded":"2024-09-14T11:51:20.046297+0000","last_fullsized":"2024-09-14T11:51:20.046297+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:34.568185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'810","reported_seq":2363,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892524+0000","last_change":"2024-09-14T11:11:06.652129+0000","last_active":"2024-09-14T11:51:03.892524+0000","last_peered":"2024-09-14T11:51:03.892524+0000","last_clean":"2024-09-14T11:51:03.892524+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:51:03.892524+0000","last_undegraded":"2024-09-14T11:51:03.892524+0000","last_fullsized":"2024-09-14T11:51:03.892524+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.890024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'187","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.661056+0000","last_change":"2024-09-14T11:11:37.865182+0000","last_active":"2024-09-14T11:52:44.661056+0000","last_peered":"2024-09-14T11:52:44.661056+0000","last_clean":"2024-09-14T11:52:44.661056+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:52:44.661056+0000","last_undegraded":"2024-09-14T11:52:44.661056+0000","last_fullsized":"2024-09-14T11:52:44.661056+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:29.726878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":535,"num_read_kb":54806,"num_write":892,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027253+0000","last_change":"2024-09-14T11:11:08.653918+0000","last_active":"2024-09-14T11:49:24.027253+0000","last_peered":"2024-09-14T11:49:24.027253+0000","last_clean":"2024-09-14T11:49:24.027253+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:49:24.027253+0000","last_undegraded":"2024-09-14T11:49:24.027253+0000","last_fullsized":"2024-09-14T11:49:24.027253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:12.531488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'138","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.449724+0000","last_change":"2024-09-14T11:11:10.665945+0000","last_active":"2024-09-14T11:52:44.449724+0000","last_peered":"2024-09-14T11:52:44.449724+0000","last_clean":"2024-09-14T11:52:44.449724+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:52:44.449724+0000","last_undegraded":"2024-09-14T11:52:44.449724+0000","last_fullsized":"2024-09-14T11:52:44.449724+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5347,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":234,"num_write":162,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.924548+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:49:38.924548+0000","last_peered":"2024-09-14T11:49:38.924548+0000","last_clean":"2024-09-14T11:49:38.924548+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:49:38.924548+0000","last_undegraded":"2024-09-14T11:49:38.924548+0000","last_fullsized":"2024-09-14T11:49:38.924548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:21.465336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938149+0000","last_change":"2024-09-14T11:11:14.690952+0000","last_active":"2024-09-14T11:51:23.938149+0000","last_peered":"2024-09-14T11:51:23.938149+0000","last_clean":"2024-09-14T11:51:23.938149+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:51:23.938149+0000","last_undegraded":"2024-09-14T11:51:23.938149+0000","last_fullsized":"2024-09-14T11:51:23.938149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:31.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'616","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444129+0000","last_change":"2024-09-14T11:11:06.651982+0000","last_active":"2024-09-14T11:52:36.444129+0000","last_peered":"2024-09-14T11:52:36.444129+0000","last_clean":"2024-09-14T11:52:36.444129+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:36.444129+0000","last_undegraded":"2024-09-14T11:52:36.444129+0000","last_fullsized":"2024-09-14T11:52:36.444129+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:10.685569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'217","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.037233+0000","last_change":"2024-09-14T11:11:37.866224+0000","last_active":"2024-09-14T11:50:44.037233+0000","last_peered":"2024-09-14T11:50:44.037233+0000","last_clean":"2024-09-14T11:50:44.037233+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:50:44.037233+0000","last_undegraded":"2024-09-14T11:50:44.037233+0000","last_fullsized":"2024-09-14T11:50:44.037233+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:52.787000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1166,"num_read_kb":81327,"num_write":1108,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922198+0000","last_change":"2024-09-14T11:11:08.657858+0000","last_active":"2024-09-14T11:49:23.922198+0000","last_peered":"2024-09-14T11:49:23.922198+0000","last_clean":"2024-09-14T11:49:23.922198+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:49:23.922198+0000","last_undegraded":"2024-09-14T11:49:23.922198+0000","last_fullsized":"2024-09-14T11:49:23.922198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:46.337725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'189","reported_seq":767,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.382663+0000","last_change":"2024-09-14T11:11:10.669699+0000","last_active":"2024-09-14T11:52:44.382663+0000","last_peered":"2024-09-14T11:52:44.382663+0000","last_clean":"2024-09-14T11:52:44.382663+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:52:44.382663+0000","last_undegraded":"2024-09-14T11:52:44.382663+0000","last_fullsized":"2024-09-14T11:52:44.382663+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:05.013360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8518,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":257,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'750","reported_seq":2409,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.321503+0000","last_change":"2024-09-14T11:11:12.680262+0000","last_active":"2024-09-14T11:52:44.321503+0000","last_peered":"2024-09-14T11:52:44.321503+0000","last_clean":"2024-09-14T11:52:44.321503+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:52:44.321503+0000","last_undegraded":"2024-09-14T11:52:44.321503+0000","last_fullsized":"2024-09-14T11:52:44.321503+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:15.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'112","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.672032+0000","last_change":"2024-09-14T11:11:14.694188+0000","last_active":"2024-09-14T11:51:21.672032+0000","last_peered":"2024-09-14T11:51:21.672032+0000","last_clean":"2024-09-14T11:51:21.672032+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:51:21.672032+0000","last_undegraded":"2024-09-14T11:51:21.672032+0000","last_fullsized":"2024-09-14T11:51:21.672032+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:45.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.438948+0000","last_change":"2024-09-14T11:11:06.655465+0000","last_active":"2024-09-14T11:52:36.438948+0000","last_peered":"2024-09-14T11:52:36.438948+0000","last_clean":"2024-09-14T11:52:36.438948+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:52:36.438948+0000","last_undegraded":"2024-09-14T11:52:36.438948+0000","last_fullsized":"2024-09-14T11:52:36.438948+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:40.046089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'215","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.459950+0000","last_change":"2024-09-14T11:11:04.650554+0000","last_active":"2024-09-14T11:52:44.459950+0000","last_peered":"2024-09-14T11:52:44.459950+0000","last_clean":"2024-09-14T11:52:44.459950+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:44.459950+0000","last_undegraded":"2024-09-14T11:52:44.459950+0000","last_fullsized":"2024-09-14T11:52:44.459950+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:21.487349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":783,"num_read_kb":15229,"num_write":1055,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.099299+0000","last_change":"2024-09-14T11:11:08.657746+0000","last_active":"2024-09-14T11:52:44.099299+0000","last_peered":"2024-09-14T11:52:44.099299+0000","last_clean":"2024-09-14T11:52:44.099299+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:52:44.099299+0000","last_undegraded":"2024-09-14T11:52:44.099299+0000","last_fullsized":"2024-09-14T11:52:44.099299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:46.646901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'65","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.268760+0000","last_change":"2024-09-14T11:11:10.883189+0000","last_active":"2024-09-14T11:51:19.268760+0000","last_peered":"2024-09-14T11:51:19.268760+0000","last_clean":"2024-09-14T11:51:19.268760+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:51:19.268760+0000","last_undegraded":"2024-09-14T11:51:19.268760+0000","last_fullsized":"2024-09-14T11:51:19.268760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:23.532287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'768","reported_seq":2418,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.322478+0000","last_change":"2024-09-14T11:11:12.682993+0000","last_active":"2024-09-14T11:52:44.322478+0000","last_peered":"2024-09-14T11:52:44.322478+0000","last_clean":"2024-09-14T11:52:44.322478+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:52:44.322478+0000","last_undegraded":"2024-09-14T11:52:44.322478+0000","last_fullsized":"2024-09-14T11:52:44.322478+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:56.550659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:57.800307+0000","last_change":"2024-09-14T11:11:14.697448+0000","last_active":"2024-09-14T11:50:57.800307+0000","last_peered":"2024-09-14T11:50:57.800307+0000","last_clean":"2024-09-14T11:50:57.800307+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:50:57.800307+0000","last_undegraded":"2024-09-14T11:50:57.800307+0000","last_fullsized":"2024-09-14T11:50:57.800307+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220492+0000","last_change":"2024-09-14T11:11:06.661084+0000","last_active":"2024-09-14T11:51:19.220492+0000","last_peered":"2024-09-14T11:51:19.220492+0000","last_clean":"2024-09-14T11:51:19.220492+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:51:19.220492+0000","last_undegraded":"2024-09-14T11:51:19.220492+0000","last_fullsized":"2024-09-14T11:51:19.220492+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:51.729421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'201","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.660302+0000","last_change":"2024-09-14T11:11:04.652428+0000","last_active":"2024-09-14T11:52:44.660302+0000","last_peered":"2024-09-14T11:52:44.660302+0000","last_clean":"2024-09-14T11:52:44.660302+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:52:44.660302+0000","last_undegraded":"2024-09-14T11:52:44.660302+0000","last_fullsized":"2024-09-14T11:52:44.660302+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:16.387464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":47606,"num_write":839,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920747+0000","last_change":"2024-09-14T11:11:08.651170+0000","last_active":"2024-09-14T11:49:23.920747+0000","last_peered":"2024-09-14T11:49:23.920747+0000","last_clean":"2024-09-14T11:49:23.920747+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:49:23.920747+0000","last_undegraded":"2024-09-14T11:49:23.920747+0000","last_fullsized":"2024-09-14T11:49:23.920747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'223","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.598981+0000","last_change":"2024-09-14T11:11:10.671679+0000","last_active":"2024-09-14T11:52:44.598981+0000","last_peered":"2024-09-14T11:52:44.598981+0000","last_clean":"2024-09-14T11:52:44.598981+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:52:44.598981+0000","last_undegraded":"2024-09-14T11:52:44.598981+0000","last_fullsized":"2024-09-14T11:52:44.598981+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26161,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":914,"num_read_kb":1030,"num_write":1436,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.915519+0000","last_change":"2024-09-14T11:11:12.685335+0000","last_active":"2024-09-14T11:49:28.915519+0000","last_peered":"2024-09-14T11:49:28.915519+0000","last_clean":"2024-09-14T11:49:28.915519+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:49:28.915519+0000","last_undegraded":"2024-09-14T11:49:28.915519+0000","last_fullsized":"2024-09-14T11:49:28.915519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:34.384085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'111","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.714149+0000","last_change":"2024-09-14T11:11:14.691254+0000","last_active":"2024-09-14T11:50:29.714149+0000","last_peered":"2024-09-14T11:50:29.714149+0000","last_clean":"2024-09-14T11:50:29.714149+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:50:29.714149+0000","last_undegraded":"2024-09-14T11:50:29.714149+0000","last_fullsized":"2024-09-14T11:50:29.714149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:56.985594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1861,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.216524+0000","last_change":"2024-09-14T11:11:06.652040+0000","last_active":"2024-09-14T11:51:02.216524+0000","last_peered":"2024-09-14T11:51:02.216524+0000","last_clean":"2024-09-14T11:51:02.216524+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:51:02.216524+0000","last_undegraded":"2024-09-14T11:51:02.216524+0000","last_fullsized":"2024-09-14T11:51:02.216524+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:46.498291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:54.037135+0000","last_change":"2024-09-14T11:10:45.305816+0000","last_active":"2024-09-14T11:48:54.037135+0000","last_peered":"2024-09-14T11:48:54.037135+0000","last_clean":"2024-09-14T11:48:54.037135+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:48:54.037135+0000","last_undegraded":"2024-09-14T11:48:54.037135+0000","last_fullsized":"2024-09-14T11:48:54.037135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:44.296214+0000","last_clean_scrub_stamp":"2024-09-14T11:10:44.296214+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:18.092025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929313+0000","last_change":"2024-09-14T11:10:53.345181+0000","last_active":"2024-09-14T11:50:28.929313+0000","last_peered":"2024-09-14T11:50:28.929313+0000","last_clean":"2024-09-14T11:50:28.929313+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:50:28.929313+0000","last_undegraded":"2024-09-14T11:50:28.929313+0000","last_fullsized":"2024-09-14T11:50:28.929313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:24.937001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.588554+0000","last_change":"2024-09-14T11:11:04.653542+0000","last_active":"2024-09-14T11:52:44.588554+0000","last_peered":"2024-09-14T11:52:44.588554+0000","last_clean":"2024-09-14T11:52:44.588554+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:52:44.588554+0000","last_undegraded":"2024-09-14T11:52:44.588554+0000","last_fullsized":"2024-09-14T11:52:44.588554+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:12.899497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1045,"num_read_kb":764,"num_write":1140,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:44.053167+0000","last_change":"2024-09-14T11:11:08.651808+0000","last_active":"2024-09-14T11:50:44.053167+0000","last_peered":"2024-09-14T11:50:44.053167+0000","last_clean":"2024-09-14T11:50:44.053167+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:50:44.053167+0000","last_undegraded":"2024-09-14T11:50:44.053167+0000","last_fullsized":"2024-09-14T11:50:44.053167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:02.176317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'324","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.721714+0000","last_change":"2024-09-14T11:11:10.671108+0000","last_active":"2024-09-14T11:52:44.721714+0000","last_peered":"2024-09-14T11:52:44.721714+0000","last_clean":"2024-09-14T11:52:44.721714+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:52:44.721714+0000","last_undegraded":"2024-09-14T11:52:44.721714+0000","last_fullsized":"2024-09-14T11:52:44.721714+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:12.563174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134988,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":1074,"num_write":544,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929432+0000","last_change":"2024-09-14T11:11:12.679614+0000","last_active":"2024-09-14T11:50:13.929432+0000","last_peered":"2024-09-14T11:50:13.929432+0000","last_clean":"2024-09-14T11:50:13.929432+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:50:13.929432+0000","last_undegraded":"2024-09-14T11:50:13.929432+0000","last_fullsized":"2024-09-14T11:50:13.929432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:26.539650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'194","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.853045+0000","last_change":"2024-09-14T11:11:14.691705+0000","last_active":"2024-09-14T11:51:21.853045+0000","last_peered":"2024-09-14T11:51:21.853045+0000","last_clean":"2024-09-14T11:51:21.853045+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:51:21.853045+0000","last_undegraded":"2024-09-14T11:51:21.853045+0000","last_fullsized":"2024-09-14T11:51:21.853045+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:32.101457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'446","reported_seq":2093,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316797+0000","last_change":"2024-09-14T11:11:06.653878+0000","last_active":"2024-09-14T11:51:21.316797+0000","last_peered":"2024-09-14T11:51:21.316797+0000","last_clean":"2024-09-14T11:51:21.316797+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:51:21.316797+0000","last_undegraded":"2024-09-14T11:51:21.316797+0000","last_fullsized":"2024-09-14T11:51:21.316797+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:53.257705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:59.037939+0000","last_change":"2024-09-14T11:10:53.603361+0000","last_active":"2024-09-14T11:48:59.037939+0000","last_peered":"2024-09-14T11:48:59.037939+0000","last_clean":"2024-09-14T11:48:59.037939+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:48:59.037939+0000","last_undegraded":"2024-09-14T11:48:59.037939+0000","last_fullsized":"2024-09-14T11:48:59.037939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:52.779908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'230","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.561036+0000","last_change":"2024-09-14T11:11:04.647226+0000","last_active":"2024-09-14T11:52:44.561036+0000","last_peered":"2024-09-14T11:52:44.561036+0000","last_clean":"2024-09-14T11:52:44.561036+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:44.561036+0000","last_undegraded":"2024-09-14T11:52:44.561036+0000","last_fullsized":"2024-09-14T11:52:44.561036+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:42.012243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":610,"num_read_kb":5636,"num_write":1050,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.926741+0000","last_change":"2024-09-14T11:11:08.653354+0000","last_active":"2024-09-14T11:50:08.926741+0000","last_peered":"2024-09-14T11:50:08.926741+0000","last_clean":"2024-09-14T11:50:08.926741+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:50:08.926741+0000","last_undegraded":"2024-09-14T11:50:08.926741+0000","last_fullsized":"2024-09-14T11:50:08.926741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:02.387161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'860","reported_seq":2290,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.605817+0000","last_change":"2024-09-14T11:11:10.668218+0000","last_active":"2024-09-14T11:52:44.605817+0000","last_peered":"2024-09-14T11:52:44.605817+0000","last_clean":"2024-09-14T11:52:44.605817+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:52:44.605817+0000","last_undegraded":"2024-09-14T11:52:44.605817+0000","last_fullsized":"2024-09-14T11:52:44.605817+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:48.390587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20878,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1373,"num_write":272,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:49.036418+0000","last_change":"2024-09-14T11:11:12.677600+0000","last_active":"2024-09-14T11:48:49.036418+0000","last_peered":"2024-09-14T11:48:49.036418+0000","last_clean":"2024-09-14T11:48:49.036418+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:48:49.036418+0000","last_undegraded":"2024-09-14T11:48:49.036418+0000","last_fullsized":"2024-09-14T11:48:49.036418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:05.483584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'130","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.325684+0000","last_change":"2024-09-14T11:11:14.883766+0000","last_active":"2024-09-14T11:51:21.325684+0000","last_peered":"2024-09-14T11:51:21.325684+0000","last_clean":"2024-09-14T11:51:21.325684+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:51:21.325684+0000","last_undegraded":"2024-09-14T11:51:21.325684+0000","last_fullsized":"2024-09-14T11:51:21.325684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:47.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'426","reported_seq":1905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179728+0000","last_change":"2024-09-14T11:11:06.661418+0000","last_active":"2024-09-14T11:51:05.179728+0000","last_peered":"2024-09-14T11:51:05.179728+0000","last_clean":"2024-09-14T11:51:05.179728+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:51:05.179728+0000","last_undegraded":"2024-09-14T11:51:05.179728+0000","last_fullsized":"2024-09-14T11:51:05.179728+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:21.916202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.035176+0000","last_change":"2024-09-14T11:10:53.338879+0000","last_active":"2024-09-14T11:50:29.035176+0000","last_peered":"2024-09-14T11:50:29.035176+0000","last_clean":"2024-09-14T11:50:29.035176+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:50:29.035176+0000","last_undegraded":"2024-09-14T11:50:29.035176+0000","last_fullsized":"2024-09-14T11:50:29.035176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:21.220428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'208","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.672573+0000","last_change":"2024-09-14T11:11:04.650254+0000","last_active":"2024-09-14T11:52:44.672573+0000","last_peered":"2024-09-14T11:52:44.672573+0000","last_clean":"2024-09-14T11:52:44.672573+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:52:44.672573+0000","last_undegraded":"2024-09-14T11:52:44.672573+0000","last_fullsized":"2024-09-14T11:52:44.672573+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:24.467276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":52749,"num_write":993,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.032552+0000","last_change":"2024-09-14T11:11:08.653735+0000","last_active":"2024-09-14T11:50:09.032552+0000","last_peered":"2024-09-14T11:50:09.032552+0000","last_clean":"2024-09-14T11:50:09.032552+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:50:09.032552+0000","last_undegraded":"2024-09-14T11:50:09.032552+0000","last_fullsized":"2024-09-14T11:50:09.032552+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:27.550107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'219","reported_seq":1256,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.446104+0000","last_change":"2024-09-14T11:11:10.885665+0000","last_active":"2024-09-14T11:52:36.446104+0000","last_peered":"2024-09-14T11:52:36.446104+0000","last_clean":"2024-09-14T11:52:36.446104+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:52:36.446104+0000","last_undegraded":"2024-09-14T11:52:36.446104+0000","last_fullsized":"2024-09-14T11:52:36.446104+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:53.645745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915668+0000","last_change":"2024-09-14T11:11:12.679585+0000","last_active":"2024-09-14T11:48:43.915668+0000","last_peered":"2024-09-14T11:48:43.915668+0000","last_clean":"2024-09-14T11:48:43.915668+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:48:43.915668+0000","last_undegraded":"2024-09-14T11:48:43.915668+0000","last_fullsized":"2024-09-14T11:48:43.915668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:37.689890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'250","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.995575+0000","last_change":"2024-09-14T11:11:14.691912+0000","last_active":"2024-09-14T11:51:21.995575+0000","last_peered":"2024-09-14T11:51:21.995575+0000","last_clean":"2024-09-14T11:51:21.995575+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:51:21.995575+0000","last_undegraded":"2024-09-14T11:51:21.995575+0000","last_fullsized":"2024-09-14T11:51:21.995575+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:38.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'458","reported_seq":2043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:01.445511+0000","last_change":"2024-09-14T11:11:06.652932+0000","last_active":"2024-09-14T11:51:01.445511+0000","last_peered":"2024-09-14T11:51:01.445511+0000","last_clean":"2024-09-14T11:51:01.445511+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:51:01.445511+0000","last_undegraded":"2024-09-14T11:51:01.445511+0000","last_fullsized":"2024-09-14T11:51:01.445511+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:11.789080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.929286+0000","last_change":"2024-09-14T11:10:53.345818+0000","last_active":"2024-09-14T11:50:28.929286+0000","last_peered":"2024-09-14T11:50:28.929286+0000","last_clean":"2024-09-14T11:50:28.929286+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:50:28.929286+0000","last_undegraded":"2024-09-14T11:50:28.929286+0000","last_fullsized":"2024-09-14T11:50:28.929286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:38.953847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'183","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.948528+0000","last_change":"2024-09-14T11:11:04.652412+0000","last_active":"2024-09-14T11:52:43.948528+0000","last_peered":"2024-09-14T11:52:43.948528+0000","last_clean":"2024-09-14T11:52:43.948528+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:52:43.948528+0000","last_undegraded":"2024-09-14T11:52:43.948528+0000","last_fullsized":"2024-09-14T11:52:43.948528+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:20.305859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":11748,"num_write":873,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916639+0000","last_change":"2024-09-14T11:11:08.656266+0000","last_active":"2024-09-14T11:48:48.916639+0000","last_peered":"2024-09-14T11:48:48.916639+0000","last_clean":"2024-09-14T11:48:48.916639+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:48:48.916639+0000","last_undegraded":"2024-09-14T11:48:48.916639+0000","last_fullsized":"2024-09-14T11:48:48.916639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:58.330377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'126","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.946961+0000","last_change":"2024-09-14T11:11:10.668058+0000","last_active":"2024-09-14T11:52:23.946961+0000","last_peered":"2024-09-14T11:52:23.946961+0000","last_clean":"2024-09-14T11:52:23.946961+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:52:23.946961+0000","last_undegraded":"2024-09-14T11:52:23.946961+0000","last_fullsized":"2024-09-14T11:52:23.946961+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:05.286724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.921295+0000","last_change":"2024-09-14T11:11:12.681877+0000","last_active":"2024-09-14T11:50:13.921295+0000","last_peered":"2024-09-14T11:50:13.921295+0000","last_clean":"2024-09-14T11:50:13.921295+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:50:13.921295+0000","last_undegraded":"2024-09-14T11:50:13.921295+0000","last_fullsized":"2024-09-14T11:50:13.921295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:19.852022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.120129+0000","last_change":"2024-09-14T11:11:14.692245+0000","last_active":"2024-09-14T11:51:03.120129+0000","last_peered":"2024-09-14T11:51:03.120129+0000","last_clean":"2024-09-14T11:51:03.120129+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:51:03.120129+0000","last_undegraded":"2024-09-14T11:51:03.120129+0000","last_fullsized":"2024-09-14T11:51:03.120129+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:24.950841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.123039+0000","last_change":"2024-09-14T11:11:06.661346+0000","last_active":"2024-09-14T11:51:03.123039+0000","last_peered":"2024-09-14T11:51:03.123039+0000","last_clean":"2024-09-14T11:51:03.123039+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:51:03.123039+0000","last_undegraded":"2024-09-14T11:51:03.123039+0000","last_fullsized":"2024-09-14T11:51:03.123039+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:19.278263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'230","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.691241+0000","last_change":"2024-09-14T11:11:04.657514+0000","last_active":"2024-09-14T11:52:44.691241+0000","last_peered":"2024-09-14T11:52:44.691241+0000","last_clean":"2024-09-14T11:52:44.691241+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:52:44.691241+0000","last_undegraded":"2024-09-14T11:52:44.691241+0000","last_fullsized":"2024-09-14T11:52:44.691241+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:47.332379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":621,"num_read_kb":15435,"num_write":887,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:28.931026+0000","last_change":"2024-09-14T11:10:53.347529+0000","last_active":"2024-09-14T11:50:28.931026+0000","last_peered":"2024-09-14T11:50:28.931026+0000","last_clean":"2024-09-14T11:50:28.931026+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:50:28.931026+0000","last_undegraded":"2024-09-14T11:50:28.931026+0000","last_fullsized":"2024-09-14T11:50:28.931026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:42.594538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933157+0000","last_change":"2024-09-14T11:11:08.653119+0000","last_active":"2024-09-14T11:50:43.933157+0000","last_peered":"2024-09-14T11:50:43.933157+0000","last_clean":"2024-09-14T11:50:43.933157+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:50:43.933157+0000","last_undegraded":"2024-09-14T11:50:43.933157+0000","last_fullsized":"2024-09-14T11:50:43.933157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:46.444354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.541194+0000","last_change":"2024-09-14T11:11:10.670087+0000","last_active":"2024-09-14T11:52:44.541194+0000","last_peered":"2024-09-14T11:52:44.541194+0000","last_clean":"2024-09-14T11:52:44.541194+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:52:44.541194+0000","last_undegraded":"2024-09-14T11:52:44.541194+0000","last_fullsized":"2024-09-14T11:52:44.541194+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:50.318692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":423,"num_read_kb":619,"num_write":282,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914988+0000","last_change":"2024-09-14T11:11:12.679038+0000","last_active":"2024-09-14T11:48:43.914988+0000","last_peered":"2024-09-14T11:48:43.914988+0000","last_clean":"2024-09-14T11:48:43.914988+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:48:43.914988+0000","last_undegraded":"2024-09-14T11:48:43.914988+0000","last_fullsized":"2024-09-14T11:48:43.914988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:12.760716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'209","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.215679+0000","last_change":"2024-09-14T11:11:14.886549+0000","last_active":"2024-09-14T11:51:19.215679+0000","last_peered":"2024-09-14T11:51:19.215679+0000","last_clean":"2024-09-14T11:51:19.215679+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:51:19.215679+0000","last_undegraded":"2024-09-14T11:51:19.215679+0000","last_fullsized":"2024-09-14T11:51:19.215679+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:17.379453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'431","reported_seq":1932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.444072+0000","last_change":"2024-09-14T11:11:06.654715+0000","last_active":"2024-09-14T11:52:36.444072+0000","last_peered":"2024-09-14T11:52:36.444072+0000","last_clean":"2024-09-14T11:52:36.444072+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:36.444072+0000","last_undegraded":"2024-09-14T11:52:36.444072+0000","last_fullsized":"2024-09-14T11:52:36.444072+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:20.183803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'220","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.672961+0000","last_change":"2024-09-14T11:11:04.642737+0000","last_active":"2024-09-14T11:52:44.672961+0000","last_peered":"2024-09-14T11:52:44.672961+0000","last_clean":"2024-09-14T11:52:44.672961+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:52:44.672961+0000","last_undegraded":"2024-09-14T11:52:44.672961+0000","last_fullsized":"2024-09-14T11:52:44.672961+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:50.508714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":606,"num_read_kb":78521,"num_write":1035,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:34.051572+0000","last_change":"2024-09-14T11:10:53.603380+0000","last_active":"2024-09-14T11:50:34.051572+0000","last_peered":"2024-09-14T11:50:34.051572+0000","last_clean":"2024-09-14T11:50:34.051572+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:50:34.051572+0000","last_undegraded":"2024-09-14T11:50:34.051572+0000","last_fullsized":"2024-09-14T11:50:34.051572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.593299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.925637+0000","last_change":"2024-09-14T11:11:08.650994+0000","last_active":"2024-09-14T11:50:43.925637+0000","last_peered":"2024-09-14T11:50:43.925637+0000","last_clean":"2024-09-14T11:50:43.925637+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:50:43.925637+0000","last_undegraded":"2024-09-14T11:50:43.925637+0000","last_fullsized":"2024-09-14T11:50:43.925637+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:30.962646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'156","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.318854+0000","last_change":"2024-09-14T11:11:10.883309+0000","last_active":"2024-09-14T11:51:19.318854+0000","last_peered":"2024-09-14T11:51:19.318854+0000","last_clean":"2024-09-14T11:51:19.318854+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:51:19.318854+0000","last_undegraded":"2024-09-14T11:51:19.318854+0000","last_fullsized":"2024-09-14T11:51:19.318854+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:14.780666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":4888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.702234+0000","last_change":"2024-09-14T11:11:12.682874+0000","last_active":"2024-09-14T11:52:44.702234+0000","last_peered":"2024-09-14T11:52:44.702234+0000","last_clean":"2024-09-14T11:52:44.702234+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:52:44.702234+0000","last_undegraded":"2024-09-14T11:52:44.702234+0000","last_fullsized":"2024-09-14T11:52:44.702234+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.028768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'341","reported_seq":1706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179290+0000","last_change":"2024-09-14T11:11:37.864782+0000","last_active":"2024-09-14T11:51:05.179290+0000","last_peered":"2024-09-14T11:51:05.179290+0000","last_clean":"2024-09-14T11:51:05.179290+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:51:05.179290+0000","last_undegraded":"2024-09-14T11:51:05.179290+0000","last_fullsized":"2024-09-14T11:51:05.179290+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:39.779073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'297","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.687626+0000","last_change":"2024-09-14T11:11:04.646682+0000","last_active":"2024-09-14T11:52:44.687626+0000","last_peered":"2024-09-14T11:52:44.687626+0000","last_clean":"2024-09-14T11:52:44.687626+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:52:44.687626+0000","last_undegraded":"2024-09-14T11:52:44.687626+0000","last_fullsized":"2024-09-14T11:52:44.687626+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:31.432886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1185,"num_read_kb":53005,"num_write":1239,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":518,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926354+0000","last_change":"2024-09-14T11:10:53.347444+0000","last_active":"2024-09-14T11:49:53.926354+0000","last_peered":"2024-09-14T11:49:53.926354+0000","last_clean":"2024-09-14T11:49:53.926354+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:49:53.926354+0000","last_undegraded":"2024-09-14T11:49:53.926354+0000","last_fullsized":"2024-09-14T11:49:53.926354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:10.019766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.930873+0000","last_change":"2024-09-14T11:11:08.649058+0000","last_active":"2024-09-14T11:50:43.930873+0000","last_peered":"2024-09-14T11:50:43.930873+0000","last_clean":"2024-09-14T11:50:43.930873+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:50:43.930873+0000","last_undegraded":"2024-09-14T11:50:43.930873+0000","last_fullsized":"2024-09-14T11:50:43.930873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:32.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'109","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.304291+0000","last_change":"2024-09-14T11:11:10.671331+0000","last_active":"2024-09-14T11:51:19.304291+0000","last_peered":"2024-09-14T11:51:19.304291+0000","last_clean":"2024-09-14T11:51:19.304291+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:51:19.304291+0000","last_undegraded":"2024-09-14T11:51:19.304291+0000","last_fullsized":"2024-09-14T11:51:19.304291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:52.798905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'820","reported_seq":4186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.323448+0000","last_change":"2024-09-14T11:11:12.678672+0000","last_active":"2024-09-14T11:52:44.323448+0000","last_peered":"2024-09-14T11:52:44.323448+0000","last_clean":"2024-09-14T11:52:44.323448+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:52:44.323448+0000","last_undegraded":"2024-09-14T11:52:44.323448+0000","last_fullsized":"2024-09-14T11:52:44.323448+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:12.941981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'298","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.901850+0000","last_change":"2024-09-14T11:11:14.686960+0000","last_active":"2024-09-14T11:51:21.901850+0000","last_peered":"2024-09-14T11:51:21.901850+0000","last_clean":"2024-09-14T11:51:21.901850+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:51:21.901850+0000","last_undegraded":"2024-09-14T11:51:21.901850+0000","last_fullsized":"2024-09-14T11:51:21.901850+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'544","reported_seq":2461,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:56.940615+0000","last_change":"2024-09-14T11:11:06.655767+0000","last_active":"2024-09-14T11:50:56.940615+0000","last_peered":"2024-09-14T11:50:56.940615+0000","last_clean":"2024-09-14T11:50:56.940615+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:50:56.940615+0000","last_undegraded":"2024-09-14T11:50:56.940615+0000","last_fullsized":"2024-09-14T11:50:56.940615+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:44.124270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'207","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.712197+0000","last_change":"2024-09-14T11:11:04.656471+0000","last_active":"2024-09-14T11:52:44.712197+0000","last_peered":"2024-09-14T11:52:44.712197+0000","last_clean":"2024-09-14T11:52:44.712197+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:52:44.712197+0000","last_undegraded":"2024-09-14T11:52:44.712197+0000","last_fullsized":"2024-09-14T11:52:44.712197+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:48.156669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":59716,"num_write":954,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918354+0000","last_change":"2024-09-14T11:10:53.603447+0000","last_active":"2024-09-14T11:49:53.918354+0000","last_peered":"2024-09-14T11:49:53.918354+0000","last_clean":"2024-09-14T11:49:53.918354+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:49:53.918354+0000","last_undegraded":"2024-09-14T11:49:53.918354+0000","last_fullsized":"2024-09-14T11:49:53.918354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:50.309295+0000","last_clean_scrub_stamp":"2024-09-14T11:10:50.309295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:52.154176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921314+0000","last_change":"2024-09-14T11:11:08.656366+0000","last_active":"2024-09-14T11:49:18.921314+0000","last_peered":"2024-09-14T11:49:18.921314+0000","last_clean":"2024-09-14T11:49:18.921314+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:49:18.921314+0000","last_undegraded":"2024-09-14T11:49:18.921314+0000","last_fullsized":"2024-09-14T11:49:18.921314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:14.566083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'320","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.577703+0000","last_change":"2024-09-14T11:11:10.883247+0000","last_active":"2024-09-14T11:52:44.577703+0000","last_peered":"2024-09-14T11:52:44.577703+0000","last_clean":"2024-09-14T11:52:44.577703+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:52:44.577703+0000","last_undegraded":"2024-09-14T11:52:44.577703+0000","last_fullsized":"2024-09-14T11:52:44.577703+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:02.820687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":700,"num_write":238,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.916205+0000","last_change":"2024-09-14T11:11:12.682882+0000","last_active":"2024-09-14T11:48:43.916205+0000","last_peered":"2024-09-14T11:48:43.916205+0000","last_clean":"2024-09-14T11:48:43.916205+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:48:43.916205+0000","last_undegraded":"2024-09-14T11:48:43.916205+0000","last_fullsized":"2024-09-14T11:48:43.916205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:35.551263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'120","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.820332+0000","last_change":"2024-09-14T11:11:14.692652+0000","last_active":"2024-09-14T11:51:20.820332+0000","last_peered":"2024-09-14T11:51:20.820332+0000","last_clean":"2024-09-14T11:51:20.820332+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:51:20.820332+0000","last_undegraded":"2024-09-14T11:51:20.820332+0000","last_fullsized":"2024-09-14T11:51:20.820332+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:49.033241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.375702+0000","last_change":"2024-09-14T11:11:14.691282+0000","last_active":"2024-09-14T11:51:21.375702+0000","last_peered":"2024-09-14T11:51:21.375702+0000","last_clean":"2024-09-14T11:51:21.375702+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:51:21.375702+0000","last_undegraded":"2024-09-14T11:51:21.375702+0000","last_fullsized":"2024-09-14T11:51:21.375702+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.621120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'729","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.436271+0000","last_change":"2024-09-14T11:11:06.653550+0000","last_active":"2024-09-14T11:52:36.436271+0000","last_peered":"2024-09-14T11:52:36.436271+0000","last_clean":"2024-09-14T11:52:36.436271+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:36.436271+0000","last_undegraded":"2024-09-14T11:52:36.436271+0000","last_fullsized":"2024-09-14T11:52:36.436271+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:16.640227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'234","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.609732+0000","last_change":"2024-09-14T11:11:38.680906+0000","last_active":"2024-09-14T11:52:44.609732+0000","last_peered":"2024-09-14T11:52:44.609732+0000","last_clean":"2024-09-14T11:52:44.609732+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:52:44.609732+0000","last_undegraded":"2024-09-14T11:52:44.609732+0000","last_fullsized":"2024-09-14T11:52:44.609732+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:40.878361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":19030,"num_write":1058,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.912602+0000","last_change":"2024-09-14T11:11:08.653208+0000","last_active":"2024-09-14T11:48:28.912602+0000","last_peered":"2024-09-14T11:48:28.912602+0000","last_clean":"2024-09-14T11:48:28.912602+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:48:28.912602+0000","last_undegraded":"2024-09-14T11:48:28.912602+0000","last_fullsized":"2024-09-14T11:48:28.912602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:42.990347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'140","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.627683+0000","last_change":"2024-09-14T11:11:10.670870+0000","last_active":"2024-09-14T11:52:44.627683+0000","last_peered":"2024-09-14T11:52:44.627683+0000","last_clean":"2024-09-14T11:52:44.627683+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:52:44.627683+0000","last_undegraded":"2024-09-14T11:52:44.627683+0000","last_fullsized":"2024-09-14T11:52:44.627683+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:25.995412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914699+0000","last_change":"2024-09-14T11:11:12.679809+0000","last_active":"2024-09-14T11:48:33.914699+0000","last_peered":"2024-09-14T11:48:33.914699+0000","last_clean":"2024-09-14T11:48:33.914699+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:48:33.914699+0000","last_undegraded":"2024-09-14T11:48:33.914699+0000","last_fullsized":"2024-09-14T11:48:33.914699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:59.317292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.176366+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:05.176366+0000","last_peered":"2024-09-14T11:51:05.176366+0000","last_clean":"2024-09-14T11:51:05.176366+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:05.176366+0000","last_undegraded":"2024-09-14T11:51:05.176366+0000","last_fullsized":"2024-09-14T11:51:05.176366+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:48.809610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'712","reported_seq":2077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308610+0000","last_change":"2024-09-14T11:11:06.656572+0000","last_active":"2024-09-14T11:51:21.308610+0000","last_peered":"2024-09-14T11:51:21.308610+0000","last_clean":"2024-09-14T11:51:21.308610+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:51:21.308610+0000","last_undegraded":"2024-09-14T11:51:21.308610+0000","last_fullsized":"2024-09-14T11:51:21.308610+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":700,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:32.091729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'188","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.575454+0000","last_change":"2024-09-14T11:11:04.662627+0000","last_active":"2024-09-14T11:52:44.575454+0000","last_peered":"2024-09-14T11:52:44.575454+0000","last_clean":"2024-09-14T11:52:44.575454+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:52:44.575454+0000","last_undegraded":"2024-09-14T11:52:44.575454+0000","last_fullsized":"2024-09-14T11:52:44.575454+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:25.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":26239,"num_write":895,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.914104+0000","last_change":"2024-09-14T11:11:08.649769+0000","last_active":"2024-09-14T11:48:28.914104+0000","last_peered":"2024-09-14T11:48:28.914104+0000","last_clean":"2024-09-14T11:48:28.914104+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:48:28.914104+0000","last_undegraded":"2024-09-14T11:48:28.914104+0000","last_fullsized":"2024-09-14T11:48:28.914104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:51.869183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'53","reported_seq":548,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.138152+0000","last_change":"2024-09-14T11:11:10.669313+0000","last_active":"2024-09-14T11:51:19.138152+0000","last_peered":"2024-09-14T11:51:19.138152+0000","last_clean":"2024-09-14T11:51:19.138152+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:51:19.138152+0000","last_undegraded":"2024-09-14T11:51:19.138152+0000","last_fullsized":"2024-09-14T11:51:19.138152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:59.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034011+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:48:34.034011+0000","last_peered":"2024-09-14T11:48:34.034011+0000","last_clean":"2024-09-14T11:48:34.034011+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:48:34.034011+0000","last_undegraded":"2024-09-14T11:48:34.034011+0000","last_fullsized":"2024-09-14T11:48:34.034011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:34.408102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'195","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.441751+0000","last_change":"2024-09-14T11:11:14.692367+0000","last_active":"2024-09-14T11:52:36.441751+0000","last_peered":"2024-09-14T11:52:36.441751+0000","last_clean":"2024-09-14T11:52:36.441751+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:52:36.441751+0000","last_undegraded":"2024-09-14T11:52:36.441751+0000","last_fullsized":"2024-09-14T11:52:36.441751+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.861427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'486","reported_seq":1995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310927+0000","last_change":"2024-09-14T11:11:06.656240+0000","last_active":"2024-09-14T11:51:21.310927+0000","last_peered":"2024-09-14T11:51:21.310927+0000","last_clean":"2024-09-14T11:51:21.310927+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:51:21.310927+0000","last_undegraded":"2024-09-14T11:51:21.310927+0000","last_fullsized":"2024-09-14T11:51:21.310927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:09.647919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'205","reported_seq":819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.551030+0000","last_change":"2024-09-14T11:11:04.661433+0000","last_active":"2024-09-14T11:52:44.551030+0000","last_peered":"2024-09-14T11:52:44.551030+0000","last_clean":"2024-09-14T11:52:44.551030+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:52:44.551030+0000","last_undegraded":"2024-09-14T11:52:44.551030+0000","last_fullsized":"2024-09-14T11:52:44.551030+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.817478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":474,"num_read_kb":67081,"num_write":927,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:29.033082+0000","last_change":"2024-09-14T11:11:08.654324+0000","last_active":"2024-09-14T11:48:29.033082+0000","last_peered":"2024-09-14T11:48:29.033082+0000","last_clean":"2024-09-14T11:48:29.033082+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:48:29.033082+0000","last_undegraded":"2024-09-14T11:48:29.033082+0000","last_fullsized":"2024-09-14T11:48:29.033082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:57.708332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'162","reported_seq":748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.513757+0000","last_change":"2024-09-14T11:11:10.672080+0000","last_active":"2024-09-14T11:52:44.513757+0000","last_peered":"2024-09-14T11:52:44.513757+0000","last_clean":"2024-09-14T11:52:44.513757+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:52:44.513757+0000","last_undegraded":"2024-09-14T11:52:44.513757+0000","last_fullsized":"2024-09-14T11:52:44.513757+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:19.936617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":278,"num_write":116,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907458+0000","last_change":"2024-09-14T11:11:12.680936+0000","last_active":"2024-09-14T11:48:33.907458+0000","last_peered":"2024-09-14T11:48:33.907458+0000","last_clean":"2024-09-14T11:48:33.907458+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:48:33.907458+0000","last_undegraded":"2024-09-14T11:48:33.907458+0000","last_fullsized":"2024-09-14T11:48:33.907458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:51.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'159","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.741928+0000","last_change":"2024-09-14T11:11:14.690690+0000","last_active":"2024-09-14T11:51:08.741928+0000","last_peered":"2024-09-14T11:51:08.741928+0000","last_clean":"2024-09-14T11:51:08.741928+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:51:08.741928+0000","last_undegraded":"2024-09-14T11:51:08.741928+0000","last_fullsized":"2024-09-14T11:51:08.741928+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:02.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1177","reported_seq":2918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.310166+0000","last_change":"2024-09-14T11:11:06.652306+0000","last_active":"2024-09-14T11:51:21.310166+0000","last_peered":"2024-09-14T11:51:21.310166+0000","last_clean":"2024-09-14T11:51:21.310166+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:51:21.310166+0000","last_undegraded":"2024-09-14T11:51:21.310166+0000","last_fullsized":"2024-09-14T11:51:21.310166+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":1100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:10.911326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'190","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.681761+0000","last_change":"2024-09-14T11:11:04.663210+0000","last_active":"2024-09-14T11:52:44.681761+0000","last_peered":"2024-09-14T11:52:44.681761+0000","last_clean":"2024-09-14T11:52:44.681761+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:52:44.681761+0000","last_undegraded":"2024-09-14T11:52:44.681761+0000","last_fullsized":"2024-09-14T11:52:44.681761+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:37.285836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":13209,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:28.906630+0000","last_change":"2024-09-14T11:11:08.653546+0000","last_active":"2024-09-14T11:48:28.906630+0000","last_peered":"2024-09-14T11:48:28.906630+0000","last_clean":"2024-09-14T11:48:28.906630+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:48:28.906630+0000","last_undegraded":"2024-09-14T11:48:28.906630+0000","last_fullsized":"2024-09-14T11:48:28.906630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:39.193897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'124","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.471340+0000","last_change":"2024-09-14T11:11:10.670918+0000","last_active":"2024-09-14T11:52:44.471340+0000","last_peered":"2024-09-14T11:52:44.471340+0000","last_clean":"2024-09-14T11:52:44.471340+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:52:44.471340+0000","last_undegraded":"2024-09-14T11:52:44.471340+0000","last_fullsized":"2024-09-14T11:52:44.471340+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:05.847749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":210,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913655+0000","last_change":"2024-09-14T11:11:12.682390+0000","last_active":"2024-09-14T11:48:33.913655+0000","last_peered":"2024-09-14T11:48:33.913655+0000","last_clean":"2024-09-14T11:48:33.913655+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:48:33.913655+0000","last_undegraded":"2024-09-14T11:48:33.913655+0000","last_fullsized":"2024-09-14T11:48:33.913655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:05.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1627","reported_seq":3327,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.122801+0000","last_change":"2024-09-14T11:11:06.654317+0000","last_active":"2024-09-14T11:51:03.122801+0000","last_peered":"2024-09-14T11:51:03.122801+0000","last_clean":"2024-09-14T11:51:03.122801+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:51:03.122801+0000","last_undegraded":"2024-09-14T11:51:03.122801+0000","last_fullsized":"2024-09-14T11:51:03.122801+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:00.474698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'230","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.555248+0000","last_change":"2024-09-14T11:11:04.645419+0000","last_active":"2024-09-14T11:52:44.555248+0000","last_peered":"2024-09-14T11:52:44.555248+0000","last_clean":"2024-09-14T11:52:44.555248+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:44.555248+0000","last_undegraded":"2024-09-14T11:52:44.555248+0000","last_fullsized":"2024-09-14T11:52:44.555248+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:57.345945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":62996,"num_write":1114,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921634+0000","last_change":"2024-09-14T11:11:08.650958+0000","last_active":"2024-09-14T11:49:18.921634+0000","last_peered":"2024-09-14T11:49:18.921634+0000","last_clean":"2024-09-14T11:49:18.921634+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:49:18.921634+0000","last_undegraded":"2024-09-14T11:49:18.921634+0000","last_fullsized":"2024-09-14T11:49:18.921634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:09.330791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'207","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.715314+0000","last_change":"2024-09-14T11:11:10.670001+0000","last_active":"2024-09-14T11:52:44.715314+0000","last_peered":"2024-09-14T11:52:44.715314+0000","last_clean":"2024-09-14T11:52:44.715314+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:52:44.715314+0000","last_undegraded":"2024-09-14T11:52:44.715314+0000","last_fullsized":"2024-09-14T11:52:44.715314+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:12.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":490,"num_write":204,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040316+0000","last_change":"2024-09-14T11:11:12.683170+0000","last_active":"2024-09-14T11:48:44.040316+0000","last_peered":"2024-09-14T11:48:44.040316+0000","last_clean":"2024-09-14T11:48:44.040316+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:48:44.040316+0000","last_undegraded":"2024-09-14T11:48:44.040316+0000","last_fullsized":"2024-09-14T11:48:44.040316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.360262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.306430+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.306430+0000","last_peered":"2024-09-14T11:51:21.306430+0000","last_clean":"2024-09-14T11:51:21.306430+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.306430+0000","last_undegraded":"2024-09-14T11:51:21.306430+0000","last_fullsized":"2024-09-14T11:51:21.306430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'422","reported_seq":2027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172836+0000","last_change":"2024-09-14T11:11:06.650905+0000","last_active":"2024-09-14T11:51:07.172836+0000","last_peered":"2024-09-14T11:51:07.172836+0000","last_clean":"2024-09-14T11:51:07.172836+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:51:07.172836+0000","last_undegraded":"2024-09-14T11:51:07.172836+0000","last_fullsized":"2024-09-14T11:51:07.172836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:45.627603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'181","reported_seq":782,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.560627+0000","last_change":"2024-09-14T11:11:04.650203+0000","last_active":"2024-09-14T11:52:44.560627+0000","last_peered":"2024-09-14T11:52:44.560627+0000","last_clean":"2024-09-14T11:52:44.560627+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:52:44.560627+0000","last_undegraded":"2024-09-14T11:52:44.560627+0000","last_fullsized":"2024-09-14T11:52:44.560627+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:25:51.827452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":12441,"num_write":906,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.100118+0000","last_change":"2024-09-14T11:11:08.653366+0000","last_active":"2024-09-14T11:52:44.100118+0000","last_peered":"2024-09-14T11:52:44.100118+0000","last_clean":"2024-09-14T11:52:44.100118+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:52:44.100118+0000","last_undegraded":"2024-09-14T11:52:44.100118+0000","last_fullsized":"2024-09-14T11:52:44.100118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:44.850713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":1194,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'163","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.483497+0000","last_change":"2024-09-14T11:11:10.668831+0000","last_active":"2024-09-14T11:52:44.483497+0000","last_peered":"2024-09-14T11:52:44.483497+0000","last_clean":"2024-09-14T11:52:44.483497+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:52:44.483497+0000","last_undegraded":"2024-09-14T11:52:44.483497+0000","last_fullsized":"2024-09-14T11:52:44.483497+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:09.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9714,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":303,"num_write":148,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915697+0000","last_change":"2024-09-14T11:11:12.681008+0000","last_active":"2024-09-14T11:48:43.915697+0000","last_peered":"2024-09-14T11:48:43.915697+0000","last_clean":"2024-09-14T11:48:43.915697+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:48:43.915697+0000","last_undegraded":"2024-09-14T11:48:43.915697+0000","last_fullsized":"2024-09-14T11:48:43.915697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:58.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'173","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:07.089853+0000","last_change":"2024-09-14T11:11:14.690312+0000","last_active":"2024-09-14T11:50:07.089853+0000","last_peered":"2024-09-14T11:50:07.089853+0000","last_clean":"2024-09-14T11:50:07.089853+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:50:07.089853+0000","last_undegraded":"2024-09-14T11:50:07.089853+0000","last_fullsized":"2024-09-14T11:50:07.089853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.026241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'376","reported_seq":1780,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:02.226513+0000","last_change":"2024-09-14T11:11:06.651125+0000","last_active":"2024-09-14T11:51:02.226513+0000","last_peered":"2024-09-14T11:51:02.226513+0000","last_clean":"2024-09-14T11:51:02.226513+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:51:02.226513+0000","last_undegraded":"2024-09-14T11:51:02.226513+0000","last_fullsized":"2024-09-14T11:51:02.226513+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:57:57.162983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'245","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.673687+0000","last_change":"2024-09-14T11:11:04.647959+0000","last_active":"2024-09-14T11:52:44.673687+0000","last_peered":"2024-09-14T11:52:44.673687+0000","last_clean":"2024-09-14T11:52:44.673687+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:52:44.673687+0000","last_undegraded":"2024-09-14T11:52:44.673687+0000","last_fullsized":"2024-09-14T11:52:44.673687+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:50.954784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":23729,"num_write":1071,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914129+0000","last_change":"2024-09-14T11:11:08.651803+0000","last_active":"2024-09-14T11:48:38.914129+0000","last_peered":"2024-09-14T11:48:38.914129+0000","last_clean":"2024-09-14T11:48:38.914129+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:48:38.914129+0000","last_undegraded":"2024-09-14T11:48:38.914129+0000","last_fullsized":"2024-09-14T11:48:38.914129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:43.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'146","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.692842+0000","last_change":"2024-09-14T11:11:10.883223+0000","last_active":"2024-09-14T11:52:44.692842+0000","last_peered":"2024-09-14T11:52:44.692842+0000","last_clean":"2024-09-14T11:52:44.692842+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:52:44.692842+0000","last_undegraded":"2024-09-14T11:52:44.692842+0000","last_fullsized":"2024-09-14T11:52:44.692842+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:29.696874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33350,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":317,"num_write":100,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921566+0000","last_change":"2024-09-14T11:11:12.681509+0000","last_active":"2024-09-14T11:49:18.921566+0000","last_peered":"2024-09-14T11:49:18.921566+0000","last_clean":"2024-09-14T11:49:18.921566+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:49:18.921566+0000","last_undegraded":"2024-09-14T11:49:18.921566+0000","last_fullsized":"2024-09-14T11:49:18.921566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:59.776741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'122","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546132+0000","last_change":"2024-09-14T11:11:14.691723+0000","last_active":"2024-09-14T11:52:37.546132+0000","last_peered":"2024-09-14T11:52:37.546132+0000","last_clean":"2024-09-14T11:52:37.546132+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:52:37.546132+0000","last_undegraded":"2024-09-14T11:52:37.546132+0000","last_fullsized":"2024-09-14T11:52:37.546132+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:16.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'480","reported_seq":2274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219612+0000","last_change":"2024-09-14T11:11:37.748529+0000","last_active":"2024-09-14T11:51:19.219612+0000","last_peered":"2024-09-14T11:51:19.219612+0000","last_clean":"2024-09-14T11:51:19.219612+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:51:19.219612+0000","last_undegraded":"2024-09-14T11:51:19.219612+0000","last_fullsized":"2024-09-14T11:51:19.219612+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:31.281473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'294","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.659908+0000","last_change":"2024-09-14T11:11:04.649863+0000","last_active":"2024-09-14T11:52:44.659908+0000","last_peered":"2024-09-14T11:52:44.659908+0000","last_clean":"2024-09-14T11:52:44.659908+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:52:44.659908+0000","last_undegraded":"2024-09-14T11:52:44.659908+0000","last_fullsized":"2024-09-14T11:52:44.659908+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.369405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":821,"num_read_kb":27323,"num_write":1074,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914708+0000","last_change":"2024-09-14T11:11:08.657837+0000","last_active":"2024-09-14T11:48:38.914708+0000","last_peered":"2024-09-14T11:48:38.914708+0000","last_clean":"2024-09-14T11:48:38.914708+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:48:38.914708+0000","last_undegraded":"2024-09-14T11:48:38.914708+0000","last_fullsized":"2024-09-14T11:48:38.914708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'70","reported_seq":582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.316786+0000","last_change":"2024-09-14T11:11:10.883222+0000","last_active":"2024-09-14T11:51:19.316786+0000","last_peered":"2024-09-14T11:51:19.316786+0000","last_clean":"2024-09-14T11:51:19.316786+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:51:19.316786+0000","last_undegraded":"2024-09-14T11:51:19.316786+0000","last_fullsized":"2024-09-14T11:51:19.316786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:29.226087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.318279+0000","last_change":"2024-09-14T11:11:12.679582+0000","last_active":"2024-09-14T11:52:44.318279+0000","last_peered":"2024-09-14T11:52:44.318279+0000","last_clean":"2024-09-14T11:52:44.318279+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:52:44.318279+0000","last_undegraded":"2024-09-14T11:52:44.318279+0000","last_fullsized":"2024-09-14T11:52:44.318279+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:59.745581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.781791+0000","last_change":"2024-09-14T11:11:14.693282+0000","last_active":"2024-09-14T11:50:48.781791+0000","last_peered":"2024-09-14T11:50:48.781791+0000","last_clean":"2024-09-14T11:50:48.781791+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:50:48.781791+0000","last_undegraded":"2024-09-14T11:50:48.781791+0000","last_fullsized":"2024-09-14T11:50:48.781791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:09.483259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.836272+0000","last_change":"2024-09-14T11:11:06.652140+0000","last_active":"2024-09-14T11:51:21.836272+0000","last_peered":"2024-09-14T11:51:21.836272+0000","last_clean":"2024-09-14T11:51:21.836272+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:51:21.836272+0000","last_undegraded":"2024-09-14T11:51:21.836272+0000","last_fullsized":"2024-09-14T11:51:21.836272+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:23.042325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'216","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.610040+0000","last_change":"2024-09-14T11:11:04.661487+0000","last_active":"2024-09-14T11:52:44.610040+0000","last_peered":"2024-09-14T11:52:44.610040+0000","last_clean":"2024-09-14T11:52:44.610040+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:52:44.610040+0000","last_undegraded":"2024-09-14T11:52:44.610040+0000","last_fullsized":"2024-09-14T11:52:44.610040+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:20.676205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":12794,"num_write":1051,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034846+0000","last_change":"2024-09-14T11:11:08.653717+0000","last_active":"2024-09-14T11:48:39.034846+0000","last_peered":"2024-09-14T11:48:39.034846+0000","last_clean":"2024-09-14T11:48:39.034846+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:48:39.034846+0000","last_undegraded":"2024-09-14T11:48:39.034846+0000","last_fullsized":"2024-09-14T11:48:39.034846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:32.879931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'169","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.398052+0000","last_change":"2024-09-14T11:11:10.669599+0000","last_active":"2024-09-14T11:52:44.398052+0000","last_peered":"2024-09-14T11:52:44.398052+0000","last_clean":"2024-09-14T11:52:44.398052+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:52:44.398052+0000","last_undegraded":"2024-09-14T11:52:44.398052+0000","last_fullsized":"2024-09-14T11:52:44.398052+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:43.348380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":294,"num_write":122,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926374+0000","last_change":"2024-09-14T11:11:12.681246+0000","last_active":"2024-09-14T11:49:53.926374+0000","last_peered":"2024-09-14T11:49:53.926374+0000","last_clean":"2024-09-14T11:49:53.926374+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:49:53.926374+0000","last_undegraded":"2024-09-14T11:49:53.926374+0000","last_fullsized":"2024-09-14T11:49:53.926374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:07.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'115","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.880410+0000","last_change":"2024-09-14T11:11:14.697190+0000","last_active":"2024-09-14T11:51:07.880410+0000","last_peered":"2024-09-14T11:51:07.880410+0000","last_clean":"2024-09-14T11:51:07.880410+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:51:07.880410+0000","last_undegraded":"2024-09-14T11:51:07.880410+0000","last_fullsized":"2024-09-14T11:51:07.880410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:51.323211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1156","reported_seq":2809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.337919+0000","last_change":"2024-09-14T11:11:06.642481+0000","last_active":"2024-09-14T11:50:58.337919+0000","last_peered":"2024-09-14T11:50:58.337919+0000","last_clean":"2024-09-14T11:50:58.337919+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:50:58.337919+0000","last_undegraded":"2024-09-14T11:50:58.337919+0000","last_fullsized":"2024-09-14T11:50:58.337919+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:24.677463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'199","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.689942+0000","last_change":"2024-09-14T11:11:04.662351+0000","last_active":"2024-09-14T11:52:44.689942+0000","last_peered":"2024-09-14T11:52:44.689942+0000","last_clean":"2024-09-14T11:52:44.689942+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:52:44.689942+0000","last_undegraded":"2024-09-14T11:52:44.689942+0000","last_fullsized":"2024-09-14T11:52:44.689942+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:07.797389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":665,"num_read_kb":26583,"num_write":943,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039639+0000","last_change":"2024-09-14T11:11:08.655874+0000","last_active":"2024-09-14T11:48:39.039639+0000","last_peered":"2024-09-14T11:48:39.039639+0000","last_clean":"2024-09-14T11:48:39.039639+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:48:39.039639+0000","last_undegraded":"2024-09-14T11:48:39.039639+0000","last_fullsized":"2024-09-14T11:48:39.039639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:09.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.407904+0000","last_change":"2024-09-14T11:11:10.673119+0000","last_active":"2024-09-14T11:52:44.407904+0000","last_peered":"2024-09-14T11:52:44.407904+0000","last_clean":"2024-09-14T11:52:44.407904+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:52:44.407904+0000","last_undegraded":"2024-09-14T11:52:44.407904+0000","last_fullsized":"2024-09-14T11:52:44.407904+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.182477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":236,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:03.919674+0000","last_change":"2024-09-14T11:11:12.680784+0000","last_active":"2024-09-14T11:50:03.919674+0000","last_peered":"2024-09-14T11:50:03.919674+0000","last_clean":"2024-09-14T11:50:03.919674+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:50:03.919674+0000","last_undegraded":"2024-09-14T11:50:03.919674+0000","last_fullsized":"2024-09-14T11:50:03.919674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:59.544800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'508","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.436715+0000","last_change":"2024-09-14T11:11:06.653662+0000","last_active":"2024-09-14T11:51:06.436715+0000","last_peered":"2024-09-14T11:51:06.436715+0000","last_clean":"2024-09-14T11:51:06.436715+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:51:06.436715+0000","last_undegraded":"2024-09-14T11:51:06.436715+0000","last_fullsized":"2024-09-14T11:51:06.436715+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:06.494569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'219","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.469130+0000","last_change":"2024-09-14T11:11:04.650685+0000","last_active":"2024-09-14T11:52:44.469130+0000","last_peered":"2024-09-14T11:52:44.469130+0000","last_clean":"2024-09-14T11:52:44.469130+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:44.469130+0000","last_undegraded":"2024-09-14T11:52:44.469130+0000","last_fullsized":"2024-09-14T11:52:44.469130+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:53.078217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":7926,"num_write":973,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.923902+0000","last_change":"2024-09-14T11:11:08.654095+0000","last_active":"2024-09-14T11:49:48.923902+0000","last_peered":"2024-09-14T11:49:48.923902+0000","last_clean":"2024-09-14T11:49:48.923902+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:49:48.923902+0000","last_undegraded":"2024-09-14T11:49:48.923902+0000","last_fullsized":"2024-09-14T11:49:48.923902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:24.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'107","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.654246+0000","last_change":"2024-09-14T11:11:10.669556+0000","last_active":"2024-09-14T11:52:44.654246+0000","last_peered":"2024-09-14T11:52:44.654246+0000","last_clean":"2024-09-14T11:52:44.654246+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:52:44.654246+0000","last_undegraded":"2024-09-14T11:52:44.654246+0000","last_fullsized":"2024-09-14T11:52:44.654246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:15.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":208,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915062+0000","last_change":"2024-09-14T11:11:12.682253+0000","last_active":"2024-09-14T11:48:43.915062+0000","last_peered":"2024-09-14T11:48:43.915062+0000","last_clean":"2024-09-14T11:48:43.915062+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:48:43.915062+0000","last_undegraded":"2024-09-14T11:48:43.915062+0000","last_fullsized":"2024-09-14T11:48:43.915062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:58.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'186","reported_seq":1636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.774324+0000","last_change":"2024-09-14T11:11:14.690239+0000","last_active":"2024-09-14T11:51:19.774324+0000","last_peered":"2024-09-14T11:51:19.774324+0000","last_clean":"2024-09-14T11:51:19.774324+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:51:19.774324+0000","last_undegraded":"2024-09-14T11:51:19.774324+0000","last_fullsized":"2024-09-14T11:51:19.774324+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:45.377535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.219526+0000","last_change":"2024-09-14T11:11:06.656585+0000","last_active":"2024-09-14T11:51:19.219526+0000","last_peered":"2024-09-14T11:51:19.219526+0000","last_clean":"2024-09-14T11:51:19.219526+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:51:19.219526+0000","last_undegraded":"2024-09-14T11:51:19.219526+0000","last_fullsized":"2024-09-14T11:51:19.219526+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:33.246710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'230","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.666348+0000","last_change":"2024-09-14T11:11:04.658553+0000","last_active":"2024-09-14T11:52:44.666348+0000","last_peered":"2024-09-14T11:52:44.666348+0000","last_clean":"2024-09-14T11:52:44.666348+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:52:44.666348+0000","last_undegraded":"2024-09-14T11:52:44.666348+0000","last_fullsized":"2024-09-14T11:52:44.666348+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:55.574919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1057,"num_read_kb":144594,"num_write":1045,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926285+0000","last_change":"2024-09-14T11:11:08.653002+0000","last_active":"2024-09-14T11:49:53.926285+0000","last_peered":"2024-09-14T11:49:53.926285+0000","last_clean":"2024-09-14T11:49:53.926285+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:49:53.926285+0000","last_undegraded":"2024-09-14T11:49:53.926285+0000","last_fullsized":"2024-09-14T11:49:53.926285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:11.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'156","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.702598+0000","last_change":"2024-09-14T11:11:10.668336+0000","last_active":"2024-09-14T11:52:44.702598+0000","last_peered":"2024-09-14T11:52:44.702598+0000","last_clean":"2024-09-14T11:52:44.702598+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:52:44.702598+0000","last_undegraded":"2024-09-14T11:52:44.702598+0000","last_fullsized":"2024-09-14T11:52:44.702598+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:48.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":208,"num_write":106,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915597+0000","last_change":"2024-09-14T11:11:12.681192+0000","last_active":"2024-09-14T11:48:43.915597+0000","last_peered":"2024-09-14T11:48:43.915597+0000","last_clean":"2024-09-14T11:48:43.915597+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:48:43.915597+0000","last_undegraded":"2024-09-14T11:48:43.915597+0000","last_fullsized":"2024-09-14T11:48:43.915597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'131","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434001+0000","last_change":"2024-09-14T11:11:14.697156+0000","last_active":"2024-09-14T11:52:36.434001+0000","last_peered":"2024-09-14T11:52:36.434001+0000","last_clean":"2024-09-14T11:52:36.434001+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:52:36.434001+0000","last_undegraded":"2024-09-14T11:52:36.434001+0000","last_fullsized":"2024-09-14T11:52:36.434001+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.319859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'851","reported_seq":2569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179734+0000","last_change":"2024-09-14T11:11:06.655238+0000","last_active":"2024-09-14T11:51:05.179734+0000","last_peered":"2024-09-14T11:51:05.179734+0000","last_clean":"2024-09-14T11:51:05.179734+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:51:05.179734+0000","last_undegraded":"2024-09-14T11:51:05.179734+0000","last_fullsized":"2024-09-14T11:51:05.179734+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:38.378965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'248","reported_seq":908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.603619+0000","last_change":"2024-09-14T11:11:04.666811+0000","last_active":"2024-09-14T11:52:44.603619+0000","last_peered":"2024-09-14T11:52:44.603619+0000","last_clean":"2024-09-14T11:52:44.603619+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:52:44.603619+0000","last_undegraded":"2024-09-14T11:52:44.603619+0000","last_fullsized":"2024-09-14T11:52:44.603619+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:58.336866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":737,"num_read_kb":42950,"num_write":1092,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'565","reported_seq":2225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844932+0000","last_change":"2024-09-14T11:11:06.651614+0000","last_active":"2024-09-14T11:51:21.844932+0000","last_peered":"2024-09-14T11:51:21.844932+0000","last_clean":"2024-09-14T11:51:21.844932+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:51:21.844932+0000","last_undegraded":"2024-09-14T11:51:21.844932+0000","last_fullsized":"2024-09-14T11:51:21.844932+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:03.537283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'180","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.490207+0000","last_change":"2024-09-14T11:11:38.680106+0000","last_active":"2024-09-14T11:52:44.490207+0000","last_peered":"2024-09-14T11:52:44.490207+0000","last_clean":"2024-09-14T11:52:44.490207+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:52:44.490207+0000","last_undegraded":"2024-09-14T11:52:44.490207+0000","last_fullsized":"2024-09-14T11:52:44.490207+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:36.864373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":43631,"num_write":872,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'524","reported_seq":2310,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845111+0000","last_change":"2024-09-14T11:11:06.653770+0000","last_active":"2024-09-14T11:51:21.845111+0000","last_peered":"2024-09-14T11:51:21.845111+0000","last_clean":"2024-09-14T11:51:21.845111+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:51:21.845111+0000","last_undegraded":"2024-09-14T11:51:21.845111+0000","last_fullsized":"2024-09-14T11:51:21.845111+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:56.985145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'217","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.665989+0000","last_change":"2024-09-14T11:11:04.659611+0000","last_active":"2024-09-14T11:52:44.665989+0000","last_peered":"2024-09-14T11:52:44.665989+0000","last_clean":"2024-09-14T11:52:44.665989+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:52:44.665989+0000","last_undegraded":"2024-09-14T11:52:44.665989+0000","last_fullsized":"2024-09-14T11:52:44.665989+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:12.810419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":22878,"num_write":1010,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'803","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435453+0000","last_change":"2024-09-14T11:11:06.651188+0000","last_active":"2024-09-14T11:52:36.435453+0000","last_peered":"2024-09-14T11:52:36.435453+0000","last_clean":"2024-09-14T11:52:36.435453+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:52:36.435453+0000","last_undegraded":"2024-09-14T11:52:36.435453+0000","last_fullsized":"2024-09-14T11:52:36.435453+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:08.763110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.640565+0000","last_change":"2024-09-14T11:11:04.650789+0000","last_active":"2024-09-14T11:52:44.640565+0000","last_peered":"2024-09-14T11:52:44.640565+0000","last_clean":"2024-09-14T11:52:44.640565+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:52:44.640565+0000","last_undegraded":"2024-09-14T11:52:44.640565+0000","last_fullsized":"2024-09-14T11:52:44.640565+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:09.442954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":47732,"num_write":877,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1006","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.837526+0000","last_change":"2024-09-14T11:11:06.654587+0000","last_active":"2024-09-14T11:51:21.837526+0000","last_peered":"2024-09-14T11:51:21.837526+0000","last_clean":"2024-09-14T11:51:21.837526+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:51:21.837526+0000","last_undegraded":"2024-09-14T11:51:21.837526+0000","last_fullsized":"2024-09-14T11:51:21.837526+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:08.260560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'279","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.625324+0000","last_change":"2024-09-14T11:11:38.149249+0000","last_active":"2024-09-14T11:52:44.625324+0000","last_peered":"2024-09-14T11:52:44.625324+0000","last_clean":"2024-09-14T11:52:44.625324+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:44.625324+0000","last_undegraded":"2024-09-14T11:52:44.625324+0000","last_fullsized":"2024-09-14T11:52:44.625324+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:11.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":719,"num_read_kb":31338,"num_write":1105,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'442","reported_seq":1981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.885285+0000","last_change":"2024-09-14T11:11:06.653604+0000","last_active":"2024-09-14T11:51:07.885285+0000","last_peered":"2024-09-14T11:51:07.885285+0000","last_clean":"2024-09-14T11:51:07.885285+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:51:07.885285+0000","last_undegraded":"2024-09-14T11:51:07.885285+0000","last_fullsized":"2024-09-14T11:51:07.885285+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:35.321390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'261","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.682540+0000","last_change":"2024-09-14T11:11:04.642725+0000","last_active":"2024-09-14T11:52:44.682540+0000","last_peered":"2024-09-14T11:52:44.682540+0000","last_clean":"2024-09-14T11:52:44.682540+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:52:44.682540+0000","last_undegraded":"2024-09-14T11:52:44.682540+0000","last_fullsized":"2024-09-14T11:52:44.682540+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:47.011169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1027,"num_read_kb":155043,"num_write":1124,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1175","reported_seq":2834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.443786+0000","last_change":"2024-09-14T11:11:06.651627+0000","last_active":"2024-09-14T11:52:36.443786+0000","last_peered":"2024-09-14T11:52:36.443786+0000","last_clean":"2024-09-14T11:52:36.443786+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:52:36.443786+0000","last_undegraded":"2024-09-14T11:52:36.443786+0000","last_fullsized":"2024-09-14T11:52:36.443786+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":1100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:01.008892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'242","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.633667+0000","last_change":"2024-09-14T11:11:04.657109+0000","last_active":"2024-09-14T11:52:44.633667+0000","last_peered":"2024-09-14T11:52:44.633667+0000","last_clean":"2024-09-14T11:52:44.633667+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:52:44.633667+0000","last_undegraded":"2024-09-14T11:52:44.633667+0000","last_fullsized":"2024-09-14T11:52:44.633667+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:20.402916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159825,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":17781,"num_write":1116,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'425","reported_seq":1952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.885480+0000","last_change":"2024-09-14T11:11:06.654109+0000","last_active":"2024-09-14T11:51:07.885480+0000","last_peered":"2024-09-14T11:51:07.885480+0000","last_clean":"2024-09-14T11:51:07.885480+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:51:07.885480+0000","last_undegraded":"2024-09-14T11:51:07.885480+0000","last_fullsized":"2024-09-14T11:51:07.885480+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:48.495731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'185","reported_seq":808,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.652125+0000","last_change":"2024-09-14T11:11:04.654477+0000","last_active":"2024-09-14T11:52:44.652125+0000","last_peered":"2024-09-14T11:52:44.652125+0000","last_clean":"2024-09-14T11:52:44.652125+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:52:44.652125+0000","last_undegraded":"2024-09-14T11:52:44.652125+0000","last_fullsized":"2024-09-14T11:52:44.652125+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:01.338332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":12452,"num_write":860,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1179","reported_seq":2658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.308328+0000","last_change":"2024-09-14T11:11:06.652958+0000","last_active":"2024-09-14T11:51:21.308328+0000","last_peered":"2024-09-14T11:51:21.308328+0000","last_clean":"2024-09-14T11:51:21.308328+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:51:21.308328+0000","last_undegraded":"2024-09-14T11:51:21.308328+0000","last_fullsized":"2024-09-14T11:51:21.308328+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":1100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:24.552197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'246","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.493580+0000","last_change":"2024-09-14T11:11:04.657280+0000","last_active":"2024-09-14T11:52:44.493580+0000","last_peered":"2024-09-14T11:52:44.493580+0000","last_clean":"2024-09-14T11:52:44.493580+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:52:44.493580+0000","last_undegraded":"2024-09-14T11:52:44.493580+0000","last_fullsized":"2024-09-14T11:52:44.493580+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:41.400680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":3825,"num_write":1017,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'758","reported_seq":2289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.435815+0000","last_change":"2024-09-14T11:11:06.651996+0000","last_active":"2024-09-14T11:52:36.435815+0000","last_peered":"2024-09-14T11:52:36.435815+0000","last_clean":"2024-09-14T11:52:36.435815+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:52:36.435815+0000","last_undegraded":"2024-09-14T11:52:36.435815+0000","last_fullsized":"2024-09-14T11:52:36.435815+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":700,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:06.359659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'244","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.596935+0000","last_change":"2024-09-14T11:11:04.651232+0000","last_active":"2024-09-14T11:52:44.596935+0000","last_peered":"2024-09-14T11:52:44.596935+0000","last_clean":"2024-09-14T11:52:44.596935+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:52:44.596935+0000","last_undegraded":"2024-09-14T11:52:44.596935+0000","last_fullsized":"2024-09-14T11:52:44.596935+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:16.752449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":9466,"num_write":1107,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:06.437393+0000","last_change":"2024-09-14T11:11:06.656624+0000","last_active":"2024-09-14T11:51:06.437393+0000","last_peered":"2024-09-14T11:51:06.437393+0000","last_clean":"2024-09-14T11:51:06.437393+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:51:06.437393+0000","last_undegraded":"2024-09-14T11:51:06.437393+0000","last_fullsized":"2024-09-14T11:51:06.437393+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:32.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'230","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.584035+0000","last_change":"2024-09-14T11:11:38.680828+0000","last_active":"2024-09-14T11:52:44.584035+0000","last_peered":"2024-09-14T11:52:44.584035+0000","last_clean":"2024-09-14T11:52:44.584035+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:52:44.584035+0000","last_undegraded":"2024-09-14T11:52:44.584035+0000","last_fullsized":"2024-09-14T11:52:44.584035+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:19.072768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":774,"num_read_kb":20654,"num_write":1086,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'570","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.123272+0000","last_change":"2024-09-14T11:11:06.655967+0000","last_active":"2024-09-14T11:51:03.123272+0000","last_peered":"2024-09-14T11:51:03.123272+0000","last_clean":"2024-09-14T11:51:03.123272+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:51:03.123272+0000","last_undegraded":"2024-09-14T11:51:03.123272+0000","last_fullsized":"2024-09-14T11:51:03.123272+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:20.387986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'179","reported_seq":802,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.586065+0000","last_change":"2024-09-14T11:11:04.663147+0000","last_active":"2024-09-14T11:52:44.586065+0000","last_peered":"2024-09-14T11:52:44.586065+0000","last_clean":"2024-09-14T11:52:44.586065+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:52:44.586065+0000","last_undegraded":"2024-09-14T11:52:44.586065+0000","last_fullsized":"2024-09-14T11:52:44.586065+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:33.911581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254527,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":19362,"num_write":819,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'501","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746597+0000","last_change":"2024-09-14T11:11:06.659368+0000","last_active":"2024-09-14T11:51:08.746597+0000","last_peered":"2024-09-14T11:51:08.746597+0000","last_clean":"2024-09-14T11:51:08.746597+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:51:08.746597+0000","last_undegraded":"2024-09-14T11:51:08.746597+0000","last_fullsized":"2024-09-14T11:51:08.746597+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:58.840799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'219","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.698663+0000","last_change":"2024-09-14T11:11:04.663046+0000","last_active":"2024-09-14T11:52:44.698663+0000","last_peered":"2024-09-14T11:52:44.698663+0000","last_clean":"2024-09-14T11:52:44.698663+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:52:44.698663+0000","last_undegraded":"2024-09-14T11:52:44.698663+0000","last_fullsized":"2024-09-14T11:52:44.698663+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:13.422693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152081,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":22963,"num_write":995,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1725","reported_seq":3529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.220305+0000","last_change":"2024-09-14T11:11:06.649254+0000","last_active":"2024-09-14T11:51:19.220305+0000","last_peered":"2024-09-14T11:51:19.220305+0000","last_clean":"2024-09-14T11:51:19.220305+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:51:19.220305+0000","last_undegraded":"2024-09-14T11:51:19.220305+0000","last_fullsized":"2024-09-14T11:51:19.220305+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:09.019220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'220","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.588584+0000","last_change":"2024-09-14T11:11:04.667994+0000","last_active":"2024-09-14T11:52:44.588584+0000","last_peered":"2024-09-14T11:52:44.588584+0000","last_clean":"2024-09-14T11:52:44.588584+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:52:44.588584+0000","last_undegraded":"2024-09-14T11:52:44.588584+0000","last_fullsized":"2024-09-14T11:52:44.588584+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:02.592974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":9299,"num_write":1026,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'390","reported_seq":1862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316772+0000","last_change":"2024-09-14T11:11:06.646168+0000","last_active":"2024-09-14T11:51:21.316772+0000","last_peered":"2024-09-14T11:51:21.316772+0000","last_clean":"2024-09-14T11:51:21.316772+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:51:21.316772+0000","last_undegraded":"2024-09-14T11:51:21.316772+0000","last_fullsized":"2024-09-14T11:51:21.316772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:16.898215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.625670+0000","last_change":"2024-09-14T11:11:04.651268+0000","last_active":"2024-09-14T11:52:44.625670+0000","last_peered":"2024-09-14T11:52:44.625670+0000","last_clean":"2024-09-14T11:52:44.625670+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:52:44.625670+0000","last_undegraded":"2024-09-14T11:52:44.625670+0000","last_fullsized":"2024-09-14T11:52:44.625670+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:23.982692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":67022,"num_write":1011,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'457","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845379+0000","last_change":"2024-09-14T11:11:06.659988+0000","last_active":"2024-09-14T11:51:21.845379+0000","last_peered":"2024-09-14T11:51:21.845379+0000","last_clean":"2024-09-14T11:51:21.845379+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:51:21.845379+0000","last_undegraded":"2024-09-14T11:51:21.845379+0000","last_fullsized":"2024-09-14T11:51:21.845379+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:38.416146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'211","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.636520+0000","last_change":"2024-09-14T11:11:38.680954+0000","last_active":"2024-09-14T11:52:44.636520+0000","last_peered":"2024-09-14T11:52:44.636520+0000","last_clean":"2024-09-14T11:52:44.636520+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:52:44.636520+0000","last_undegraded":"2024-09-14T11:52:44.636520+0000","last_fullsized":"2024-09-14T11:52:44.636520+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:16.743206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":27752,"num_write":889,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'207","reported_seq":794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.479672+0000","last_change":"2024-09-14T11:11:04.661066+0000","last_active":"2024-09-14T11:52:44.479672+0000","last_peered":"2024-09-14T11:52:44.479672+0000","last_clean":"2024-09-14T11:52:44.479672+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:52:44.479672+0000","last_undegraded":"2024-09-14T11:52:44.479672+0000","last_fullsized":"2024-09-14T11:52:44.479672+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:37.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":2089,"num_write":994,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'473","reported_seq":1931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.179160+0000","last_change":"2024-09-14T11:11:06.654014+0000","last_active":"2024-09-14T11:51:05.179160+0000","last_peered":"2024-09-14T11:51:05.179160+0000","last_clean":"2024-09-14T11:51:05.179160+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:51:05.179160+0000","last_undegraded":"2024-09-14T11:51:05.179160+0000","last_fullsized":"2024-09-14T11:51:05.179160+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:57.254011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'262","reported_seq":917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.666146+0000","last_change":"2024-09-14T11:11:04.647071+0000","last_active":"2024-09-14T11:52:44.666146+0000","last_peered":"2024-09-14T11:52:44.666146+0000","last_clean":"2024-09-14T11:52:44.666146+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:52:44.666146+0000","last_undegraded":"2024-09-14T11:52:44.666146+0000","last_fullsized":"2024-09-14T11:52:44.666146+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:36.999590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":42624,"num_write":1182,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'381","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.844858+0000","last_change":"2024-09-14T11:11:06.651474+0000","last_active":"2024-09-14T11:51:21.844858+0000","last_peered":"2024-09-14T11:51:21.844858+0000","last_clean":"2024-09-14T11:51:21.844858+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:51:21.844858+0000","last_undegraded":"2024-09-14T11:51:21.844858+0000","last_fullsized":"2024-09-14T11:51:21.844858+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:12.583169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1586,"ondisk_log_size":1586,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":466,"ondisk_log_size":466,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":429920,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8367,"num_read_kb":10850,"num_write":5651,"num_write_kb":2859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1852,"ondisk_log_size":1852,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2871,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4062,"ondisk_log_size":4062,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":29484888,"num_objects":168,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":42482,"num_read_kb":2539626,"num_write":64328,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41172992,"data_stored":41172992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168157,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":181387,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542655,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272880,"kb_used_data":11136,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94098960,"statfs":{"total":96636764160,"available":96357335040,"internally_reserved":0,"allocated":11403264,"data_stored":9409551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542655,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246312,"kb_used_data":8240,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94125528,"statfs":{"total":96636764160,"available":96384540672,"internally_reserved":0,"allocated":8437760,"data_stored":6489937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542653,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107664,"kb_used_data":8364,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264176,"statfs":{"total":96636764160,"available":96526516224,"internally_reserved":0,"allocated":8564736,"data_stored":6565787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542653,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120296,"kb_used_data":8588,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94251544,"statfs":{"total":96636764160,"available":96513581056,"internally_reserved":0,"allocated":8794112,"data_stored":6869156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114358726},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542652,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264312,"kb_used_data":8156,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94107528,"statfs":{"total":96636764160,"available":96366108672,"internally_reserved":0,"allocated":8351744,"data_stored":6374693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542653,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94604,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94277236,"statfs":{"total":96636764160,"available":96539889664,"internally_reserved":0,"allocated":9474048,"data_stored":7547937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542653,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149488,"kb_used_data":10012,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222352,"statfs":{"total":96636764160,"available":96483688448,"internally_reserved":0,"allocated":10252288,"data_stored":8286792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542654,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284740,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94087100,"statfs":{"total":96636764160,"available":96345190400,"internally_reserved":0,"allocated":10858496,"data_stored":8869545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6021120,"data_stored":6021120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6029312,"data_stored":6029312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4116480,"data_stored":4116480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4612096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":4308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4231168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":6561792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:52:52.645 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.645 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.645 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.646 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.647 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.648 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.649 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.650 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.651 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.652 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.653 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.654 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.655 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.656 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.657 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.658 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.659 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.660 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.661 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.662 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.663 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.664 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.665 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.666 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.667 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.668 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:10:44.296214+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.669 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.670 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.671 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.672 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.673 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:10:50.309295+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.674 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.675 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.676 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.677 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.678 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.679 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.680 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.681 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.682 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.683 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.684 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:52:52.685 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:53:12.687 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:13.030 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:53:13.048 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:53:13.051 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1530,"stamp":"2024-09-14T11:53:11.082267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30522513,"num_objects":632,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":299502,"num_read_kb":3128085,"num_write":146428,"num_write_kb":2544950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31479,"num_omap_keys":127,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12815,"ondisk_log_size":12815,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1543984,"kb_used_data":74352,"kb_used_omap":12,"kb_used_meta":1469491,"kb_avail":753430736,"statfs":{"total":773094113280,"available":771513073664,"internally_reserved":0,"allocated":76136448,"data_stored":60413398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1504759345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26841,"num_omap_keys":108,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005301"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.697419+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:52:44.697419+0000","last_peered":"2024-09-14T11:52:44.697419+0000","last_clean":"2024-09-14T11:52:44.697419+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:52:44.697419+0000","last_undegraded":"2024-09-14T11:52:44.697419+0000","last_fullsized":"2024-09-14T11:52:44.697419+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.949783+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:52:43.949783+0000","last_peered":"2024-09-14T11:52:43.949783+0000","last_clean":"2024-09-14T11:52:43.949783+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:52:43.949783+0000","last_undegraded":"2024-09-14T11:52:43.949783+0000","last_fullsized":"2024-09-14T11:52:43.949783+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935603+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:51:03.935603+0000","last_peered":"2024-09-14T11:51:03.935603+0000","last_clean":"2024-09-14T11:51:03.935603+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:51:03.935603+0000","last_undegraded":"2024-09-14T11:51:03.935603+0000","last_fullsized":"2024-09-14T11:51:03.935603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.020550+0000","last_change":"2024-09-14T11:38:32.849060+0000","last_active":"2024-09-14T11:48:34.020550+0000","last_peered":"2024-09-14T11:48:34.020550+0000","last_clean":"2024-09-14T11:48:34.020550+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:48:34.020550+0000","last_undegraded":"2024-09-14T11:48:34.020550+0000","last_fullsized":"2024-09-14T11:48:34.020550+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:37.543006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.529195+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:52:44.529195+0000","last_peered":"2024-09-14T11:52:44.529195+0000","last_clean":"2024-09-14T11:52:44.529195+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:52:44.529195+0000","last_undegraded":"2024-09-14T11:52:44.529195+0000","last_fullsized":"2024-09-14T11:52:44.529195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.950140+0000","last_change":"2024-09-14T11:27:43.844600+0000","last_active":"2024-09-14T11:52:43.950140+0000","last_peered":"2024-09-14T11:52:43.950140+0000","last_clean":"2024-09-14T11:52:43.950140+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:52:43.950140+0000","last_undegraded":"2024-09-14T11:52:43.950140+0000","last_fullsized":"2024-09-14T11:52:43.950140+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:40.492649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.031874+0000","last_change":"2024-09-14T11:26:02.011475+0000","last_active":"2024-09-14T11:50:04.031874+0000","last_peered":"2024-09-14T11:50:04.031874+0000","last_clean":"2024-09-14T11:50:04.031874+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:50:04.031874+0000","last_undegraded":"2024-09-14T11:50:04.031874+0000","last_fullsized":"2024-09-14T11:50:04.031874+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:06.067789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.924789+0000","last_change":"2024-09-14T11:38:32.844854+0000","last_active":"2024-09-14T11:50:38.924789+0000","last_peered":"2024-09-14T11:50:38.924789+0000","last_clean":"2024-09-14T11:50:38.924789+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:50:38.924789+0000","last_undegraded":"2024-09-14T11:50:38.924789+0000","last_fullsized":"2024-09-14T11:50:38.924789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'10","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528901+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:52:44.528901+0000","last_peered":"2024-09-14T11:52:44.528901+0000","last_clean":"2024-09-14T11:52:44.528901+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:52:44.528901+0000","last_undegraded":"2024-09-14T11:52:44.528901+0000","last_fullsized":"2024-09-14T11:52:44.528901+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":15373,"num_write":10,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:44.029442+0000","last_change":"2024-09-14T11:27:43.839478+0000","last_active":"2024-09-14T11:49:44.029442+0000","last_peered":"2024-09-14T11:49:44.029442+0000","last_clean":"2024-09-14T11:49:44.029442+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:49:44.029442+0000","last_undegraded":"2024-09-14T11:49:44.029442+0000","last_fullsized":"2024-09-14T11:49:44.029442+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:44.742446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933161+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:50:43.933161+0000","last_peered":"2024-09-14T11:50:43.933161+0000","last_clean":"2024-09-14T11:50:43.933161+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:50:43.933161+0000","last_undegraded":"2024-09-14T11:50:43.933161+0000","last_fullsized":"2024-09-14T11:50:43.933161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.948585+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:52:43.948585+0000","last_peered":"2024-09-14T11:52:43.948585+0000","last_clean":"2024-09-14T11:52:43.948585+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:52:43.948585+0000","last_undegraded":"2024-09-14T11:52:43.948585+0000","last_fullsized":"2024-09-14T11:52:43.948585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.942732+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:52:03.942732+0000","last_peered":"2024-09-14T11:52:03.942732+0000","last_clean":"2024-09-14T11:52:03.942732+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:52:03.942732+0000","last_undegraded":"2024-09-14T11:52:03.942732+0000","last_fullsized":"2024-09-14T11:52:03.942732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935095+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:51:03.935095+0000","last_peered":"2024-09-14T11:51:03.935095+0000","last_clean":"2024-09-14T11:51:03.935095+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:51:03.935095+0000","last_undegraded":"2024-09-14T11:51:03.935095+0000","last_fullsized":"2024-09-14T11:51:03.935095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.936054+0000","last_change":"2024-09-14T11:27:46.877556+0000","last_active":"2024-09-14T11:51:58.936054+0000","last_peered":"2024-09-14T11:51:58.936054+0000","last_clean":"2024-09-14T11:51:58.936054+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:51:58.936054+0000","last_undegraded":"2024-09-14T11:51:58.936054+0000","last_fullsized":"2024-09-14T11:51:58.936054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:18.433716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941850+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:51:58.941850+0000","last_peered":"2024-09-14T11:51:58.941850+0000","last_clean":"2024-09-14T11:51:58.941850+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:51:58.941850+0000","last_undegraded":"2024-09-14T11:51:58.941850+0000","last_fullsized":"2024-09-14T11:51:58.941850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":398,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907414+0000","last_change":"2024-09-14T11:26:02.016774+0000","last_active":"2024-09-14T11:48:33.907414+0000","last_peered":"2024-09-14T11:48:33.907414+0000","last_clean":"2024-09-14T11:48:33.907414+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:48:33.907414+0000","last_undegraded":"2024-09-14T11:48:33.907414+0000","last_fullsized":"2024-09-14T11:48:33.907414+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:07.106001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'14","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.380641+0000","last_change":"2024-09-14T11:27:46.886470+0000","last_active":"2024-09-14T11:52:44.380641+0000","last_peered":"2024-09-14T11:52:44.380641+0000","last_clean":"2024-09-14T11:52:44.380641+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:52:44.380641+0000","last_undegraded":"2024-09-14T11:52:44.380641+0000","last_fullsized":"2024-09-14T11:52:44.380641+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:31.966694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19456,"num_write":24,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.546348+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:52:44.546348+0000","last_peered":"2024-09-14T11:52:44.546348+0000","last_clean":"2024-09-14T11:52:44.546348+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:52:44.546348+0000","last_undegraded":"2024-09-14T11:52:44.546348+0000","last_fullsized":"2024-09-14T11:52:44.546348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5174,"num_write":14,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.574307+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:52:44.574307+0000","last_peered":"2024-09-14T11:52:44.574307+0000","last_clean":"2024-09-14T11:52:44.574307+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:52:44.574307+0000","last_undegraded":"2024-09-14T11:52:44.574307+0000","last_fullsized":"2024-09-14T11:52:44.574307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12280,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.928980+0000","last_change":"2024-09-14T11:26:02.018044+0000","last_active":"2024-09-14T11:50:13.928980+0000","last_peered":"2024-09-14T11:50:13.928980+0000","last_clean":"2024-09-14T11:50:13.928980+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:50:13.928980+0000","last_undegraded":"2024-09-14T11:50:13.928980+0000","last_fullsized":"2024-09-14T11:50:13.928980+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:20.434831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943383+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:51:58.943383+0000","last_peered":"2024-09-14T11:51:58.943383+0000","last_clean":"2024-09-14T11:51:58.943383+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:51:58.943383+0000","last_undegraded":"2024-09-14T11:51:58.943383+0000","last_fullsized":"2024-09-14T11:51:58.943383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.445655+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:52:44.445655+0000","last_peered":"2024-09-14T11:52:44.445655+0000","last_clean":"2024-09-14T11:52:44.445655+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:52:44.445655+0000","last_undegraded":"2024-09-14T11:52:44.445655+0000","last_fullsized":"2024-09-14T11:52:44.445655+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:57.988895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033275+0000","last_change":"2024-09-14T11:38:32.848295+0000","last_active":"2024-09-14T11:50:14.033275+0000","last_peered":"2024-09-14T11:50:14.033275+0000","last_clean":"2024-09-14T11:50:14.033275+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:50:14.033275+0000","last_undegraded":"2024-09-14T11:50:14.033275+0000","last_fullsized":"2024-09-14T11:50:14.033275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:48.994528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.380627+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:52:44.380627+0000","last_peered":"2024-09-14T11:52:44.380627+0000","last_clean":"2024-09-14T11:52:44.380627+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:52:44.380627+0000","last_undegraded":"2024-09-14T11:52:44.380627+0000","last_fullsized":"2024-09-14T11:52:44.380627+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.064017+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:51:54.064017+0000","last_peered":"2024-09-14T11:51:54.064017+0000","last_clean":"2024-09-14T11:51:54.064017+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:51:54.064017+0000","last_undegraded":"2024-09-14T11:51:54.064017+0000","last_fullsized":"2024-09-14T11:51:54.064017+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943433+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:51:58.943433+0000","last_peered":"2024-09-14T11:51:58.943433+0000","last_clean":"2024-09-14T11:51:58.943433+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:51:58.943433+0000","last_undegraded":"2024-09-14T11:51:58.943433+0000","last_fullsized":"2024-09-14T11:51:58.943433+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.027786+0000","last_change":"2024-09-14T11:27:43.833928+0000","last_active":"2024-09-14T11:49:29.027786+0000","last_peered":"2024-09-14T11:49:29.027786+0000","last_clean":"2024-09-14T11:49:29.027786+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:49:29.027786+0000","last_undegraded":"2024-09-14T11:49:29.027786+0000","last_fullsized":"2024-09-14T11:49:29.027786+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:18.568174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033312+0000","last_change":"2024-09-14T11:26:02.016653+0000","last_active":"2024-09-14T11:50:14.033312+0000","last_peered":"2024-09-14T11:50:14.033312+0000","last_clean":"2024-09-14T11:50:14.033312+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:50:14.033312+0000","last_undegraded":"2024-09-14T11:50:14.033312+0000","last_fullsized":"2024-09-14T11:50:14.033312+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:16.371317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941930+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:51:58.941930+0000","last_peered":"2024-09-14T11:51:58.941930+0000","last_clean":"2024-09-14T11:51:58.941930+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:51:58.941930+0000","last_undegraded":"2024-09-14T11:51:58.941930+0000","last_fullsized":"2024-09-14T11:51:58.941930+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932512+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:50:38.932512+0000","last_peered":"2024-09-14T11:50:38.932512+0000","last_clean":"2024-09-14T11:50:38.932512+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:50:38.932512+0000","last_undegraded":"2024-09-14T11:50:38.932512+0000","last_fullsized":"2024-09-14T11:50:38.932512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.935782+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:51:08.935782+0000","last_peered":"2024-09-14T11:51:08.935782+0000","last_clean":"2024-09-14T11:51:08.935782+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:51:08.935782+0000","last_undegraded":"2024-09-14T11:51:08.935782+0000","last_fullsized":"2024-09-14T11:51:08.935782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:19.871430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3076,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.914944+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:48:43.914944+0000","last_peered":"2024-09-14T11:48:43.914944+0000","last_clean":"2024-09-14T11:48:43.914944+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:48:43.914944+0000","last_undegraded":"2024-09-14T11:48:43.914944+0000","last_fullsized":"2024-09-14T11:48:43.914944+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:16.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932525+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:50:38.932525+0000","last_peered":"2024-09-14T11:50:38.932525+0000","last_clean":"2024-09-14T11:50:38.932525+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:50:38.932525+0000","last_undegraded":"2024-09-14T11:50:38.932525+0000","last_fullsized":"2024-09-14T11:50:38.932525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916531+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:48:48.916531+0000","last_peered":"2024-09-14T11:48:48.916531+0000","last_clean":"2024-09-14T11:48:48.916531+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:48:48.916531+0000","last_undegraded":"2024-09-14T11:48:48.916531+0000","last_fullsized":"2024-09-14T11:48:48.916531+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:11.857660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935589+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:51:03.935589+0000","last_peered":"2024-09-14T11:51:03.935589+0000","last_clean":"2024-09-14T11:51:03.935589+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:51:03.935589+0000","last_undegraded":"2024-09-14T11:51:03.935589+0000","last_fullsized":"2024-09-14T11:51:03.935589+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:55.958857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:48.916982+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:48:48.916982+0000","last_peered":"2024-09-14T11:48:48.916982+0000","last_clean":"2024-09-14T11:48:48.916982+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:48:48.916982+0000","last_undegraded":"2024-09-14T11:48:48.916982+0000","last_fullsized":"2024-09-14T11:48:48.916982+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:18.041265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.909029+0000","last_change":"2024-09-14T11:27:43.841798+0000","last_active":"2024-09-14T11:48:43.909029+0000","last_peered":"2024-09-14T11:48:43.909029+0000","last_clean":"2024-09-14T11:48:43.909029+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:48:43.909029+0000","last_undegraded":"2024-09-14T11:48:43.909029+0000","last_fullsized":"2024-09-14T11:48:43.909029+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.555324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920603+0000","last_change":"2024-09-14T11:26:02.017294+0000","last_active":"2024-09-14T11:49:23.920603+0000","last_peered":"2024-09-14T11:49:23.920603+0000","last_clean":"2024-09-14T11:49:23.920603+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:49:23.920603+0000","last_undegraded":"2024-09-14T11:49:23.920603+0000","last_fullsized":"2024-09-14T11:49:23.920603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:28.763964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932488+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:50:38.932488+0000","last_peered":"2024-09-14T11:50:38.932488+0000","last_clean":"2024-09-14T11:50:38.932488+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:50:38.932488+0000","last_undegraded":"2024-09-14T11:50:38.932488+0000","last_fullsized":"2024-09-14T11:50:38.932488+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'8","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.489272+0000","last_change":"2024-09-14T11:27:46.878156+0000","last_active":"2024-09-14T11:52:44.489272+0000","last_peered":"2024-09-14T11:52:44.489272+0000","last_clean":"2024-09-14T11:52:44.489272+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:52:44.489272+0000","last_undegraded":"2024-09-14T11:52:44.489272+0000","last_fullsized":"2024-09-14T11:52:44.489272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:16.494557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":8,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040261+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:48:44.040261+0000","last_peered":"2024-09-14T11:48:44.040261+0000","last_clean":"2024-09-14T11:48:44.040261+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:48:44.040261+0000","last_undegraded":"2024-09-14T11:48:44.040261+0000","last_fullsized":"2024-09-14T11:48:44.040261+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:04.138703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027203+0000","last_change":"2024-09-14T11:38:32.848761+0000","last_active":"2024-09-14T11:49:24.027203+0000","last_peered":"2024-09-14T11:49:24.027203+0000","last_clean":"2024-09-14T11:49:24.027203+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:49:24.027203+0000","last_undegraded":"2024-09-14T11:49:24.027203+0000","last_fullsized":"2024-09-14T11:49:24.027203+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:43.405538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.948450+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:52:33.948450+0000","last_peered":"2024-09-14T11:52:33.948450+0000","last_clean":"2024-09-14T11:52:33.948450+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:52:33.948450+0000","last_undegraded":"2024-09-14T11:52:33.948450+0000","last_fullsized":"2024-09-14T11:52:33.948450+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'10","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069792+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:52:29.069792+0000","last_peered":"2024-09-14T11:52:29.069792+0000","last_clean":"2024-09-14T11:52:29.069792+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:52:29.069792+0000","last_undegraded":"2024-09-14T11:52:29.069792+0000","last_fullsized":"2024-09-14T11:52:29.069792+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21510,"num_write":20,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.934554+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:50:53.934554+0000","last_peered":"2024-09-14T11:50:53.934554+0000","last_clean":"2024-09-14T11:50:53.934554+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:50:53.934554+0000","last_undegraded":"2024-09-14T11:50:53.934554+0000","last_fullsized":"2024-09-14T11:50:53.934554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033300+0000","last_change":"2024-09-14T11:27:43.841930+0000","last_active":"2024-09-14T11:50:14.033300+0000","last_peered":"2024-09-14T11:50:14.033300+0000","last_clean":"2024-09-14T11:50:14.033300+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:50:14.033300+0000","last_undegraded":"2024-09-14T11:50:14.033300+0000","last_fullsized":"2024-09-14T11:50:14.033300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:26.616106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.932095+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:50:48.932095+0000","last_peered":"2024-09-14T11:50:48.932095+0000","last_clean":"2024-09-14T11:50:48.932095+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:50:48.932095+0000","last_undegraded":"2024-09-14T11:50:48.932095+0000","last_fullsized":"2024-09-14T11:50:48.932095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.914592+0000","last_change":"2024-09-14T11:38:32.850327+0000","last_active":"2024-09-14T11:49:23.914592+0000","last_peered":"2024-09-14T11:49:23.914592+0000","last_clean":"2024-09-14T11:49:23.914592+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:49:23.914592+0000","last_undegraded":"2024-09-14T11:49:23.914592+0000","last_fullsized":"2024-09-14T11:49:23.914592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:28.582258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:38.949517+0000","last_change":"2024-09-14T11:27:47.189562+0000","last_active":"2024-09-14T11:52:38.949517+0000","last_peered":"2024-09-14T11:52:38.949517+0000","last_clean":"2024-09-14T11:52:38.949517+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:52:38.949517+0000","last_undegraded":"2024-09-14T11:52:38.949517+0000","last_fullsized":"2024-09-14T11:52:38.949517+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:40.247709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.947353+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:52:28.947353+0000","last_peered":"2024-09-14T11:52:28.947353+0000","last_clean":"2024-09-14T11:52:28.947353+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:52:28.947353+0000","last_undegraded":"2024-09-14T11:52:28.947353+0000","last_fullsized":"2024-09-14T11:52:28.947353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":149,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.926405+0000","last_change":"2024-09-14T11:26:02.014516+0000","last_active":"2024-09-14T11:50:48.926405+0000","last_peered":"2024-09-14T11:50:48.926405+0000","last_clean":"2024-09-14T11:50:48.926405+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:50:48.926405+0000","last_undegraded":"2024-09-14T11:50:48.926405+0000","last_fullsized":"2024-09-14T11:50:48.926405+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528715+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:52:44.528715+0000","last_peered":"2024-09-14T11:52:44.528715+0000","last_clean":"2024-09-14T11:52:44.528715+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:52:44.528715+0000","last_undegraded":"2024-09-14T11:52:44.528715+0000","last_fullsized":"2024-09-14T11:52:44.528715+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929898+0000","last_change":"2024-09-14T11:27:43.842788+0000","last_active":"2024-09-14T11:50:18.929898+0000","last_peered":"2024-09-14T11:50:18.929898+0000","last_clean":"2024-09-14T11:50:18.929898+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:50:18.929898+0000","last_undegraded":"2024-09-14T11:50:18.929898+0000","last_fullsized":"2024-09-14T11:50:18.929898+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.092780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.037825+0000","last_change":"2024-09-14T11:26:02.009131+0000","last_active":"2024-09-14T11:50:49.037825+0000","last_peered":"2024-09-14T11:50:49.037825+0000","last_clean":"2024-09-14T11:50:49.037825+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:50:49.037825+0000","last_undegraded":"2024-09-14T11:50:49.037825+0000","last_fullsized":"2024-09-14T11:50:49.037825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939031+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:51:38.939031+0000","last_peered":"2024-09-14T11:51:38.939031+0000","last_clean":"2024-09-14T11:51:38.939031+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:51:38.939031+0000","last_undegraded":"2024-09-14T11:51:38.939031+0000","last_fullsized":"2024-09-14T11:51:38.939031+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6166,"num_write":6,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933751+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:48.933751+0000","last_peered":"2024-09-14T11:50:48.933751+0000","last_clean":"2024-09-14T11:50:48.933751+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:48.933751+0000","last_undegraded":"2024-09-14T11:50:48.933751+0000","last_fullsized":"2024-09-14T11:50:48.933751+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061553+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:51:39.061553+0000","last_peered":"2024-09-14T11:51:39.061553+0000","last_clean":"2024-09-14T11:51:39.061553+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:51:39.061553+0000","last_undegraded":"2024-09-14T11:51:39.061553+0000","last_fullsized":"2024-09-14T11:51:39.061553+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.529065+0000","last_change":"2024-09-14T11:27:43.843512+0000","last_active":"2024-09-14T11:52:44.529065+0000","last_peered":"2024-09-14T11:52:44.529065+0000","last_clean":"2024-09-14T11:52:44.529065+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:52:44.529065+0000","last_undegraded":"2024-09-14T11:52:44.529065+0000","last_fullsized":"2024-09-14T11:52:44.529065+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:55.973787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4143,"num_write":14,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929860+0000","last_change":"2024-09-14T11:27:46.881654+0000","last_active":"2024-09-14T11:50:18.929860+0000","last_peered":"2024-09-14T11:50:18.929860+0000","last_clean":"2024-09-14T11:50:18.929860+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:50:18.929860+0000","last_undegraded":"2024-09-14T11:50:18.929860+0000","last_fullsized":"2024-09-14T11:50:18.929860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:09.752180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061607+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:51:39.061607+0000","last_peered":"2024-09-14T11:51:39.061607+0000","last_clean":"2024-09-14T11:51:39.061607+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:51:39.061607+0000","last_undegraded":"2024-09-14T11:51:39.061607+0000","last_fullsized":"2024-09-14T11:51:39.061607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918260+0000","last_change":"2024-09-14T11:26:02.015867+0000","last_active":"2024-09-14T11:49:53.918260+0000","last_peered":"2024-09-14T11:49:53.918260+0000","last_clean":"2024-09-14T11:49:53.918260+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:49:53.918260+0000","last_undegraded":"2024-09-14T11:49:53.918260+0000","last_fullsized":"2024-09-14T11:49:53.918260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:45.729260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.055999+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:51:04.055999+0000","last_peered":"2024-09-14T11:51:04.055999+0000","last_clean":"2024-09-14T11:51:04.055999+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:51:04.055999+0000","last_undegraded":"2024-09-14T11:51:04.055999+0000","last_fullsized":"2024-09-14T11:51:04.055999+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.708498+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:52:44.708498+0000","last_peered":"2024-09-14T11:52:44.708498+0000","last_clean":"2024-09-14T11:52:44.708498+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:52:44.708498+0000","last_undegraded":"2024-09-14T11:52:44.708498+0000","last_fullsized":"2024-09-14T11:52:44.708498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.650184+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:52:44.650184+0000","last_peered":"2024-09-14T11:52:44.650184+0000","last_clean":"2024-09-14T11:52:44.650184+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:52:44.650184+0000","last_undegraded":"2024-09-14T11:52:44.650184+0000","last_fullsized":"2024-09-14T11:52:44.650184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10258,"num_write":8,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.934219+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:51:03.934219+0000","last_peered":"2024-09-14T11:51:03.934219+0000","last_clean":"2024-09-14T11:51:03.934219+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:51:03.934219+0000","last_undegraded":"2024-09-14T11:51:03.934219+0000","last_fullsized":"2024-09-14T11:51:03.934219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933194+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:50:43.933194+0000","last_peered":"2024-09-14T11:50:43.933194+0000","last_clean":"2024-09-14T11:50:43.933194+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:50:43.933194+0000","last_undegraded":"2024-09-14T11:50:43.933194+0000","last_fullsized":"2024-09-14T11:50:43.933194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.648469+0000","last_change":"2024-09-14T11:27:43.842571+0000","last_active":"2024-09-14T11:52:44.648469+0000","last_peered":"2024-09-14T11:52:44.648469+0000","last_clean":"2024-09-14T11:52:44.648469+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:52:44.648469+0000","last_undegraded":"2024-09-14T11:52:44.648469+0000","last_fullsized":"2024-09-14T11:52:44.648469+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:54.316859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4136,"num_write":12,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.918333+0000","last_change":"2024-09-14T11:26:02.017925+0000","last_active":"2024-09-14T11:49:53.918333+0000","last_peered":"2024-09-14T11:49:53.918333+0000","last_clean":"2024-09-14T11:49:53.918333+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:49:53.918333+0000","last_undegraded":"2024-09-14T11:49:53.918333+0000","last_fullsized":"2024-09-14T11:49:53.918333+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:08.536746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.938534+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:51:33.938534+0000","last_peered":"2024-09-14T11:51:33.938534+0000","last_clean":"2024-09-14T11:51:33.938534+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:51:33.938534+0000","last_undegraded":"2024-09-14T11:51:33.938534+0000","last_fullsized":"2024-09-14T11:51:33.938534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056053+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:51:04.056053+0000","last_peered":"2024-09-14T11:51:04.056053+0000","last_clean":"2024-09-14T11:51:04.056053+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:51:04.056053+0000","last_undegraded":"2024-09-14T11:51:04.056053+0000","last_fullsized":"2024-09-14T11:51:04.056053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.933736+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:51:03.933736+0000","last_peered":"2024-09-14T11:51:03.933736+0000","last_clean":"2024-09-14T11:51:03.933736+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:51:03.933736+0000","last_undegraded":"2024-09-14T11:51:03.933736+0000","last_fullsized":"2024-09-14T11:51:03.933736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939147+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:51:38.939147+0000","last_peered":"2024-09-14T11:51:38.939147+0000","last_clean":"2024-09-14T11:51:38.939147+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:51:38.939147+0000","last_undegraded":"2024-09-14T11:51:38.939147+0000","last_fullsized":"2024-09-14T11:51:38.939147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.060905+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:51:34.060905+0000","last_peered":"2024-09-14T11:51:34.060905+0000","last_clean":"2024-09-14T11:51:34.060905+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:51:34.060905+0000","last_undegraded":"2024-09-14T11:51:34.060905+0000","last_fullsized":"2024-09-14T11:51:34.060905+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935044+0000","last_change":"2024-09-14T11:26:02.017129+0000","last_active":"2024-09-14T11:51:03.935044+0000","last_peered":"2024-09-14T11:51:03.935044+0000","last_clean":"2024-09-14T11:51:03.935044+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:51:03.935044+0000","last_undegraded":"2024-09-14T11:51:03.935044+0000","last_fullsized":"2024-09-14T11:51:03.935044+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.027265+0000","last_change":"2024-09-14T11:38:32.849590+0000","last_active":"2024-09-14T11:49:24.027265+0000","last_peered":"2024-09-14T11:49:24.027265+0000","last_clean":"2024-09-14T11:49:24.027265+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:49:24.027265+0000","last_undegraded":"2024-09-14T11:49:24.027265+0000","last_fullsized":"2024-09-14T11:49:24.027265+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:47.728058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'5","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528783+0000","last_change":"2024-09-14T11:27:46.881829+0000","last_active":"2024-09-14T11:52:44.528783+0000","last_peered":"2024-09-14T11:52:44.528783+0000","last_clean":"2024-09-14T11:52:44.528783+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:52:44.528783+0000","last_undegraded":"2024-09-14T11:52:44.528783+0000","last_fullsized":"2024-09-14T11:52:44.528783+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:28.272707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528818+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:52:44.528818+0000","last_peered":"2024-09-14T11:52:44.528818+0000","last_clean":"2024-09-14T11:52:44.528818+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:52:44.528818+0000","last_undegraded":"2024-09-14T11:52:44.528818+0000","last_fullsized":"2024-09-14T11:52:44.528818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.934234+0000","last_change":"2024-09-14T11:26:02.004701+0000","last_active":"2024-09-14T11:51:03.934234+0000","last_peered":"2024-09-14T11:51:03.934234+0000","last_clean":"2024-09-14T11:51:03.934234+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:51:03.934234+0000","last_undegraded":"2024-09-14T11:51:03.934234+0000","last_fullsized":"2024-09-14T11:51:03.934234+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.072123+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:52:44.072123+0000","last_peered":"2024-09-14T11:52:44.072123+0000","last_clean":"2024-09-14T11:52:44.072123+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:52:44.072123+0000","last_undegraded":"2024-09-14T11:52:44.072123+0000","last_fullsized":"2024-09-14T11:52:44.072123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.933780+0000","last_change":"2024-09-14T11:26:02.017353+0000","last_active":"2024-09-14T11:51:03.933780+0000","last_peered":"2024-09-14T11:51:03.933780+0000","last_clean":"2024-09-14T11:51:03.933780+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:51:03.933780+0000","last_undegraded":"2024-09-14T11:51:03.933780+0000","last_fullsized":"2024-09-14T11:51:03.933780+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935528+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:51:03.935528+0000","last_peered":"2024-09-14T11:51:03.935528+0000","last_clean":"2024-09-14T11:51:03.935528+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:51:03.935528+0000","last_undegraded":"2024-09-14T11:51:03.935528+0000","last_fullsized":"2024-09-14T11:51:03.935528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.925650+0000","last_change":"2024-09-14T11:27:46.880908+0000","last_active":"2024-09-14T11:50:43.925650+0000","last_peered":"2024-09-14T11:50:43.925650+0000","last_clean":"2024-09-14T11:50:43.925650+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:50:43.925650+0000","last_undegraded":"2024-09-14T11:50:43.925650+0000","last_fullsized":"2024-09-14T11:50:43.925650+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:28.300991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932313+0000","last_change":"2024-09-14T11:27:43.841331+0000","last_active":"2024-09-14T11:50:38.932313+0000","last_peered":"2024-09-14T11:50:38.932313+0000","last_clean":"2024-09-14T11:50:38.932313+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:50:38.932313+0000","last_undegraded":"2024-09-14T11:50:38.932313+0000","last_fullsized":"2024-09-14T11:50:38.932313+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:03.837930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.928305+0000","last_change":"2024-09-14T11:26:02.017191+0000","last_active":"2024-09-14T11:51:03.928305+0000","last_peered":"2024-09-14T11:51:03.928305+0000","last_clean":"2024-09-14T11:51:03.928305+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:51:03.928305+0000","last_undegraded":"2024-09-14T11:51:03.928305+0000","last_fullsized":"2024-09-14T11:51:03.928305+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056063+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:51:04.056063+0000","last_peered":"2024-09-14T11:51:04.056063+0000","last_clean":"2024-09-14T11:51:04.056063+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:51:04.056063+0000","last_undegraded":"2024-09-14T11:51:04.056063+0000","last_fullsized":"2024-09-14T11:51:04.056063+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.930926+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:50:43.930926+0000","last_peered":"2024-09-14T11:50:43.930926+0000","last_clean":"2024-09-14T11:50:43.930926+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:50:43.930926+0000","last_undegraded":"2024-09-14T11:50:43.930926+0000","last_fullsized":"2024-09-14T11:50:43.930926+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.942657+0000","last_change":"2024-09-14T11:27:43.841443+0000","last_active":"2024-09-14T11:52:43.942657+0000","last_peered":"2024-09-14T11:52:43.942657+0000","last_clean":"2024-09-14T11:52:43.942657+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:52:43.942657+0000","last_undegraded":"2024-09-14T11:52:43.942657+0000","last_fullsized":"2024-09-14T11:52:43.942657+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:06.530035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10252,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:04.046775+0000","last_change":"2024-09-14T11:26:02.020510+0000","last_active":"2024-09-14T11:50:04.046775+0000","last_peered":"2024-09-14T11:50:04.046775+0000","last_clean":"2024-09-14T11:50:04.046775+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:50:04.046775+0000","last_undegraded":"2024-09-14T11:50:04.046775+0000","last_fullsized":"2024-09-14T11:50:04.046775+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:08.037149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'219","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.104497+0000","last_change":"2024-09-14T11:53:04.104497+0000","last_active":"2024-09-14T11:53:04.104497+0000","last_peered":"2024-09-14T11:53:04.104497+0000","last_clean":"2024-09-14T11:53:04.104497+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:53:04.104497+0000","last_undegraded":"2024-09-14T11:53:04.104497+0000","last_fullsized":"2024-09-14T11:53:04.104497+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.104357+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:27.489992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":26852,"num_write":1005,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1170","reported_seq":2801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:47.942831+0000","last_change":"2024-09-14T11:11:06.652913+0000","last_active":"2024-09-14T11:50:47.942831+0000","last_peered":"2024-09-14T11:50:47.942831+0000","last_clean":"2024-09-14T11:50:47.942831+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:50:47.942831+0000","last_undegraded":"2024-09-14T11:50:47.942831+0000","last_fullsized":"2024-09-14T11:50:47.942831+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:14.129052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'198","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.685758+0000","last_change":"2024-09-14T11:52:55.685758+0000","last_active":"2024-09-14T11:52:55.685758+0000","last_peered":"2024-09-14T11:52:55.685758+0000","last_clean":"2024-09-14T11:52:55.685758+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:52:55.685758+0000","last_undegraded":"2024-09-14T11:52:55.685758+0000","last_fullsized":"2024-09-14T11:52:55.685758+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.685603+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:37.938060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":7476,"num_write":916,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'449","reported_seq":2025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.437450+0000","last_change":"2024-09-14T11:11:06.659297+0000","last_active":"2024-09-14T11:52:36.437450+0000","last_peered":"2024-09-14T11:52:36.437450+0000","last_clean":"2024-09-14T11:52:36.437450+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:52:36.437450+0000","last_undegraded":"2024-09-14T11:52:36.437450+0000","last_fullsized":"2024-09-14T11:52:36.437450+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:11.366968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'223","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.173154+0000","last_change":"2024-09-14T11:52:58.173154+0000","last_active":"2024-09-14T11:52:58.173154+0000","last_peered":"2024-09-14T11:52:58.173154+0000","last_clean":"2024-09-14T11:52:58.173154+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:52:58.173154+0000","last_undegraded":"2024-09-14T11:52:58.173154+0000","last_fullsized":"2024-09-14T11:52:58.173154+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.172939+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:36.789370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":599,"num_read_kb":30059,"num_write":1074,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'879","reported_seq":2626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.892231+0000","last_change":"2024-09-14T11:11:06.647529+0000","last_active":"2024-09-14T11:51:03.892231+0000","last_peered":"2024-09-14T11:51:03.892231+0000","last_clean":"2024-09-14T11:51:03.892231+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:51:03.892231+0000","last_undegraded":"2024-09-14T11:51:03.892231+0000","last_fullsized":"2024-09-14T11:51:03.892231+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":800,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:50.451539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'228","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.163088+0000","last_change":"2024-09-14T11:53:03.163088+0000","last_active":"2024-09-14T11:53:03.163088+0000","last_peered":"2024-09-14T11:53:03.163088+0000","last_clean":"2024-09-14T11:53:03.163088+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:53:03.163088+0000","last_undegraded":"2024-09-14T11:53:03.163088+0000","last_fullsized":"2024-09-14T11:53:03.163088+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.162958+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:03.455162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":74674,"num_write":901,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'394","reported_seq":1946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.058982+0000","last_change":"2024-09-14T11:53:07.058982+0000","last_active":"2024-09-14T11:53:07.058982+0000","last_peered":"2024-09-14T11:53:07.058982+0000","last_clean":"2024-09-14T11:53:07.058982+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:53:07.058982+0000","last_undegraded":"2024-09-14T11:53:07.058982+0000","last_fullsized":"2024-09-14T11:53:07.058982+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.058896+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.485594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'244","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.132482+0000","last_change":"2024-09-14T11:53:07.132482+0000","last_active":"2024-09-14T11:53:07.132482+0000","last_peered":"2024-09-14T11:53:07.132482+0000","last_clean":"2024-09-14T11:53:07.132482+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:53:07.132482+0000","last_undegraded":"2024-09-14T11:53:07.132482+0000","last_fullsized":"2024-09-14T11:53:07.132482+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.132325+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:44.056191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":17405,"num_write":1116,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'823","reported_seq":2492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.080576+0000","last_change":"2024-09-14T11:53:03.080576+0000","last_active":"2024-09-14T11:53:03.080576+0000","last_peered":"2024-09-14T11:53:03.080576+0000","last_clean":"2024-09-14T11:53:03.080576+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:53:03.080576+0000","last_undegraded":"2024-09-14T11:53:03.080576+0000","last_fullsized":"2024-09-14T11:53:03.080576+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.080464+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:29.386530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'217","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.129946+0000","last_change":"2024-09-14T11:53:02.129946+0000","last_active":"2024-09-14T11:53:02.129946+0000","last_peered":"2024-09-14T11:53:02.129946+0000","last_clean":"2024-09-14T11:53:02.129946+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:53:02.129946+0000","last_undegraded":"2024-09-14T11:53:02.129946+0000","last_fullsized":"2024-09-14T11:53:02.129946+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.129833+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.366991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":70473,"num_write":980,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'495","reported_seq":2045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172878+0000","last_change":"2024-09-14T11:11:06.646675+0000","last_active":"2024-09-14T11:51:07.172878+0000","last_peered":"2024-09-14T11:51:07.172878+0000","last_clean":"2024-09-14T11:51:07.172878+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:51:07.172878+0000","last_undegraded":"2024-09-14T11:51:07.172878+0000","last_fullsized":"2024-09-14T11:51:07.172878+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:56.132334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'224","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.111904+0000","last_change":"2024-09-14T11:53:03.111904+0000","last_active":"2024-09-14T11:53:03.111904+0000","last_peered":"2024-09-14T11:53:03.111904+0000","last_clean":"2024-09-14T11:53:03.111904+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:53:03.111904+0000","last_undegraded":"2024-09-14T11:53:03.111904+0000","last_fullsized":"2024-09-14T11:53:03.111904+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.111777+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:53.985189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":632,"num_read_kb":10774,"num_write":1050,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'701","reported_seq":2124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.172528+0000","last_change":"2024-09-14T11:11:06.661372+0000","last_active":"2024-09-14T11:51:07.172528+0000","last_peered":"2024-09-14T11:51:07.172528+0000","last_clean":"2024-09-14T11:51:07.172528+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:51:07.172528+0000","last_undegraded":"2024-09-14T11:51:07.172528+0000","last_fullsized":"2024-09-14T11:51:07.172528+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:52.380188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'235","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.227469+0000","last_change":"2024-09-14T11:53:01.227469+0000","last_active":"2024-09-14T11:53:01.227469+0000","last_peered":"2024-09-14T11:53:01.227469+0000","last_clean":"2024-09-14T11:53:01.227469+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:53:01.227469+0000","last_undegraded":"2024-09-14T11:53:01.227469+0000","last_fullsized":"2024-09-14T11:53:01.227469+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.227337+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:36.676072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1301,"num_read_kb":98345,"num_write":1096,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'785","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.459599+0000","last_change":"2024-09-14T11:53:06.459599+0000","last_active":"2024-09-14T11:53:06.459599+0000","last_peered":"2024-09-14T11:53:06.459599+0000","last_clean":"2024-09-14T11:53:06.459599+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:53:06.459599+0000","last_undegraded":"2024-09-14T11:53:06.459599+0000","last_fullsized":"2024-09-14T11:53:06.459599+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.459498+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:46.080698+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'849","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.977158+0000","last_change":"2024-09-14T11:53:06.977094+0000","last_active":"2024-09-14T11:53:06.977158+0000","last_peered":"2024-09-14T11:53:06.977158+0000","last_clean":"2024-09-14T11:53:06.977158+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:53:06.977158+0000","last_undegraded":"2024-09-14T11:53:06.977158+0000","last_fullsized":"2024-09-14T11:53:06.977158+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'849","last_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_deep_scrub":"263'849","last_deep_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.976996+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:52.713389+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'237","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.158616+0000","last_change":"2024-09-14T11:53:01.158616+0000","last_active":"2024-09-14T11:53:01.158616+0000","last_peered":"2024-09-14T11:53:01.158616+0000","last_clean":"2024-09-14T11:53:01.158616+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:53:01.158616+0000","last_undegraded":"2024-09-14T11:53:01.158616+0000","last_fullsized":"2024-09-14T11:53:01.158616+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.158497+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:17.980141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":29179,"num_write":1120,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.147798+0000","last_change":"2024-09-14T11:53:06.147735+0000","last_active":"2024-09-14T11:53:06.147798+0000","last_peered":"2024-09-14T11:53:06.147798+0000","last_clean":"2024-09-14T11:53:06.147798+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:53:06.147798+0000","last_undegraded":"2024-09-14T11:53:06.147798+0000","last_fullsized":"2024-09-14T11:53:06.147798+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'874","last_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_deep_scrub":"263'874","last_deep_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.147589+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:09.954332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.050944+0000","last_change":"2024-09-14T11:52:58.050944+0000","last_active":"2024-09-14T11:52:58.050944+0000","last_peered":"2024-09-14T11:52:58.050944+0000","last_clean":"2024-09-14T11:52:58.050944+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:52:58.050944+0000","last_undegraded":"2024-09-14T11:52:58.050944+0000","last_fullsized":"2024-09-14T11:52:58.050944+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.050832+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:44.576976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":818,"num_read_kb":241766,"num_write":938,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'520","reported_seq":2228,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.166308+0000","last_change":"2024-09-14T11:53:08.166308+0000","last_active":"2024-09-14T11:53:08.166308+0000","last_peered":"2024-09-14T11:53:08.166308+0000","last_clean":"2024-09-14T11:53:08.166308+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:53:08.166308+0000","last_undegraded":"2024-09-14T11:53:08.166308+0000","last_fullsized":"2024-09-14T11:53:08.166308+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.166227+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.323522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'271","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.033421+0000","last_change":"2024-09-14T11:52:55.033421+0000","last_active":"2024-09-14T11:52:55.033421+0000","last_peered":"2024-09-14T11:52:55.033421+0000","last_clean":"2024-09-14T11:52:55.033421+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:52:55.033421+0000","last_undegraded":"2024-09-14T11:52:55.033421+0000","last_fullsized":"2024-09-14T11:52:55.033421+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'271","last_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_deep_scrub":"263'271","last_deep_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.033320+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.632089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":32324,"num_write":1007,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'859","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.571925+0000","last_change":"2024-09-14T11:52:57.571925+0000","last_active":"2024-09-14T11:52:57.571925+0000","last_peered":"2024-09-14T11:52:57.571925+0000","last_clean":"2024-09-14T11:52:57.571925+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:52:57.571925+0000","last_undegraded":"2024-09-14T11:52:57.571925+0000","last_fullsized":"2024-09-14T11:52:57.571925+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'859","last_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_deep_scrub":"263'859","last_deep_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.571844+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:30.711939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'237","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.142508+0000","last_change":"2024-09-14T11:52:54.142508+0000","last_active":"2024-09-14T11:52:54.142508+0000","last_peered":"2024-09-14T11:52:54.142508+0000","last_clean":"2024-09-14T11:52:54.142508+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:52:54.142508+0000","last_undegraded":"2024-09-14T11:52:54.142508+0000","last_fullsized":"2024-09-14T11:52:54.142508+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.142380+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:13.742745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":18423,"num_write":1039,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1030","reported_seq":2690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.596255+0000","last_change":"2024-09-14T11:53:00.596255+0000","last_active":"2024-09-14T11:53:00.596255+0000","last_peered":"2024-09-14T11:53:00.596255+0000","last_clean":"2024-09-14T11:53:00.596255+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:53:00.596255+0000","last_undegraded":"2024-09-14T11:53:00.596255+0000","last_fullsized":"2024-09-14T11:53:00.596255+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1030","last_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_deep_scrub":"263'1030","last_deep_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.596176+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:15.754364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'208","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.216578+0000","last_change":"2024-09-14T11:53:00.216578+0000","last_active":"2024-09-14T11:53:00.216578+0000","last_peered":"2024-09-14T11:53:00.216578+0000","last_clean":"2024-09-14T11:53:00.216578+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:53:00.216578+0000","last_undegraded":"2024-09-14T11:53:00.216578+0000","last_fullsized":"2024-09-14T11:53:00.216578+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.216460+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:58.339356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":19801,"num_write":945,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'479","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.954376+0000","last_change":"2024-09-14T11:53:07.954376+0000","last_active":"2024-09-14T11:53:07.954376+0000","last_peered":"2024-09-14T11:53:07.954376+0000","last_clean":"2024-09-14T11:53:07.954376+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:53:07.954376+0000","last_undegraded":"2024-09-14T11:53:07.954376+0000","last_fullsized":"2024-09-14T11:53:07.954376+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.954280+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:48.601994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'231","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.176414+0000","last_change":"2024-09-14T11:52:57.176414+0000","last_active":"2024-09-14T11:52:57.176414+0000","last_peered":"2024-09-14T11:52:57.176414+0000","last_clean":"2024-09-14T11:52:57.176414+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:52:57.176414+0000","last_undegraded":"2024-09-14T11:52:57.176414+0000","last_fullsized":"2024-09-14T11:52:57.176414+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.176294+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:01.150031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1266,"num_read_kb":11303,"num_write":1123,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'134","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.905769+0000","last_change":"2024-09-14T11:11:14.694441+0000","last_active":"2024-09-14T11:51:21.905769+0000","last_peered":"2024-09-14T11:51:21.905769+0000","last_clean":"2024-09-14T11:51:21.905769+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:51:21.905769+0000","last_undegraded":"2024-09-14T11:51:21.905769+0000","last_fullsized":"2024-09-14T11:51:21.905769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:00.901804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'946","reported_seq":2827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.250658+0000","last_change":"2024-09-14T11:53:04.250658+0000","last_active":"2024-09-14T11:53:04.250658+0000","last_peered":"2024-09-14T11:53:04.250658+0000","last_clean":"2024-09-14T11:53:04.250658+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:53:04.250658+0000","last_undegraded":"2024-09-14T11:53:04.250658+0000","last_fullsized":"2024-09-14T11:53:04.250658+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'946","last_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_deep_scrub":"263'946","last_deep_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.250543+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":900,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:39.287226+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'233","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.164938+0000","last_change":"2024-09-14T11:53:00.164869+0000","last_active":"2024-09-14T11:53:00.164938+0000","last_peered":"2024-09-14T11:53:00.164938+0000","last_clean":"2024-09-14T11:53:00.164938+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:53:00.164938+0000","last_undegraded":"2024-09-14T11:53:00.164938+0000","last_fullsized":"2024-09-14T11:53:00.164938+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.164685+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:01.744253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368206,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":732,"num_read_kb":7795,"num_write":1213,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.089256+0000","last_change":"2024-09-14T11:11:08.656138+0000","last_active":"2024-09-14T11:52:44.089256+0000","last_peered":"2024-09-14T11:52:44.089256+0000","last_clean":"2024-09-14T11:52:44.089256+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:52:44.089256+0000","last_undegraded":"2024-09-14T11:52:44.089256+0000","last_fullsized":"2024-09-14T11:52:44.089256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:46.774101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'191","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.590375+0000","last_change":"2024-09-14T11:11:10.669375+0000","last_active":"2024-09-14T11:52:44.590375+0000","last_peered":"2024-09-14T11:52:44.590375+0000","last_clean":"2024-09-14T11:52:44.590375+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:52:44.590375+0000","last_undegraded":"2024-09-14T11:52:44.590375+0000","last_fullsized":"2024-09-14T11:52:44.590375+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:40.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":349,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045436+0000","last_change":"2024-09-14T11:11:12.678656+0000","last_active":"2024-09-14T11:49:54.045436+0000","last_peered":"2024-09-14T11:49:54.045436+0000","last_clean":"2024-09-14T11:49:54.045436+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:49:54.045436+0000","last_undegraded":"2024-09-14T11:49:54.045436+0000","last_fullsized":"2024-09-14T11:49:54.045436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:17.903974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2494","reported_seq":4314,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.904000+0000","last_change":"2024-09-14T11:11:14.691811+0000","last_active":"2024-09-14T11:51:21.904000+0000","last_peered":"2024-09-14T11:51:21.904000+0000","last_clean":"2024-09-14T11:51:21.904000+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:51:21.904000+0000","last_undegraded":"2024-09-14T11:51:21.904000+0000","last_fullsized":"2024-09-14T11:51:21.904000+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":2400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:53.391799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'508","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.160252+0000","last_change":"2024-09-14T11:53:05.160252+0000","last_active":"2024-09-14T11:53:05.160252+0000","last_peered":"2024-09-14T11:53:05.160252+0000","last_clean":"2024-09-14T11:53:05.160252+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:53:05.160252+0000","last_undegraded":"2024-09-14T11:53:05.160252+0000","last_fullsized":"2024-09-14T11:53:05.160252+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'508","last_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_deep_scrub":"263'508","last_deep_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.160161+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:03.024651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'190","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.226742+0000","last_change":"2024-09-14T11:52:50.226660+0000","last_active":"2024-09-14T11:52:50.226742+0000","last_peered":"2024-09-14T11:52:50.226742+0000","last_clean":"2024-09-14T11:52:50.226742+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:52:50.226742+0000","last_undegraded":"2024-09-14T11:52:50.226742+0000","last_fullsized":"2024-09-14T11:52:50.226742+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.226549+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:48.793214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":11633,"num_write":915,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.915492+0000","last_change":"2024-09-14T11:11:08.651536+0000","last_active":"2024-09-14T11:48:38.915492+0000","last_peered":"2024-09-14T11:48:38.915492+0000","last_clean":"2024-09-14T11:48:38.915492+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:48:38.915492+0000","last_undegraded":"2024-09-14T11:48:38.915492+0000","last_fullsized":"2024-09-14T11:48:38.915492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:53.401285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'91","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.281938+0000","last_change":"2024-09-14T11:11:10.665667+0000","last_active":"2024-09-14T11:51:19.281938+0000","last_peered":"2024-09-14T11:51:19.281938+0000","last_clean":"2024-09-14T11:51:19.281938+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:51:19.281938+0000","last_undegraded":"2024-09-14T11:51:19.281938+0000","last_fullsized":"2024-09-14T11:51:19.281938+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:39.702426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924491+0000","last_change":"2024-09-14T11:11:12.680761+0000","last_active":"2024-09-14T11:49:53.924491+0000","last_peered":"2024-09-14T11:49:53.924491+0000","last_clean":"2024-09-14T11:49:53.924491+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:49:53.924491+0000","last_undegraded":"2024-09-14T11:49:53.924491+0000","last_fullsized":"2024-09-14T11:49:53.924491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:43.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'123","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:55.339329+0000","last_change":"2024-09-14T11:11:14.689043+0000","last_active":"2024-09-14T11:50:55.339329+0000","last_peered":"2024-09-14T11:50:55.339329+0000","last_clean":"2024-09-14T11:50:55.339329+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:50:55.339329+0000","last_undegraded":"2024-09-14T11:50:55.339329+0000","last_fullsized":"2024-09-14T11:50:55.339329+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:04.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'394","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.123155+0000","last_change":"2024-09-14T11:53:02.123155+0000","last_active":"2024-09-14T11:53:02.123155+0000","last_peered":"2024-09-14T11:53:02.123155+0000","last_clean":"2024-09-14T11:53:02.123155+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:53:02.123155+0000","last_undegraded":"2024-09-14T11:53:02.123155+0000","last_fullsized":"2024-09-14T11:53:02.123155+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.123061+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:43.333665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094056+0000","last_change":"2024-09-14T11:52:57.093996+0000","last_active":"2024-09-14T11:52:57.094056+0000","last_peered":"2024-09-14T11:52:57.094056+0000","last_clean":"2024-09-14T11:52:57.094056+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:52:57.094056+0000","last_undegraded":"2024-09-14T11:52:57.094056+0000","last_fullsized":"2024-09-14T11:52:57.094056+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.093902+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.305587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":25054,"num_write":828,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925536+0000","last_change":"2024-09-14T11:11:08.651600+0000","last_active":"2024-09-14T11:49:48.925536+0000","last_peered":"2024-09-14T11:49:48.925536+0000","last_clean":"2024-09-14T11:49:48.925536+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:49:48.925536+0000","last_undegraded":"2024-09-14T11:49:48.925536+0000","last_fullsized":"2024-09-14T11:49:48.925536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:50.328934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.523674+0000","last_change":"2024-09-14T11:53:08.523674+0000","last_active":"2024-09-14T11:53:08.523674+0000","last_peered":"2024-09-14T11:53:08.523674+0000","last_clean":"2024-09-14T11:53:08.523674+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:53:08.523674+0000","last_undegraded":"2024-09-14T11:53:08.523674+0000","last_fullsized":"2024-09-14T11:53:08.523674+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.523568+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:13.194309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'765","reported_seq":2151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.320355+0000","last_change":"2024-09-14T11:11:12.682478+0000","last_active":"2024-09-14T11:52:44.320355+0000","last_peered":"2024-09-14T11:52:44.320355+0000","last_clean":"2024-09-14T11:52:44.320355+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:52:44.320355+0000","last_undegraded":"2024-09-14T11:52:44.320355+0000","last_fullsized":"2024-09-14T11:52:44.320355+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:25.618170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'257","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.373071+0000","last_change":"2024-09-14T11:11:14.886604+0000","last_active":"2024-09-14T11:51:21.373071+0000","last_peered":"2024-09-14T11:51:21.373071+0000","last_clean":"2024-09-14T11:51:21.373071+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:51:21.373071+0000","last_undegraded":"2024-09-14T11:51:21.373071+0000","last_fullsized":"2024-09-14T11:51:21.373071+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:17.055065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'612","reported_seq":2281,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.242310+0000","last_change":"2024-09-14T11:53:05.242310+0000","last_active":"2024-09-14T11:53:05.242310+0000","last_peered":"2024-09-14T11:53:05.242310+0000","last_clean":"2024-09-14T11:53:05.242310+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:53:05.242310+0000","last_undegraded":"2024-09-14T11:53:05.242310+0000","last_fullsized":"2024-09-14T11:53:05.242310+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'612","last_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_deep_scrub":"263'612","last_deep_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.242215+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:11.508154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'257","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.040132+0000","last_change":"2024-09-14T11:52:53.040059+0000","last_active":"2024-09-14T11:52:53.040132+0000","last_peered":"2024-09-14T11:52:53.040132+0000","last_clean":"2024-09-14T11:52:53.040132+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:52:53.040132+0000","last_undegraded":"2024-09-14T11:52:53.040132+0000","last_fullsized":"2024-09-14T11:52:53.040132+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.039947+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:30.725773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1223,"num_read_kb":9329,"num_write":1113,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.924083+0000","last_change":"2024-09-14T11:11:08.658911+0000","last_active":"2024-09-14T11:49:48.924083+0000","last_peered":"2024-09-14T11:49:48.924083+0000","last_clean":"2024-09-14T11:49:48.924083+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:49:48.924083+0000","last_undegraded":"2024-09-14T11:49:48.924083+0000","last_fullsized":"2024-09-14T11:49:48.924083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:43.590217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'116","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.522536+0000","last_change":"2024-09-14T11:11:10.883531+0000","last_active":"2024-09-14T11:52:44.522536+0000","last_peered":"2024-09-14T11:52:44.522536+0000","last_clean":"2024-09-14T11:52:44.522536+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:52:44.522536+0000","last_undegraded":"2024-09-14T11:52:44.522536+0000","last_fullsized":"2024-09-14T11:52:44.522536+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:37.652994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8244,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":211,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'819","reported_seq":2292,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.324541+0000","last_change":"2024-09-14T11:11:12.683537+0000","last_active":"2024-09-14T11:52:44.324541+0000","last_peered":"2024-09-14T11:52:44.324541+0000","last_clean":"2024-09-14T11:52:44.324541+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:52:44.324541+0000","last_undegraded":"2024-09-14T11:52:44.324541+0000","last_fullsized":"2024-09-14T11:52:44.324541+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:38.308562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.160898+0000","last_change":"2024-09-14T11:53:04.160898+0000","last_active":"2024-09-14T11:53:04.160898+0000","last_peered":"2024-09-14T11:53:04.160898+0000","last_clean":"2024-09-14T11:53:04.160898+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:53:04.160898+0000","last_undegraded":"2024-09-14T11:53:04.160898+0000","last_fullsized":"2024-09-14T11:53:04.160898+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.160798+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:16.863145+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'224","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.129865+0000","last_change":"2024-09-14T11:52:58.129865+0000","last_active":"2024-09-14T11:52:58.129865+0000","last_peered":"2024-09-14T11:52:58.129865+0000","last_clean":"2024-09-14T11:52:58.129865+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:52:58.129865+0000","last_undegraded":"2024-09-14T11:52:58.129865+0000","last_fullsized":"2024-09-14T11:52:58.129865+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.129706+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:14.434843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079921,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":75141,"num_write":989,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:09.047547+0000","last_change":"2024-09-14T11:11:08.659594+0000","last_active":"2024-09-14T11:50:09.047547+0000","last_peered":"2024-09-14T11:50:09.047547+0000","last_clean":"2024-09-14T11:50:09.047547+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:50:09.047547+0000","last_undegraded":"2024-09-14T11:50:09.047547+0000","last_fullsized":"2024-09-14T11:50:09.047547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:14.059630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'203","reported_seq":807,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.619250+0000","last_change":"2024-09-14T11:11:10.883185+0000","last_active":"2024-09-14T11:52:44.619250+0000","last_peered":"2024-09-14T11:52:44.619250+0000","last_clean":"2024-09-14T11:52:44.619250+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:52:44.619250+0000","last_undegraded":"2024-09-14T11:52:44.619250+0000","last_fullsized":"2024-09-14T11:52:44.619250+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:41.597617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":357,"num_write":162,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922914+0000","last_change":"2024-09-14T11:11:12.678507+0000","last_active":"2024-09-14T11:49:28.922914+0000","last_peered":"2024-09-14T11:49:28.922914+0000","last_clean":"2024-09-14T11:49:28.922914+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:49:28.922914+0000","last_undegraded":"2024-09-14T11:49:28.922914+0000","last_fullsized":"2024-09-14T11:49:28.922914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:11.631396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'544","reported_seq":1346,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.551545+0000","last_change":"2024-09-14T11:11:14.691810+0000","last_active":"2024-09-14T11:52:37.551545+0000","last_peered":"2024-09-14T11:52:37.551545+0000","last_clean":"2024-09-14T11:52:37.551545+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:52:37.551545+0000","last_undegraded":"2024-09-14T11:52:37.551545+0000","last_fullsized":"2024-09-14T11:52:37.551545+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'471","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.111042+0000","last_change":"2024-09-14T11:52:56.111042+0000","last_active":"2024-09-14T11:52:56.111042+0000","last_peered":"2024-09-14T11:52:56.111042+0000","last_clean":"2024-09-14T11:52:56.111042+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:52:56.111042+0000","last_undegraded":"2024-09-14T11:52:56.111042+0000","last_fullsized":"2024-09-14T11:52:56.111042+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.110952+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:29.334828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'226","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.097229+0000","last_change":"2024-09-14T11:52:56.097229+0000","last_active":"2024-09-14T11:52:56.097229+0000","last_peered":"2024-09-14T11:52:56.097229+0000","last_clean":"2024-09-14T11:52:56.097229+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:56.097229+0000","last_undegraded":"2024-09-14T11:52:56.097229+0000","last_fullsized":"2024-09-14T11:52:56.097229+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.097135+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:19.941231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":64064,"num_write":1014,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.588684+0000","last_change":"2024-09-14T11:53:02.588684+0000","last_active":"2024-09-14T11:53:02.588684+0000","last_peered":"2024-09-14T11:53:02.588684+0000","last_clean":"2024-09-14T11:53:02.588684+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:53:02.588684+0000","last_undegraded":"2024-09-14T11:53:02.588684+0000","last_fullsized":"2024-09-14T11:53:02.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.588602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:29.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'138","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.415386+0000","last_change":"2024-09-14T11:11:10.669181+0000","last_active":"2024-09-14T11:52:44.415386+0000","last_peered":"2024-09-14T11:52:44.415386+0000","last_clean":"2024-09-14T11:52:44.415386+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:52:44.415386+0000","last_undegraded":"2024-09-14T11:52:44.415386+0000","last_fullsized":"2024-09-14T11:52:44.415386+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:51.810244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":213,"num_write":84,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:23.930561+0000","last_change":"2024-09-14T11:11:12.677186+0000","last_active":"2024-09-14T11:50:23.930561+0000","last_peered":"2024-09-14T11:50:23.930561+0000","last_clean":"2024-09-14T11:50:23.930561+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:50:23.930561+0000","last_undegraded":"2024-09-14T11:50:23.930561+0000","last_fullsized":"2024-09-14T11:50:23.930561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:15.808510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'120","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:27.143571+0000","last_change":"2024-09-14T11:11:14.693436+0000","last_active":"2024-09-14T11:52:27.143571+0000","last_peered":"2024-09-14T11:52:27.143571+0000","last_clean":"2024-09-14T11:52:27.143571+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:52:27.143571+0000","last_undegraded":"2024-09-14T11:52:27.143571+0000","last_fullsized":"2024-09-14T11:52:27.143571+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'382","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.036223+0000","last_change":"2024-09-14T11:53:02.036223+0000","last_active":"2024-09-14T11:53:02.036223+0000","last_peered":"2024-09-14T11:53:02.036223+0000","last_clean":"2024-09-14T11:53:02.036223+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:53:02.036223+0000","last_undegraded":"2024-09-14T11:53:02.036223+0000","last_fullsized":"2024-09-14T11:53:02.036223+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.036135+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:25.081091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'225","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.154258+0000","last_change":"2024-09-14T11:52:59.154258+0000","last_active":"2024-09-14T11:52:59.154258+0000","last_peered":"2024-09-14T11:52:59.154258+0000","last_clean":"2024-09-14T11:52:59.154258+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:52:59.154258+0000","last_undegraded":"2024-09-14T11:52:59.154258+0000","last_fullsized":"2024-09-14T11:52:59.154258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.154158+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:38.092830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":542,"num_read_kb":106193,"num_write":937,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.544626+0000","last_change":"2024-09-14T11:53:03.544626+0000","last_active":"2024-09-14T11:53:03.544626+0000","last_peered":"2024-09-14T11:53:03.544626+0000","last_clean":"2024-09-14T11:53:03.544626+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:53:03.544626+0000","last_undegraded":"2024-09-14T11:53:03.544626+0000","last_fullsized":"2024-09-14T11:53:03.544626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.544542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.748879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'159","reported_seq":734,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.643588+0000","last_change":"2024-09-14T11:11:10.670978+0000","last_active":"2024-09-14T11:52:44.643588+0000","last_peered":"2024-09-14T11:52:44.643588+0000","last_clean":"2024-09-14T11:52:44.643588+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:52:44.643588+0000","last_undegraded":"2024-09-14T11:52:44.643588+0000","last_fullsized":"2024-09-14T11:52:44.643588+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:50.765426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":261,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'774","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.325789+0000","last_change":"2024-09-14T11:11:12.682806+0000","last_active":"2024-09-14T11:52:44.325789+0000","last_peered":"2024-09-14T11:52:44.325789+0000","last_clean":"2024-09-14T11:52:44.325789+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:52:44.325789+0000","last_undegraded":"2024-09-14T11:52:44.325789+0000","last_fullsized":"2024-09-14T11:52:44.325789+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:25.160041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.385498+0000","last_change":"2024-09-14T11:11:14.691211+0000","last_active":"2024-09-14T11:52:36.385498+0000","last_peered":"2024-09-14T11:52:36.385498+0000","last_clean":"2024-09-14T11:52:36.385498+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:52:36.385498+0000","last_undegraded":"2024-09-14T11:52:36.385498+0000","last_fullsized":"2024-09-14T11:52:36.385498+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:53.737487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'570","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.186783+0000","last_change":"2024-09-14T11:53:00.186783+0000","last_active":"2024-09-14T11:53:00.186783+0000","last_peered":"2024-09-14T11:53:00.186783+0000","last_clean":"2024-09-14T11:53:00.186783+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:53:00.186783+0000","last_undegraded":"2024-09-14T11:53:00.186783+0000","last_fullsized":"2024-09-14T11:53:00.186783+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'570","last_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_deep_scrub":"263'570","last_deep_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.186701+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:41.511182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'207","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.111500+0000","last_change":"2024-09-14T11:52:55.111500+0000","last_active":"2024-09-14T11:52:55.111500+0000","last_peered":"2024-09-14T11:52:55.111500+0000","last_clean":"2024-09-14T11:52:55.111500+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:52:55.111500+0000","last_undegraded":"2024-09-14T11:52:55.111500+0000","last_fullsized":"2024-09-14T11:52:55.111500+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.111364+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:22.418671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":32215,"num_write":875,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.475652+0000","last_change":"2024-09-14T11:53:05.475652+0000","last_active":"2024-09-14T11:53:05.475652+0000","last_peered":"2024-09-14T11:53:05.475652+0000","last_clean":"2024-09-14T11:53:05.475652+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:53:05.475652+0000","last_undegraded":"2024-09-14T11:53:05.475652+0000","last_fullsized":"2024-09-14T11:53:05.475652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.475568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:15.444965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'190","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.676102+0000","last_change":"2024-09-14T11:11:10.668579+0000","last_active":"2024-09-14T11:52:44.676102+0000","last_peered":"2024-09-14T11:52:44.676102+0000","last_clean":"2024-09-14T11:52:44.676102+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:52:44.676102+0000","last_undegraded":"2024-09-14T11:52:44.676102+0000","last_fullsized":"2024-09-14T11:52:44.676102+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:33.675356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13546,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":273,"num_read_kb":390,"num_write":132,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.033234+0000","last_change":"2024-09-14T11:11:12.682825+0000","last_active":"2024-09-14T11:50:14.033234+0000","last_peered":"2024-09-14T11:50:14.033234+0000","last_clean":"2024-09-14T11:50:14.033234+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:50:14.033234+0000","last_undegraded":"2024-09-14T11:50:14.033234+0000","last_fullsized":"2024-09-14T11:50:14.033234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:17.085965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'136","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.046297+0000","last_change":"2024-09-14T11:11:14.694759+0000","last_active":"2024-09-14T11:51:20.046297+0000","last_peered":"2024-09-14T11:51:20.046297+0000","last_clean":"2024-09-14T11:51:20.046297+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:51:20.046297+0000","last_undegraded":"2024-09-14T11:51:20.046297+0000","last_fullsized":"2024-09-14T11:51:20.046297+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:34.568185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'811","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.066558+0000","last_change":"2024-09-14T11:52:57.066558+0000","last_active":"2024-09-14T11:52:57.066558+0000","last_peered":"2024-09-14T11:52:57.066558+0000","last_clean":"2024-09-14T11:52:57.066558+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:52:57.066558+0000","last_undegraded":"2024-09-14T11:52:57.066558+0000","last_fullsized":"2024-09-14T11:52:57.066558+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.066478+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.841841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'187","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.216155+0000","last_change":"2024-09-14T11:52:51.216155+0000","last_active":"2024-09-14T11:52:51.216155+0000","last_peered":"2024-09-14T11:52:51.216155+0000","last_clean":"2024-09-14T11:52:51.216155+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:52:51.216155+0000","last_undegraded":"2024-09-14T11:52:51.216155+0000","last_fullsized":"2024-09-14T11:52:51.216155+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.216003+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.941139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":535,"num_read_kb":54806,"num_write":892,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.525107+0000","last_change":"2024-09-14T11:53:04.525107+0000","last_active":"2024-09-14T11:53:04.525107+0000","last_peered":"2024-09-14T11:53:04.525107+0000","last_clean":"2024-09-14T11:53:04.525107+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:53:04.525107+0000","last_undegraded":"2024-09-14T11:53:04.525107+0000","last_fullsized":"2024-09-14T11:53:04.525107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.525015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:40.108078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'138","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.449724+0000","last_change":"2024-09-14T11:11:10.665945+0000","last_active":"2024-09-14T11:52:44.449724+0000","last_peered":"2024-09-14T11:52:44.449724+0000","last_clean":"2024-09-14T11:52:44.449724+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:52:44.449724+0000","last_undegraded":"2024-09-14T11:52:44.449724+0000","last_fullsized":"2024-09-14T11:52:44.449724+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.116133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5347,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":234,"num_write":162,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:38.924548+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:49:38.924548+0000","last_peered":"2024-09-14T11:49:38.924548+0000","last_clean":"2024-09-14T11:49:38.924548+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:49:38.924548+0000","last_undegraded":"2024-09-14T11:49:38.924548+0000","last_fullsized":"2024-09-14T11:49:38.924548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:21.465336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938149+0000","last_change":"2024-09-14T11:11:14.690952+0000","last_active":"2024-09-14T11:51:23.938149+0000","last_peered":"2024-09-14T11:51:23.938149+0000","last_clean":"2024-09-14T11:51:23.938149+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:51:23.938149+0000","last_undegraded":"2024-09-14T11:51:23.938149+0000","last_fullsized":"2024-09-14T11:51:23.938149+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:31.964931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'617","reported_seq":2142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.075392+0000","last_change":"2024-09-14T11:52:58.075392+0000","last_active":"2024-09-14T11:52:58.075392+0000","last_peered":"2024-09-14T11:52:58.075392+0000","last_clean":"2024-09-14T11:52:58.075392+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:58.075392+0000","last_undegraded":"2024-09-14T11:52:58.075392+0000","last_fullsized":"2024-09-14T11:52:58.075392+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.075304+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:31.134395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'217","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.692209+0000","last_change":"2024-09-14T11:52:51.692109+0000","last_active":"2024-09-14T11:52:51.692209+0000","last_peered":"2024-09-14T11:52:51.692209+0000","last_clean":"2024-09-14T11:52:51.692209+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:52:51.692209+0000","last_undegraded":"2024-09-14T11:52:51.692209+0000","last_fullsized":"2024-09-14T11:52:51.692209+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.691968+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:42.697133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1166,"num_read_kb":81327,"num_write":1108,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.592370+0000","last_change":"2024-09-14T11:53:07.592370+0000","last_active":"2024-09-14T11:53:07.592370+0000","last_peered":"2024-09-14T11:53:07.592370+0000","last_clean":"2024-09-14T11:53:07.592370+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:53:07.592370+0000","last_undegraded":"2024-09-14T11:53:07.592370+0000","last_fullsized":"2024-09-14T11:53:07.592370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.592234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:13.451667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'195","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.475678+0000","last_change":"2024-09-14T11:53:07.475678+0000","last_active":"2024-09-14T11:53:07.475678+0000","last_peered":"2024-09-14T11:53:07.475678+0000","last_clean":"2024-09-14T11:53:07.475678+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:53:07.475678+0000","last_undegraded":"2024-09-14T11:53:07.475678+0000","last_fullsized":"2024-09-14T11:53:07.475678+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.475570+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:11.623372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8518,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":257,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'750","reported_seq":2409,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.321503+0000","last_change":"2024-09-14T11:11:12.680262+0000","last_active":"2024-09-14T11:52:44.321503+0000","last_peered":"2024-09-14T11:52:44.321503+0000","last_clean":"2024-09-14T11:52:44.321503+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:52:44.321503+0000","last_undegraded":"2024-09-14T11:52:44.321503+0000","last_fullsized":"2024-09-14T11:52:44.321503+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:15.187022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'112","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.841117+0000","last_change":"2024-09-14T11:11:14.694188+0000","last_active":"2024-09-14T11:51:21.841117+0000","last_peered":"2024-09-14T11:51:21.841117+0000","last_clean":"2024-09-14T11:51:21.841117+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:51:21.841117+0000","last_undegraded":"2024-09-14T11:51:21.841117+0000","last_fullsized":"2024-09-14T11:51:21.841117+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.086088+0000","last_change":"2024-09-14T11:53:00.086088+0000","last_active":"2024-09-14T11:53:00.086088+0000","last_peered":"2024-09-14T11:53:00.086088+0000","last_clean":"2024-09-14T11:53:00.086088+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:53:00.086088+0000","last_undegraded":"2024-09-14T11:53:00.086088+0000","last_fullsized":"2024-09-14T11:53:00.086088+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.085999+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:14.084510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'215","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.132110+0000","last_change":"2024-09-14T11:52:53.132110+0000","last_active":"2024-09-14T11:52:53.132110+0000","last_peered":"2024-09-14T11:52:53.132110+0000","last_clean":"2024-09-14T11:52:53.132110+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:53.132110+0000","last_undegraded":"2024-09-14T11:52:53.132110+0000","last_fullsized":"2024-09-14T11:52:53.132110+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.131957+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.645543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":783,"num_read_kb":15229,"num_write":1055,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.099299+0000","last_change":"2024-09-14T11:11:08.657746+0000","last_active":"2024-09-14T11:52:44.099299+0000","last_peered":"2024-09-14T11:52:44.099299+0000","last_clean":"2024-09-14T11:52:44.099299+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:52:44.099299+0000","last_undegraded":"2024-09-14T11:52:44.099299+0000","last_fullsized":"2024-09-14T11:52:44.099299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:46.646901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'65","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.268760+0000","last_change":"2024-09-14T11:11:10.883189+0000","last_active":"2024-09-14T11:51:19.268760+0000","last_peered":"2024-09-14T11:51:19.268760+0000","last_clean":"2024-09-14T11:51:19.268760+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:51:19.268760+0000","last_undegraded":"2024-09-14T11:51:19.268760+0000","last_fullsized":"2024-09-14T11:51:19.268760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:23.532287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'768","reported_seq":2418,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.322478+0000","last_change":"2024-09-14T11:11:12.682993+0000","last_active":"2024-09-14T11:52:44.322478+0000","last_peered":"2024-09-14T11:52:44.322478+0000","last_clean":"2024-09-14T11:52:44.322478+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:52:44.322478+0000","last_undegraded":"2024-09-14T11:52:44.322478+0000","last_fullsized":"2024-09-14T11:52:44.322478+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:56.550659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:58.335408+0000","last_change":"2024-09-14T11:11:14.697448+0000","last_active":"2024-09-14T11:50:58.335408+0000","last_peered":"2024-09-14T11:50:58.335408+0000","last_clean":"2024-09-14T11:50:58.335408+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:50:58.335408+0000","last_undegraded":"2024-09-14T11:50:58.335408+0000","last_fullsized":"2024-09-14T11:50:58.335408+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.564244+0000","last_change":"2024-09-14T11:53:01.564244+0000","last_active":"2024-09-14T11:53:01.564244+0000","last_peered":"2024-09-14T11:53:01.564244+0000","last_clean":"2024-09-14T11:53:01.564244+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:53:01.564244+0000","last_undegraded":"2024-09-14T11:53:01.564244+0000","last_fullsized":"2024-09-14T11:53:01.564244+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.564148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'201","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.211667+0000","last_change":"2024-09-14T11:52:52.211667+0000","last_active":"2024-09-14T11:52:52.211667+0000","last_peered":"2024-09-14T11:52:52.211667+0000","last_clean":"2024-09-14T11:52:52.211667+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:52:52.211667+0000","last_undegraded":"2024-09-14T11:52:52.211667+0000","last_fullsized":"2024-09-14T11:52:52.211667+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.211587+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:11.190379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":47606,"num_write":839,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.920747+0000","last_change":"2024-09-14T11:11:08.651170+0000","last_active":"2024-09-14T11:49:23.920747+0000","last_peered":"2024-09-14T11:49:23.920747+0000","last_clean":"2024-09-14T11:49:23.920747+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:49:23.920747+0000","last_undegraded":"2024-09-14T11:49:23.920747+0000","last_fullsized":"2024-09-14T11:49:23.920747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'223","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.598981+0000","last_change":"2024-09-14T11:11:10.671679+0000","last_active":"2024-09-14T11:52:44.598981+0000","last_peered":"2024-09-14T11:52:44.598981+0000","last_clean":"2024-09-14T11:52:44.598981+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:52:44.598981+0000","last_undegraded":"2024-09-14T11:52:44.598981+0000","last_fullsized":"2024-09-14T11:52:44.598981+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:53.236902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26161,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":914,"num_read_kb":1030,"num_write":1436,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.145378+0000","last_change":"2024-09-14T11:53:08.145378+0000","last_active":"2024-09-14T11:53:08.145378+0000","last_peered":"2024-09-14T11:53:08.145378+0000","last_clean":"2024-09-14T11:53:08.145378+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:53:08.145378+0000","last_undegraded":"2024-09-14T11:53:08.145378+0000","last_fullsized":"2024-09-14T11:53:08.145378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'111","reported_seq":596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933439+0000","last_change":"2024-09-14T11:11:14.691254+0000","last_active":"2024-09-14T11:50:48.933439+0000","last_peered":"2024-09-14T11:50:48.933439+0000","last_clean":"2024-09-14T11:50:48.933439+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:50:48.933439+0000","last_undegraded":"2024-09-14T11:50:48.933439+0000","last_fullsized":"2024-09-14T11:50:48.933439+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.037506+0000","last_change":"2024-09-14T11:52:59.037506+0000","last_active":"2024-09-14T11:52:59.037506+0000","last_peered":"2024-09-14T11:52:59.037506+0000","last_clean":"2024-09-14T11:52:59.037506+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:52:59.037506+0000","last_undegraded":"2024-09-14T11:52:59.037506+0000","last_fullsized":"2024-09-14T11:52:59.037506+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'406","last_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_deep_scrub":"263'406","last_deep_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.037411+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:45.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.055848+0000","last_change":"2024-09-14T11:52:53.055791+0000","last_active":"2024-09-14T11:52:53.055848+0000","last_peered":"2024-09-14T11:52:53.055848+0000","last_clean":"2024-09-14T11:52:53.055848+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:52:53.055848+0000","last_undegraded":"2024-09-14T11:52:53.055848+0000","last_fullsized":"2024-09-14T11:52:53.055848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.055702+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:39.492461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073420+0000","last_change":"2024-09-14T11:52:54.073420+0000","last_active":"2024-09-14T11:52:54.073420+0000","last_peered":"2024-09-14T11:52:54.073420+0000","last_clean":"2024-09-14T11:52:54.073420+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:52:54.073420+0000","last_undegraded":"2024-09-14T11:52:54.073420+0000","last_fullsized":"2024-09-14T11:52:54.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:45.391206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.243231+0000","last_change":"2024-09-14T11:52:53.243231+0000","last_active":"2024-09-14T11:52:53.243231+0000","last_peered":"2024-09-14T11:52:53.243231+0000","last_clean":"2024-09-14T11:52:53.243231+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:52:53.243231+0000","last_undegraded":"2024-09-14T11:52:53.243231+0000","last_fullsized":"2024-09-14T11:52:53.243231+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.243044+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:20.104275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1045,"num_read_kb":764,"num_write":1140,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.176344+0000","last_change":"2024-09-14T11:53:08.176344+0000","last_active":"2024-09-14T11:53:08.176344+0000","last_peered":"2024-09-14T11:53:08.176344+0000","last_clean":"2024-09-14T11:53:08.176344+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:53:08.176344+0000","last_undegraded":"2024-09-14T11:53:08.176344+0000","last_fullsized":"2024-09-14T11:53:08.176344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.176258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:21.229609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'324","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.721714+0000","last_change":"2024-09-14T11:11:10.671108+0000","last_active":"2024-09-14T11:52:44.721714+0000","last_peered":"2024-09-14T11:52:44.721714+0000","last_clean":"2024-09-14T11:52:44.721714+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:52:44.721714+0000","last_undegraded":"2024-09-14T11:52:44.721714+0000","last_fullsized":"2024-09-14T11:52:44.721714+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:12.563174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134988,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":1074,"num_write":544,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929432+0000","last_change":"2024-09-14T11:11:12.679614+0000","last_active":"2024-09-14T11:50:13.929432+0000","last_peered":"2024-09-14T11:50:13.929432+0000","last_clean":"2024-09-14T11:50:13.929432+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:50:13.929432+0000","last_undegraded":"2024-09-14T11:50:13.929432+0000","last_fullsized":"2024-09-14T11:50:13.929432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:26.539650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'194","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.853045+0000","last_change":"2024-09-14T11:11:14.691705+0000","last_active":"2024-09-14T11:51:21.853045+0000","last_peered":"2024-09-14T11:51:21.853045+0000","last_clean":"2024-09-14T11:51:21.853045+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:51:21.853045+0000","last_undegraded":"2024-09-14T11:51:21.853045+0000","last_fullsized":"2024-09-14T11:51:21.853045+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:32.101457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'450","reported_seq":2105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.140049+0000","last_change":"2024-09-14T11:53:01.140049+0000","last_active":"2024-09-14T11:53:01.140049+0000","last_peered":"2024-09-14T11:53:01.140049+0000","last_clean":"2024-09-14T11:53:01.140049+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:53:01.140049+0000","last_undegraded":"2024-09-14T11:53:01.140049+0000","last_fullsized":"2024-09-14T11:53:01.140049+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.139965+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:32.411582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.036795+0000","last_change":"2024-09-14T11:52:54.036739+0000","last_active":"2024-09-14T11:52:54.036795+0000","last_peered":"2024-09-14T11:52:54.036795+0000","last_clean":"2024-09-14T11:52:54.036795+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:52:54.036795+0000","last_undegraded":"2024-09-14T11:52:54.036795+0000","last_fullsized":"2024-09-14T11:52:54.036795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.036632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:29.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'230","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.250978+0000","last_change":"2024-09-14T11:52:49.250978+0000","last_active":"2024-09-14T11:52:49.250978+0000","last_peered":"2024-09-14T11:52:49.250978+0000","last_clean":"2024-09-14T11:52:49.250978+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:49.250978+0000","last_undegraded":"2024-09-14T11:52:49.250978+0000","last_fullsized":"2024-09-14T11:52:49.250978+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.250850+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:59.097045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":610,"num_read_kb":5636,"num_write":1050,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:08.926741+0000","last_change":"2024-09-14T11:11:08.653354+0000","last_active":"2024-09-14T11:50:08.926741+0000","last_peered":"2024-09-14T11:50:08.926741+0000","last_clean":"2024-09-14T11:50:08.926741+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:50:08.926741+0000","last_undegraded":"2024-09-14T11:50:08.926741+0000","last_fullsized":"2024-09-14T11:50:08.926741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:02.387161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'860","reported_seq":2291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.724613+0000","last_change":"2024-09-14T11:11:10.668218+0000","last_active":"2024-09-14T11:52:44.724613+0000","last_peered":"2024-09-14T11:52:44.724613+0000","last_clean":"2024-09-14T11:52:44.724613+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:52:44.724613+0000","last_undegraded":"2024-09-14T11:52:44.724613+0000","last_fullsized":"2024-09-14T11:52:44.724613+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20878,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1373,"num_write":272,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:54.054578+0000","last_change":"2024-09-14T11:11:12.677600+0000","last_active":"2024-09-14T11:50:54.054578+0000","last_peered":"2024-09-14T11:50:54.054578+0000","last_clean":"2024-09-14T11:50:54.054578+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:50:54.054578+0000","last_undegraded":"2024-09-14T11:50:54.054578+0000","last_fullsized":"2024-09-14T11:50:54.054578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'130","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.325684+0000","last_change":"2024-09-14T11:11:14.883766+0000","last_active":"2024-09-14T11:51:21.325684+0000","last_peered":"2024-09-14T11:51:21.325684+0000","last_clean":"2024-09-14T11:51:21.325684+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:51:21.325684+0000","last_undegraded":"2024-09-14T11:51:21.325684+0000","last_fullsized":"2024-09-14T11:51:21.325684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:47.449599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'428","reported_seq":1915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.640237+0000","last_change":"2024-09-14T11:52:57.640237+0000","last_active":"2024-09-14T11:52:57.640237+0000","last_peered":"2024-09-14T11:52:57.640237+0000","last_clean":"2024-09-14T11:52:57.640237+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:52:57.640237+0000","last_undegraded":"2024-09-14T11:52:57.640237+0000","last_fullsized":"2024-09-14T11:52:57.640237+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.640146+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:10.948568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.657825+0000","last_change":"2024-09-14T11:52:50.657825+0000","last_active":"2024-09-14T11:52:50.657825+0000","last_peered":"2024-09-14T11:52:50.657825+0000","last_clean":"2024-09-14T11:52:50.657825+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:52:50.657825+0000","last_undegraded":"2024-09-14T11:52:50.657825+0000","last_fullsized":"2024-09-14T11:52:50.657825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.657760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:14.569819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'208","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.653529+0000","last_change":"2024-09-14T11:52:50.653452+0000","last_active":"2024-09-14T11:52:50.653529+0000","last_peered":"2024-09-14T11:52:50.653529+0000","last_clean":"2024-09-14T11:52:50.653529+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:52:50.653529+0000","last_undegraded":"2024-09-14T11:52:50.653529+0000","last_fullsized":"2024-09-14T11:52:50.653529+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.653307+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:26.358362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":52749,"num_write":993,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.580907+0000","last_change":"2024-09-14T11:53:01.580907+0000","last_active":"2024-09-14T11:53:01.580907+0000","last_peered":"2024-09-14T11:53:01.580907+0000","last_clean":"2024-09-14T11:53:01.580907+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:53:01.580907+0000","last_undegraded":"2024-09-14T11:53:01.580907+0000","last_fullsized":"2024-09-14T11:53:01.580907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.580787+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:28.319926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'219","reported_seq":1257,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.664009+0000","last_change":"2024-09-14T11:11:10.885665+0000","last_active":"2024-09-14T11:52:37.664009+0000","last_peered":"2024-09-14T11:52:37.664009+0000","last_clean":"2024-09-14T11:52:37.664009+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:52:37.664009+0000","last_undegraded":"2024-09-14T11:52:37.664009+0000","last_fullsized":"2024-09-14T11:52:37.664009+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933809+0000","last_change":"2024-09-14T11:11:12.679585+0000","last_active":"2024-09-14T11:50:48.933809+0000","last_peered":"2024-09-14T11:50:48.933809+0000","last_clean":"2024-09-14T11:50:48.933809+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:50:48.933809+0000","last_undegraded":"2024-09-14T11:50:48.933809+0000","last_fullsized":"2024-09-14T11:50:48.933809+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'250","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.995575+0000","last_change":"2024-09-14T11:11:14.691912+0000","last_active":"2024-09-14T11:51:21.995575+0000","last_peered":"2024-09-14T11:51:21.995575+0000","last_clean":"2024-09-14T11:51:21.995575+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:51:21.995575+0000","last_undegraded":"2024-09-14T11:51:21.995575+0000","last_fullsized":"2024-09-14T11:51:21.995575+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:38.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'460","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.638836+0000","last_change":"2024-09-14T11:52:56.638836+0000","last_active":"2024-09-14T11:52:56.638836+0000","last_peered":"2024-09-14T11:52:56.638836+0000","last_clean":"2024-09-14T11:52:56.638836+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:52:56.638836+0000","last_undegraded":"2024-09-14T11:52:56.638836+0000","last_fullsized":"2024-09-14T11:52:56.638836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.638748+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:35.929585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.023077+0000","last_change":"2024-09-14T11:52:52.023077+0000","last_active":"2024-09-14T11:52:52.023077+0000","last_peered":"2024-09-14T11:52:52.023077+0000","last_clean":"2024-09-14T11:52:52.023077+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:52:52.023077+0000","last_undegraded":"2024-09-14T11:52:52.023077+0000","last_fullsized":"2024-09-14T11:52:52.023077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.022923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:46.997948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'183","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.093157+0000","last_change":"2024-09-14T11:52:52.093157+0000","last_active":"2024-09-14T11:52:52.093157+0000","last_peered":"2024-09-14T11:52:52.093157+0000","last_clean":"2024-09-14T11:52:52.093157+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:52:52.093157+0000","last_undegraded":"2024-09-14T11:52:52.093157+0000","last_fullsized":"2024-09-14T11:52:52.093157+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.093023+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:24.168597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":11748,"num_write":873,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.934445+0000","last_change":"2024-09-14T11:11:08.656266+0000","last_active":"2024-09-14T11:50:53.934445+0000","last_peered":"2024-09-14T11:50:53.934445+0000","last_clean":"2024-09-14T11:50:53.934445+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:50:53.934445+0000","last_undegraded":"2024-09-14T11:50:53.934445+0000","last_fullsized":"2024-09-14T11:50:53.934445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'126","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:23.946961+0000","last_change":"2024-09-14T11:11:10.668058+0000","last_active":"2024-09-14T11:52:23.946961+0000","last_peered":"2024-09-14T11:52:23.946961+0000","last_clean":"2024-09-14T11:52:23.946961+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:52:23.946961+0000","last_undegraded":"2024-09-14T11:52:23.946961+0000","last_fullsized":"2024-09-14T11:52:23.946961+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:05.286724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.096626+0000","last_change":"2024-09-14T11:53:07.096626+0000","last_active":"2024-09-14T11:53:07.096626+0000","last_peered":"2024-09-14T11:53:07.096626+0000","last_clean":"2024-09-14T11:53:07.096626+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:53:07.096626+0000","last_undegraded":"2024-09-14T11:53:07.096626+0000","last_fullsized":"2024-09-14T11:53:07.096626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.096502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.120129+0000","last_change":"2024-09-14T11:11:14.692245+0000","last_active":"2024-09-14T11:51:03.120129+0000","last_peered":"2024-09-14T11:51:03.120129+0000","last_clean":"2024-09-14T11:51:03.120129+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:51:03.120129+0000","last_undegraded":"2024-09-14T11:51:03.120129+0000","last_fullsized":"2024-09-14T11:51:03.120129+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:24.950841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.620545+0000","last_change":"2024-09-14T11:52:59.620545+0000","last_active":"2024-09-14T11:52:59.620545+0000","last_peered":"2024-09-14T11:52:59.620545+0000","last_clean":"2024-09-14T11:52:59.620545+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:52:59.620545+0000","last_undegraded":"2024-09-14T11:52:59.620545+0000","last_fullsized":"2024-09-14T11:52:59.620545+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.620455+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.069591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'230","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.046740+0000","last_change":"2024-09-14T11:52:53.046663+0000","last_active":"2024-09-14T11:52:53.046740+0000","last_peered":"2024-09-14T11:52:53.046740+0000","last_clean":"2024-09-14T11:52:53.046740+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:52:53.046740+0000","last_undegraded":"2024-09-14T11:52:53.046740+0000","last_fullsized":"2024-09-14T11:52:53.046740+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.046573+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:56.461752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":621,"num_read_kb":15435,"num_write":887,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.655319+0000","last_change":"2024-09-14T11:52:49.655319+0000","last_active":"2024-09-14T11:52:49.655319+0000","last_peered":"2024-09-14T11:52:49.655319+0000","last_clean":"2024-09-14T11:52:49.655319+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:52:49.655319+0000","last_undegraded":"2024-09-14T11:52:49.655319+0000","last_fullsized":"2024-09-14T11:52:49.655319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.655243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:56.511174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.093954+0000","last_change":"2024-09-14T11:53:08.093954+0000","last_active":"2024-09-14T11:53:08.093954+0000","last_peered":"2024-09-14T11:53:08.093954+0000","last_clean":"2024-09-14T11:53:08.093954+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:53:08.093954+0000","last_undegraded":"2024-09-14T11:53:08.093954+0000","last_fullsized":"2024-09-14T11:53:08.093954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:08.707957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'294","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.541194+0000","last_change":"2024-09-14T11:11:10.670087+0000","last_active":"2024-09-14T11:52:44.541194+0000","last_peered":"2024-09-14T11:52:44.541194+0000","last_clean":"2024-09-14T11:52:44.541194+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:52:44.541194+0000","last_undegraded":"2024-09-14T11:52:44.541194+0000","last_fullsized":"2024-09-14T11:52:44.541194+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:50.318692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":423,"num_read_kb":619,"num_write":282,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.931731+0000","last_change":"2024-09-14T11:11:12.679038+0000","last_active":"2024-09-14T11:50:48.931731+0000","last_peered":"2024-09-14T11:50:48.931731+0000","last_clean":"2024-09-14T11:50:48.931731+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:50:48.931731+0000","last_undegraded":"2024-09-14T11:50:48.931731+0000","last_fullsized":"2024-09-14T11:50:48.931731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'209","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.215679+0000","last_change":"2024-09-14T11:11:14.886549+0000","last_active":"2024-09-14T11:51:19.215679+0000","last_peered":"2024-09-14T11:51:19.215679+0000","last_clean":"2024-09-14T11:51:19.215679+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:51:19.215679+0000","last_undegraded":"2024-09-14T11:51:19.215679+0000","last_fullsized":"2024-09-14T11:51:19.215679+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:17.379453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'432","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.206365+0000","last_change":"2024-09-14T11:52:59.206365+0000","last_active":"2024-09-14T11:52:59.206365+0000","last_peered":"2024-09-14T11:52:59.206365+0000","last_clean":"2024-09-14T11:52:59.206365+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:59.206365+0000","last_undegraded":"2024-09-14T11:52:59.206365+0000","last_fullsized":"2024-09-14T11:52:59.206365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.206274+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:24.686804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'220","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.617381+0000","last_change":"2024-09-14T11:52:52.617381+0000","last_active":"2024-09-14T11:52:52.617381+0000","last_peered":"2024-09-14T11:52:52.617381+0000","last_clean":"2024-09-14T11:52:52.617381+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:52:52.617381+0000","last_undegraded":"2024-09-14T11:52:52.617381+0000","last_fullsized":"2024-09-14T11:52:52.617381+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.617251+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.949283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":606,"num_read_kb":78521,"num_write":1035,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.074859+0000","last_change":"2024-09-14T11:52:55.074859+0000","last_active":"2024-09-14T11:52:55.074859+0000","last_peered":"2024-09-14T11:52:55.074859+0000","last_clean":"2024-09-14T11:52:55.074859+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:52:55.074859+0000","last_undegraded":"2024-09-14T11:52:55.074859+0000","last_fullsized":"2024-09-14T11:52:55.074859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.074773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.397184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.051330+0000","last_change":"2024-09-14T11:53:04.051330+0000","last_active":"2024-09-14T11:53:04.051330+0000","last_peered":"2024-09-14T11:53:04.051330+0000","last_clean":"2024-09-14T11:53:04.051330+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:53:04.051330+0000","last_undegraded":"2024-09-14T11:53:04.051330+0000","last_fullsized":"2024-09-14T11:53:04.051330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.051237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.225013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'156","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.319858+0000","last_change":"2024-09-14T11:11:10.883309+0000","last_active":"2024-09-14T11:51:19.319858+0000","last_peered":"2024-09-14T11:51:19.319858+0000","last_clean":"2024-09-14T11:51:19.319858+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:51:19.319858+0000","last_undegraded":"2024-09-14T11:51:19.319858+0000","last_fullsized":"2024-09-14T11:51:19.319858+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'803","reported_seq":4888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.702234+0000","last_change":"2024-09-14T11:11:12.682874+0000","last_active":"2024-09-14T11:52:44.702234+0000","last_peered":"2024-09-14T11:52:44.702234+0000","last_clean":"2024-09-14T11:52:44.702234+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:52:44.702234+0000","last_undegraded":"2024-09-14T11:52:44.702234+0000","last_fullsized":"2024-09-14T11:52:44.702234+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:22.028768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'342","reported_seq":1715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.566626+0000","last_change":"2024-09-14T11:52:58.566626+0000","last_active":"2024-09-14T11:52:58.566626+0000","last_peered":"2024-09-14T11:52:58.566626+0000","last_clean":"2024-09-14T11:52:58.566626+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:52:58.566626+0000","last_undegraded":"2024-09-14T11:52:58.566626+0000","last_fullsized":"2024-09-14T11:52:58.566626+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.566512+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:15.609009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'297","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.184746+0000","last_change":"2024-09-14T11:52:55.184746+0000","last_active":"2024-09-14T11:52:55.184746+0000","last_peered":"2024-09-14T11:52:55.184746+0000","last_clean":"2024-09-14T11:52:55.184746+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:52:55.184746+0000","last_undegraded":"2024-09-14T11:52:55.184746+0000","last_fullsized":"2024-09-14T11:52:55.184746+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.184619+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.242032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1185,"num_read_kb":53005,"num_write":1239,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.619046+0000","last_change":"2024-09-14T11:52:51.619046+0000","last_active":"2024-09-14T11:52:51.619046+0000","last_peered":"2024-09-14T11:52:51.619046+0000","last_clean":"2024-09-14T11:52:51.619046+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:52:51.619046+0000","last_undegraded":"2024-09-14T11:52:51.619046+0000","last_fullsized":"2024-09-14T11:52:51.619046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.618977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:09.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.930873+0000","last_change":"2024-09-14T11:11:08.649058+0000","last_active":"2024-09-14T11:50:43.930873+0000","last_peered":"2024-09-14T11:50:43.930873+0000","last_clean":"2024-09-14T11:50:43.930873+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:50:43.930873+0000","last_undegraded":"2024-09-14T11:50:43.930873+0000","last_fullsized":"2024-09-14T11:50:43.930873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:32.385019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'109","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.305262+0000","last_change":"2024-09-14T11:11:10.671331+0000","last_active":"2024-09-14T11:51:19.305262+0000","last_peered":"2024-09-14T11:51:19.305262+0000","last_clean":"2024-09-14T11:51:19.305262+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:51:19.305262+0000","last_undegraded":"2024-09-14T11:51:19.305262+0000","last_fullsized":"2024-09-14T11:51:19.305262+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'820","reported_seq":4187,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.730438+0000","last_change":"2024-09-14T11:11:12.678672+0000","last_active":"2024-09-14T11:52:44.730438+0000","last_peered":"2024-09-14T11:52:44.730438+0000","last_clean":"2024-09-14T11:52:44.730438+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:52:44.730438+0000","last_undegraded":"2024-09-14T11:52:44.730438+0000","last_fullsized":"2024-09-14T11:52:44.730438+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'298","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.901850+0000","last_change":"2024-09-14T11:11:14.686960+0000","last_active":"2024-09-14T11:51:21.901850+0000","last_peered":"2024-09-14T11:51:21.901850+0000","last_clean":"2024-09-14T11:51:21.901850+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:51:21.901850+0000","last_undegraded":"2024-09-14T11:51:21.901850+0000","last_fullsized":"2024-09-14T11:51:21.901850+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:51.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'547","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.103069+0000","last_change":"2024-09-14T11:52:55.103069+0000","last_active":"2024-09-14T11:52:55.103069+0000","last_peered":"2024-09-14T11:52:55.103069+0000","last_clean":"2024-09-14T11:52:55.103069+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:52:55.103069+0000","last_undegraded":"2024-09-14T11:52:55.103069+0000","last_fullsized":"2024-09-14T11:52:55.103069+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.102970+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.863637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.184613+0000","last_change":"2024-09-14T11:52:51.184613+0000","last_active":"2024-09-14T11:52:51.184613+0000","last_peered":"2024-09-14T11:52:51.184613+0000","last_clean":"2024-09-14T11:52:51.184613+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:52:51.184613+0000","last_undegraded":"2024-09-14T11:52:51.184613+0000","last_fullsized":"2024-09-14T11:52:51.184613+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.184537+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:22.858482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":59716,"num_write":954,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.049162+0000","last_change":"2024-09-14T11:52:52.049162+0000","last_active":"2024-09-14T11:52:52.049162+0000","last_peered":"2024-09-14T11:52:52.049162+0000","last_clean":"2024-09-14T11:52:52.049162+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:52:52.049162+0000","last_undegraded":"2024-09-14T11:52:52.049162+0000","last_fullsized":"2024-09-14T11:52:52.049162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.049078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:46.676372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921314+0000","last_change":"2024-09-14T11:11:08.656366+0000","last_active":"2024-09-14T11:49:18.921314+0000","last_peered":"2024-09-14T11:49:18.921314+0000","last_clean":"2024-09-14T11:49:18.921314+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:49:18.921314+0000","last_undegraded":"2024-09-14T11:49:18.921314+0000","last_fullsized":"2024-09-14T11:49:18.921314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:14.566083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'320","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.578537+0000","last_change":"2024-09-14T11:11:10.883247+0000","last_active":"2024-09-14T11:52:44.578537+0000","last_peered":"2024-09-14T11:52:44.578537+0000","last_clean":"2024-09-14T11:52:44.578537+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:52:44.578537+0000","last_undegraded":"2024-09-14T11:52:44.578537+0000","last_fullsized":"2024-09-14T11:52:44.578537+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":700,"num_write":238,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933828+0000","last_change":"2024-09-14T11:11:12.682882+0000","last_active":"2024-09-14T11:50:48.933828+0000","last_peered":"2024-09-14T11:50:48.933828+0000","last_clean":"2024-09-14T11:50:48.933828+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:50:48.933828+0000","last_undegraded":"2024-09-14T11:50:48.933828+0000","last_fullsized":"2024-09-14T11:50:48.933828+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'120","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:20.820332+0000","last_change":"2024-09-14T11:11:14.692652+0000","last_active":"2024-09-14T11:51:20.820332+0000","last_peered":"2024-09-14T11:51:20.820332+0000","last_clean":"2024-09-14T11:51:20.820332+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:51:20.820332+0000","last_undegraded":"2024-09-14T11:51:20.820332+0000","last_fullsized":"2024-09-14T11:51:20.820332+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:49.033241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'145","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.952084+0000","last_change":"2024-09-14T11:11:14.691282+0000","last_active":"2024-09-14T11:51:21.952084+0000","last_peered":"2024-09-14T11:51:21.952084+0000","last_clean":"2024-09-14T11:51:21.952084+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:51:21.952084+0000","last_undegraded":"2024-09-14T11:51:21.952084+0000","last_fullsized":"2024-09-14T11:51:21.952084+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'730","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.077001+0000","last_change":"2024-09-14T11:52:59.076916+0000","last_active":"2024-09-14T11:52:59.077001+0000","last_peered":"2024-09-14T11:52:59.077001+0000","last_clean":"2024-09-14T11:52:59.077001+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:59.077001+0000","last_undegraded":"2024-09-14T11:52:59.077001+0000","last_fullsized":"2024-09-14T11:52:59.077001+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'730","last_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_deep_scrub":"263'730","last_deep_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.076833+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:00.485111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'234","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648589+0000","last_change":"2024-09-14T11:52:54.648589+0000","last_active":"2024-09-14T11:52:54.648589+0000","last_peered":"2024-09-14T11:52:54.648589+0000","last_clean":"2024-09-14T11:52:54.648589+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:52:54.648589+0000","last_undegraded":"2024-09-14T11:52:54.648589+0000","last_fullsized":"2024-09-14T11:52:54.648589+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'234","last_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_deep_scrub":"263'234","last_deep_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648451+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.438311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":19030,"num_write":1058,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.567001+0000","last_change":"2024-09-14T11:53:06.566908+0000","last_active":"2024-09-14T11:53:06.567001+0000","last_peered":"2024-09-14T11:53:06.567001+0000","last_clean":"2024-09-14T11:53:06.567001+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:53:06.567001+0000","last_undegraded":"2024-09-14T11:53:06.567001+0000","last_fullsized":"2024-09-14T11:53:06.567001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.566787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:22.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'140","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.627683+0000","last_change":"2024-09-14T11:11:10.670870+0000","last_active":"2024-09-14T11:52:44.627683+0000","last_peered":"2024-09-14T11:52:44.627683+0000","last_clean":"2024-09-14T11:52:44.627683+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:52:44.627683+0000","last_undegraded":"2024-09-14T11:52:44.627683+0000","last_fullsized":"2024-09-14T11:52:44.627683+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:25.995412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914699+0000","last_change":"2024-09-14T11:11:12.679809+0000","last_active":"2024-09-14T11:48:33.914699+0000","last_peered":"2024-09-14T11:48:33.914699+0000","last_clean":"2024-09-14T11:48:33.914699+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:48:33.914699+0000","last_undegraded":"2024-09-14T11:48:33.914699+0000","last_fullsized":"2024-09-14T11:48:33.914699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:59.317292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:05.176366+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:05.176366+0000","last_peered":"2024-09-14T11:51:05.176366+0000","last_clean":"2024-09-14T11:51:05.176366+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:05.176366+0000","last_undegraded":"2024-09-14T11:51:05.176366+0000","last_fullsized":"2024-09-14T11:51:05.176366+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:34:48.809610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'714","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.612425+0000","last_change":"2024-09-14T11:53:02.612361+0000","last_active":"2024-09-14T11:53:02.612425+0000","last_peered":"2024-09-14T11:53:02.612425+0000","last_clean":"2024-09-14T11:53:02.612425+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:53:02.612425+0000","last_undegraded":"2024-09-14T11:53:02.612425+0000","last_fullsized":"2024-09-14T11:53:02.612425+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'714","last_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_deep_scrub":"263'714","last_deep_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.612273+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:14.047702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'188","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.133662+0000","last_change":"2024-09-14T11:53:02.133662+0000","last_active":"2024-09-14T11:53:02.133662+0000","last_peered":"2024-09-14T11:53:02.133662+0000","last_clean":"2024-09-14T11:53:02.133662+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:53:02.133662+0000","last_undegraded":"2024-09-14T11:53:02.133662+0000","last_fullsized":"2024-09-14T11:53:02.133662+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.133543+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:44.205392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":26239,"num_write":895,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933862+0000","last_change":"2024-09-14T11:11:08.649769+0000","last_active":"2024-09-14T11:50:48.933862+0000","last_peered":"2024-09-14T11:50:48.933862+0000","last_clean":"2024-09-14T11:50:48.933862+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:50:48.933862+0000","last_undegraded":"2024-09-14T11:50:48.933862+0000","last_fullsized":"2024-09-14T11:50:48.933862+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'53","reported_seq":548,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.138152+0000","last_change":"2024-09-14T11:11:10.669313+0000","last_active":"2024-09-14T11:51:19.138152+0000","last_peered":"2024-09-14T11:51:19.138152+0000","last_clean":"2024-09-14T11:51:19.138152+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:51:19.138152+0000","last_undegraded":"2024-09-14T11:51:19.138152+0000","last_fullsized":"2024-09-14T11:51:19.138152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:59.713099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034011+0000","last_change":"2024-09-14T11:11:12.680118+0000","last_active":"2024-09-14T11:48:34.034011+0000","last_peered":"2024-09-14T11:48:34.034011+0000","last_clean":"2024-09-14T11:48:34.034011+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:48:34.034011+0000","last_undegraded":"2024-09-14T11:48:34.034011+0000","last_fullsized":"2024-09-14T11:48:34.034011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:34.408102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'195","reported_seq":707,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.441751+0000","last_change":"2024-09-14T11:11:14.692367+0000","last_active":"2024-09-14T11:52:36.441751+0000","last_peered":"2024-09-14T11:52:36.441751+0000","last_clean":"2024-09-14T11:52:36.441751+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:52:36.441751+0000","last_undegraded":"2024-09-14T11:52:36.441751+0000","last_fullsized":"2024-09-14T11:52:36.441751+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:21.861427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'490","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.224894+0000","last_change":"2024-09-14T11:53:03.224838+0000","last_active":"2024-09-14T11:53:03.224894+0000","last_peered":"2024-09-14T11:53:03.224894+0000","last_clean":"2024-09-14T11:53:03.224894+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:53:03.224894+0000","last_undegraded":"2024-09-14T11:53:03.224894+0000","last_fullsized":"2024-09-14T11:53:03.224894+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.224751+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:34.212444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'205","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.109079+0000","last_change":"2024-09-14T11:52:56.109079+0000","last_active":"2024-09-14T11:52:56.109079+0000","last_peered":"2024-09-14T11:52:56.109079+0000","last_clean":"2024-09-14T11:52:56.109079+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:52:56.109079+0000","last_undegraded":"2024-09-14T11:52:56.109079+0000","last_fullsized":"2024-09-14T11:52:56.109079+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.108961+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:38.858667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":474,"num_read_kb":67081,"num_write":927,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:49.053748+0000","last_change":"2024-09-14T11:11:08.654324+0000","last_active":"2024-09-14T11:50:49.053748+0000","last_peered":"2024-09-14T11:50:49.053748+0000","last_clean":"2024-09-14T11:50:49.053748+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:50:49.053748+0000","last_undegraded":"2024-09-14T11:50:49.053748+0000","last_fullsized":"2024-09-14T11:50:49.053748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'162","reported_seq":748,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.513757+0000","last_change":"2024-09-14T11:11:10.672080+0000","last_active":"2024-09-14T11:52:44.513757+0000","last_peered":"2024-09-14T11:52:44.513757+0000","last_clean":"2024-09-14T11:52:44.513757+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:52:44.513757+0000","last_undegraded":"2024-09-14T11:52:44.513757+0000","last_fullsized":"2024-09-14T11:52:44.513757+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:19.936617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":278,"num_write":116,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.907458+0000","last_change":"2024-09-14T11:11:12.680936+0000","last_active":"2024-09-14T11:48:33.907458+0000","last_peered":"2024-09-14T11:48:33.907458+0000","last_clean":"2024-09-14T11:48:33.907458+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:48:33.907458+0000","last_undegraded":"2024-09-14T11:48:33.907458+0000","last_fullsized":"2024-09-14T11:48:33.907458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:51.042361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'159","reported_seq":663,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.741928+0000","last_change":"2024-09-14T11:11:14.690690+0000","last_active":"2024-09-14T11:51:08.741928+0000","last_peered":"2024-09-14T11:51:08.741928+0000","last_clean":"2024-09-14T11:51:08.741928+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:51:08.741928+0000","last_undegraded":"2024-09-14T11:51:08.741928+0000","last_fullsized":"2024-09-14T11:51:08.741928+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:02.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1180","reported_seq":2930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.193367+0000","last_change":"2024-09-14T11:53:02.193307+0000","last_active":"2024-09-14T11:53:02.193367+0000","last_peered":"2024-09-14T11:53:02.193367+0000","last_clean":"2024-09-14T11:53:02.193367+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:53:02.193367+0000","last_undegraded":"2024-09-14T11:53:02.193367+0000","last_fullsized":"2024-09-14T11:53:02.193367+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1180","last_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_deep_scrub":"263'1180","last_deep_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.193183+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:52.922671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'190","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.177272+0000","last_change":"2024-09-14T11:52:52.177272+0000","last_active":"2024-09-14T11:52:52.177272+0000","last_peered":"2024-09-14T11:52:52.177272+0000","last_clean":"2024-09-14T11:52:52.177272+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:52:52.177272+0000","last_undegraded":"2024-09-14T11:52:52.177272+0000","last_fullsized":"2024-09-14T11:52:52.177272+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.177191+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.347583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":13209,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.059077+0000","last_change":"2024-09-14T11:53:05.059021+0000","last_active":"2024-09-14T11:53:05.059077+0000","last_peered":"2024-09-14T11:53:05.059077+0000","last_clean":"2024-09-14T11:53:05.059077+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:53:05.059077+0000","last_undegraded":"2024-09-14T11:53:05.059077+0000","last_fullsized":"2024-09-14T11:53:05.059077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.058935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.616585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'124","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.471340+0000","last_change":"2024-09-14T11:11:10.670918+0000","last_active":"2024-09-14T11:52:44.471340+0000","last_peered":"2024-09-14T11:52:44.471340+0000","last_clean":"2024-09-14T11:52:44.471340+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:52:44.471340+0000","last_undegraded":"2024-09-14T11:52:44.471340+0000","last_fullsized":"2024-09-14T11:52:44.471340+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:05.847749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":210,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913655+0000","last_change":"2024-09-14T11:11:12.682390+0000","last_active":"2024-09-14T11:48:33.913655+0000","last_peered":"2024-09-14T11:48:33.913655+0000","last_clean":"2024-09-14T11:48:33.913655+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:48:33.913655+0000","last_undegraded":"2024-09-14T11:48:33.913655+0000","last_fullsized":"2024-09-14T11:48:33.913655+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:05.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1630","reported_seq":3338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.020929+0000","last_change":"2024-09-14T11:53:00.020929+0000","last_active":"2024-09-14T11:53:00.020929+0000","last_peered":"2024-09-14T11:53:00.020929+0000","last_clean":"2024-09-14T11:53:00.020929+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:53:00.020929+0000","last_undegraded":"2024-09-14T11:53:00.020929+0000","last_fullsized":"2024-09-14T11:53:00.020929+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1630","last_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_deep_scrub":"263'1630","last_deep_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.020831+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:01.658072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'230","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.223218+0000","last_change":"2024-09-14T11:52:54.223218+0000","last_active":"2024-09-14T11:52:54.223218+0000","last_peered":"2024-09-14T11:52:54.223218+0000","last_clean":"2024-09-14T11:52:54.223218+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:54.223218+0000","last_undegraded":"2024-09-14T11:52:54.223218+0000","last_fullsized":"2024-09-14T11:52:54.223218+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.223086+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:16.621473+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":62996,"num_write":1114,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921634+0000","last_change":"2024-09-14T11:11:08.650958+0000","last_active":"2024-09-14T11:49:18.921634+0000","last_peered":"2024-09-14T11:49:18.921634+0000","last_clean":"2024-09-14T11:49:18.921634+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:49:18.921634+0000","last_undegraded":"2024-09-14T11:49:18.921634+0000","last_fullsized":"2024-09-14T11:49:18.921634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:09.330791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'207","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.715314+0000","last_change":"2024-09-14T11:11:10.670001+0000","last_active":"2024-09-14T11:52:44.715314+0000","last_peered":"2024-09-14T11:52:44.715314+0000","last_clean":"2024-09-14T11:52:44.715314+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:52:44.715314+0000","last_undegraded":"2024-09-14T11:52:44.715314+0000","last_fullsized":"2024-09-14T11:52:44.715314+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:12.845985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":490,"num_write":204,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:44.040316+0000","last_change":"2024-09-14T11:11:12.683170+0000","last_active":"2024-09-14T11:48:44.040316+0000","last_peered":"2024-09-14T11:48:44.040316+0000","last_clean":"2024-09-14T11:48:44.040316+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:48:44.040316+0000","last_undegraded":"2024-09-14T11:48:44.040316+0000","last_fullsized":"2024-09-14T11:48:44.040316+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.360262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.306430+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.306430+0000","last_peered":"2024-09-14T11:51:21.306430+0000","last_clean":"2024-09-14T11:51:21.306430+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.306430+0000","last_undegraded":"2024-09-14T11:51:21.306430+0000","last_fullsized":"2024-09-14T11:51:21.306430+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:39.189954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'426","reported_seq":2039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.118696+0000","last_change":"2024-09-14T11:53:03.118696+0000","last_active":"2024-09-14T11:53:03.118696+0000","last_peered":"2024-09-14T11:53:03.118696+0000","last_clean":"2024-09-14T11:53:03.118696+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:53:03.118696+0000","last_undegraded":"2024-09-14T11:53:03.118696+0000","last_fullsized":"2024-09-14T11:53:03.118696+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.118613+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.478029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'181","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.646490+0000","last_change":"2024-09-14T11:52:58.646490+0000","last_active":"2024-09-14T11:52:58.646490+0000","last_peered":"2024-09-14T11:52:58.646490+0000","last_clean":"2024-09-14T11:52:58.646490+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:52:58.646490+0000","last_undegraded":"2024-09-14T11:52:58.646490+0000","last_fullsized":"2024-09-14T11:52:58.646490+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.646391+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:28.666065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":12441,"num_write":906,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.108231+0000","last_change":"2024-09-14T11:53:06.108231+0000","last_active":"2024-09-14T11:53:06.108231+0000","last_peered":"2024-09-14T11:53:06.108231+0000","last_clean":"2024-09-14T11:53:06.108231+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:53:06.108231+0000","last_undegraded":"2024-09-14T11:53:06.108231+0000","last_fullsized":"2024-09-14T11:53:06.108231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.108140+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:42.873671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":1194,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'163","reported_seq":736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.483497+0000","last_change":"2024-09-14T11:11:10.668831+0000","last_active":"2024-09-14T11:52:44.483497+0000","last_peered":"2024-09-14T11:52:44.483497+0000","last_clean":"2024-09-14T11:52:44.483497+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:52:44.483497+0000","last_undegraded":"2024-09-14T11:52:44.483497+0000","last_fullsized":"2024-09-14T11:52:44.483497+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:09.314233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9714,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":303,"num_write":148,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915697+0000","last_change":"2024-09-14T11:11:12.681008+0000","last_active":"2024-09-14T11:48:43.915697+0000","last_peered":"2024-09-14T11:48:43.915697+0000","last_clean":"2024-09-14T11:48:43.915697+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:48:43.915697+0000","last_undegraded":"2024-09-14T11:48:43.915697+0000","last_fullsized":"2024-09-14T11:48:43.915697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:58.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'173","reported_seq":701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:07.089853+0000","last_change":"2024-09-14T11:11:14.690312+0000","last_active":"2024-09-14T11:50:07.089853+0000","last_peered":"2024-09-14T11:50:07.089853+0000","last_clean":"2024-09-14T11:50:07.089853+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:50:07.089853+0000","last_undegraded":"2024-09-14T11:50:07.089853+0000","last_fullsized":"2024-09-14T11:50:07.089853+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:02.026241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'378","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.177623+0000","last_change":"2024-09-14T11:53:07.177623+0000","last_active":"2024-09-14T11:53:07.177623+0000","last_peered":"2024-09-14T11:53:07.177623+0000","last_clean":"2024-09-14T11:53:07.177623+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:53:07.177623+0000","last_undegraded":"2024-09-14T11:53:07.177623+0000","last_fullsized":"2024-09-14T11:53:07.177623+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.177534+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:21.980111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'245","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.133645+0000","last_change":"2024-09-14T11:52:51.133645+0000","last_active":"2024-09-14T11:52:51.133645+0000","last_peered":"2024-09-14T11:52:51.133645+0000","last_clean":"2024-09-14T11:52:51.133645+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:52:51.133645+0000","last_undegraded":"2024-09-14T11:52:51.133645+0000","last_fullsized":"2024-09-14T11:52:51.133645+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'245","last_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_deep_scrub":"263'245","last_deep_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.133522+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:35.776995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":23729,"num_write":1071,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914129+0000","last_change":"2024-09-14T11:11:08.651803+0000","last_active":"2024-09-14T11:48:38.914129+0000","last_peered":"2024-09-14T11:48:38.914129+0000","last_clean":"2024-09-14T11:48:38.914129+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:48:38.914129+0000","last_undegraded":"2024-09-14T11:48:38.914129+0000","last_fullsized":"2024-09-14T11:48:38.914129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:43.244734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'146","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.693783+0000","last_change":"2024-09-14T11:11:10.883223+0000","last_active":"2024-09-14T11:52:44.693783+0000","last_peered":"2024-09-14T11:52:44.693783+0000","last_clean":"2024-09-14T11:52:44.693783+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:52:44.693783+0000","last_undegraded":"2024-09-14T11:52:44.693783+0000","last_fullsized":"2024-09-14T11:52:44.693783+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33350,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":317,"num_write":100,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:18.921566+0000","last_change":"2024-09-14T11:11:12.681509+0000","last_active":"2024-09-14T11:49:18.921566+0000","last_peered":"2024-09-14T11:49:18.921566+0000","last_clean":"2024-09-14T11:49:18.921566+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:49:18.921566+0000","last_undegraded":"2024-09-14T11:49:18.921566+0000","last_fullsized":"2024-09-14T11:49:18.921566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:59.776741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'122","reported_seq":605,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:37.546132+0000","last_change":"2024-09-14T11:11:14.691723+0000","last_active":"2024-09-14T11:52:37.546132+0000","last_peered":"2024-09-14T11:52:37.546132+0000","last_clean":"2024-09-14T11:52:37.546132+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:52:37.546132+0000","last_undegraded":"2024-09-14T11:52:37.546132+0000","last_fullsized":"2024-09-14T11:52:37.546132+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:16.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'482","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.573570+0000","last_change":"2024-09-14T11:52:59.573570+0000","last_active":"2024-09-14T11:52:59.573570+0000","last_peered":"2024-09-14T11:52:59.573570+0000","last_clean":"2024-09-14T11:52:59.573570+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:52:59.573570+0000","last_undegraded":"2024-09-14T11:52:59.573570+0000","last_fullsized":"2024-09-14T11:52:59.573570+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'482","last_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_deep_scrub":"263'482","last_deep_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.573481+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:46.583273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'294","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.166071+0000","last_change":"2024-09-14T11:52:53.166071+0000","last_active":"2024-09-14T11:52:53.166071+0000","last_peered":"2024-09-14T11:52:53.166071+0000","last_clean":"2024-09-14T11:52:53.166071+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:52:53.166071+0000","last_undegraded":"2024-09-14T11:52:53.166071+0000","last_fullsized":"2024-09-14T11:52:53.166071+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.165977+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:14.077350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":821,"num_read_kb":27323,"num_write":1074,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:38.914708+0000","last_change":"2024-09-14T11:11:08.657837+0000","last_active":"2024-09-14T11:48:38.914708+0000","last_peered":"2024-09-14T11:48:38.914708+0000","last_clean":"2024-09-14T11:48:38.914708+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:48:38.914708+0000","last_undegraded":"2024-09-14T11:48:38.914708+0000","last_fullsized":"2024-09-14T11:48:38.914708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:04.731555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'70","reported_seq":582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.316786+0000","last_change":"2024-09-14T11:11:10.883222+0000","last_active":"2024-09-14T11:51:19.316786+0000","last_peered":"2024-09-14T11:51:19.316786+0000","last_clean":"2024-09-14T11:51:19.316786+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:51:19.316786+0000","last_undegraded":"2024-09-14T11:51:19.316786+0000","last_fullsized":"2024-09-14T11:51:19.316786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:29.226087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.725494+0000","last_change":"2024-09-14T11:11:12.679582+0000","last_active":"2024-09-14T11:52:44.725494+0000","last_peered":"2024-09-14T11:52:44.725494+0000","last_clean":"2024-09-14T11:52:44.725494+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:52:44.725494+0000","last_undegraded":"2024-09-14T11:52:44.725494+0000","last_fullsized":"2024-09-14T11:52:44.725494+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.781791+0000","last_change":"2024-09-14T11:11:14.693282+0000","last_active":"2024-09-14T11:50:48.781791+0000","last_peered":"2024-09-14T11:50:48.781791+0000","last_clean":"2024-09-14T11:50:48.781791+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:50:48.781791+0000","last_undegraded":"2024-09-14T11:50:48.781791+0000","last_fullsized":"2024-09-14T11:50:48.781791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:09.483259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.967406+0000","last_change":"2024-09-14T11:53:02.967406+0000","last_active":"2024-09-14T11:53:02.967406+0000","last_peered":"2024-09-14T11:53:02.967406+0000","last_clean":"2024-09-14T11:53:02.967406+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:53:02.967406+0000","last_undegraded":"2024-09-14T11:53:02.967406+0000","last_fullsized":"2024-09-14T11:53:02.967406+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1013","last_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_deep_scrub":"263'1013","last_deep_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.967314+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:15.598856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'216","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.111172+0000","last_change":"2024-09-14T11:52:57.111172+0000","last_active":"2024-09-14T11:52:57.111172+0000","last_peered":"2024-09-14T11:52:57.111172+0000","last_clean":"2024-09-14T11:52:57.111172+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:52:57.111172+0000","last_undegraded":"2024-09-14T11:52:57.111172+0000","last_fullsized":"2024-09-14T11:52:57.111172+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.111027+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:22.998621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":12794,"num_write":1051,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.034846+0000","last_change":"2024-09-14T11:11:08.653717+0000","last_active":"2024-09-14T11:48:39.034846+0000","last_peered":"2024-09-14T11:48:39.034846+0000","last_clean":"2024-09-14T11:48:39.034846+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:48:39.034846+0000","last_undegraded":"2024-09-14T11:48:39.034846+0000","last_fullsized":"2024-09-14T11:48:39.034846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:32.879931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'169","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.398052+0000","last_change":"2024-09-14T11:11:10.669599+0000","last_active":"2024-09-14T11:52:44.398052+0000","last_peered":"2024-09-14T11:52:44.398052+0000","last_clean":"2024-09-14T11:52:44.398052+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:52:44.398052+0000","last_undegraded":"2024-09-14T11:52:44.398052+0000","last_fullsized":"2024-09-14T11:52:44.398052+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:43.348380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":294,"num_write":122,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926374+0000","last_change":"2024-09-14T11:11:12.681246+0000","last_active":"2024-09-14T11:49:53.926374+0000","last_peered":"2024-09-14T11:49:53.926374+0000","last_clean":"2024-09-14T11:49:53.926374+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:49:53.926374+0000","last_undegraded":"2024-09-14T11:49:53.926374+0000","last_fullsized":"2024-09-14T11:49:53.926374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:07.331430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'115","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:07.880410+0000","last_change":"2024-09-14T11:11:14.697190+0000","last_active":"2024-09-14T11:51:07.880410+0000","last_peered":"2024-09-14T11:51:07.880410+0000","last_clean":"2024-09-14T11:51:07.880410+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:51:07.880410+0000","last_undegraded":"2024-09-14T11:51:07.880410+0000","last_fullsized":"2024-09-14T11:51:07.880410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:51.323211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1158","reported_seq":2819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.002594+0000","last_change":"2024-09-14T11:53:02.002594+0000","last_active":"2024-09-14T11:53:02.002594+0000","last_peered":"2024-09-14T11:53:02.002594+0000","last_clean":"2024-09-14T11:53:02.002594+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:53:02.002594+0000","last_undegraded":"2024-09-14T11:53:02.002594+0000","last_fullsized":"2024-09-14T11:53:02.002594+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.002510+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.793177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'199","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.195803+0000","last_change":"2024-09-14T11:52:59.195803+0000","last_active":"2024-09-14T11:52:59.195803+0000","last_peered":"2024-09-14T11:52:59.195803+0000","last_clean":"2024-09-14T11:52:59.195803+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:52:59.195803+0000","last_undegraded":"2024-09-14T11:52:59.195803+0000","last_fullsized":"2024-09-14T11:52:59.195803+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.195690+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:29.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":665,"num_read_kb":26583,"num_write":943,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039639+0000","last_change":"2024-09-14T11:11:08.655874+0000","last_active":"2024-09-14T11:48:39.039639+0000","last_peered":"2024-09-14T11:48:39.039639+0000","last_clean":"2024-09-14T11:48:39.039639+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:48:39.039639+0000","last_undegraded":"2024-09-14T11:48:39.039639+0000","last_fullsized":"2024-09-14T11:48:39.039639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:09.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'131","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.407904+0000","last_change":"2024-09-14T11:11:10.673119+0000","last_active":"2024-09-14T11:52:44.407904+0000","last_peered":"2024-09-14T11:52:44.407904+0000","last_clean":"2024-09-14T11:52:44.407904+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:52:44.407904+0000","last_undegraded":"2024-09-14T11:52:44.407904+0000","last_fullsized":"2024-09-14T11:52:44.407904+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:42.182477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":236,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:03.919674+0000","last_change":"2024-09-14T11:11:12.680784+0000","last_active":"2024-09-14T11:50:03.919674+0000","last_peered":"2024-09-14T11:50:03.919674+0000","last_clean":"2024-09-14T11:50:03.919674+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:50:03.919674+0000","last_undegraded":"2024-09-14T11:50:03.919674+0000","last_fullsized":"2024-09-14T11:50:03.919674+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:59.544800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'509","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.192324+0000","last_change":"2024-09-14T11:53:06.192324+0000","last_active":"2024-09-14T11:53:06.192324+0000","last_peered":"2024-09-14T11:53:06.192324+0000","last_clean":"2024-09-14T11:53:06.192324+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:53:06.192324+0000","last_undegraded":"2024-09-14T11:53:06.192324+0000","last_fullsized":"2024-09-14T11:53:06.192324+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.192233+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.491268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'219","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.233144+0000","last_change":"2024-09-14T11:52:56.233144+0000","last_active":"2024-09-14T11:52:56.233144+0000","last_peered":"2024-09-14T11:52:56.233144+0000","last_clean":"2024-09-14T11:52:56.233144+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:56.233144+0000","last_undegraded":"2024-09-14T11:52:56.233144+0000","last_fullsized":"2024-09-14T11:52:56.233144+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.232989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:07.476932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":7926,"num_write":973,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.923902+0000","last_change":"2024-09-14T11:11:08.654095+0000","last_active":"2024-09-14T11:49:48.923902+0000","last_peered":"2024-09-14T11:49:48.923902+0000","last_clean":"2024-09-14T11:49:48.923902+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:49:48.923902+0000","last_undegraded":"2024-09-14T11:49:48.923902+0000","last_fullsized":"2024-09-14T11:49:48.923902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:07.634721+0000","last_clean_scrub_stamp":"2024-09-14T11:11:07.634721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:24.218559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'107","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.654246+0000","last_change":"2024-09-14T11:11:10.669556+0000","last_active":"2024-09-14T11:52:44.654246+0000","last_peered":"2024-09-14T11:52:44.654246+0000","last_clean":"2024-09-14T11:52:44.654246+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:52:44.654246+0000","last_undegraded":"2024-09-14T11:52:44.654246+0000","last_fullsized":"2024-09-14T11:52:44.654246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:15.724714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":208,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915062+0000","last_change":"2024-09-14T11:11:12.682253+0000","last_active":"2024-09-14T11:48:43.915062+0000","last_peered":"2024-09-14T11:48:43.915062+0000","last_clean":"2024-09-14T11:48:43.915062+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:48:43.915062+0000","last_undegraded":"2024-09-14T11:48:43.915062+0000","last_fullsized":"2024-09-14T11:48:43.915062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:58.792704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'186","reported_seq":1636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:19.774324+0000","last_change":"2024-09-14T11:11:14.690239+0000","last_active":"2024-09-14T11:51:19.774324+0000","last_peered":"2024-09-14T11:51:19.774324+0000","last_clean":"2024-09-14T11:51:19.774324+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:51:19.774324+0000","last_undegraded":"2024-09-14T11:51:19.774324+0000","last_fullsized":"2024-09-14T11:51:19.774324+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:45.377535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.047117+0000","last_change":"2024-09-14T11:53:01.047117+0000","last_active":"2024-09-14T11:53:01.047117+0000","last_peered":"2024-09-14T11:53:01.047117+0000","last_clean":"2024-09-14T11:53:01.047117+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:53:01.047117+0000","last_undegraded":"2024-09-14T11:53:01.047117+0000","last_fullsized":"2024-09-14T11:53:01.047117+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.047027+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:29.624414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'230","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.174275+0000","last_change":"2024-09-14T11:52:54.174275+0000","last_active":"2024-09-14T11:52:54.174275+0000","last_peered":"2024-09-14T11:52:54.174275+0000","last_clean":"2024-09-14T11:52:54.174275+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:52:54.174275+0000","last_undegraded":"2024-09-14T11:52:54.174275+0000","last_fullsized":"2024-09-14T11:52:54.174275+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.174100+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:15.196149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1057,"num_read_kb":144594,"num_write":1045,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.621816+0000","last_change":"2024-09-14T11:53:08.621816+0000","last_active":"2024-09-14T11:53:08.621816+0000","last_peered":"2024-09-14T11:53:08.621816+0000","last_clean":"2024-09-14T11:53:08.621816+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:53:08.621816+0000","last_undegraded":"2024-09-14T11:53:08.621816+0000","last_fullsized":"2024-09-14T11:53:08.621816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.621675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:07.357313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'156","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.702598+0000","last_change":"2024-09-14T11:11:10.668336+0000","last_active":"2024-09-14T11:52:44.702598+0000","last_peered":"2024-09-14T11:52:44.702598+0000","last_clean":"2024-09-14T11:52:44.702598+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:52:44.702598+0000","last_undegraded":"2024-09-14T11:52:44.702598+0000","last_fullsized":"2024-09-14T11:52:44.702598+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:09.639489+0000","last_clean_scrub_stamp":"2024-09-14T11:11:09.639489+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:48.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":208,"num_write":106,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:43.915597+0000","last_change":"2024-09-14T11:11:12.681192+0000","last_active":"2024-09-14T11:48:43.915597+0000","last_peered":"2024-09-14T11:48:43.915597+0000","last_clean":"2024-09-14T11:48:43.915597+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:48:43.915597+0000","last_undegraded":"2024-09-14T11:48:43.915597+0000","last_fullsized":"2024-09-14T11:48:43.915597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:11.651487+0000","last_clean_scrub_stamp":"2024-09-14T11:11:11.651487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:16.703382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'131","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:36.434001+0000","last_change":"2024-09-14T11:11:14.697156+0000","last_active":"2024-09-14T11:52:36.434001+0000","last_peered":"2024-09-14T11:52:36.434001+0000","last_clean":"2024-09-14T11:52:36.434001+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:52:36.434001+0000","last_undegraded":"2024-09-14T11:52:36.434001+0000","last_fullsized":"2024-09-14T11:52:36.434001+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:54.319859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'852","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.568807+0000","last_change":"2024-09-14T11:53:05.568807+0000","last_active":"2024-09-14T11:53:05.568807+0000","last_peered":"2024-09-14T11:53:05.568807+0000","last_clean":"2024-09-14T11:53:05.568807+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:53:05.568807+0000","last_undegraded":"2024-09-14T11:53:05.568807+0000","last_fullsized":"2024-09-14T11:53:05.568807+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'852","last_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_deep_scrub":"263'852","last_deep_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.568712+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.647100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'248","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.065807+0000","last_change":"2024-09-14T11:52:56.065807+0000","last_active":"2024-09-14T11:52:56.065807+0000","last_peered":"2024-09-14T11:52:56.065807+0000","last_clean":"2024-09-14T11:52:56.065807+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:52:56.065807+0000","last_undegraded":"2024-09-14T11:52:56.065807+0000","last_fullsized":"2024-09-14T11:52:56.065807+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'248","last_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_deep_scrub":"263'248","last_deep_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.065655+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:38.524060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":737,"num_read_kb":42950,"num_write":1092,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'568","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.610451+0000","last_change":"2024-09-14T11:53:04.610451+0000","last_active":"2024-09-14T11:53:04.610451+0000","last_peered":"2024-09-14T11:53:04.610451+0000","last_clean":"2024-09-14T11:53:04.610451+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:53:04.610451+0000","last_undegraded":"2024-09-14T11:53:04.610451+0000","last_fullsized":"2024-09-14T11:53:04.610451+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'568","last_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_deep_scrub":"263'568","last_deep_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.610328+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:59.992487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1797,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'180","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.720382+0000","last_change":"2024-09-14T11:52:52.720382+0000","last_active":"2024-09-14T11:52:52.720382+0000","last_peered":"2024-09-14T11:52:52.720382+0000","last_clean":"2024-09-14T11:52:52.720382+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:52:52.720382+0000","last_undegraded":"2024-09-14T11:52:52.720382+0000","last_fullsized":"2024-09-14T11:52:52.720382+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.720305+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:22.441860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":43631,"num_write":872,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'531","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.174316+0000","last_change":"2024-09-14T11:53:06.174316+0000","last_active":"2024-09-14T11:53:06.174316+0000","last_peered":"2024-09-14T11:53:06.174316+0000","last_clean":"2024-09-14T11:53:06.174316+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:53:06.174316+0000","last_undegraded":"2024-09-14T11:53:06.174316+0000","last_fullsized":"2024-09-14T11:53:06.174316+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'531","last_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_deep_scrub":"263'531","last_deep_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.174226+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:29.796542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'217","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.151067+0000","last_change":"2024-09-14T11:52:58.151067+0000","last_active":"2024-09-14T11:52:58.151067+0000","last_peered":"2024-09-14T11:52:58.151067+0000","last_clean":"2024-09-14T11:52:58.151067+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:52:58.151067+0000","last_undegraded":"2024-09-14T11:52:58.151067+0000","last_fullsized":"2024-09-14T11:52:58.151067+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.150955+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:54.421678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":22878,"num_write":1010,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'805","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.635510+0000","last_change":"2024-09-14T11:53:03.635510+0000","last_active":"2024-09-14T11:53:03.635510+0000","last_peered":"2024-09-14T11:53:03.635510+0000","last_clean":"2024-09-14T11:53:03.635510+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:53:03.635510+0000","last_undegraded":"2024-09-14T11:53:03.635510+0000","last_fullsized":"2024-09-14T11:53:03.635510+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.635426+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:26.207368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.172379+0000","last_change":"2024-09-14T11:52:55.172379+0000","last_active":"2024-09-14T11:52:55.172379+0000","last_peered":"2024-09-14T11:52:55.172379+0000","last_clean":"2024-09-14T11:52:55.172379+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:52:55.172379+0000","last_undegraded":"2024-09-14T11:52:55.172379+0000","last_fullsized":"2024-09-14T11:52:55.172379+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.172292+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.954230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":47732,"num_write":877,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1006","reported_seq":2725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.845526+0000","last_change":"2024-09-14T11:11:06.654587+0000","last_active":"2024-09-14T11:51:21.845526+0000","last_peered":"2024-09-14T11:51:21.845526+0000","last_clean":"2024-09-14T11:51:21.845526+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:51:21.845526+0000","last_undegraded":"2024-09-14T11:51:21.845526+0000","last_fullsized":"2024-09-14T11:51:21.845526+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":900,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'279","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.244702+0000","last_change":"2024-09-14T11:52:57.244702+0000","last_active":"2024-09-14T11:52:57.244702+0000","last_peered":"2024-09-14T11:52:57.244702+0000","last_clean":"2024-09-14T11:52:57.244702+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:57.244702+0000","last_undegraded":"2024-09-14T11:52:57.244702+0000","last_fullsized":"2024-09-14T11:52:57.244702+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.244601+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:06.713036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":719,"num_read_kb":31338,"num_write":1105,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'444","reported_seq":1991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.964108+0000","last_change":"2024-09-14T11:53:03.964108+0000","last_active":"2024-09-14T11:53:03.964108+0000","last_peered":"2024-09-14T11:53:03.964108+0000","last_clean":"2024-09-14T11:53:03.964108+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:53:03.964108+0000","last_undegraded":"2024-09-14T11:53:03.964108+0000","last_fullsized":"2024-09-14T11:53:03.964108+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.963982+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:15.186551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'261","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.641663+0000","last_change":"2024-09-14T11:52:53.641663+0000","last_active":"2024-09-14T11:52:53.641663+0000","last_peered":"2024-09-14T11:52:53.641663+0000","last_clean":"2024-09-14T11:52:53.641663+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:52:53.641663+0000","last_undegraded":"2024-09-14T11:52:53.641663+0000","last_fullsized":"2024-09-14T11:52:53.641663+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.641559+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:15.729013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1027,"num_read_kb":155043,"num_write":1124,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1176","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.128014+0000","last_change":"2024-09-14T11:53:08.128014+0000","last_active":"2024-09-14T11:53:08.128014+0000","last_peered":"2024-09-14T11:53:08.128014+0000","last_clean":"2024-09-14T11:53:08.128014+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:53:08.128014+0000","last_undegraded":"2024-09-14T11:53:08.128014+0000","last_fullsized":"2024-09-14T11:53:08.128014+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1176","last_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_deep_scrub":"263'1176","last_deep_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.127935+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:40.579497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'242","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094291+0000","last_change":"2024-09-14T11:52:57.094291+0000","last_active":"2024-09-14T11:52:57.094291+0000","last_peered":"2024-09-14T11:52:57.094291+0000","last_clean":"2024-09-14T11:52:57.094291+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:52:57.094291+0000","last_undegraded":"2024-09-14T11:52:57.094291+0000","last_fullsized":"2024-09-14T11:52:57.094291+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.094079+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:41.823322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159825,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":17781,"num_write":1116,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'429","reported_seq":1964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.075754+0000","last_change":"2024-09-14T11:53:01.075754+0000","last_active":"2024-09-14T11:53:01.075754+0000","last_peered":"2024-09-14T11:53:01.075754+0000","last_clean":"2024-09-14T11:53:01.075754+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:53:01.075754+0000","last_undegraded":"2024-09-14T11:53:01.075754+0000","last_fullsized":"2024-09-14T11:53:01.075754+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.075650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.154836+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'185","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.248333+0000","last_change":"2024-09-14T11:52:59.248333+0000","last_active":"2024-09-14T11:52:59.248333+0000","last_peered":"2024-09-14T11:52:59.248333+0000","last_clean":"2024-09-14T11:52:59.248333+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:52:59.248333+0000","last_undegraded":"2024-09-14T11:52:59.248333+0000","last_fullsized":"2024-09-14T11:52:59.248333+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.248194+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:41.711860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":12452,"num_write":860,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1183","reported_seq":2671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.137570+0000","last_change":"2024-09-14T11:53:05.137512+0000","last_active":"2024-09-14T11:53:05.137570+0000","last_peered":"2024-09-14T11:53:05.137570+0000","last_clean":"2024-09-14T11:53:05.137570+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:53:05.137570+0000","last_undegraded":"2024-09-14T11:53:05.137570+0000","last_fullsized":"2024-09-14T11:53:05.137570+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1183","last_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_deep_scrub":"263'1183","last_deep_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.137429+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:37.154275+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'246","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.181196+0000","last_change":"2024-09-14T11:53:00.181196+0000","last_active":"2024-09-14T11:53:00.181196+0000","last_peered":"2024-09-14T11:53:00.181196+0000","last_clean":"2024-09-14T11:53:00.181196+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:53:00.181196+0000","last_undegraded":"2024-09-14T11:53:00.181196+0000","last_fullsized":"2024-09-14T11:53:00.181196+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.181003+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:48.772246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":3825,"num_write":1017,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'761","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.984873+0000","last_change":"2024-09-14T11:53:05.984808+0000","last_active":"2024-09-14T11:53:05.984873+0000","last_peered":"2024-09-14T11:53:05.984873+0000","last_clean":"2024-09-14T11:53:05.984873+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:53:05.984873+0000","last_undegraded":"2024-09-14T11:53:05.984873+0000","last_fullsized":"2024-09-14T11:53:05.984873+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.984718+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.922626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'244","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.260968+0000","last_change":"2024-09-14T11:52:58.260968+0000","last_active":"2024-09-14T11:52:58.260968+0000","last_peered":"2024-09-14T11:52:58.260968+0000","last_clean":"2024-09-14T11:52:58.260968+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:52:58.260968+0000","last_undegraded":"2024-09-14T11:52:58.260968+0000","last_fullsized":"2024-09-14T11:52:58.260968+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.260863+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:49.114336+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":9466,"num_write":1107,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.619266+0000","last_change":"2024-09-14T11:52:56.619266+0000","last_active":"2024-09-14T11:52:56.619266+0000","last_peered":"2024-09-14T11:52:56.619266+0000","last_clean":"2024-09-14T11:52:56.619266+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:52:56.619266+0000","last_undegraded":"2024-09-14T11:52:56.619266+0000","last_fullsized":"2024-09-14T11:52:56.619266+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'693","last_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_deep_scrub":"263'693","last_deep_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.619176+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:46.303405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'230","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.693886+0000","last_change":"2024-09-14T11:52:53.693886+0000","last_active":"2024-09-14T11:52:53.693886+0000","last_peered":"2024-09-14T11:52:53.693886+0000","last_clean":"2024-09-14T11:52:53.693886+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:52:53.693886+0000","last_undegraded":"2024-09-14T11:52:53.693886+0000","last_fullsized":"2024-09-14T11:52:53.693886+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.693782+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:02.123870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":774,"num_read_kb":20654,"num_write":1086,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'572","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.004654+0000","last_change":"2024-09-14T11:53:05.004654+0000","last_active":"2024-09-14T11:53:05.004654+0000","last_peered":"2024-09-14T11:53:05.004654+0000","last_clean":"2024-09-14T11:53:05.004654+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:53:05.004654+0000","last_undegraded":"2024-09-14T11:53:05.004654+0000","last_fullsized":"2024-09-14T11:53:05.004654+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'572","last_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_deep_scrub":"263'572","last_deep_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.004567+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:12.480296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'179","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.170135+0000","last_change":"2024-09-14T11:52:56.170135+0000","last_active":"2024-09-14T11:52:56.170135+0000","last_peered":"2024-09-14T11:52:56.170135+0000","last_clean":"2024-09-14T11:52:56.170135+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:52:56.170135+0000","last_undegraded":"2024-09-14T11:52:56.170135+0000","last_fullsized":"2024-09-14T11:52:56.170135+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.169996+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:19.783821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254527,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":19362,"num_write":819,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'501","reported_seq":2108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.746597+0000","last_change":"2024-09-14T11:11:06.659368+0000","last_active":"2024-09-14T11:51:08.746597+0000","last_peered":"2024-09-14T11:51:08.746597+0000","last_clean":"2024-09-14T11:51:08.746597+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:51:08.746597+0000","last_undegraded":"2024-09-14T11:51:08.746597+0000","last_fullsized":"2024-09-14T11:51:08.746597+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:58.840799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'219","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073972+0000","last_change":"2024-09-14T11:52:54.073972+0000","last_active":"2024-09-14T11:52:54.073972+0000","last_peered":"2024-09-14T11:52:54.073972+0000","last_clean":"2024-09-14T11:52:54.073972+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:52:54.073972+0000","last_undegraded":"2024-09-14T11:52:54.073972+0000","last_fullsized":"2024-09-14T11:52:54.073972+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073820+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.734459+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152081,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":22963,"num_write":995,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1731","reported_seq":3543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.120989+0000","last_change":"2024-09-14T11:53:04.120989+0000","last_active":"2024-09-14T11:53:04.120989+0000","last_peered":"2024-09-14T11:53:04.120989+0000","last_clean":"2024-09-14T11:53:04.120989+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:53:04.120989+0000","last_undegraded":"2024-09-14T11:53:04.120989+0000","last_fullsized":"2024-09-14T11:53:04.120989+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1731","last_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_deep_scrub":"263'1731","last_deep_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.120897+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":1700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.055522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'220","reported_seq":826,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.588584+0000","last_change":"2024-09-14T11:11:04.667994+0000","last_active":"2024-09-14T11:52:44.588584+0000","last_peered":"2024-09-14T11:52:44.588584+0000","last_clean":"2024-09-14T11:52:44.588584+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:52:44.588584+0000","last_undegraded":"2024-09-14T11:52:44.588584+0000","last_fullsized":"2024-09-14T11:52:44.588584+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:03.613742+0000","last_clean_scrub_stamp":"2024-09-14T11:11:03.613742+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:02.592974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":9299,"num_write":1026,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'390","reported_seq":1862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.316772+0000","last_change":"2024-09-14T11:11:06.646168+0000","last_active":"2024-09-14T11:51:21.316772+0000","last_peered":"2024-09-14T11:51:21.316772+0000","last_clean":"2024-09-14T11:51:21.316772+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:51:21.316772+0000","last_undegraded":"2024-09-14T11:51:21.316772+0000","last_fullsized":"2024-09-14T11:51:21.316772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:05.631338+0000","last_clean_scrub_stamp":"2024-09-14T11:11:05.631338+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:12:16.898215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648290+0000","last_change":"2024-09-14T11:52:54.648221+0000","last_active":"2024-09-14T11:52:54.648290+0000","last_peered":"2024-09-14T11:52:54.648290+0000","last_clean":"2024-09-14T11:52:54.648290+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:52:54.648290+0000","last_undegraded":"2024-09-14T11:52:54.648290+0000","last_fullsized":"2024-09-14T11:52:54.648290+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648125+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:31.594989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":67022,"num_write":1011,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'461","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.119760+0000","last_change":"2024-09-14T11:53:05.119760+0000","last_active":"2024-09-14T11:53:05.119760+0000","last_peered":"2024-09-14T11:53:05.119760+0000","last_clean":"2024-09-14T11:53:05.119760+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:53:05.119760+0000","last_undegraded":"2024-09-14T11:53:05.119760+0000","last_fullsized":"2024-09-14T11:53:05.119760+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'461","last_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_deep_scrub":"263'461","last_deep_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.119654+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:53.766096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'211","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.651909+0000","last_change":"2024-09-14T11:52:55.651909+0000","last_active":"2024-09-14T11:52:55.651909+0000","last_peered":"2024-09-14T11:52:55.651909+0000","last_clean":"2024-09-14T11:52:55.651909+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:52:55.651909+0000","last_undegraded":"2024-09-14T11:52:55.651909+0000","last_fullsized":"2024-09-14T11:52:55.651909+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.651812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:24.237587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":27752,"num_write":889,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'207","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.136326+0000","last_change":"2024-09-14T11:53:01.136253+0000","last_active":"2024-09-14T11:53:01.136326+0000","last_peered":"2024-09-14T11:53:01.136326+0000","last_clean":"2024-09-14T11:53:01.136326+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:53:01.136326+0000","last_undegraded":"2024-09-14T11:53:01.136326+0000","last_fullsized":"2024-09-14T11:53:01.136326+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.136124+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.376828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":2089,"num_write":994,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'476","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.095010+0000","last_change":"2024-09-14T11:53:06.095010+0000","last_active":"2024-09-14T11:53:06.095010+0000","last_peered":"2024-09-14T11:53:06.095010+0000","last_clean":"2024-09-14T11:53:06.095010+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:53:06.095010+0000","last_undegraded":"2024-09-14T11:53:06.095010+0000","last_fullsized":"2024-09-14T11:53:06.095010+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.094919+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:39.988396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":919,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'262","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.594608+0000","last_change":"2024-09-14T11:53:00.594508+0000","last_active":"2024-09-14T11:53:00.594608+0000","last_peered":"2024-09-14T11:53:00.594608+0000","last_clean":"2024-09-14T11:53:00.594608+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:53:00.594608+0000","last_undegraded":"2024-09-14T11:53:00.594608+0000","last_fullsized":"2024-09-14T11:53:00.594608+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.594344+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:04.083599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":42624,"num_write":1182,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'383","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.201899+0000","last_change":"2024-09-14T11:53:07.201899+0000","last_active":"2024-09-14T11:53:07.201899+0000","last_peered":"2024-09-14T11:53:07.201899+0000","last_clean":"2024-09-14T11:53:07.201899+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:53:07.201899+0000","last_undegraded":"2024-09-14T11:53:07.201899+0000","last_fullsized":"2024-09-14T11:53:07.201899+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.201806+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:07.993574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1586,"ondisk_log_size":1586,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":466,"ondisk_log_size":466,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":429920,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8367,"num_read_kb":10850,"num_write":5651,"num_write_kb":2859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1864,"ondisk_log_size":1864,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2871,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31479,"num_omap_keys":127,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4095,"ondisk_log_size":4095,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":29484888,"num_objects":168,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":42482,"num_read_kb":2539626,"num_write":64328,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41172992,"data_stored":41172992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168157,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":181387,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542659,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272784,"kb_used_data":11136,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94099056,"statfs":{"total":96636764160,"available":96357433344,"internally_reserved":0,"allocated":11403264,"data_stored":9409551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542659,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246272,"kb_used_data":8240,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94125568,"statfs":{"total":96636764160,"available":96384581632,"internally_reserved":0,"allocated":8437760,"data_stored":6489937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":243726790},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542657,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107580,"kb_used_data":8364,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":8564736,"data_stored":6565787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542657,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124444,"kb_used_data":8588,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94247396,"statfs":{"total":96636764160,"available":96509333504,"internally_reserved":0,"allocated":8794112,"data_stored":6869156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":118618566},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542656,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264236,"kb_used_data":8156,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94107604,"statfs":{"total":96636764160,"available":96366186496,"internally_reserved":0,"allocated":8351744,"data_stored":6374693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542657,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94580,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94277260,"statfs":{"total":96636764160,"available":96539914240,"internally_reserved":0,"allocated":9474048,"data_stored":7547937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542657,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149420,"kb_used_data":10012,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222420,"statfs":{"total":96636764160,"available":96483758080,"internally_reserved":0,"allocated":10252288,"data_stored":8286792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542658,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284668,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94087172,"statfs":{"total":96636764160,"available":96345264128,"internally_reserved":0,"allocated":10858496,"data_stored":8869545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6021120,"data_stored":6021120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6029312,"data_stored":6029312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4116480,"data_stored":4116480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4612096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":4308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4231168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":6561792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:13.067 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.067 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.067 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.067 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.068 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.069 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.070 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.071 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.072 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.073 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.074 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.075 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.076 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.077 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.078 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.079 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.080 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.081 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.082 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.083 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.084 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.085 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.086 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.087 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.088 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.089 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.090 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.091 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.092 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.093 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.094 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.095 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.096 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.097 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.098 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:11:07.634721+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:11:09.639489+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:11:11.651487+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.099 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.100 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.100 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.100 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:11:03.613742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=3, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.100 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:11:05.631338+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:13.100 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:53:33.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:33.440 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:53:33.451 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:53:33.453 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1541,"stamp":"2024-09-14T11:53:33.091407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30522513,"num_objects":632,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":299502,"num_read_kb":3128085,"num_write":146428,"num_write_kb":2544950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740640,"num_omap_keys":1781,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12700,"ondisk_log_size":12700,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1556464,"kb_used_data":74352,"kb_used_omap":12,"kb_used_meta":1481971,"kb_avail":753418256,"statfs":{"total":773094113280,"available":771500294144,"internally_reserved":0,"allocated":76136448,"data_stored":60413398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1517538865},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":532499,"num_omap_keys":1236,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004829"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.038914+0000","last_change":"2024-09-14T11:38:32.849830+0000","last_active":"2024-09-14T11:48:34.038914+0000","last_peered":"2024-09-14T11:48:34.038914+0000","last_clean":"2024-09-14T11:48:34.038914+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:48:34.038914+0000","last_undegraded":"2024-09-14T11:48:34.038914+0000","last_fullsized":"2024-09-14T11:48:34.038914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:16.467169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.697419+0000","last_change":"2024-09-14T11:27:46.879279+0000","last_active":"2024-09-14T11:52:44.697419+0000","last_peered":"2024-09-14T11:52:44.697419+0000","last_clean":"2024-09-14T11:52:44.697419+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:52:44.697419+0000","last_undegraded":"2024-09-14T11:52:44.697419+0000","last_fullsized":"2024-09-14T11:52:44.697419+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:44.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.949783+0000","last_change":"2024-09-14T11:27:43.845274+0000","last_active":"2024-09-14T11:52:43.949783+0000","last_peered":"2024-09-14T11:52:43.949783+0000","last_clean":"2024-09-14T11:52:43.949783+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:52:43.949783+0000","last_undegraded":"2024-09-14T11:52:43.949783+0000","last_fullsized":"2024-09-14T11:52:43.949783+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:35.519742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":116,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935603+0000","last_change":"2024-09-14T11:26:02.012894+0000","last_active":"2024-09-14T11:51:03.935603+0000","last_peered":"2024-09-14T11:51:03.935603+0000","last_clean":"2024-09-14T11:51:03.935603+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:51:03.935603+0000","last_undegraded":"2024-09-14T11:51:03.935603+0000","last_fullsized":"2024-09-14T11:51:03.935603+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.733014+0000","last_change":"2024-09-14T11:53:21.733014+0000","last_active":"2024-09-14T11:53:21.733014+0000","last_peered":"2024-09-14T11:53:21.733014+0000","last_clean":"2024-09-14T11:53:21.733014+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:53:21.733014+0000","last_undegraded":"2024-09-14T11:53:21.733014+0000","last_fullsized":"2024-09-14T11:53:21.733014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.732931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:48.663290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.529195+0000","last_change":"2024-09-14T11:27:46.879355+0000","last_active":"2024-09-14T11:52:44.529195+0000","last_peered":"2024-09-14T11:52:44.529195+0000","last_clean":"2024-09-14T11:52:44.529195+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:52:44.529195+0000","last_undegraded":"2024-09-14T11:52:44.529195+0000","last_fullsized":"2024-09-14T11:52:44.529195+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:17.912212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.761554+0000","last_change":"2024-09-14T11:53:25.761554+0000","last_active":"2024-09-14T11:53:25.761554+0000","last_peered":"2024-09-14T11:53:25.761554+0000","last_clean":"2024-09-14T11:53:25.761554+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:53:25.761554+0000","last_undegraded":"2024-09-14T11:53:25.761554+0000","last_fullsized":"2024-09-14T11:53:25.761554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.761462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:51.621198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.588869+0000","last_change":"2024-09-14T11:53:13.588869+0000","last_active":"2024-09-14T11:53:13.588869+0000","last_peered":"2024-09-14T11:53:13.588869+0000","last_clean":"2024-09-14T11:53:13.588869+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:53:13.588869+0000","last_undegraded":"2024-09-14T11:53:13.588869+0000","last_fullsized":"2024-09-14T11:53:13.588869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.588787+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:59.522176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.148490+0000","last_change":"2024-09-14T11:53:28.148490+0000","last_active":"2024-09-14T11:53:28.148490+0000","last_peered":"2024-09-14T11:53:28.148490+0000","last_clean":"2024-09-14T11:53:28.148490+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:53:28.148490+0000","last_undegraded":"2024-09-14T11:53:28.148490+0000","last_fullsized":"2024-09-14T11:53:28.148490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.148399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:17.010275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'10","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528901+0000","last_change":"2024-09-14T11:27:47.189522+0000","last_active":"2024-09-14T11:52:44.528901+0000","last_peered":"2024-09-14T11:52:44.528901+0000","last_clean":"2024-09-14T11:52:44.528901+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:52:44.528901+0000","last_undegraded":"2024-09-14T11:52:44.528901+0000","last_fullsized":"2024-09-14T11:52:44.528901+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:42.100757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":15373,"num_write":10,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.676892+0000","last_change":"2024-09-14T11:53:17.676892+0000","last_active":"2024-09-14T11:53:17.676892+0000","last_peered":"2024-09-14T11:53:17.676892+0000","last_clean":"2024-09-14T11:53:17.676892+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:53:17.676892+0000","last_undegraded":"2024-09-14T11:53:17.676892+0000","last_fullsized":"2024-09-14T11:53:17.676892+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.676763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:55.098276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.913736+0000","last_change":"2024-09-14T11:26:02.015392+0000","last_active":"2024-09-14T11:48:33.913736+0000","last_peered":"2024-09-14T11:48:33.913736+0000","last_clean":"2024-09-14T11:48:33.913736+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:48:33.913736+0000","last_undegraded":"2024-09-14T11:48:33.913736+0000","last_fullsized":"2024-09-14T11:48:33.913736+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:40.397488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933161+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:50:43.933161+0000","last_peered":"2024-09-14T11:50:43.933161+0000","last_clean":"2024-09-14T11:50:43.933161+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:50:43.933161+0000","last_undegraded":"2024-09-14T11:50:43.933161+0000","last_fullsized":"2024-09-14T11:50:43.933161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926162+0000","last_change":"2024-09-14T11:27:47.187254+0000","last_active":"2024-09-14T11:49:53.926162+0000","last_peered":"2024-09-14T11:49:53.926162+0000","last_clean":"2024-09-14T11:49:53.926162+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:49:53.926162+0000","last_undegraded":"2024-09-14T11:49:53.926162+0000","last_fullsized":"2024-09-14T11:49:53.926162+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:08.432596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:43.948585+0000","last_change":"2024-09-14T11:27:43.841893+0000","last_active":"2024-09-14T11:52:43.948585+0000","last_peered":"2024-09-14T11:52:43.948585+0000","last_clean":"2024-09-14T11:52:43.948585+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:52:43.948585+0000","last_undegraded":"2024-09-14T11:52:43.948585+0000","last_fullsized":"2024-09-14T11:52:43.948585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.808275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:33.914837+0000","last_change":"2024-09-14T11:26:02.013990+0000","last_active":"2024-09-14T11:48:33.914837+0000","last_peered":"2024-09-14T11:48:33.914837+0000","last_clean":"2024-09-14T11:48:33.914837+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:48:33.914837+0000","last_undegraded":"2024-09-14T11:48:33.914837+0000","last_fullsized":"2024-09-14T11:48:33.914837+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:37.165964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:03.942732+0000","last_change":"2024-09-14T11:27:46.876773+0000","last_active":"2024-09-14T11:52:03.942732+0000","last_peered":"2024-09-14T11:52:03.942732+0000","last_clean":"2024-09-14T11:52:03.942732+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:52:03.942732+0000","last_undegraded":"2024-09-14T11:52:03.942732+0000","last_fullsized":"2024-09-14T11:52:03.942732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:05.186633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922927+0000","last_change":"2024-09-14T11:27:43.843927+0000","last_active":"2024-09-14T11:49:28.922927+0000","last_peered":"2024-09-14T11:49:28.922927+0000","last_clean":"2024-09-14T11:49:28.922927+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:49:28.922927+0000","last_undegraded":"2024-09-14T11:49:28.922927+0000","last_fullsized":"2024-09-14T11:49:28.922927+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:10.217548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:30.281911+0000","last_change":"2024-09-14T11:26:02.016766+0000","last_active":"2024-09-14T11:50:30.281911+0000","last_peered":"2024-09-14T11:50:30.281911+0000","last_clean":"2024-09-14T11:50:30.281911+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:50:30.281911+0000","last_undegraded":"2024-09-14T11:50:30.281911+0000","last_fullsized":"2024-09-14T11:50:30.281911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:19.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935095+0000","last_change":"2024-09-14T11:38:32.853368+0000","last_active":"2024-09-14T11:51:03.935095+0000","last_peered":"2024-09-14T11:51:03.935095+0000","last_clean":"2024-09-14T11:51:03.935095+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:51:03.935095+0000","last_undegraded":"2024-09-14T11:51:03.935095+0000","last_fullsized":"2024-09-14T11:51:03.935095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.186792+0000","last_change":"2024-09-14T11:53:26.186792+0000","last_active":"2024-09-14T11:53:26.186792+0000","last_peered":"2024-09-14T11:53:26.186792+0000","last_clean":"2024-09-14T11:53:26.186792+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:53:26.186792+0000","last_undegraded":"2024-09-14T11:53:26.186792+0000","last_fullsized":"2024-09-14T11:53:26.186792+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.186683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.326191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941850+0000","last_change":"2024-09-14T11:27:43.847596+0000","last_active":"2024-09-14T11:51:58.941850+0000","last_peered":"2024-09-14T11:51:58.941850+0000","last_clean":"2024-09-14T11:51:58.941850+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:51:58.941850+0000","last_undegraded":"2024-09-14T11:51:58.941850+0000","last_fullsized":"2024-09-14T11:51:58.941850+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:53.530069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":406,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.163945+0000","last_change":"2024-09-14T11:53:19.163945+0000","last_active":"2024-09-14T11:53:19.163945+0000","last_peered":"2024-09-14T11:53:19.163945+0000","last_clean":"2024-09-14T11:53:19.163945+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:53:19.163945+0000","last_undegraded":"2024-09-14T11:53:19.163945+0000","last_fullsized":"2024-09-14T11:53:19.163945+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.163864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:12.503202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034076+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:48:34.034076+0000","last_peered":"2024-09-14T11:48:34.034076+0000","last_clean":"2024-09-14T11:48:34.034076+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:48:34.034076+0000","last_undegraded":"2024-09-14T11:48:34.034076+0000","last_fullsized":"2024-09-14T11:48:34.034076+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:01.326904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'14","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.213836+0000","last_change":"2024-09-14T11:53:25.213836+0000","last_active":"2024-09-14T11:53:25.213836+0000","last_peered":"2024-09-14T11:53:25.213836+0000","last_clean":"2024-09-14T11:53:25.213836+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:53:25.213836+0000","last_undegraded":"2024-09-14T11:53:25.213836+0000","last_fullsized":"2024-09-14T11:53:25.213836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.213730+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:10.155497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19456,"num_write":24,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.546348+0000","last_change":"2024-09-14T11:27:43.844745+0000","last_active":"2024-09-14T11:52:44.546348+0000","last_peered":"2024-09-14T11:52:44.546348+0000","last_clean":"2024-09-14T11:52:44.546348+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:52:44.546348+0000","last_undegraded":"2024-09-14T11:52:44.546348+0000","last_fullsized":"2024-09-14T11:52:44.546348+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:33.699071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5174,"num_write":14,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930045+0000","last_change":"2024-09-14T11:26:02.015057+0000","last_active":"2024-09-14T11:50:18.930045+0000","last_peered":"2024-09-14T11:50:18.930045+0000","last_clean":"2024-09-14T11:50:18.930045+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:50:18.930045+0000","last_undegraded":"2024-09-14T11:50:18.930045+0000","last_fullsized":"2024-09-14T11:50:18.930045+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:48.977275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:34.034111+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:48:34.034111+0000","last_peered":"2024-09-14T11:48:34.034111+0000","last_clean":"2024-09-14T11:48:34.034111+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:48:34.034111+0000","last_undegraded":"2024-09-14T11:48:34.034111+0000","last_fullsized":"2024-09-14T11:48:34.034111+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:13.303166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:48:39.039611+0000","last_change":"2024-09-14T11:28:38.981293+0000","last_active":"2024-09-14T11:48:39.039611+0000","last_peered":"2024-09-14T11:48:39.039611+0000","last_clean":"2024-09-14T11:48:39.039611+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:48:39.039611+0000","last_undegraded":"2024-09-14T11:48:39.039611+0000","last_fullsized":"2024-09-14T11:48:39.039611+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:19.659414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.574307+0000","last_change":"2024-09-14T11:27:43.845155+0000","last_active":"2024-09-14T11:52:44.574307+0000","last_peered":"2024-09-14T11:52:44.574307+0000","last_clean":"2024-09-14T11:52:44.574307+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:52:44.574307+0000","last_undegraded":"2024-09-14T11:52:44.574307+0000","last_fullsized":"2024-09-14T11:52:44.574307+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:48.461242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12280,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.762011+0000","last_change":"2024-09-14T11:53:24.762011+0000","last_active":"2024-09-14T11:53:24.762011+0000","last_peered":"2024-09-14T11:53:24.762011+0000","last_clean":"2024-09-14T11:53:24.762011+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:53:24.762011+0000","last_undegraded":"2024-09-14T11:53:24.762011+0000","last_fullsized":"2024-09-14T11:53:24.762011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.761926+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929032+0000","last_change":"2024-09-14T11:38:32.852428+0000","last_active":"2024-09-14T11:50:13.929032+0000","last_peered":"2024-09-14T11:50:13.929032+0000","last_clean":"2024-09-14T11:50:13.929032+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:50:13.929032+0000","last_undegraded":"2024-09-14T11:50:13.929032+0000","last_fullsized":"2024-09-14T11:50:13.929032+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:39.088714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943383+0000","last_change":"2024-09-14T11:27:47.187389+0000","last_active":"2024-09-14T11:51:58.943383+0000","last_peered":"2024-09-14T11:51:58.943383+0000","last_clean":"2024-09-14T11:51:58.943383+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:51:58.943383+0000","last_undegraded":"2024-09-14T11:51:58.943383+0000","last_fullsized":"2024-09-14T11:51:58.943383+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:30.862941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.648906+0000","last_change":"2024-09-14T11:27:43.843198+0000","last_active":"2024-09-14T11:52:44.648906+0000","last_peered":"2024-09-14T11:52:44.648906+0000","last_clean":"2024-09-14T11:52:44.648906+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:52:44.648906+0000","last_undegraded":"2024-09-14T11:52:44.648906+0000","last_fullsized":"2024-09-14T11:52:44.648906+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.929479+0000","last_change":"2024-09-14T11:26:02.015082+0000","last_active":"2024-09-14T11:50:13.929479+0000","last_peered":"2024-09-14T11:50:13.929479+0000","last_clean":"2024-09-14T11:50:13.929479+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:50:13.929479+0000","last_undegraded":"2024-09-14T11:50:13.929479+0000","last_fullsized":"2024-09-14T11:50:13.929479+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:28.515299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.739702+0000","last_change":"2024-09-14T11:53:20.739702+0000","last_active":"2024-09-14T11:53:20.739702+0000","last_peered":"2024-09-14T11:53:20.739702+0000","last_clean":"2024-09-14T11:53:20.739702+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:53:20.739702+0000","last_undegraded":"2024-09-14T11:53:20.739702+0000","last_fullsized":"2024-09-14T11:53:20.739702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.739591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:32.573639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.380627+0000","last_change":"2024-09-14T11:27:47.188108+0000","last_active":"2024-09-14T11:52:44.380627+0000","last_peered":"2024-09-14T11:52:44.380627+0000","last_clean":"2024-09-14T11:52:44.380627+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:52:44.380627+0000","last_undegraded":"2024-09-14T11:52:44.380627+0000","last_fullsized":"2024-09-14T11:52:44.380627+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:25.653417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'7","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:54.064017+0000","last_change":"2024-09-14T11:27:43.840540+0000","last_active":"2024-09-14T11:51:54.064017+0000","last_peered":"2024-09-14T11:51:54.064017+0000","last_clean":"2024-09-14T11:51:54.064017+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:51:54.064017+0000","last_undegraded":"2024-09-14T11:51:54.064017+0000","last_fullsized":"2024-09-14T11:51:54.064017+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:49.717589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:29.703082+0000","last_change":"2024-09-14T11:26:02.013979+0000","last_active":"2024-09-14T11:50:29.703082+0000","last_peered":"2024-09-14T11:50:29.703082+0000","last_clean":"2024-09-14T11:50:29.703082+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:50:29.703082+0000","last_undegraded":"2024-09-14T11:50:29.703082+0000","last_fullsized":"2024-09-14T11:50:29.703082+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:06.260890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:14.048397+0000","last_change":"2024-09-14T11:38:32.851724+0000","last_active":"2024-09-14T11:50:14.048397+0000","last_peered":"2024-09-14T11:50:14.048397+0000","last_clean":"2024-09-14T11:50:14.048397+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:50:14.048397+0000","last_undegraded":"2024-09-14T11:50:14.048397+0000","last_fullsized":"2024-09-14T11:50:14.048397+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:59.739499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'4","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.943433+0000","last_change":"2024-09-14T11:27:47.188660+0000","last_active":"2024-09-14T11:51:58.943433+0000","last_peered":"2024-09-14T11:51:58.943433+0000","last_clean":"2024-09-14T11:51:58.943433+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:51:58.943433+0000","last_undegraded":"2024-09-14T11:51:58.943433+0000","last_fullsized":"2024-09-14T11:51:58.943433+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:10.163957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.627528+0000","last_change":"2024-09-14T11:53:15.627528+0000","last_active":"2024-09-14T11:53:15.627528+0000","last_peered":"2024-09-14T11:53:15.627528+0000","last_clean":"2024-09-14T11:53:15.627528+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:53:15.627528+0000","last_undegraded":"2024-09-14T11:53:15.627528+0000","last_fullsized":"2024-09-14T11:53:15.627528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.627437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.549615+0000","last_change":"2024-09-14T11:53:12.549615+0000","last_active":"2024-09-14T11:53:12.549615+0000","last_peered":"2024-09-14T11:53:12.549615+0000","last_clean":"2024-09-14T11:53:12.549615+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:53:12.549615+0000","last_undegraded":"2024-09-14T11:53:12.549615+0000","last_fullsized":"2024-09-14T11:53:12.549615+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.549522+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.167383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927344+0000","last_change":"2024-09-14T11:38:32.849363+0000","last_active":"2024-09-14T11:50:13.927344+0000","last_peered":"2024-09-14T11:50:13.927344+0000","last_clean":"2024-09-14T11:50:13.927344+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:50:13.927344+0000","last_undegraded":"2024-09-14T11:50:13.927344+0000","last_fullsized":"2024-09-14T11:50:13.927344+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:45.064527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:58.941930+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:51:58.941930+0000","last_peered":"2024-09-14T11:51:58.941930+0000","last_clean":"2024-09-14T11:51:58.941930+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:51:58.941930+0000","last_undegraded":"2024-09-14T11:51:58.941930+0000","last_fullsized":"2024-09-14T11:51:58.941930+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:15.763399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.923109+0000","last_change":"2024-09-14T11:27:43.847407+0000","last_active":"2024-09-14T11:49:28.923109+0000","last_peered":"2024-09-14T11:49:28.923109+0000","last_clean":"2024-09-14T11:49:28.923109+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:49:28.923109+0000","last_undegraded":"2024-09-14T11:49:28.923109+0000","last_fullsized":"2024-09-14T11:49:28.923109+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:19.979580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041316+0000","last_change":"2024-09-14T11:26:02.014208+0000","last_active":"2024-09-14T11:49:24.041316+0000","last_peered":"2024-09-14T11:49:24.041316+0000","last_clean":"2024-09-14T11:49:24.041316+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:49:24.041316+0000","last_undegraded":"2024-09-14T11:49:24.041316+0000","last_fullsized":"2024-09-14T11:49:24.041316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:09.598411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932512+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:50:38.932512+0000","last_peered":"2024-09-14T11:50:38.932512+0000","last_clean":"2024-09-14T11:50:38.932512+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:50:38.932512+0000","last_undegraded":"2024-09-14T11:50:38.932512+0000","last_fullsized":"2024-09-14T11:50:38.932512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.633134+0000","last_change":"2024-09-14T11:27:46.877799+0000","last_active":"2024-09-14T11:52:44.633134+0000","last_peered":"2024-09-14T11:52:44.633134+0000","last_clean":"2024-09-14T11:52:44.633134+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:52:44.633134+0000","last_undegraded":"2024-09-14T11:52:44.633134+0000","last_fullsized":"2024-09-14T11:52:44.633134+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3076,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.933702+0000","last_change":"2024-09-14T11:27:43.841376+0000","last_active":"2024-09-14T11:51:03.933702+0000","last_peered":"2024-09-14T11:51:03.933702+0000","last_clean":"2024-09-14T11:51:03.933702+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:51:03.933702+0000","last_undegraded":"2024-09-14T11:51:03.933702+0000","last_fullsized":"2024-09-14T11:51:03.933702+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041292+0000","last_change":"2024-09-14T11:26:02.015336+0000","last_active":"2024-09-14T11:49:24.041292+0000","last_peered":"2024-09-14T11:49:24.041292+0000","last_clean":"2024-09-14T11:49:24.041292+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:49:24.041292+0000","last_undegraded":"2024-09-14T11:49:24.041292+0000","last_fullsized":"2024-09-14T11:49:24.041292+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:16:34.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932525+0000","last_change":"2024-09-14T11:38:32.854718+0000","last_active":"2024-09-14T11:50:38.932525+0000","last_peered":"2024-09-14T11:50:38.932525+0000","last_clean":"2024-09-14T11:50:38.932525+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:50:38.932525+0000","last_undegraded":"2024-09-14T11:50:38.932525+0000","last_fullsized":"2024-09-14T11:50:38.932525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.935720+0000","last_change":"2024-09-14T11:27:46.879559+0000","last_active":"2024-09-14T11:51:08.935720+0000","last_peered":"2024-09-14T11:51:08.935720+0000","last_clean":"2024-09-14T11:51:08.935720+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:51:08.935720+0000","last_undegraded":"2024-09-14T11:51:08.935720+0000","last_fullsized":"2024-09-14T11:51:08.935720+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.625342+0000","last_change":"2024-09-14T11:27:43.833079+0000","last_active":"2024-09-14T11:52:44.625342+0000","last_peered":"2024-09-14T11:52:44.625342+0000","last_clean":"2024-09-14T11:52:44.625342+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:52:44.625342+0000","last_undegraded":"2024-09-14T11:52:44.625342+0000","last_fullsized":"2024-09-14T11:52:44.625342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922244+0000","last_change":"2024-09-14T11:26:02.012550+0000","last_active":"2024-09-14T11:49:23.922244+0000","last_peered":"2024-09-14T11:49:23.922244+0000","last_clean":"2024-09-14T11:49:23.922244+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:49:23.922244+0000","last_undegraded":"2024-09-14T11:49:23.922244+0000","last_fullsized":"2024-09-14T11:49:23.922244+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:33.538929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:08.936172+0000","last_change":"2024-09-14T11:27:46.881994+0000","last_active":"2024-09-14T11:51:08.936172+0000","last_peered":"2024-09-14T11:51:08.936172+0000","last_clean":"2024-09-14T11:51:08.936172+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:51:08.936172+0000","last_undegraded":"2024-09-14T11:51:08.936172+0000","last_fullsized":"2024-09-14T11:51:08.936172+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.152130+0000","last_change":"2024-09-14T11:53:22.152065+0000","last_active":"2024-09-14T11:53:22.152130+0000","last_peered":"2024-09-14T11:53:22.152130+0000","last_clean":"2024-09-14T11:53:22.152130+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:53:22.152130+0000","last_undegraded":"2024-09-14T11:53:22.152130+0000","last_fullsized":"2024-09-14T11:53:22.152130+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.151939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.121719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.081225+0000","last_change":"2024-09-14T11:53:28.081225+0000","last_active":"2024-09-14T11:53:28.081225+0000","last_peered":"2024-09-14T11:53:28.081225+0000","last_clean":"2024-09-14T11:53:28.081225+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:53:28.081225+0000","last_undegraded":"2024-09-14T11:53:28.081225+0000","last_fullsized":"2024-09-14T11:53:28.081225+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.081140+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:12.464070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932488+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:50:38.932488+0000","last_peered":"2024-09-14T11:50:38.932488+0000","last_clean":"2024-09-14T11:50:38.932488+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:50:38.932488+0000","last_undegraded":"2024-09-14T11:50:38.932488+0000","last_fullsized":"2024-09-14T11:50:38.932488+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'8","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.194215+0000","last_change":"2024-09-14T11:53:24.194095+0000","last_active":"2024-09-14T11:53:24.194215+0000","last_peered":"2024-09-14T11:53:24.194215+0000","last_clean":"2024-09-14T11:53:24.194215+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:53:24.194215+0000","last_undegraded":"2024-09-14T11:53:24.194215+0000","last_fullsized":"2024-09-14T11:53:24.194215+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.193998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:25.664721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":8,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.934255+0000","last_change":"2024-09-14T11:27:43.842443+0000","last_active":"2024-09-14T11:51:03.934255+0000","last_peered":"2024-09-14T11:51:03.934255+0000","last_clean":"2024-09-14T11:51:03.934255+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:51:03.934255+0000","last_undegraded":"2024-09-14T11:51:03.934255+0000","last_fullsized":"2024-09-14T11:51:03.934255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.921875+0000","last_change":"2024-09-14T11:26:02.017822+0000","last_active":"2024-09-14T11:49:23.921875+0000","last_peered":"2024-09-14T11:49:23.921875+0000","last_clean":"2024-09-14T11:49:23.921875+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:49:23.921875+0000","last_undegraded":"2024-09-14T11:49:23.921875+0000","last_fullsized":"2024-09-14T11:49:23.921875+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:31.508629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.717869+0000","last_change":"2024-09-14T11:53:18.717869+0000","last_active":"2024-09-14T11:53:18.717869+0000","last_peered":"2024-09-14T11:53:18.717869+0000","last_clean":"2024-09-14T11:53:18.717869+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:53:18.717869+0000","last_undegraded":"2024-09-14T11:53:18.717869+0000","last_fullsized":"2024-09-14T11:53:18.717869+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.717779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:33.948450+0000","last_change":"2024-09-14T11:27:46.879231+0000","last_active":"2024-09-14T11:52:33.948450+0000","last_peered":"2024-09-14T11:52:33.948450+0000","last_clean":"2024-09-14T11:52:33.948450+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:52:33.948450+0000","last_undegraded":"2024-09-14T11:52:33.948450+0000","last_fullsized":"2024-09-14T11:52:33.948450+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:07.471474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'10","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:29.069792+0000","last_change":"2024-09-14T11:27:43.838255+0000","last_active":"2024-09-14T11:52:29.069792+0000","last_peered":"2024-09-14T11:52:29.069792+0000","last_clean":"2024-09-14T11:52:29.069792+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:52:29.069792+0000","last_undegraded":"2024-09-14T11:52:29.069792+0000","last_fullsized":"2024-09-14T11:52:29.069792+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:23.552650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21510,"num_write":20,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:53.934554+0000","last_change":"2024-09-14T11:26:02.012866+0000","last_active":"2024-09-14T11:50:53.934554+0000","last_peered":"2024-09-14T11:50:53.934554+0000","last_clean":"2024-09-14T11:50:53.934554+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:50:53.934554+0000","last_undegraded":"2024-09-14T11:50:53.934554+0000","last_fullsized":"2024-09-14T11:50:53.934554+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044607+0000","last_change":"2024-09-14T11:38:32.849792+0000","last_active":"2024-09-14T11:49:49.044607+0000","last_peered":"2024-09-14T11:49:49.044607+0000","last_clean":"2024-09-14T11:49:49.044607+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:49:49.044607+0000","last_undegraded":"2024-09-14T11:49:49.044607+0000","last_fullsized":"2024-09-14T11:49:49.044607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:26.617929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.929998+0000","last_change":"2024-09-14T11:27:46.875123+0000","last_active":"2024-09-14T11:50:18.929998+0000","last_peered":"2024-09-14T11:50:18.929998+0000","last_clean":"2024-09-14T11:50:18.929998+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:50:18.929998+0000","last_undegraded":"2024-09-14T11:50:18.929998+0000","last_fullsized":"2024-09-14T11:50:18.929998+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:12.857187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.663445+0000","last_change":"2024-09-14T11:53:16.663445+0000","last_active":"2024-09-14T11:53:16.663445+0000","last_peered":"2024-09-14T11:53:16.663445+0000","last_clean":"2024-09-14T11:53:16.663445+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:53:16.663445+0000","last_undegraded":"2024-09-14T11:53:16.663445+0000","last_fullsized":"2024-09-14T11:53:16.663445+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.663354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:23.071337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.932095+0000","last_change":"2024-09-14T11:26:02.018906+0000","last_active":"2024-09-14T11:50:48.932095+0000","last_peered":"2024-09-14T11:50:48.932095+0000","last_clean":"2024-09-14T11:50:48.932095+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:50:48.932095+0000","last_undegraded":"2024-09-14T11:50:48.932095+0000","last_fullsized":"2024-09-14T11:50:48.932095+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.159984+0000","last_change":"2024-09-14T11:53:27.159984+0000","last_active":"2024-09-14T11:53:27.159984+0000","last_peered":"2024-09-14T11:53:27.159984+0000","last_clean":"2024-09-14T11:53:27.159984+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:53:27.159984+0000","last_undegraded":"2024-09-14T11:53:27.159984+0000","last_fullsized":"2024-09-14T11:53:27.159984+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.159896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:22.228903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.724293+0000","last_change":"2024-09-14T11:53:28.724293+0000","last_active":"2024-09-14T11:53:28.724293+0000","last_peered":"2024-09-14T11:53:28.724293+0000","last_clean":"2024-09-14T11:53:28.724293+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:53:28.724293+0000","last_undegraded":"2024-09-14T11:53:28.724293+0000","last_fullsized":"2024-09-14T11:53:28.724293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.724205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:53.783027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:28.947353+0000","last_change":"2024-09-14T11:27:43.845547+0000","last_active":"2024-09-14T11:52:28.947353+0000","last_peered":"2024-09-14T11:52:28.947353+0000","last_clean":"2024-09-14T11:52:28.947353+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:52:28.947353+0000","last_undegraded":"2024-09-14T11:52:28.947353+0000","last_fullsized":"2024-09-14T11:52:28.947353+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:27.915610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.163194+0000","last_change":"2024-09-14T11:53:20.163194+0000","last_active":"2024-09-14T11:53:20.163194+0000","last_peered":"2024-09-14T11:53:20.163194+0000","last_clean":"2024-09-14T11:53:20.163194+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:53:20.163194+0000","last_undegraded":"2024-09-14T11:53:20.163194+0000","last_fullsized":"2024-09-14T11:53:20.163194+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.163114+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:11.811539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:24.041255+0000","last_change":"2024-09-14T11:38:32.850501+0000","last_active":"2024-09-14T11:49:24.041255+0000","last_peered":"2024-09-14T11:49:24.041255+0000","last_clean":"2024-09-14T11:49:24.041255+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:49:24.041255+0000","last_undegraded":"2024-09-14T11:49:24.041255+0000","last_fullsized":"2024-09-14T11:49:24.041255+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:18.395398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'4","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528715+0000","last_change":"2024-09-14T11:27:46.876489+0000","last_active":"2024-09-14T11:52:44.528715+0000","last_peered":"2024-09-14T11:52:44.528715+0000","last_clean":"2024-09-14T11:52:44.528715+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:52:44.528715+0000","last_undegraded":"2024-09-14T11:52:44.528715+0000","last_fullsized":"2024-09-14T11:52:44.528715+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:10.023296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.797058+0000","last_change":"2024-09-14T11:53:22.797058+0000","last_active":"2024-09-14T11:53:22.797058+0000","last_peered":"2024-09-14T11:53:22.797058+0000","last_clean":"2024-09-14T11:53:22.797058+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:53:22.797058+0000","last_undegraded":"2024-09-14T11:53:22.797058+0000","last_fullsized":"2024-09-14T11:53:22.797058+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.796963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:55.082758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.547416+0000","last_change":"2024-09-14T11:53:11.547416+0000","last_active":"2024-09-14T11:53:11.547416+0000","last_peered":"2024-09-14T11:53:11.547416+0000","last_clean":"2024-09-14T11:53:11.547416+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:53:11.547416+0000","last_undegraded":"2024-09-14T11:53:11.547416+0000","last_fullsized":"2024-09-14T11:53:11.547416+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.547332+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.246053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939031+0000","last_change":"2024-09-14T11:27:46.881349+0000","last_active":"2024-09-14T11:51:38.939031+0000","last_peered":"2024-09-14T11:51:38.939031+0000","last_clean":"2024-09-14T11:51:38.939031+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:51:38.939031+0000","last_undegraded":"2024-09-14T11:51:38.939031+0000","last_fullsized":"2024-09-14T11:51:38.939031+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:31:07.329851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6166,"num_write":6,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922185+0000","last_change":"2024-09-14T11:27:43.842516+0000","last_active":"2024-09-14T11:49:23.922185+0000","last_peered":"2024-09-14T11:49:23.922185+0000","last_clean":"2024-09-14T11:49:23.922185+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:49:23.922185+0000","last_undegraded":"2024-09-14T11:49:23.922185+0000","last_fullsized":"2024-09-14T11:49:23.922185+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:36:33.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:48.933751+0000","last_change":"2024-09-14T11:26:02.015845+0000","last_active":"2024-09-14T11:50:48.933751+0000","last_peered":"2024-09-14T11:50:48.933751+0000","last_clean":"2024-09-14T11:50:48.933751+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:50:48.933751+0000","last_undegraded":"2024-09-14T11:50:48.933751+0000","last_fullsized":"2024-09-14T11:50:48.933751+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044669+0000","last_change":"2024-09-14T11:38:32.848563+0000","last_active":"2024-09-14T11:49:49.044669+0000","last_peered":"2024-09-14T11:49:49.044669+0000","last_clean":"2024-09-14T11:49:49.044669+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:49:49.044669+0000","last_undegraded":"2024-09-14T11:49:49.044669+0000","last_fullsized":"2024-09-14T11:49:49.044669+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:44.419731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061553+0000","last_change":"2024-09-14T11:27:47.187083+0000","last_active":"2024-09-14T11:51:39.061553+0000","last_peered":"2024-09-14T11:51:39.061553+0000","last_clean":"2024-09-14T11:51:39.061553+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:51:39.061553+0000","last_undegraded":"2024-09-14T11:51:39.061553+0000","last_fullsized":"2024-09-14T11:51:39.061553+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:44.321075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.750077+0000","last_change":"2024-09-14T11:53:23.750077+0000","last_active":"2024-09-14T11:53:23.750077+0000","last_peered":"2024-09-14T11:53:23.750077+0000","last_clean":"2024-09-14T11:53:23.750077+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:53:23.750077+0000","last_undegraded":"2024-09-14T11:53:23.750077+0000","last_fullsized":"2024-09-14T11:53:23.750077+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.749996+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:49.227281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4143,"num_write":14,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:54.045267+0000","last_change":"2024-09-14T11:26:02.013826+0000","last_active":"2024-09-14T11:49:54.045267+0000","last_peered":"2024-09-14T11:49:54.045267+0000","last_clean":"2024-09-14T11:49:54.045267+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:49:54.045267+0000","last_undegraded":"2024-09-14T11:49:54.045267+0000","last_fullsized":"2024-09-14T11:49:54.045267+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:24.723686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:49.044630+0000","last_change":"2024-09-14T11:38:32.851896+0000","last_active":"2024-09-14T11:49:49.044630+0000","last_peered":"2024-09-14T11:49:49.044630+0000","last_clean":"2024-09-14T11:49:49.044630+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:49:49.044630+0000","last_undegraded":"2024-09-14T11:49:49.044630+0000","last_fullsized":"2024-09-14T11:49:49.044630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:52.897526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.766402+0000","last_change":"2024-09-14T11:53:27.766402+0000","last_active":"2024-09-14T11:53:27.766402+0000","last_peered":"2024-09-14T11:53:27.766402+0000","last_clean":"2024-09-14T11:53:27.766402+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:53:27.766402+0000","last_undegraded":"2024-09-14T11:53:27.766402+0000","last_fullsized":"2024-09-14T11:53:27.766402+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.766298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:30.703536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:28.922984+0000","last_change":"2024-09-14T11:27:43.847309+0000","last_active":"2024-09-14T11:49:28.922984+0000","last_peered":"2024-09-14T11:49:28.922984+0000","last_clean":"2024-09-14T11:49:28.922984+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:49:28.922984+0000","last_undegraded":"2024-09-14T11:49:28.922984+0000","last_fullsized":"2024-09-14T11:49:28.922984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:25.077659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926046+0000","last_change":"2024-09-14T11:26:02.006422+0000","last_active":"2024-09-14T11:49:53.926046+0000","last_peered":"2024-09-14T11:49:53.926046+0000","last_clean":"2024-09-14T11:49:53.926046+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:49:53.926046+0000","last_undegraded":"2024-09-14T11:49:53.926046+0000","last_fullsized":"2024-09-14T11:49:53.926046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:55.700405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925821+0000","last_change":"2024-09-14T11:38:32.849612+0000","last_active":"2024-09-14T11:49:48.925821+0000","last_peered":"2024-09-14T11:49:48.925821+0000","last_clean":"2024-09-14T11:49:48.925821+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:49:48.925821+0000","last_undegraded":"2024-09-14T11:49:48.925821+0000","last_fullsized":"2024-09-14T11:49:48.925821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.995220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:39.061607+0000","last_change":"2024-09-14T11:27:46.882198+0000","last_active":"2024-09-14T11:51:39.061607+0000","last_peered":"2024-09-14T11:51:39.061607+0000","last_clean":"2024-09-14T11:51:39.061607+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:51:39.061607+0000","last_undegraded":"2024-09-14T11:51:39.061607+0000","last_fullsized":"2024-09-14T11:51:39.061607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:52.483941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:13.927194+0000","last_change":"2024-09-14T11:27:43.844132+0000","last_active":"2024-09-14T11:50:13.927194+0000","last_peered":"2024-09-14T11:50:13.927194+0000","last_clean":"2024-09-14T11:50:13.927194+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:50:13.927194+0000","last_undegraded":"2024-09-14T11:50:13.927194+0000","last_fullsized":"2024-09-14T11:50:13.927194+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:39:36.875967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.155477+0000","last_change":"2024-09-14T11:53:18.155477+0000","last_active":"2024-09-14T11:53:18.155477+0000","last_peered":"2024-09-14T11:53:18.155477+0000","last_clean":"2024-09-14T11:53:18.155477+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:53:18.155477+0000","last_undegraded":"2024-09-14T11:53:18.155477+0000","last_fullsized":"2024-09-14T11:53:18.155477+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'62","last_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_deep_scrub":"263'62","last_deep_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.155393+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:37.081156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.055999+0000","last_change":"2024-09-14T11:38:32.849854+0000","last_active":"2024-09-14T11:51:04.055999+0000","last_peered":"2024-09-14T11:51:04.055999+0000","last_clean":"2024-09-14T11:51:04.055999+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:51:04.055999+0000","last_undegraded":"2024-09-14T11:51:04.055999+0000","last_fullsized":"2024-09-14T11:51:04.055999+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'6","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.708498+0000","last_change":"2024-09-14T11:27:46.873884+0000","last_active":"2024-09-14T11:52:44.708498+0000","last_peered":"2024-09-14T11:52:44.708498+0000","last_clean":"2024-09-14T11:52:44.708498+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:52:44.708498+0000","last_undegraded":"2024-09-14T11:52:44.708498+0000","last_fullsized":"2024-09-14T11:52:44.708498+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.650184+0000","last_change":"2024-09-14T11:27:43.842553+0000","last_active":"2024-09-14T11:52:44.650184+0000","last_peered":"2024-09-14T11:52:44.650184+0000","last_clean":"2024-09-14T11:52:44.650184+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:52:44.650184+0000","last_undegraded":"2024-09-14T11:52:44.650184+0000","last_fullsized":"2024-09-14T11:52:44.650184+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:08.969487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10258,"num_write":8,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.926465+0000","last_change":"2024-09-14T11:26:02.013046+0000","last_active":"2024-09-14T11:49:53.926465+0000","last_peered":"2024-09-14T11:49:53.926465+0000","last_clean":"2024-09-14T11:49:53.926465+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:49:53.926465+0000","last_undegraded":"2024-09-14T11:49:53.926465+0000","last_fullsized":"2024-09-14T11:49:53.926465+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:52.565530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.934219+0000","last_change":"2024-09-14T11:38:32.856923+0000","last_active":"2024-09-14T11:51:03.934219+0000","last_peered":"2024-09-14T11:51:03.934219+0000","last_clean":"2024-09-14T11:51:03.934219+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:51:03.934219+0000","last_undegraded":"2024-09-14T11:51:03.934219+0000","last_fullsized":"2024-09-14T11:51:03.934219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933194+0000","last_change":"2024-09-14T11:27:47.187433+0000","last_active":"2024-09-14T11:50:43.933194+0000","last_peered":"2024-09-14T11:50:43.933194+0000","last_clean":"2024-09-14T11:50:43.933194+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:50:43.933194+0000","last_undegraded":"2024-09-14T11:50:43.933194+0000","last_fullsized":"2024-09-14T11:50:43.933194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:07.266126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.617156+0000","last_change":"2024-09-14T11:53:14.617156+0000","last_active":"2024-09-14T11:53:14.617156+0000","last_peered":"2024-09-14T11:53:14.617156+0000","last_clean":"2024-09-14T11:53:14.617156+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:53:14.617156+0000","last_undegraded":"2024-09-14T11:53:14.617156+0000","last_fullsized":"2024-09-14T11:53:14.617156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.617045+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:52.240454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4136,"num_write":12,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.172440+0000","last_change":"2024-09-14T11:53:17.172440+0000","last_active":"2024-09-14T11:53:17.172440+0000","last_peered":"2024-09-14T11:53:17.172440+0000","last_clean":"2024-09-14T11:53:17.172440+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:53:17.172440+0000","last_undegraded":"2024-09-14T11:53:17.172440+0000","last_fullsized":"2024-09-14T11:53:17.172440+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.172319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.845904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932258+0000","last_change":"2024-09-14T11:38:32.855347+0000","last_active":"2024-09-14T11:50:38.932258+0000","last_peered":"2024-09-14T11:50:38.932258+0000","last_clean":"2024-09-14T11:50:38.932258+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:50:38.932258+0000","last_undegraded":"2024-09-14T11:50:38.932258+0000","last_fullsized":"2024-09-14T11:50:38.932258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:15:01.634692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:29.042169+0000","last_change":"2024-09-14T11:27:47.187952+0000","last_active":"2024-09-14T11:49:29.042169+0000","last_peered":"2024-09-14T11:49:29.042169+0000","last_clean":"2024-09-14T11:49:29.042169+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:49:29.042169+0000","last_undegraded":"2024-09-14T11:49:29.042169+0000","last_fullsized":"2024-09-14T11:49:29.042169+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:16.024424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:33.938534+0000","last_change":"2024-09-14T11:27:43.839456+0000","last_active":"2024-09-14T11:51:33.938534+0000","last_peered":"2024-09-14T11:51:33.938534+0000","last_clean":"2024-09-14T11:51:33.938534+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:51:33.938534+0000","last_undegraded":"2024-09-14T11:51:33.938534+0000","last_fullsized":"2024-09-14T11:51:33.938534+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:00.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056053+0000","last_change":"2024-09-14T11:26:02.019572+0000","last_active":"2024-09-14T11:51:04.056053+0000","last_peered":"2024-09-14T11:51:04.056053+0000","last_clean":"2024-09-14T11:51:04.056053+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:51:04.056053+0000","last_undegraded":"2024-09-14T11:51:04.056053+0000","last_fullsized":"2024-09-14T11:51:04.056053+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:26:00.989096+0000","last_clean_scrub_stamp":"2024-09-14T11:26:00.989096+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.933736+0000","last_change":"2024-09-14T11:38:32.848404+0000","last_active":"2024-09-14T11:51:03.933736+0000","last_peered":"2024-09-14T11:51:03.933736+0000","last_clean":"2024-09-14T11:51:03.933736+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:51:03.933736+0000","last_undegraded":"2024-09-14T11:51:03.933736+0000","last_fullsized":"2024-09-14T11:51:03.933736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:38.939147+0000","last_change":"2024-09-14T11:27:46.878344+0000","last_active":"2024-09-14T11:51:38.939147+0000","last_peered":"2024-09-14T11:51:38.939147+0000","last_clean":"2024-09-14T11:51:38.939147+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:51:38.939147+0000","last_undegraded":"2024-09-14T11:51:38.939147+0000","last_fullsized":"2024-09-14T11:51:38.939147+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:02.140097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:34.060905+0000","last_change":"2024-09-14T11:27:43.829831+0000","last_active":"2024-09-14T11:51:34.060905+0000","last_peered":"2024-09-14T11:51:34.060905+0000","last_clean":"2024-09-14T11:51:34.060905+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:51:34.060905+0000","last_undegraded":"2024-09-14T11:51:34.060905+0000","last_fullsized":"2024-09-14T11:51:34.060905+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:35.823657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.828156+0000","last_change":"2024-09-14T11:53:20.828156+0000","last_active":"2024-09-14T11:53:20.828156+0000","last_peered":"2024-09-14T11:53:20.828156+0000","last_clean":"2024-09-14T11:53:20.828156+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:53:20.828156+0000","last_undegraded":"2024-09-14T11:53:20.828156+0000","last_fullsized":"2024-09-14T11:53:20.828156+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.828045+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:47.654466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.699168+0000","last_change":"2024-09-14T11:53:19.699168+0000","last_active":"2024-09-14T11:53:19.699168+0000","last_peered":"2024-09-14T11:53:19.699168+0000","last_clean":"2024-09-14T11:53:19.699168+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:53:19.699168+0000","last_undegraded":"2024-09-14T11:53:19.699168+0000","last_fullsized":"2024-09-14T11:53:19.699168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.699072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:41.679367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.775884+0000","last_change":"2024-09-14T11:53:26.775884+0000","last_active":"2024-09-14T11:53:26.775884+0000","last_peered":"2024-09-14T11:53:26.775884+0000","last_clean":"2024-09-14T11:53:26.775884+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:53:26.775884+0000","last_undegraded":"2024-09-14T11:53:26.775884+0000","last_fullsized":"2024-09-14T11:53:26.775884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.775762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:28.794807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.528818+0000","last_change":"2024-09-14T11:27:43.843840+0000","last_active":"2024-09-14T11:52:44.528818+0000","last_peered":"2024-09-14T11:52:44.528818+0000","last_clean":"2024-09-14T11:52:44.528818+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:52:44.528818+0000","last_undegraded":"2024-09-14T11:52:44.528818+0000","last_fullsized":"2024-09-14T11:52:44.528818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:24.199443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.396807+0000","last_change":"2024-09-14T11:53:28.396807+0000","last_active":"2024-09-14T11:53:28.396807+0000","last_peered":"2024-09-14T11:53:28.396807+0000","last_clean":"2024-09-14T11:53:28.396807+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:53:28.396807+0000","last_undegraded":"2024-09-14T11:53:28.396807+0000","last_fullsized":"2024-09-14T11:53:28.396807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.396726+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:24.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:23.922365+0000","last_change":"2024-09-14T11:38:32.850392+0000","last_active":"2024-09-14T11:49:23.922365+0000","last_peered":"2024-09-14T11:49:23.922365+0000","last_clean":"2024-09-14T11:49:23.922365+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:49:23.922365+0000","last_undegraded":"2024-09-14T11:49:23.922365+0000","last_fullsized":"2024-09-14T11:49:23.922365+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:07.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:53.924494+0000","last_change":"2024-09-14T11:27:46.882778+0000","last_active":"2024-09-14T11:49:53.924494+0000","last_peered":"2024-09-14T11:49:53.924494+0000","last_clean":"2024-09-14T11:49:53.924494+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:49:53.924494+0000","last_undegraded":"2024-09-14T11:49:53.924494+0000","last_fullsized":"2024-09-14T11:49:53.924494+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.898095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:44.072123+0000","last_change":"2024-09-14T11:27:43.835600+0000","last_active":"2024-09-14T11:52:44.072123+0000","last_peered":"2024-09-14T11:52:44.072123+0000","last_clean":"2024-09-14T11:52:44.072123+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:52:44.072123+0000","last_undegraded":"2024-09-14T11:52:44.072123+0000","last_fullsized":"2024-09-14T11:52:44.072123+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:42.815576+0000","last_clean_scrub_stamp":"2024-09-14T11:27:42.815576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:31.597164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.065726+0000","last_change":"2024-09-14T11:53:26.065726+0000","last_active":"2024-09-14T11:53:26.065726+0000","last_peered":"2024-09-14T11:53:26.065726+0000","last_clean":"2024-09-14T11:53:26.065726+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:53:26.065726+0000","last_undegraded":"2024-09-14T11:53:26.065726+0000","last_fullsized":"2024-09-14T11:53:26.065726+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.065590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.826773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.935528+0000","last_change":"2024-09-14T11:38:32.851496+0000","last_active":"2024-09-14T11:51:03.935528+0000","last_peered":"2024-09-14T11:51:03.935528+0000","last_clean":"2024-09-14T11:51:03.935528+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:51:03.935528+0000","last_undegraded":"2024-09-14T11:51:03.935528+0000","last_fullsized":"2024-09-14T11:51:03.935528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.177891+0000","last_change":"2024-09-14T11:53:23.177891+0000","last_active":"2024-09-14T11:53:23.177891+0000","last_peered":"2024-09-14T11:53:23.177891+0000","last_clean":"2024-09-14T11:53:23.177891+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:53:23.177891+0000","last_undegraded":"2024-09-14T11:53:23.177891+0000","last_fullsized":"2024-09-14T11:53:23.177891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.177795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:38.025123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.812440+0000","last_change":"2024-09-14T11:53:21.812440+0000","last_active":"2024-09-14T11:53:21.812440+0000","last_peered":"2024-09-14T11:53:21.812440+0000","last_clean":"2024-09-14T11:53:21.812440+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:53:21.812440+0000","last_undegraded":"2024-09-14T11:53:21.812440+0000","last_fullsized":"2024-09-14T11:53:21.812440+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.812301+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:47.150896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.199859+0000","last_change":"2024-09-14T11:53:16.199859+0000","last_active":"2024-09-14T11:53:16.199859+0000","last_peered":"2024-09-14T11:53:16.199859+0000","last_clean":"2024-09-14T11:53:16.199859+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:53:16.199859+0000","last_undegraded":"2024-09-14T11:53:16.199859+0000","last_fullsized":"2024-09-14T11:53:16.199859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.199776+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.362128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056063+0000","last_change":"2024-09-14T11:38:32.852659+0000","last_active":"2024-09-14T11:51:04.056063+0000","last_peered":"2024-09-14T11:51:04.056063+0000","last_clean":"2024-09-14T11:51:04.056063+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:51:04.056063+0000","last_undegraded":"2024-09-14T11:51:04.056063+0000","last_fullsized":"2024-09-14T11:51:04.056063+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.930926+0000","last_change":"2024-09-14T11:27:46.882671+0000","last_active":"2024-09-14T11:50:43.930926+0000","last_peered":"2024-09-14T11:50:43.930926+0000","last_clean":"2024-09-14T11:50:43.930926+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:50:43.930926+0000","last_undegraded":"2024-09-14T11:50:43.930926+0000","last_fullsized":"2024-09-14T11:50:43.930926+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:27:45.848385+0000","last_clean_scrub_stamp":"2024-09-14T11:27:45.848385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.930038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.154587+0000","last_change":"2024-09-14T11:53:21.154587+0000","last_active":"2024-09-14T11:53:21.154587+0000","last_peered":"2024-09-14T11:53:21.154587+0000","last_clean":"2024-09-14T11:53:21.154587+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:53:21.154587+0000","last_undegraded":"2024-09-14T11:53:21.154587+0000","last_fullsized":"2024-09-14T11:53:21.154587+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.154476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:42.611630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10252,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.328533+0000","last_change":"2024-09-14T11:53:28.328533+0000","last_active":"2024-09-14T11:53:28.328533+0000","last_peered":"2024-09-14T11:53:28.328533+0000","last_clean":"2024-09-14T11:53:28.328533+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:53:28.328533+0000","last_undegraded":"2024-09-14T11:53:28.328533+0000","last_fullsized":"2024-09-14T11:53:28.328533+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.328421+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:54.143049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'219","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.104497+0000","last_change":"2024-09-14T11:53:04.104497+0000","last_active":"2024-09-14T11:53:04.104497+0000","last_peered":"2024-09-14T11:53:04.104497+0000","last_clean":"2024-09-14T11:53:04.104497+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:53:04.104497+0000","last_undegraded":"2024-09-14T11:53:04.104497+0000","last_fullsized":"2024-09-14T11:53:04.104497+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.104357+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:27.489992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":26852,"num_write":1005,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1172","reported_seq":2811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.163374+0000","last_change":"2024-09-14T11:53:09.163374+0000","last_active":"2024-09-14T11:53:09.163374+0000","last_peered":"2024-09-14T11:53:09.163374+0000","last_clean":"2024-09-14T11:53:09.163374+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:53:09.163374+0000","last_undegraded":"2024-09-14T11:53:09.163374+0000","last_fullsized":"2024-09-14T11:53:09.163374+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1172","last_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_deep_scrub":"263'1172","last_deep_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.163255+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:51.571485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'198","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.685758+0000","last_change":"2024-09-14T11:52:55.685758+0000","last_active":"2024-09-14T11:52:55.685758+0000","last_peered":"2024-09-14T11:52:55.685758+0000","last_clean":"2024-09-14T11:52:55.685758+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:52:55.685758+0000","last_undegraded":"2024-09-14T11:52:55.685758+0000","last_fullsized":"2024-09-14T11:52:55.685758+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.685603+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:37.938060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":7476,"num_write":916,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.143695+0000","last_change":"2024-09-14T11:53:11.143695+0000","last_active":"2024-09-14T11:53:11.143695+0000","last_peered":"2024-09-14T11:53:11.143695+0000","last_clean":"2024-09-14T11:53:11.143695+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:53:11.143695+0000","last_undegraded":"2024-09-14T11:53:11.143695+0000","last_fullsized":"2024-09-14T11:53:11.143695+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.143584+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:47.330573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'223","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.173154+0000","last_change":"2024-09-14T11:52:58.173154+0000","last_active":"2024-09-14T11:52:58.173154+0000","last_peered":"2024-09-14T11:52:58.173154+0000","last_clean":"2024-09-14T11:52:58.173154+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:52:58.173154+0000","last_undegraded":"2024-09-14T11:52:58.173154+0000","last_fullsized":"2024-09-14T11:52:58.173154+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.172939+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:36.789370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":599,"num_read_kb":30059,"num_write":1074,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'881","reported_seq":2636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.958959+0000","last_change":"2024-09-14T11:53:08.958959+0000","last_active":"2024-09-14T11:53:08.958959+0000","last_peered":"2024-09-14T11:53:08.958959+0000","last_clean":"2024-09-14T11:53:08.958959+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:53:08.958959+0000","last_undegraded":"2024-09-14T11:53:08.958959+0000","last_fullsized":"2024-09-14T11:53:08.958959+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.958854+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:40.823184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'228","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.163179+0000","last_change":"2024-09-14T11:53:03.163088+0000","last_active":"2024-09-14T11:53:03.163179+0000","last_peered":"2024-09-14T11:53:03.163179+0000","last_clean":"2024-09-14T11:53:03.163179+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:53:03.163179+0000","last_undegraded":"2024-09-14T11:53:03.163179+0000","last_fullsized":"2024-09-14T11:53:03.163179+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.162958+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:03.455162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":74674,"num_write":901,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'394","reported_seq":1946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.058982+0000","last_change":"2024-09-14T11:53:07.058982+0000","last_active":"2024-09-14T11:53:07.058982+0000","last_peered":"2024-09-14T11:53:07.058982+0000","last_clean":"2024-09-14T11:53:07.058982+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:53:07.058982+0000","last_undegraded":"2024-09-14T11:53:07.058982+0000","last_fullsized":"2024-09-14T11:53:07.058982+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.058896+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.485594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'244","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.132482+0000","last_change":"2024-09-14T11:53:07.132482+0000","last_active":"2024-09-14T11:53:07.132482+0000","last_peered":"2024-09-14T11:53:07.132482+0000","last_clean":"2024-09-14T11:53:07.132482+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:53:07.132482+0000","last_undegraded":"2024-09-14T11:53:07.132482+0000","last_fullsized":"2024-09-14T11:53:07.132482+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.132325+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:44.056191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":17405,"num_write":1116,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'823","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.080635+0000","last_change":"2024-09-14T11:53:03.080576+0000","last_active":"2024-09-14T11:53:03.080635+0000","last_peered":"2024-09-14T11:53:03.080635+0000","last_clean":"2024-09-14T11:53:03.080635+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:53:03.080635+0000","last_undegraded":"2024-09-14T11:53:03.080635+0000","last_fullsized":"2024-09-14T11:53:03.080635+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.080464+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:29.386530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'217","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.129946+0000","last_change":"2024-09-14T11:53:02.129946+0000","last_active":"2024-09-14T11:53:02.129946+0000","last_peered":"2024-09-14T11:53:02.129946+0000","last_clean":"2024-09-14T11:53:02.129946+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:53:02.129946+0000","last_undegraded":"2024-09-14T11:53:02.129946+0000","last_fullsized":"2024-09-14T11:53:02.129946+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.129833+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.366991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":70473,"num_write":980,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'498","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.966298+0000","last_change":"2024-09-14T11:53:09.966298+0000","last_active":"2024-09-14T11:53:09.966298+0000","last_peered":"2024-09-14T11:53:09.966298+0000","last_clean":"2024-09-14T11:53:09.966298+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:53:09.966298+0000","last_undegraded":"2024-09-14T11:53:09.966298+0000","last_fullsized":"2024-09-14T11:53:09.966298+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.966206+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:47.015458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'224","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.111904+0000","last_change":"2024-09-14T11:53:03.111904+0000","last_active":"2024-09-14T11:53:03.111904+0000","last_peered":"2024-09-14T11:53:03.111904+0000","last_clean":"2024-09-14T11:53:03.111904+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:53:03.111904+0000","last_undegraded":"2024-09-14T11:53:03.111904+0000","last_fullsized":"2024-09-14T11:53:03.111904+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.111777+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:53.985189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":632,"num_read_kb":10774,"num_write":1050,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'703","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.204946+0000","last_change":"2024-09-14T11:53:10.204946+0000","last_active":"2024-09-14T11:53:10.204946+0000","last_peered":"2024-09-14T11:53:10.204946+0000","last_clean":"2024-09-14T11:53:10.204946+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:53:10.204946+0000","last_undegraded":"2024-09-14T11:53:10.204946+0000","last_fullsized":"2024-09-14T11:53:10.204946+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.204838+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:48.344428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'235","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.227469+0000","last_change":"2024-09-14T11:53:01.227469+0000","last_active":"2024-09-14T11:53:01.227469+0000","last_peered":"2024-09-14T11:53:01.227469+0000","last_clean":"2024-09-14T11:53:01.227469+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:53:01.227469+0000","last_undegraded":"2024-09-14T11:53:01.227469+0000","last_fullsized":"2024-09-14T11:53:01.227469+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.227337+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:36.676072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1301,"num_read_kb":98345,"num_write":1096,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'785","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.459599+0000","last_change":"2024-09-14T11:53:06.459599+0000","last_active":"2024-09-14T11:53:06.459599+0000","last_peered":"2024-09-14T11:53:06.459599+0000","last_clean":"2024-09-14T11:53:06.459599+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:53:06.459599+0000","last_undegraded":"2024-09-14T11:53:06.459599+0000","last_fullsized":"2024-09-14T11:53:06.459599+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.459498+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:46.080698+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'849","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.977158+0000","last_change":"2024-09-14T11:53:06.977094+0000","last_active":"2024-09-14T11:53:06.977158+0000","last_peered":"2024-09-14T11:53:06.977158+0000","last_clean":"2024-09-14T11:53:06.977158+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:53:06.977158+0000","last_undegraded":"2024-09-14T11:53:06.977158+0000","last_fullsized":"2024-09-14T11:53:06.977158+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'849","last_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_deep_scrub":"263'849","last_deep_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.976996+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:52.713389+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'237","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.158616+0000","last_change":"2024-09-14T11:53:01.158616+0000","last_active":"2024-09-14T11:53:01.158616+0000","last_peered":"2024-09-14T11:53:01.158616+0000","last_clean":"2024-09-14T11:53:01.158616+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:53:01.158616+0000","last_undegraded":"2024-09-14T11:53:01.158616+0000","last_fullsized":"2024-09-14T11:53:01.158616+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.158497+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:17.980141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":29179,"num_write":1120,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.147798+0000","last_change":"2024-09-14T11:53:06.147735+0000","last_active":"2024-09-14T11:53:06.147798+0000","last_peered":"2024-09-14T11:53:06.147798+0000","last_clean":"2024-09-14T11:53:06.147798+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:53:06.147798+0000","last_undegraded":"2024-09-14T11:53:06.147798+0000","last_fullsized":"2024-09-14T11:53:06.147798+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'874","last_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_deep_scrub":"263'874","last_deep_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.147589+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:09.954332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.050944+0000","last_change":"2024-09-14T11:52:58.050944+0000","last_active":"2024-09-14T11:52:58.050944+0000","last_peered":"2024-09-14T11:52:58.050944+0000","last_clean":"2024-09-14T11:52:58.050944+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:52:58.050944+0000","last_undegraded":"2024-09-14T11:52:58.050944+0000","last_fullsized":"2024-09-14T11:52:58.050944+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.050832+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:44.576976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":818,"num_read_kb":241766,"num_write":938,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'520","reported_seq":2229,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.166364+0000","last_change":"2024-09-14T11:53:08.166308+0000","last_active":"2024-09-14T11:53:08.166364+0000","last_peered":"2024-09-14T11:53:08.166364+0000","last_clean":"2024-09-14T11:53:08.166364+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:53:08.166364+0000","last_undegraded":"2024-09-14T11:53:08.166364+0000","last_fullsized":"2024-09-14T11:53:08.166364+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.166227+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.323522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'271","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.033421+0000","last_change":"2024-09-14T11:52:55.033421+0000","last_active":"2024-09-14T11:52:55.033421+0000","last_peered":"2024-09-14T11:52:55.033421+0000","last_clean":"2024-09-14T11:52:55.033421+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:52:55.033421+0000","last_undegraded":"2024-09-14T11:52:55.033421+0000","last_fullsized":"2024-09-14T11:52:55.033421+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'271","last_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_deep_scrub":"263'271","last_deep_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.033320+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.632089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":32324,"num_write":1007,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'859","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.571925+0000","last_change":"2024-09-14T11:52:57.571925+0000","last_active":"2024-09-14T11:52:57.571925+0000","last_peered":"2024-09-14T11:52:57.571925+0000","last_clean":"2024-09-14T11:52:57.571925+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:52:57.571925+0000","last_undegraded":"2024-09-14T11:52:57.571925+0000","last_fullsized":"2024-09-14T11:52:57.571925+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'859","last_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_deep_scrub":"263'859","last_deep_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.571844+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:30.711939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'237","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.142508+0000","last_change":"2024-09-14T11:52:54.142508+0000","last_active":"2024-09-14T11:52:54.142508+0000","last_peered":"2024-09-14T11:52:54.142508+0000","last_clean":"2024-09-14T11:52:54.142508+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:52:54.142508+0000","last_undegraded":"2024-09-14T11:52:54.142508+0000","last_fullsized":"2024-09-14T11:52:54.142508+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.142380+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:13.742745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":18423,"num_write":1039,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1030","reported_seq":2690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.596255+0000","last_change":"2024-09-14T11:53:00.596255+0000","last_active":"2024-09-14T11:53:00.596255+0000","last_peered":"2024-09-14T11:53:00.596255+0000","last_clean":"2024-09-14T11:53:00.596255+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:53:00.596255+0000","last_undegraded":"2024-09-14T11:53:00.596255+0000","last_fullsized":"2024-09-14T11:53:00.596255+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1030","last_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_deep_scrub":"263'1030","last_deep_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.596176+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:15.754364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'208","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.216578+0000","last_change":"2024-09-14T11:53:00.216578+0000","last_active":"2024-09-14T11:53:00.216578+0000","last_peered":"2024-09-14T11:53:00.216578+0000","last_clean":"2024-09-14T11:53:00.216578+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:53:00.216578+0000","last_undegraded":"2024-09-14T11:53:00.216578+0000","last_fullsized":"2024-09-14T11:53:00.216578+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.216460+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:58.339356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":19801,"num_write":945,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'479","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.954376+0000","last_change":"2024-09-14T11:53:07.954376+0000","last_active":"2024-09-14T11:53:07.954376+0000","last_peered":"2024-09-14T11:53:07.954376+0000","last_clean":"2024-09-14T11:53:07.954376+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:53:07.954376+0000","last_undegraded":"2024-09-14T11:53:07.954376+0000","last_fullsized":"2024-09-14T11:53:07.954376+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.954280+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:48.601994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'231","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.176475+0000","last_change":"2024-09-14T11:52:57.176414+0000","last_active":"2024-09-14T11:52:57.176475+0000","last_peered":"2024-09-14T11:52:57.176475+0000","last_clean":"2024-09-14T11:52:57.176475+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:52:57.176475+0000","last_undegraded":"2024-09-14T11:52:57.176475+0000","last_fullsized":"2024-09-14T11:52:57.176475+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.176294+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:01.150031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1266,"num_read_kb":11303,"num_write":1123,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'138","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.065815+0000","last_change":"2024-09-14T11:53:25.065815+0000","last_active":"2024-09-14T11:53:25.065815+0000","last_peered":"2024-09-14T11:53:25.065815+0000","last_clean":"2024-09-14T11:53:25.065815+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:53:25.065815+0000","last_undegraded":"2024-09-14T11:53:25.065815+0000","last_fullsized":"2024-09-14T11:53:25.065815+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.065723+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:59.914655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'946","reported_seq":2828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.250749+0000","last_change":"2024-09-14T11:53:04.250658+0000","last_active":"2024-09-14T11:53:04.250749+0000","last_peered":"2024-09-14T11:53:04.250749+0000","last_clean":"2024-09-14T11:53:04.250749+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:53:04.250749+0000","last_undegraded":"2024-09-14T11:53:04.250749+0000","last_fullsized":"2024-09-14T11:53:04.250749+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'946","last_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_deep_scrub":"263'946","last_deep_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.250543+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":900,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:39.287226+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'233","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.164938+0000","last_change":"2024-09-14T11:53:00.164869+0000","last_active":"2024-09-14T11:53:00.164938+0000","last_peered":"2024-09-14T11:53:00.164938+0000","last_clean":"2024-09-14T11:53:00.164938+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:53:00.164938+0000","last_undegraded":"2024-09-14T11:53:00.164938+0000","last_fullsized":"2024-09-14T11:53:00.164938+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.164685+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:01.744253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368206,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":732,"num_read_kb":7795,"num_write":1213,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"263'4","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.236685+0000","last_change":"2024-09-14T11:53:13.236685+0000","last_active":"2024-09-14T11:53:13.236685+0000","last_peered":"2024-09-14T11:53:13.236685+0000","last_clean":"2024-09-14T11:53:13.236685+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:53:13.236685+0000","last_undegraded":"2024-09-14T11:53:13.236685+0000","last_fullsized":"2024-09-14T11:53:13.236685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.236601+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:46.099722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'194","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.123485+0000","last_change":"2024-09-14T11:53:14.123485+0000","last_active":"2024-09-14T11:53:14.123485+0000","last_peered":"2024-09-14T11:53:14.123485+0000","last_clean":"2024-09-14T11:53:14.123485+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:53:14.123485+0000","last_undegraded":"2024-09-14T11:53:14.123485+0000","last_fullsized":"2024-09-14T11:53:14.123485+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.123396+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.394550+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":349,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.282150+0000","last_change":"2024-09-14T11:53:23.282150+0000","last_active":"2024-09-14T11:53:23.282150+0000","last_peered":"2024-09-14T11:53:23.282150+0000","last_clean":"2024-09-14T11:53:23.282150+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:53:23.282150+0000","last_undegraded":"2024-09-14T11:53:23.282150+0000","last_fullsized":"2024-09-14T11:53:23.282150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.282066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:13.449577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2496","reported_seq":4324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.352817+0000","last_change":"2024-09-14T11:53:26.352817+0000","last_active":"2024-09-14T11:53:26.352817+0000","last_peered":"2024-09-14T11:53:26.352817+0000","last_clean":"2024-09-14T11:53:26.352817+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:53:26.352817+0000","last_undegraded":"2024-09-14T11:53:26.352817+0000","last_fullsized":"2024-09-14T11:53:26.352817+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2496","last_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_deep_scrub":"263'2496","last_deep_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.352725+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:36.910529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'508","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.160252+0000","last_change":"2024-09-14T11:53:05.160252+0000","last_active":"2024-09-14T11:53:05.160252+0000","last_peered":"2024-09-14T11:53:05.160252+0000","last_clean":"2024-09-14T11:53:05.160252+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:53:05.160252+0000","last_undegraded":"2024-09-14T11:53:05.160252+0000","last_fullsized":"2024-09-14T11:53:05.160252+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'508","last_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_deep_scrub":"263'508","last_deep_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.160161+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:03.024651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'190","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.226742+0000","last_change":"2024-09-14T11:52:50.226660+0000","last_active":"2024-09-14T11:52:50.226742+0000","last_peered":"2024-09-14T11:52:50.226742+0000","last_clean":"2024-09-14T11:52:50.226742+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:52:50.226742+0000","last_undegraded":"2024-09-14T11:52:50.226742+0000","last_fullsized":"2024-09-14T11:52:50.226742+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.226549+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:48.793214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":11633,"num_write":915,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.140960+0000","last_change":"2024-09-14T11:53:17.140902+0000","last_active":"2024-09-14T11:53:17.140960+0000","last_peered":"2024-09-14T11:53:17.140960+0000","last_clean":"2024-09-14T11:53:17.140960+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:53:17.140960+0000","last_undegraded":"2024-09-14T11:53:17.140960+0000","last_fullsized":"2024-09-14T11:53:17.140960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.140817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.091423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'95","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.975820+0000","last_change":"2024-09-14T11:53:17.975820+0000","last_active":"2024-09-14T11:53:17.975820+0000","last_peered":"2024-09-14T11:53:17.975820+0000","last_clean":"2024-09-14T11:53:17.975820+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:53:17.975820+0000","last_undegraded":"2024-09-14T11:53:17.975820+0000","last_fullsized":"2024-09-14T11:53:17.975820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.975694+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:23.245588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.095490+0000","last_change":"2024-09-14T11:53:22.095490+0000","last_active":"2024-09-14T11:53:22.095490+0000","last_peered":"2024-09-14T11:53:22.095490+0000","last_clean":"2024-09-14T11:53:22.095490+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:53:22.095490+0000","last_undegraded":"2024-09-14T11:53:22.095490+0000","last_fullsized":"2024-09-14T11:53:22.095490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.095388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:54.732324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'128","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.190188+0000","last_change":"2024-09-14T11:53:26.190188+0000","last_active":"2024-09-14T11:53:26.190188+0000","last_peered":"2024-09-14T11:53:26.190188+0000","last_clean":"2024-09-14T11:53:26.190188+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:53:26.190188+0000","last_undegraded":"2024-09-14T11:53:26.190188+0000","last_fullsized":"2024-09-14T11:53:26.190188+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.190093+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:42.068452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'394","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.123155+0000","last_change":"2024-09-14T11:53:02.123155+0000","last_active":"2024-09-14T11:53:02.123155+0000","last_peered":"2024-09-14T11:53:02.123155+0000","last_clean":"2024-09-14T11:53:02.123155+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:53:02.123155+0000","last_undegraded":"2024-09-14T11:53:02.123155+0000","last_fullsized":"2024-09-14T11:53:02.123155+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.123061+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:43.333665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094056+0000","last_change":"2024-09-14T11:52:57.093996+0000","last_active":"2024-09-14T11:52:57.094056+0000","last_peered":"2024-09-14T11:52:57.094056+0000","last_clean":"2024-09-14T11:52:57.094056+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:52:57.094056+0000","last_undegraded":"2024-09-14T11:52:57.094056+0000","last_fullsized":"2024-09-14T11:52:57.094056+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.093902+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.305587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":25054,"num_write":828,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.134952+0000","last_change":"2024-09-14T11:53:12.134952+0000","last_active":"2024-09-14T11:53:12.134952+0000","last_peered":"2024-09-14T11:53:12.134952+0000","last_clean":"2024-09-14T11:53:12.134952+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:53:12.134952+0000","last_undegraded":"2024-09-14T11:53:12.134952+0000","last_fullsized":"2024-09-14T11:53:12.134952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.134861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:32.227065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.523769+0000","last_change":"2024-09-14T11:53:08.523674+0000","last_active":"2024-09-14T11:53:08.523769+0000","last_peered":"2024-09-14T11:53:08.523769+0000","last_clean":"2024-09-14T11:53:08.523769+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:53:08.523769+0000","last_undegraded":"2024-09-14T11:53:08.523769+0000","last_fullsized":"2024-09-14T11:53:08.523769+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.523568+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:13.194309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.285964+0000","last_change":"2024-09-14T11:53:24.285964+0000","last_active":"2024-09-14T11:53:24.285964+0000","last_peered":"2024-09-14T11:53:24.285964+0000","last_clean":"2024-09-14T11:53:24.285964+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:53:24.285964+0000","last_undegraded":"2024-09-14T11:53:24.285964+0000","last_fullsized":"2024-09-14T11:53:24.285964+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.285877+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.843489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'260","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.096151+0000","last_change":"2024-09-14T11:53:27.096151+0000","last_active":"2024-09-14T11:53:27.096151+0000","last_peered":"2024-09-14T11:53:27.096151+0000","last_clean":"2024-09-14T11:53:27.096151+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:53:27.096151+0000","last_undegraded":"2024-09-14T11:53:27.096151+0000","last_fullsized":"2024-09-14T11:53:27.096151+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.096040+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:25.152267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'612","reported_seq":2281,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.242310+0000","last_change":"2024-09-14T11:53:05.242310+0000","last_active":"2024-09-14T11:53:05.242310+0000","last_peered":"2024-09-14T11:53:05.242310+0000","last_clean":"2024-09-14T11:53:05.242310+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:53:05.242310+0000","last_undegraded":"2024-09-14T11:53:05.242310+0000","last_fullsized":"2024-09-14T11:53:05.242310+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'612","last_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_deep_scrub":"263'612","last_deep_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.242215+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:11.508154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'257","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.040132+0000","last_change":"2024-09-14T11:52:53.040059+0000","last_active":"2024-09-14T11:52:53.040132+0000","last_peered":"2024-09-14T11:52:53.040132+0000","last_clean":"2024-09-14T11:52:53.040132+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:52:53.040132+0000","last_undegraded":"2024-09-14T11:52:53.040132+0000","last_fullsized":"2024-09-14T11:52:53.040132+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.039947+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:30.725773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1223,"num_read_kb":9329,"num_write":1113,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.268246+0000","last_change":"2024-09-14T11:53:14.268246+0000","last_active":"2024-09-14T11:53:14.268246+0000","last_peered":"2024-09-14T11:53:14.268246+0000","last_clean":"2024-09-14T11:53:14.268246+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:53:14.268246+0000","last_undegraded":"2024-09-14T11:53:14.268246+0000","last_fullsized":"2024-09-14T11:53:14.268246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.268157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:01.064220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'120","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.286387+0000","last_change":"2024-09-14T11:53:19.286387+0000","last_active":"2024-09-14T11:53:19.286387+0000","last_peered":"2024-09-14T11:53:19.286387+0000","last_clean":"2024-09-14T11:53:19.286387+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:53:19.286387+0000","last_undegraded":"2024-09-14T11:53:19.286387+0000","last_fullsized":"2024-09-14T11:53:19.286387+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.286298+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:51.574721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8244,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":211,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'820","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.115955+0000","last_change":"2024-09-14T11:53:26.115955+0000","last_active":"2024-09-14T11:53:26.115955+0000","last_peered":"2024-09-14T11:53:26.115955+0000","last_clean":"2024-09-14T11:53:26.115955+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:53:26.115955+0000","last_undegraded":"2024-09-14T11:53:26.115955+0000","last_fullsized":"2024-09-14T11:53:26.115955+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.115863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:09.612135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.160898+0000","last_change":"2024-09-14T11:53:04.160898+0000","last_active":"2024-09-14T11:53:04.160898+0000","last_peered":"2024-09-14T11:53:04.160898+0000","last_clean":"2024-09-14T11:53:04.160898+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:53:04.160898+0000","last_undegraded":"2024-09-14T11:53:04.160898+0000","last_fullsized":"2024-09-14T11:53:04.160898+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.160798+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:16.863145+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'224","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.129865+0000","last_change":"2024-09-14T11:52:58.129865+0000","last_active":"2024-09-14T11:52:58.129865+0000","last_peered":"2024-09-14T11:52:58.129865+0000","last_clean":"2024-09-14T11:52:58.129865+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:52:58.129865+0000","last_undegraded":"2024-09-14T11:52:58.129865+0000","last_fullsized":"2024-09-14T11:52:58.129865+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.129706+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:14.434843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079921,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":75141,"num_write":989,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.162665+0000","last_change":"2024-09-14T11:53:13.162665+0000","last_active":"2024-09-14T11:53:13.162665+0000","last_peered":"2024-09-14T11:53:13.162665+0000","last_clean":"2024-09-14T11:53:13.162665+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:53:13.162665+0000","last_undegraded":"2024-09-14T11:53:13.162665+0000","last_fullsized":"2024-09-14T11:53:13.162665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.162577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:39.747982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'212","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.338000+0000","last_change":"2024-09-14T11:53:16.338000+0000","last_active":"2024-09-14T11:53:16.338000+0000","last_peered":"2024-09-14T11:53:16.338000+0000","last_clean":"2024-09-14T11:53:16.338000+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:53:16.338000+0000","last_undegraded":"2024-09-14T11:53:16.338000+0000","last_fullsized":"2024-09-14T11:53:16.338000+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.337891+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:14.933423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":357,"num_write":162,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.782825+0000","last_change":"2024-09-14T11:53:19.782825+0000","last_active":"2024-09-14T11:53:19.782825+0000","last_peered":"2024-09-14T11:53:19.782825+0000","last_clean":"2024-09-14T11:53:19.782825+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:53:19.782825+0000","last_undegraded":"2024-09-14T11:53:19.782825+0000","last_fullsized":"2024-09-14T11:53:19.782825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.782705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'547","reported_seq":1357,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.384403+0000","last_change":"2024-09-14T11:53:22.384403+0000","last_active":"2024-09-14T11:53:22.384403+0000","last_peered":"2024-09-14T11:53:22.384403+0000","last_clean":"2024-09-14T11:53:22.384403+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:53:22.384403+0000","last_undegraded":"2024-09-14T11:53:22.384403+0000","last_fullsized":"2024-09-14T11:53:22.384403+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.384319+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:30.798105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'471","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.111042+0000","last_change":"2024-09-14T11:52:56.111042+0000","last_active":"2024-09-14T11:52:56.111042+0000","last_peered":"2024-09-14T11:52:56.111042+0000","last_clean":"2024-09-14T11:52:56.111042+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:52:56.111042+0000","last_undegraded":"2024-09-14T11:52:56.111042+0000","last_fullsized":"2024-09-14T11:52:56.111042+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.110952+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:29.334828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'226","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.097229+0000","last_change":"2024-09-14T11:52:56.097229+0000","last_active":"2024-09-14T11:52:56.097229+0000","last_peered":"2024-09-14T11:52:56.097229+0000","last_clean":"2024-09-14T11:52:56.097229+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:56.097229+0000","last_undegraded":"2024-09-14T11:52:56.097229+0000","last_fullsized":"2024-09-14T11:52:56.097229+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.097135+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:19.941231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":64064,"num_write":1014,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.588684+0000","last_change":"2024-09-14T11:53:02.588684+0000","last_active":"2024-09-14T11:53:02.588684+0000","last_peered":"2024-09-14T11:53:02.588684+0000","last_clean":"2024-09-14T11:53:02.588684+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:53:02.588684+0000","last_undegraded":"2024-09-14T11:53:02.588684+0000","last_fullsized":"2024-09-14T11:53:02.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.588602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:29.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'143","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.136485+0000","last_change":"2024-09-14T11:53:16.136485+0000","last_active":"2024-09-14T11:53:16.136485+0000","last_peered":"2024-09-14T11:53:16.136485+0000","last_clean":"2024-09-14T11:53:16.136485+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:53:16.136485+0000","last_undegraded":"2024-09-14T11:53:16.136485+0000","last_fullsized":"2024-09-14T11:53:16.136485+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.136400+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.731799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":213,"num_write":84,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.073259+0000","last_change":"2024-09-14T11:53:23.073259+0000","last_active":"2024-09-14T11:53:23.073259+0000","last_peered":"2024-09-14T11:53:23.073259+0000","last_clean":"2024-09-14T11:53:23.073259+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:53:23.073259+0000","last_undegraded":"2024-09-14T11:53:23.073259+0000","last_fullsized":"2024-09-14T11:53:23.073259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.073170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:23.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'123","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.181896+0000","last_change":"2024-09-14T11:53:15.181896+0000","last_active":"2024-09-14T11:53:15.181896+0000","last_peered":"2024-09-14T11:53:15.181896+0000","last_clean":"2024-09-14T11:53:15.181896+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:53:15.181896+0000","last_undegraded":"2024-09-14T11:53:15.181896+0000","last_fullsized":"2024-09-14T11:53:15.181896+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.181804+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:14.148465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'382","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.036223+0000","last_change":"2024-09-14T11:53:02.036223+0000","last_active":"2024-09-14T11:53:02.036223+0000","last_peered":"2024-09-14T11:53:02.036223+0000","last_clean":"2024-09-14T11:53:02.036223+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:53:02.036223+0000","last_undegraded":"2024-09-14T11:53:02.036223+0000","last_fullsized":"2024-09-14T11:53:02.036223+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.036135+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:25.081091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'225","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.154258+0000","last_change":"2024-09-14T11:52:59.154258+0000","last_active":"2024-09-14T11:52:59.154258+0000","last_peered":"2024-09-14T11:52:59.154258+0000","last_clean":"2024-09-14T11:52:59.154258+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:52:59.154258+0000","last_undegraded":"2024-09-14T11:52:59.154258+0000","last_fullsized":"2024-09-14T11:52:59.154258+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.154158+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:38.092830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":542,"num_read_kb":106193,"num_write":937,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.544626+0000","last_change":"2024-09-14T11:53:03.544626+0000","last_active":"2024-09-14T11:53:03.544626+0000","last_peered":"2024-09-14T11:53:03.544626+0000","last_clean":"2024-09-14T11:53:03.544626+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:53:03.544626+0000","last_undegraded":"2024-09-14T11:53:03.544626+0000","last_fullsized":"2024-09-14T11:53:03.544626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.544542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.748879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'166","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.261160+0000","last_change":"2024-09-14T11:53:17.261160+0000","last_active":"2024-09-14T11:53:17.261160+0000","last_peered":"2024-09-14T11:53:17.261160+0000","last_clean":"2024-09-14T11:53:17.261160+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:53:17.261160+0000","last_undegraded":"2024-09-14T11:53:17.261160+0000","last_fullsized":"2024-09-14T11:53:17.261160+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.261070+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:34.279643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":261,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'775","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.182129+0000","last_change":"2024-09-14T11:53:19.182129+0000","last_active":"2024-09-14T11:53:19.182129+0000","last_peered":"2024-09-14T11:53:19.182129+0000","last_clean":"2024-09-14T11:53:19.182129+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:53:19.182129+0000","last_undegraded":"2024-09-14T11:53:19.182129+0000","last_fullsized":"2024-09-14T11:53:19.182129+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.181998+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:38.184284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.106544+0000","last_change":"2024-09-14T11:53:23.106544+0000","last_active":"2024-09-14T11:53:23.106544+0000","last_peered":"2024-09-14T11:53:23.106544+0000","last_clean":"2024-09-14T11:53:23.106544+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:53:23.106544+0000","last_undegraded":"2024-09-14T11:53:23.106544+0000","last_fullsized":"2024-09-14T11:53:23.106544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.106462+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:40.912530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'570","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.186783+0000","last_change":"2024-09-14T11:53:00.186783+0000","last_active":"2024-09-14T11:53:00.186783+0000","last_peered":"2024-09-14T11:53:00.186783+0000","last_clean":"2024-09-14T11:53:00.186783+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:53:00.186783+0000","last_undegraded":"2024-09-14T11:53:00.186783+0000","last_fullsized":"2024-09-14T11:53:00.186783+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'570","last_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_deep_scrub":"263'570","last_deep_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.186701+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:41.511182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'207","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.111500+0000","last_change":"2024-09-14T11:52:55.111500+0000","last_active":"2024-09-14T11:52:55.111500+0000","last_peered":"2024-09-14T11:52:55.111500+0000","last_clean":"2024-09-14T11:52:55.111500+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:52:55.111500+0000","last_undegraded":"2024-09-14T11:52:55.111500+0000","last_fullsized":"2024-09-14T11:52:55.111500+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.111364+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:22.418671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":32215,"num_write":875,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.475652+0000","last_change":"2024-09-14T11:53:05.475652+0000","last_active":"2024-09-14T11:53:05.475652+0000","last_peered":"2024-09-14T11:53:05.475652+0000","last_clean":"2024-09-14T11:53:05.475652+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:53:05.475652+0000","last_undegraded":"2024-09-14T11:53:05.475652+0000","last_fullsized":"2024-09-14T11:53:05.475652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.475568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:15.444965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.098235+0000","last_change":"2024-09-14T11:53:12.098235+0000","last_active":"2024-09-14T11:53:12.098235+0000","last_peered":"2024-09-14T11:53:12.098235+0000","last_clean":"2024-09-14T11:53:12.098235+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:53:12.098235+0000","last_undegraded":"2024-09-14T11:53:12.098235+0000","last_fullsized":"2024-09-14T11:53:12.098235+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.098129+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:24.419869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13546,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":273,"num_read_kb":390,"num_write":132,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.508991+0000","last_change":"2024-09-14T11:53:09.508991+0000","last_active":"2024-09-14T11:53:09.508991+0000","last_peered":"2024-09-14T11:53:09.508991+0000","last_clean":"2024-09-14T11:53:09.508991+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:53:09.508991+0000","last_undegraded":"2024-09-14T11:53:09.508991+0000","last_fullsized":"2024-09-14T11:53:09.508991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.508870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:39.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.718255+0000","last_change":"2024-09-14T11:53:16.718255+0000","last_active":"2024-09-14T11:53:16.718255+0000","last_peered":"2024-09-14T11:53:16.718255+0000","last_clean":"2024-09-14T11:53:16.718255+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:53:16.718255+0000","last_undegraded":"2024-09-14T11:53:16.718255+0000","last_fullsized":"2024-09-14T11:53:16.718255+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.718166+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.547409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'811","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.066558+0000","last_change":"2024-09-14T11:52:57.066558+0000","last_active":"2024-09-14T11:52:57.066558+0000","last_peered":"2024-09-14T11:52:57.066558+0000","last_clean":"2024-09-14T11:52:57.066558+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:52:57.066558+0000","last_undegraded":"2024-09-14T11:52:57.066558+0000","last_fullsized":"2024-09-14T11:52:57.066558+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.066478+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.841841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'187","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.216155+0000","last_change":"2024-09-14T11:52:51.216155+0000","last_active":"2024-09-14T11:52:51.216155+0000","last_peered":"2024-09-14T11:52:51.216155+0000","last_clean":"2024-09-14T11:52:51.216155+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:52:51.216155+0000","last_undegraded":"2024-09-14T11:52:51.216155+0000","last_fullsized":"2024-09-14T11:52:51.216155+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.216003+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.941139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":535,"num_read_kb":54806,"num_write":892,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.525107+0000","last_change":"2024-09-14T11:53:04.525107+0000","last_active":"2024-09-14T11:53:04.525107+0000","last_peered":"2024-09-14T11:53:04.525107+0000","last_clean":"2024-09-14T11:53:04.525107+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:53:04.525107+0000","last_undegraded":"2024-09-14T11:53:04.525107+0000","last_fullsized":"2024-09-14T11:53:04.525107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.525015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:40.108078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'144","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.962742+0000","last_change":"2024-09-14T11:53:15.962742+0000","last_active":"2024-09-14T11:53:15.962742+0000","last_peered":"2024-09-14T11:53:15.962742+0000","last_clean":"2024-09-14T11:53:15.962742+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:53:15.962742+0000","last_undegraded":"2024-09-14T11:53:15.962742+0000","last_fullsized":"2024-09-14T11:53:15.962742+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.962648+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.163212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5347,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":234,"num_write":162,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.122842+0000","last_change":"2024-09-14T11:53:17.122842+0000","last_active":"2024-09-14T11:53:17.122842+0000","last_peered":"2024-09-14T11:53:17.122842+0000","last_clean":"2024-09-14T11:53:17.122842+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:53:17.122842+0000","last_undegraded":"2024-09-14T11:53:17.122842+0000","last_fullsized":"2024-09-14T11:53:17.122842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.122746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:30.958511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'136","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.087070+0000","last_change":"2024-09-14T11:53:28.087070+0000","last_active":"2024-09-14T11:53:28.087070+0000","last_peered":"2024-09-14T11:53:28.087070+0000","last_clean":"2024-09-14T11:53:28.087070+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:53:28.087070+0000","last_undegraded":"2024-09-14T11:53:28.087070+0000","last_fullsized":"2024-09-14T11:53:28.087070+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.086985+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:09.791675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'617","reported_seq":2142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.075392+0000","last_change":"2024-09-14T11:52:58.075392+0000","last_active":"2024-09-14T11:52:58.075392+0000","last_peered":"2024-09-14T11:52:58.075392+0000","last_clean":"2024-09-14T11:52:58.075392+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:58.075392+0000","last_undegraded":"2024-09-14T11:52:58.075392+0000","last_fullsized":"2024-09-14T11:52:58.075392+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.075304+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:31.134395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'217","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.692209+0000","last_change":"2024-09-14T11:52:51.692109+0000","last_active":"2024-09-14T11:52:51.692209+0000","last_peered":"2024-09-14T11:52:51.692209+0000","last_clean":"2024-09-14T11:52:51.692209+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:52:51.692209+0000","last_undegraded":"2024-09-14T11:52:51.692209+0000","last_fullsized":"2024-09-14T11:52:51.692209+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.691968+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:42.697133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1166,"num_read_kb":81327,"num_write":1108,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.592370+0000","last_change":"2024-09-14T11:53:07.592370+0000","last_active":"2024-09-14T11:53:07.592370+0000","last_peered":"2024-09-14T11:53:07.592370+0000","last_clean":"2024-09-14T11:53:07.592370+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:53:07.592370+0000","last_undegraded":"2024-09-14T11:53:07.592370+0000","last_fullsized":"2024-09-14T11:53:07.592370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.592234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:13.451667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'195","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.475678+0000","last_change":"2024-09-14T11:53:07.475678+0000","last_active":"2024-09-14T11:53:07.475678+0000","last_peered":"2024-09-14T11:53:07.475678+0000","last_clean":"2024-09-14T11:53:07.475678+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:53:07.475678+0000","last_undegraded":"2024-09-14T11:53:07.475678+0000","last_fullsized":"2024-09-14T11:53:07.475678+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.475570+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:11.623372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8518,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":257,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'750","reported_seq":2417,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.521357+0000","last_change":"2024-09-14T11:53:10.521357+0000","last_active":"2024-09-14T11:53:10.521357+0000","last_peered":"2024-09-14T11:53:10.521357+0000","last_clean":"2024-09-14T11:53:10.521357+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:53:10.521357+0000","last_undegraded":"2024-09-14T11:53:10.521357+0000","last_fullsized":"2024-09-14T11:53:10.521357+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.521256+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.722472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.703637+0000","last_change":"2024-09-14T11:53:15.703637+0000","last_active":"2024-09-14T11:53:15.703637+0000","last_peered":"2024-09-14T11:53:15.703637+0000","last_clean":"2024-09-14T11:53:15.703637+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:53:15.703637+0000","last_undegraded":"2024-09-14T11:53:15.703637+0000","last_fullsized":"2024-09-14T11:53:15.703637+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.703534+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:51.533479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.086088+0000","last_change":"2024-09-14T11:53:00.086088+0000","last_active":"2024-09-14T11:53:00.086088+0000","last_peered":"2024-09-14T11:53:00.086088+0000","last_clean":"2024-09-14T11:53:00.086088+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:53:00.086088+0000","last_undegraded":"2024-09-14T11:53:00.086088+0000","last_fullsized":"2024-09-14T11:53:00.086088+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.085999+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:14.084510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'215","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.132110+0000","last_change":"2024-09-14T11:52:53.132110+0000","last_active":"2024-09-14T11:52:53.132110+0000","last_peered":"2024-09-14T11:52:53.132110+0000","last_clean":"2024-09-14T11:52:53.132110+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:53.132110+0000","last_undegraded":"2024-09-14T11:52:53.132110+0000","last_fullsized":"2024-09-14T11:52:53.132110+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.131957+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.645543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":783,"num_read_kb":15229,"num_write":1055,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.189264+0000","last_change":"2024-09-14T11:53:12.189264+0000","last_active":"2024-09-14T11:53:12.189264+0000","last_peered":"2024-09-14T11:53:12.189264+0000","last_clean":"2024-09-14T11:53:12.189264+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:53:12.189264+0000","last_undegraded":"2024-09-14T11:53:12.189264+0000","last_fullsized":"2024-09-14T11:53:12.189264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.189152+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:05.891449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'70","reported_seq":594,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.143795+0000","last_change":"2024-09-14T11:53:19.143795+0000","last_active":"2024-09-14T11:53:19.143795+0000","last_peered":"2024-09-14T11:53:19.143795+0000","last_clean":"2024-09-14T11:53:19.143795+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:53:19.143795+0000","last_undegraded":"2024-09-14T11:53:19.143795+0000","last_fullsized":"2024-09-14T11:53:19.143795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'70","last_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_deep_scrub":"263'70","last_deep_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.143710+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:32.602096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'768","reported_seq":2426,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.117368+0000","last_change":"2024-09-14T11:53:09.117368+0000","last_active":"2024-09-14T11:53:09.117368+0000","last_peered":"2024-09-14T11:53:09.117368+0000","last_clean":"2024-09-14T11:53:09.117368+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:53:09.117368+0000","last_undegraded":"2024-09-14T11:53:09.117368+0000","last_fullsized":"2024-09-14T11:53:09.117368+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.117283+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:44.960384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.092221+0000","last_change":"2024-09-14T11:53:23.092221+0000","last_active":"2024-09-14T11:53:23.092221+0000","last_peered":"2024-09-14T11:53:23.092221+0000","last_clean":"2024-09-14T11:53:23.092221+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:53:23.092221+0000","last_undegraded":"2024-09-14T11:53:23.092221+0000","last_fullsized":"2024-09-14T11:53:23.092221+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.092123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:11.099011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.564244+0000","last_change":"2024-09-14T11:53:01.564244+0000","last_active":"2024-09-14T11:53:01.564244+0000","last_peered":"2024-09-14T11:53:01.564244+0000","last_clean":"2024-09-14T11:53:01.564244+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:53:01.564244+0000","last_undegraded":"2024-09-14T11:53:01.564244+0000","last_fullsized":"2024-09-14T11:53:01.564244+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.564148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'201","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.211667+0000","last_change":"2024-09-14T11:52:52.211667+0000","last_active":"2024-09-14T11:52:52.211667+0000","last_peered":"2024-09-14T11:52:52.211667+0000","last_clean":"2024-09-14T11:52:52.211667+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:52:52.211667+0000","last_undegraded":"2024-09-14T11:52:52.211667+0000","last_fullsized":"2024-09-14T11:52:52.211667+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.211587+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:11.190379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":47606,"num_write":839,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.989761+0000","last_change":"2024-09-14T11:53:11.989761+0000","last_active":"2024-09-14T11:53:11.989761+0000","last_peered":"2024-09-14T11:53:11.989761+0000","last_clean":"2024-09-14T11:53:11.989761+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:53:11.989761+0000","last_undegraded":"2024-09-14T11:53:11.989761+0000","last_fullsized":"2024-09-14T11:53:11.989761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.989664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:25.415110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'232","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.436418+0000","last_change":"2024-09-14T11:53:19.436418+0000","last_active":"2024-09-14T11:53:19.436418+0000","last_peered":"2024-09-14T11:53:19.436418+0000","last_clean":"2024-09-14T11:53:19.436418+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:53:19.436418+0000","last_undegraded":"2024-09-14T11:53:19.436418+0000","last_fullsized":"2024-09-14T11:53:19.436418+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.436301+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:00.458988+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26161,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":914,"num_read_kb":1030,"num_write":1436,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.145378+0000","last_change":"2024-09-14T11:53:08.145378+0000","last_active":"2024-09-14T11:53:08.145378+0000","last_peered":"2024-09-14T11:53:08.145378+0000","last_clean":"2024-09-14T11:53:08.145378+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:53:08.145378+0000","last_undegraded":"2024-09-14T11:53:08.145378+0000","last_fullsized":"2024-09-14T11:53:08.145378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.745898+0000","last_change":"2024-09-14T11:53:17.745898+0000","last_active":"2024-09-14T11:53:17.745898+0000","last_peered":"2024-09-14T11:53:17.745898+0000","last_clean":"2024-09-14T11:53:17.745898+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:53:17.745898+0000","last_undegraded":"2024-09-14T11:53:17.745898+0000","last_fullsized":"2024-09-14T11:53:17.745898+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.745809+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:39.872828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.037506+0000","last_change":"2024-09-14T11:52:59.037506+0000","last_active":"2024-09-14T11:52:59.037506+0000","last_peered":"2024-09-14T11:52:59.037506+0000","last_clean":"2024-09-14T11:52:59.037506+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:52:59.037506+0000","last_undegraded":"2024-09-14T11:52:59.037506+0000","last_fullsized":"2024-09-14T11:52:59.037506+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'406","last_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_deep_scrub":"263'406","last_deep_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.037411+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:45.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.055848+0000","last_change":"2024-09-14T11:52:53.055791+0000","last_active":"2024-09-14T11:52:53.055848+0000","last_peered":"2024-09-14T11:52:53.055848+0000","last_clean":"2024-09-14T11:52:53.055848+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:52:53.055848+0000","last_undegraded":"2024-09-14T11:52:53.055848+0000","last_fullsized":"2024-09-14T11:52:53.055848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.055702+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:39.492461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073420+0000","last_change":"2024-09-14T11:52:54.073420+0000","last_active":"2024-09-14T11:52:54.073420+0000","last_peered":"2024-09-14T11:52:54.073420+0000","last_clean":"2024-09-14T11:52:54.073420+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:52:54.073420+0000","last_undegraded":"2024-09-14T11:52:54.073420+0000","last_fullsized":"2024-09-14T11:52:54.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:45.391206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.243231+0000","last_change":"2024-09-14T11:52:53.243231+0000","last_active":"2024-09-14T11:52:53.243231+0000","last_peered":"2024-09-14T11:52:53.243231+0000","last_clean":"2024-09-14T11:52:53.243231+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:52:53.243231+0000","last_undegraded":"2024-09-14T11:52:53.243231+0000","last_fullsized":"2024-09-14T11:52:53.243231+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.243044+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:20.104275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1045,"num_read_kb":764,"num_write":1140,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.176344+0000","last_change":"2024-09-14T11:53:08.176344+0000","last_active":"2024-09-14T11:53:08.176344+0000","last_peered":"2024-09-14T11:53:08.176344+0000","last_clean":"2024-09-14T11:53:08.176344+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:53:08.176344+0000","last_undegraded":"2024-09-14T11:53:08.176344+0000","last_fullsized":"2024-09-14T11:53:08.176344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.176258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:21.229609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'331","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.336879+0000","last_change":"2024-09-14T11:53:17.336879+0000","last_active":"2024-09-14T11:53:17.336879+0000","last_peered":"2024-09-14T11:53:17.336879+0000","last_clean":"2024-09-14T11:53:17.336879+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:53:17.336879+0000","last_undegraded":"2024-09-14T11:53:17.336879+0000","last_fullsized":"2024-09-14T11:53:17.336879+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.336772+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.322808+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134988,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":1074,"num_write":544,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107214,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.166171+0000","last_change":"2024-09-14T11:53:21.166171+0000","last_active":"2024-09-14T11:53:21.166171+0000","last_peered":"2024-09-14T11:53:21.166171+0000","last_clean":"2024-09-14T11:53:21.166171+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:53:21.166171+0000","last_undegraded":"2024-09-14T11:53:21.166171+0000","last_fullsized":"2024-09-14T11:53:21.166171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.166078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:24.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'197","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.181810+0000","last_change":"2024-09-14T11:53:13.181810+0000","last_active":"2024-09-14T11:53:13.181810+0000","last_peered":"2024-09-14T11:53:13.181810+0000","last_clean":"2024-09-14T11:53:13.181810+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:53:13.181810+0000","last_undegraded":"2024-09-14T11:53:13.181810+0000","last_fullsized":"2024-09-14T11:53:13.181810+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.181724+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:09.456237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'450","reported_seq":2105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.140049+0000","last_change":"2024-09-14T11:53:01.140049+0000","last_active":"2024-09-14T11:53:01.140049+0000","last_peered":"2024-09-14T11:53:01.140049+0000","last_clean":"2024-09-14T11:53:01.140049+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:53:01.140049+0000","last_undegraded":"2024-09-14T11:53:01.140049+0000","last_fullsized":"2024-09-14T11:53:01.140049+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.139965+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:32.411582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.036795+0000","last_change":"2024-09-14T11:52:54.036739+0000","last_active":"2024-09-14T11:52:54.036795+0000","last_peered":"2024-09-14T11:52:54.036795+0000","last_clean":"2024-09-14T11:52:54.036795+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:52:54.036795+0000","last_undegraded":"2024-09-14T11:52:54.036795+0000","last_fullsized":"2024-09-14T11:52:54.036795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.036632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:29.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'230","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.250978+0000","last_change":"2024-09-14T11:52:49.250978+0000","last_active":"2024-09-14T11:52:49.250978+0000","last_peered":"2024-09-14T11:52:49.250978+0000","last_clean":"2024-09-14T11:52:49.250978+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:49.250978+0000","last_undegraded":"2024-09-14T11:52:49.250978+0000","last_fullsized":"2024-09-14T11:52:49.250978+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.250850+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:59.097045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":610,"num_read_kb":5636,"num_write":1050,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.194649+0000","last_change":"2024-09-14T11:53:11.194649+0000","last_active":"2024-09-14T11:53:11.194649+0000","last_peered":"2024-09-14T11:53:11.194649+0000","last_clean":"2024-09-14T11:53:11.194649+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:53:11.194649+0000","last_undegraded":"2024-09-14T11:53:11.194649+0000","last_fullsized":"2024-09-14T11:53:11.194649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.194559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.510855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'867","reported_seq":2306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.686128+0000","last_change":"2024-09-14T11:53:11.686128+0000","last_active":"2024-09-14T11:53:11.686128+0000","last_peered":"2024-09-14T11:53:11.686128+0000","last_clean":"2024-09-14T11:53:11.686128+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:53:11.686128+0000","last_undegraded":"2024-09-14T11:53:11.686128+0000","last_fullsized":"2024-09-14T11:53:11.686128+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'867","last_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_deep_scrub":"263'867","last_deep_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.686006+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.101195+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20878,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1373,"num_write":272,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.287601+0000","last_change":"2024-09-14T11:53:20.287601+0000","last_active":"2024-09-14T11:53:20.287601+0000","last_peered":"2024-09-14T11:53:20.287601+0000","last_clean":"2024-09-14T11:53:20.287601+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:53:20.287601+0000","last_undegraded":"2024-09-14T11:53:20.287601+0000","last_fullsized":"2024-09-14T11:53:20.287601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.287514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.831683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.776959+0000","last_change":"2024-09-14T11:53:18.776959+0000","last_active":"2024-09-14T11:53:18.776959+0000","last_peered":"2024-09-14T11:53:18.776959+0000","last_clean":"2024-09-14T11:53:18.776959+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:53:18.776959+0000","last_undegraded":"2024-09-14T11:53:18.776959+0000","last_fullsized":"2024-09-14T11:53:18.776959+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.776875+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:11.227597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'428","reported_seq":1915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.640237+0000","last_change":"2024-09-14T11:52:57.640237+0000","last_active":"2024-09-14T11:52:57.640237+0000","last_peered":"2024-09-14T11:52:57.640237+0000","last_clean":"2024-09-14T11:52:57.640237+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:52:57.640237+0000","last_undegraded":"2024-09-14T11:52:57.640237+0000","last_fullsized":"2024-09-14T11:52:57.640237+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.640146+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:10.948568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.657825+0000","last_change":"2024-09-14T11:52:50.657825+0000","last_active":"2024-09-14T11:52:50.657825+0000","last_peered":"2024-09-14T11:52:50.657825+0000","last_clean":"2024-09-14T11:52:50.657825+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:52:50.657825+0000","last_undegraded":"2024-09-14T11:52:50.657825+0000","last_fullsized":"2024-09-14T11:52:50.657825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.657760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:14.569819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'208","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.653529+0000","last_change":"2024-09-14T11:52:50.653452+0000","last_active":"2024-09-14T11:52:50.653529+0000","last_peered":"2024-09-14T11:52:50.653529+0000","last_clean":"2024-09-14T11:52:50.653529+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:52:50.653529+0000","last_undegraded":"2024-09-14T11:52:50.653529+0000","last_fullsized":"2024-09-14T11:52:50.653529+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.653307+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:26.358362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":52749,"num_write":993,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.580907+0000","last_change":"2024-09-14T11:53:01.580907+0000","last_active":"2024-09-14T11:53:01.580907+0000","last_peered":"2024-09-14T11:53:01.580907+0000","last_clean":"2024-09-14T11:53:01.580907+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:53:01.580907+0000","last_undegraded":"2024-09-14T11:53:01.580907+0000","last_fullsized":"2024-09-14T11:53:01.580907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.580787+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:28.319926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'228","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.218442+0000","last_change":"2024-09-14T11:53:16.218442+0000","last_active":"2024-09-14T11:53:16.218442+0000","last_peered":"2024-09-14T11:53:16.218442+0000","last_clean":"2024-09-14T11:53:16.218442+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:53:16.218442+0000","last_undegraded":"2024-09-14T11:53:16.218442+0000","last_fullsized":"2024-09-14T11:53:16.218442+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.218353+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.126525+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.162973+0000","last_change":"2024-09-14T11:53:16.162973+0000","last_active":"2024-09-14T11:53:16.162973+0000","last_peered":"2024-09-14T11:53:16.162973+0000","last_clean":"2024-09-14T11:53:16.162973+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:53:16.162973+0000","last_undegraded":"2024-09-14T11:53:16.162973+0000","last_fullsized":"2024-09-14T11:53:16.162973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.162891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:17.105651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.090088+0000","last_change":"2024-09-14T11:53:27.090088+0000","last_active":"2024-09-14T11:53:27.090088+0000","last_peered":"2024-09-14T11:53:27.090088+0000","last_clean":"2024-09-14T11:53:27.090088+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:53:27.090088+0000","last_undegraded":"2024-09-14T11:53:27.090088+0000","last_fullsized":"2024-09-14T11:53:27.090088+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.089965+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:34.480113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'460","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.638836+0000","last_change":"2024-09-14T11:52:56.638836+0000","last_active":"2024-09-14T11:52:56.638836+0000","last_peered":"2024-09-14T11:52:56.638836+0000","last_clean":"2024-09-14T11:52:56.638836+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:52:56.638836+0000","last_undegraded":"2024-09-14T11:52:56.638836+0000","last_fullsized":"2024-09-14T11:52:56.638836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.638748+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:35.929585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.023077+0000","last_change":"2024-09-14T11:52:52.023077+0000","last_active":"2024-09-14T11:52:52.023077+0000","last_peered":"2024-09-14T11:52:52.023077+0000","last_clean":"2024-09-14T11:52:52.023077+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:52:52.023077+0000","last_undegraded":"2024-09-14T11:52:52.023077+0000","last_fullsized":"2024-09-14T11:52:52.023077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.022923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:46.997948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'183","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.093157+0000","last_change":"2024-09-14T11:52:52.093157+0000","last_active":"2024-09-14T11:52:52.093157+0000","last_peered":"2024-09-14T11:52:52.093157+0000","last_clean":"2024-09-14T11:52:52.093157+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:52:52.093157+0000","last_undegraded":"2024-09-14T11:52:52.093157+0000","last_fullsized":"2024-09-14T11:52:52.093157+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.093023+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:24.168597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":11748,"num_write":873,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.055602+0000","last_change":"2024-09-14T11:53:09.055602+0000","last_active":"2024-09-14T11:53:09.055602+0000","last_peered":"2024-09-14T11:53:09.055602+0000","last_clean":"2024-09-14T11:53:09.055602+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:53:09.055602+0000","last_undegraded":"2024-09-14T11:53:09.055602+0000","last_fullsized":"2024-09-14T11:53:09.055602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.055524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.648168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'133","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.182260+0000","last_change":"2024-09-14T11:53:14.182260+0000","last_active":"2024-09-14T11:53:14.182260+0000","last_peered":"2024-09-14T11:53:14.182260+0000","last_clean":"2024-09-14T11:53:14.182260+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:53:14.182260+0000","last_undegraded":"2024-09-14T11:53:14.182260+0000","last_fullsized":"2024-09-14T11:53:14.182260+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.182169+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.712494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.096626+0000","last_change":"2024-09-14T11:53:07.096626+0000","last_active":"2024-09-14T11:53:07.096626+0000","last_peered":"2024-09-14T11:53:07.096626+0000","last_clean":"2024-09-14T11:53:07.096626+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:53:07.096626+0000","last_undegraded":"2024-09-14T11:53:07.096626+0000","last_fullsized":"2024-09-14T11:53:07.096626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.096502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.402188+0000","last_change":"2024-09-14T11:53:23.402188+0000","last_active":"2024-09-14T11:53:23.402188+0000","last_peered":"2024-09-14T11:53:23.402188+0000","last_clean":"2024-09-14T11:53:23.402188+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:53:23.402188+0000","last_undegraded":"2024-09-14T11:53:23.402188+0000","last_fullsized":"2024-09-14T11:53:23.402188+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.402102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:13.285898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.620545+0000","last_change":"2024-09-14T11:52:59.620545+0000","last_active":"2024-09-14T11:52:59.620545+0000","last_peered":"2024-09-14T11:52:59.620545+0000","last_clean":"2024-09-14T11:52:59.620545+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:52:59.620545+0000","last_undegraded":"2024-09-14T11:52:59.620545+0000","last_fullsized":"2024-09-14T11:52:59.620545+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.620455+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.069591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'230","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.046740+0000","last_change":"2024-09-14T11:52:53.046663+0000","last_active":"2024-09-14T11:52:53.046740+0000","last_peered":"2024-09-14T11:52:53.046740+0000","last_clean":"2024-09-14T11:52:53.046740+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:52:53.046740+0000","last_undegraded":"2024-09-14T11:52:53.046740+0000","last_fullsized":"2024-09-14T11:52:53.046740+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.046573+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:56.461752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":621,"num_read_kb":15435,"num_write":887,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.655319+0000","last_change":"2024-09-14T11:52:49.655319+0000","last_active":"2024-09-14T11:52:49.655319+0000","last_peered":"2024-09-14T11:52:49.655319+0000","last_clean":"2024-09-14T11:52:49.655319+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:52:49.655319+0000","last_undegraded":"2024-09-14T11:52:49.655319+0000","last_fullsized":"2024-09-14T11:52:49.655319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.655243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:56.511174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.093954+0000","last_change":"2024-09-14T11:53:08.093954+0000","last_active":"2024-09-14T11:53:08.093954+0000","last_peered":"2024-09-14T11:53:08.093954+0000","last_clean":"2024-09-14T11:53:08.093954+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:53:08.093954+0000","last_undegraded":"2024-09-14T11:53:08.093954+0000","last_fullsized":"2024-09-14T11:53:08.093954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:08.707957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.094345+0000","last_change":"2024-09-14T11:53:11.094245+0000","last_active":"2024-09-14T11:53:11.094345+0000","last_peered":"2024-09-14T11:53:11.094345+0000","last_clean":"2024-09-14T11:53:11.094345+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:53:11.094345+0000","last_undegraded":"2024-09-14T11:53:11.094345+0000","last_fullsized":"2024-09-14T11:53:11.094345+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.094126+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:08.521028+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":423,"num_read_kb":619,"num_write":282,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.045776+0000","last_change":"2024-09-14T11:53:21.045776+0000","last_active":"2024-09-14T11:53:21.045776+0000","last_peered":"2024-09-14T11:53:21.045776+0000","last_clean":"2024-09-14T11:53:21.045776+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:53:21.045776+0000","last_undegraded":"2024-09-14T11:53:21.045776+0000","last_fullsized":"2024-09-14T11:53:21.045776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.045682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.343493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'214","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.181097+0000","last_change":"2024-09-14T11:53:25.181097+0000","last_active":"2024-09-14T11:53:25.181097+0000","last_peered":"2024-09-14T11:53:25.181097+0000","last_clean":"2024-09-14T11:53:25.181097+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:53:25.181097+0000","last_undegraded":"2024-09-14T11:53:25.181097+0000","last_fullsized":"2024-09-14T11:53:25.181097+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.180991+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:20.010846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'432","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.206365+0000","last_change":"2024-09-14T11:52:59.206365+0000","last_active":"2024-09-14T11:52:59.206365+0000","last_peered":"2024-09-14T11:52:59.206365+0000","last_clean":"2024-09-14T11:52:59.206365+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:59.206365+0000","last_undegraded":"2024-09-14T11:52:59.206365+0000","last_fullsized":"2024-09-14T11:52:59.206365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.206274+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:24.686804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'220","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.617381+0000","last_change":"2024-09-14T11:52:52.617381+0000","last_active":"2024-09-14T11:52:52.617381+0000","last_peered":"2024-09-14T11:52:52.617381+0000","last_clean":"2024-09-14T11:52:52.617381+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:52:52.617381+0000","last_undegraded":"2024-09-14T11:52:52.617381+0000","last_fullsized":"2024-09-14T11:52:52.617381+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.617251+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.949283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":606,"num_read_kb":78521,"num_write":1035,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.074859+0000","last_change":"2024-09-14T11:52:55.074859+0000","last_active":"2024-09-14T11:52:55.074859+0000","last_peered":"2024-09-14T11:52:55.074859+0000","last_clean":"2024-09-14T11:52:55.074859+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:52:55.074859+0000","last_undegraded":"2024-09-14T11:52:55.074859+0000","last_fullsized":"2024-09-14T11:52:55.074859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.074773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.397184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.051330+0000","last_change":"2024-09-14T11:53:04.051330+0000","last_active":"2024-09-14T11:53:04.051330+0000","last_peered":"2024-09-14T11:53:04.051330+0000","last_clean":"2024-09-14T11:53:04.051330+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:53:04.051330+0000","last_undegraded":"2024-09-14T11:53:04.051330+0000","last_fullsized":"2024-09-14T11:53:04.051330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.051237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.225013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.709019+0000","last_change":"2024-09-14T11:53:10.709019+0000","last_active":"2024-09-14T11:53:10.709019+0000","last_peered":"2024-09-14T11:53:10.709019+0000","last_clean":"2024-09-14T11:53:10.709019+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:53:10.709019+0000","last_undegraded":"2024-09-14T11:53:10.709019+0000","last_fullsized":"2024-09-14T11:53:10.709019+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.708910+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:06.343251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'804","reported_seq":4898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.425484+0000","last_change":"2024-09-14T11:53:20.425417+0000","last_active":"2024-09-14T11:53:20.425484+0000","last_peered":"2024-09-14T11:53:20.425484+0000","last_clean":"2024-09-14T11:53:20.425484+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:53:20.425484+0000","last_undegraded":"2024-09-14T11:53:20.425484+0000","last_fullsized":"2024-09-14T11:53:20.425484+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.425325+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:54.306099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'153","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:53.942699+0000","last_change":"2024-09-14T11:11:14.883774+0000","last_active":"2024-09-14T11:51:53.942699+0000","last_peered":"2024-09-14T11:51:53.942699+0000","last_clean":"2024-09-14T11:51:53.942699+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:51:53.942699+0000","last_undegraded":"2024-09-14T11:51:53.942699+0000","last_fullsized":"2024-09-14T11:51:53.942699+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:06.502949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'342","reported_seq":1715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.566626+0000","last_change":"2024-09-14T11:52:58.566626+0000","last_active":"2024-09-14T11:52:58.566626+0000","last_peered":"2024-09-14T11:52:58.566626+0000","last_clean":"2024-09-14T11:52:58.566626+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:52:58.566626+0000","last_undegraded":"2024-09-14T11:52:58.566626+0000","last_fullsized":"2024-09-14T11:52:58.566626+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.566512+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:15.609009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'297","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.184746+0000","last_change":"2024-09-14T11:52:55.184746+0000","last_active":"2024-09-14T11:52:55.184746+0000","last_peered":"2024-09-14T11:52:55.184746+0000","last_clean":"2024-09-14T11:52:55.184746+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:52:55.184746+0000","last_undegraded":"2024-09-14T11:52:55.184746+0000","last_fullsized":"2024-09-14T11:52:55.184746+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.184619+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.242032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1185,"num_read_kb":53005,"num_write":1239,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.619046+0000","last_change":"2024-09-14T11:52:51.619046+0000","last_active":"2024-09-14T11:52:51.619046+0000","last_peered":"2024-09-14T11:52:51.619046+0000","last_clean":"2024-09-14T11:52:51.619046+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:52:51.619046+0000","last_undegraded":"2024-09-14T11:52:51.619046+0000","last_fullsized":"2024-09-14T11:52:51.619046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.618977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:09.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.970888+0000","last_change":"2024-09-14T11:53:10.970888+0000","last_active":"2024-09-14T11:53:10.970888+0000","last_peered":"2024-09-14T11:53:10.970888+0000","last_clean":"2024-09-14T11:53:10.970888+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:53:10.970888+0000","last_undegraded":"2024-09-14T11:53:10.970888+0000","last_fullsized":"2024-09-14T11:53:10.970888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.970798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:12.248353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'114","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.010145+0000","last_change":"2024-09-14T11:53:15.010145+0000","last_active":"2024-09-14T11:53:15.010145+0000","last_peered":"2024-09-14T11:53:15.010145+0000","last_clean":"2024-09-14T11:53:15.010145+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:53:15.010145+0000","last_undegraded":"2024-09-14T11:53:15.010145+0000","last_fullsized":"2024-09-14T11:53:15.010145+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.010051+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:26.337936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'821","reported_seq":4196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.105578+0000","last_change":"2024-09-14T11:53:25.105578+0000","last_active":"2024-09-14T11:53:25.105578+0000","last_peered":"2024-09-14T11:53:25.105578+0000","last_clean":"2024-09-14T11:53:25.105578+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:53:25.105578+0000","last_undegraded":"2024-09-14T11:53:25.105578+0000","last_fullsized":"2024-09-14T11:53:25.105578+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'821","last_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_deep_scrub":"263'821","last_deep_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.105499+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:28.204436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'302","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.148521+0000","last_change":"2024-09-14T11:53:24.148521+0000","last_active":"2024-09-14T11:53:24.148521+0000","last_peered":"2024-09-14T11:53:24.148521+0000","last_clean":"2024-09-14T11:53:24.148521+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:53:24.148521+0000","last_undegraded":"2024-09-14T11:53:24.148521+0000","last_fullsized":"2024-09-14T11:53:24.148521+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.148430+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:52.508148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'547","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.103069+0000","last_change":"2024-09-14T11:52:55.103069+0000","last_active":"2024-09-14T11:52:55.103069+0000","last_peered":"2024-09-14T11:52:55.103069+0000","last_clean":"2024-09-14T11:52:55.103069+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:52:55.103069+0000","last_undegraded":"2024-09-14T11:52:55.103069+0000","last_fullsized":"2024-09-14T11:52:55.103069+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.102970+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.863637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.184613+0000","last_change":"2024-09-14T11:52:51.184613+0000","last_active":"2024-09-14T11:52:51.184613+0000","last_peered":"2024-09-14T11:52:51.184613+0000","last_clean":"2024-09-14T11:52:51.184613+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:52:51.184613+0000","last_undegraded":"2024-09-14T11:52:51.184613+0000","last_fullsized":"2024-09-14T11:52:51.184613+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.184537+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:22.858482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":59716,"num_write":954,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.049162+0000","last_change":"2024-09-14T11:52:52.049162+0000","last_active":"2024-09-14T11:52:52.049162+0000","last_peered":"2024-09-14T11:52:52.049162+0000","last_clean":"2024-09-14T11:52:52.049162+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:52:52.049162+0000","last_undegraded":"2024-09-14T11:52:52.049162+0000","last_fullsized":"2024-09-14T11:52:52.049162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.049078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:46.676372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.152296+0000","last_change":"2024-09-14T11:53:13.152251+0000","last_active":"2024-09-14T11:53:13.152296+0000","last_peered":"2024-09-14T11:53:13.152296+0000","last_clean":"2024-09-14T11:53:13.152296+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:53:13.152296+0000","last_undegraded":"2024-09-14T11:53:13.152296+0000","last_fullsized":"2024-09-14T11:53:13.152296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.152189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.260123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'328","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.175445+0000","last_change":"2024-09-14T11:53:15.175445+0000","last_active":"2024-09-14T11:53:15.175445+0000","last_peered":"2024-09-14T11:53:15.175445+0000","last_clean":"2024-09-14T11:53:15.175445+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:53:15.175445+0000","last_undegraded":"2024-09-14T11:53:15.175445+0000","last_fullsized":"2024-09-14T11:53:15.175445+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.175339+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:47.661577+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":700,"num_write":238,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.156207+0000","last_change":"2024-09-14T11:53:20.156207+0000","last_active":"2024-09-14T11:53:20.156207+0000","last_peered":"2024-09-14T11:53:20.156207+0000","last_clean":"2024-09-14T11:53:20.156207+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:53:20.156207+0000","last_undegraded":"2024-09-14T11:53:20.156207+0000","last_fullsized":"2024-09-14T11:53:20.156207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.156101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:40.870675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'122","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.377574+0000","last_change":"2024-09-14T11:53:24.377574+0000","last_active":"2024-09-14T11:53:24.377574+0000","last_peered":"2024-09-14T11:53:24.377574+0000","last_clean":"2024-09-14T11:53:24.377574+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:53:24.377574+0000","last_undegraded":"2024-09-14T11:53:24.377574+0000","last_fullsized":"2024-09-14T11:53:24.377574+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.377480+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:39.476878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'146","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.213746+0000","last_change":"2024-09-14T11:53:28.213746+0000","last_active":"2024-09-14T11:53:28.213746+0000","last_peered":"2024-09-14T11:53:28.213746+0000","last_clean":"2024-09-14T11:53:28.213746+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:53:28.213746+0000","last_undegraded":"2024-09-14T11:53:28.213746+0000","last_fullsized":"2024-09-14T11:53:28.213746+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.213666+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.633390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'730","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.077001+0000","last_change":"2024-09-14T11:52:59.076916+0000","last_active":"2024-09-14T11:52:59.077001+0000","last_peered":"2024-09-14T11:52:59.077001+0000","last_clean":"2024-09-14T11:52:59.077001+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:59.077001+0000","last_undegraded":"2024-09-14T11:52:59.077001+0000","last_fullsized":"2024-09-14T11:52:59.077001+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'730","last_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_deep_scrub":"263'730","last_deep_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.076833+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:00.485111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'234","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648589+0000","last_change":"2024-09-14T11:52:54.648589+0000","last_active":"2024-09-14T11:52:54.648589+0000","last_peered":"2024-09-14T11:52:54.648589+0000","last_clean":"2024-09-14T11:52:54.648589+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:52:54.648589+0000","last_undegraded":"2024-09-14T11:52:54.648589+0000","last_fullsized":"2024-09-14T11:52:54.648589+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'234","last_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_deep_scrub":"263'234","last_deep_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648451+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.438311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":19030,"num_write":1058,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.567001+0000","last_change":"2024-09-14T11:53:06.566908+0000","last_active":"2024-09-14T11:53:06.567001+0000","last_peered":"2024-09-14T11:53:06.567001+0000","last_clean":"2024-09-14T11:53:06.567001+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:53:06.567001+0000","last_undegraded":"2024-09-14T11:53:06.567001+0000","last_fullsized":"2024-09-14T11:53:06.567001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.566787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:22.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.177257+0000","last_change":"2024-09-14T11:53:15.177257+0000","last_active":"2024-09-14T11:53:15.177257+0000","last_peered":"2024-09-14T11:53:15.177257+0000","last_clean":"2024-09-14T11:53:15.177257+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:53:15.177257+0000","last_undegraded":"2024-09-14T11:53:15.177257+0000","last_fullsized":"2024-09-14T11:53:15.177257+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.177164+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.136369+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.099503+0000","last_change":"2024-09-14T11:53:24.099503+0000","last_active":"2024-09-14T11:53:24.099503+0000","last_peered":"2024-09-14T11:53:24.099503+0000","last_clean":"2024-09-14T11:53:24.099503+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:53:24.099503+0000","last_undegraded":"2024-09-14T11:53:24.099503+0000","last_fullsized":"2024-09-14T11:53:24.099503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.099423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:22.546626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:23.938247+0000","last_change":"2024-09-14T11:11:14.690424+0000","last_active":"2024-09-14T11:51:23.938247+0000","last_peered":"2024-09-14T11:51:23.938247+0000","last_clean":"2024-09-14T11:51:23.938247+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:51:23.938247+0000","last_undegraded":"2024-09-14T11:51:23.938247+0000","last_fullsized":"2024-09-14T11:51:23.938247+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'714","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.612425+0000","last_change":"2024-09-14T11:53:02.612361+0000","last_active":"2024-09-14T11:53:02.612425+0000","last_peered":"2024-09-14T11:53:02.612425+0000","last_clean":"2024-09-14T11:53:02.612425+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:53:02.612425+0000","last_undegraded":"2024-09-14T11:53:02.612425+0000","last_fullsized":"2024-09-14T11:53:02.612425+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'714","last_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_deep_scrub":"263'714","last_deep_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.612273+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:14.047702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'188","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.133662+0000","last_change":"2024-09-14T11:53:02.133662+0000","last_active":"2024-09-14T11:53:02.133662+0000","last_peered":"2024-09-14T11:53:02.133662+0000","last_clean":"2024-09-14T11:53:02.133662+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:53:02.133662+0000","last_undegraded":"2024-09-14T11:53:02.133662+0000","last_fullsized":"2024-09-14T11:53:02.133662+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.133543+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:44.205392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":26239,"num_write":895,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.095817+0000","last_change":"2024-09-14T11:53:11.095817+0000","last_active":"2024-09-14T11:53:11.095817+0000","last_peered":"2024-09-14T11:53:11.095817+0000","last_clean":"2024-09-14T11:53:11.095817+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:53:11.095817+0000","last_undegraded":"2024-09-14T11:53:11.095817+0000","last_fullsized":"2024-09-14T11:53:11.095817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.095748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:44.339265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'56","reported_seq":560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.134541+0000","last_change":"2024-09-14T11:53:13.134495+0000","last_active":"2024-09-14T11:53:13.134541+0000","last_peered":"2024-09-14T11:53:13.134541+0000","last_clean":"2024-09-14T11:53:13.134541+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:53:13.134541+0000","last_undegraded":"2024-09-14T11:53:13.134541+0000","last_fullsized":"2024-09-14T11:53:13.134541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'56","last_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_deep_scrub":"263'56","last_deep_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.134433+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:17.922011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.276886+0000","last_change":"2024-09-14T11:53:22.276886+0000","last_active":"2024-09-14T11:53:22.276886+0000","last_peered":"2024-09-14T11:53:22.276886+0000","last_clean":"2024-09-14T11:53:22.276886+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:53:22.276886+0000","last_undegraded":"2024-09-14T11:53:22.276886+0000","last_fullsized":"2024-09-14T11:53:22.276886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.276785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:00.923129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'196","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.178248+0000","last_change":"2024-09-14T11:53:27.178248+0000","last_active":"2024-09-14T11:53:27.178248+0000","last_peered":"2024-09-14T11:53:27.178248+0000","last_clean":"2024-09-14T11:53:27.178248+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:53:27.178248+0000","last_undegraded":"2024-09-14T11:53:27.178248+0000","last_fullsized":"2024-09-14T11:53:27.178248+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.178165+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:20.272802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'490","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.224894+0000","last_change":"2024-09-14T11:53:03.224838+0000","last_active":"2024-09-14T11:53:03.224894+0000","last_peered":"2024-09-14T11:53:03.224894+0000","last_clean":"2024-09-14T11:53:03.224894+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:53:03.224894+0000","last_undegraded":"2024-09-14T11:53:03.224894+0000","last_fullsized":"2024-09-14T11:53:03.224894+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.224751+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:34.212444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'205","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.109079+0000","last_change":"2024-09-14T11:52:56.109079+0000","last_active":"2024-09-14T11:52:56.109079+0000","last_peered":"2024-09-14T11:52:56.109079+0000","last_clean":"2024-09-14T11:52:56.109079+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:52:56.109079+0000","last_undegraded":"2024-09-14T11:52:56.109079+0000","last_fullsized":"2024-09-14T11:52:56.109079+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.108961+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:38.858667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":474,"num_read_kb":67081,"num_write":927,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.152240+0000","last_change":"2024-09-14T11:53:12.152240+0000","last_active":"2024-09-14T11:53:12.152240+0000","last_peered":"2024-09-14T11:53:12.152240+0000","last_clean":"2024-09-14T11:53:12.152240+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:53:12.152240+0000","last_undegraded":"2024-09-14T11:53:12.152240+0000","last_fullsized":"2024-09-14T11:53:12.152240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.152139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:42.429598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'167","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.162673+0000","last_change":"2024-09-14T11:53:21.162673+0000","last_active":"2024-09-14T11:53:21.162673+0000","last_peered":"2024-09-14T11:53:21.162673+0000","last_clean":"2024-09-14T11:53:21.162673+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:53:21.162673+0000","last_undegraded":"2024-09-14T11:53:21.162673+0000","last_fullsized":"2024-09-14T11:53:21.162673+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.162567+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:31.657212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":278,"num_write":116,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.083218+0000","last_change":"2024-09-14T11:53:10.083150+0000","last_active":"2024-09-14T11:53:10.083218+0000","last_peered":"2024-09-14T11:53:10.083218+0000","last_clean":"2024-09-14T11:53:10.083218+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:53:10.083218+0000","last_undegraded":"2024-09-14T11:53:10.083218+0000","last_fullsized":"2024-09-14T11:53:10.083218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.083034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:04.878196+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'160","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.350930+0000","last_change":"2024-09-14T11:53:27.350930+0000","last_active":"2024-09-14T11:53:27.350930+0000","last_peered":"2024-09-14T11:53:27.350930+0000","last_clean":"2024-09-14T11:53:27.350930+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:53:27.350930+0000","last_undegraded":"2024-09-14T11:53:27.350930+0000","last_fullsized":"2024-09-14T11:53:27.350930+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'160","last_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_deep_scrub":"263'160","last_deep_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.350845+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:40.944695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1180","reported_seq":2930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.193367+0000","last_change":"2024-09-14T11:53:02.193307+0000","last_active":"2024-09-14T11:53:02.193367+0000","last_peered":"2024-09-14T11:53:02.193367+0000","last_clean":"2024-09-14T11:53:02.193367+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:53:02.193367+0000","last_undegraded":"2024-09-14T11:53:02.193367+0000","last_fullsized":"2024-09-14T11:53:02.193367+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1180","last_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_deep_scrub":"263'1180","last_deep_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.193183+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:52.922671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'190","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.177272+0000","last_change":"2024-09-14T11:52:52.177272+0000","last_active":"2024-09-14T11:52:52.177272+0000","last_peered":"2024-09-14T11:52:52.177272+0000","last_clean":"2024-09-14T11:52:52.177272+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:52:52.177272+0000","last_undegraded":"2024-09-14T11:52:52.177272+0000","last_fullsized":"2024-09-14T11:52:52.177272+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.177191+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.347583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":13209,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.059077+0000","last_change":"2024-09-14T11:53:05.059021+0000","last_active":"2024-09-14T11:53:05.059077+0000","last_peered":"2024-09-14T11:53:05.059077+0000","last_clean":"2024-09-14T11:53:05.059077+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:53:05.059077+0000","last_undegraded":"2024-09-14T11:53:05.059077+0000","last_fullsized":"2024-09-14T11:53:05.059077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.058935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.616585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'128","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.283758+0000","last_change":"2024-09-14T11:53:18.283758+0000","last_active":"2024-09-14T11:53:18.283758+0000","last_peered":"2024-09-14T11:53:18.283758+0000","last_clean":"2024-09-14T11:53:18.283758+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:53:18.283758+0000","last_undegraded":"2024-09-14T11:53:18.283758+0000","last_fullsized":"2024-09-14T11:53:18.283758+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.283644+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:20.993861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":210,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.167421+0000","last_change":"2024-09-14T11:53:18.167421+0000","last_active":"2024-09-14T11:53:18.167421+0000","last_peered":"2024-09-14T11:53:18.167421+0000","last_clean":"2024-09-14T11:53:18.167421+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:53:18.167421+0000","last_undegraded":"2024-09-14T11:53:18.167421+0000","last_fullsized":"2024-09-14T11:53:18.167421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.167336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:49.069995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1630","reported_seq":3338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.020929+0000","last_change":"2024-09-14T11:53:00.020929+0000","last_active":"2024-09-14T11:53:00.020929+0000","last_peered":"2024-09-14T11:53:00.020929+0000","last_clean":"2024-09-14T11:53:00.020929+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:53:00.020929+0000","last_undegraded":"2024-09-14T11:53:00.020929+0000","last_fullsized":"2024-09-14T11:53:00.020929+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1630","last_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_deep_scrub":"263'1630","last_deep_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.020831+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:01.658072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'230","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.223218+0000","last_change":"2024-09-14T11:52:54.223218+0000","last_active":"2024-09-14T11:52:54.223218+0000","last_peered":"2024-09-14T11:52:54.223218+0000","last_clean":"2024-09-14T11:52:54.223218+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:54.223218+0000","last_undegraded":"2024-09-14T11:52:54.223218+0000","last_fullsized":"2024-09-14T11:52:54.223218+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.223086+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:16.621473+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":62996,"num_write":1114,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.072476+0000","last_change":"2024-09-14T11:53:10.072366+0000","last_active":"2024-09-14T11:53:10.072476+0000","last_peered":"2024-09-14T11:53:10.072476+0000","last_clean":"2024-09-14T11:53:10.072476+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:53:10.072476+0000","last_undegraded":"2024-09-14T11:53:10.072476+0000","last_fullsized":"2024-09-14T11:53:10.072476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.072273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:53.959740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.646754+0000","last_change":"2024-09-14T11:53:12.646754+0000","last_active":"2024-09-14T11:53:12.646754+0000","last_peered":"2024-09-14T11:53:12.646754+0000","last_clean":"2024-09-14T11:53:12.646754+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:53:12.646754+0000","last_undegraded":"2024-09-14T11:53:12.646754+0000","last_fullsized":"2024-09-14T11:53:12.646754+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.646643+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:18.251475+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":490,"num_write":204,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.429630+0000","last_change":"2024-09-14T11:53:21.429630+0000","last_active":"2024-09-14T11:53:21.429630+0000","last_peered":"2024-09-14T11:53:21.429630+0000","last_clean":"2024-09-14T11:53:21.429630+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:53:21.429630+0000","last_undegraded":"2024-09-14T11:53:21.429630+0000","last_fullsized":"2024-09-14T11:53:21.429630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.429514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:02.974268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'163","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:21.327466+0000","last_change":"2024-09-14T11:11:14.886973+0000","last_active":"2024-09-14T11:51:21.327466+0000","last_peered":"2024-09-14T11:51:21.327466+0000","last_clean":"2024-09-14T11:51:21.327466+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:51:21.327466+0000","last_undegraded":"2024-09-14T11:51:21.327466+0000","last_fullsized":"2024-09-14T11:51:21.327466+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'426","reported_seq":2040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.118762+0000","last_change":"2024-09-14T11:53:03.118696+0000","last_active":"2024-09-14T11:53:03.118762+0000","last_peered":"2024-09-14T11:53:03.118762+0000","last_clean":"2024-09-14T11:53:03.118762+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:53:03.118762+0000","last_undegraded":"2024-09-14T11:53:03.118762+0000","last_fullsized":"2024-09-14T11:53:03.118762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.118613+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.478029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'181","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.646490+0000","last_change":"2024-09-14T11:52:58.646490+0000","last_active":"2024-09-14T11:52:58.646490+0000","last_peered":"2024-09-14T11:52:58.646490+0000","last_clean":"2024-09-14T11:52:58.646490+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:52:58.646490+0000","last_undegraded":"2024-09-14T11:52:58.646490+0000","last_fullsized":"2024-09-14T11:52:58.646490+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.646391+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:28.666065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":12441,"num_write":906,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.108231+0000","last_change":"2024-09-14T11:53:06.108231+0000","last_active":"2024-09-14T11:53:06.108231+0000","last_peered":"2024-09-14T11:53:06.108231+0000","last_clean":"2024-09-14T11:53:06.108231+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:53:06.108231+0000","last_undegraded":"2024-09-14T11:53:06.108231+0000","last_fullsized":"2024-09-14T11:53:06.108231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.108140+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:42.873671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":1194,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'171","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.305912+0000","last_change":"2024-09-14T11:53:21.305912+0000","last_active":"2024-09-14T11:53:21.305912+0000","last_peered":"2024-09-14T11:53:21.305912+0000","last_clean":"2024-09-14T11:53:21.305912+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:53:21.305912+0000","last_undegraded":"2024-09-14T11:53:21.305912+0000","last_fullsized":"2024-09-14T11:53:21.305912+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.305812+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:16.144405+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9714,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":303,"num_write":148,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.665636+0000","last_change":"2024-09-14T11:53:13.665636+0000","last_active":"2024-09-14T11:53:13.665636+0000","last_peered":"2024-09-14T11:53:13.665636+0000","last_clean":"2024-09-14T11:53:13.665636+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:53:13.665636+0000","last_undegraded":"2024-09-14T11:53:13.665636+0000","last_fullsized":"2024-09-14T11:53:13.665636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.665547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:19.013303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'179","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.158325+0000","last_change":"2024-09-14T11:53:14.158325+0000","last_active":"2024-09-14T11:53:14.158325+0000","last_peered":"2024-09-14T11:53:14.158325+0000","last_clean":"2024-09-14T11:53:14.158325+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:53:14.158325+0000","last_undegraded":"2024-09-14T11:53:14.158325+0000","last_fullsized":"2024-09-14T11:53:14.158325+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.158221+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:36.491282+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'378","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.177623+0000","last_change":"2024-09-14T11:53:07.177623+0000","last_active":"2024-09-14T11:53:07.177623+0000","last_peered":"2024-09-14T11:53:07.177623+0000","last_clean":"2024-09-14T11:53:07.177623+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:53:07.177623+0000","last_undegraded":"2024-09-14T11:53:07.177623+0000","last_fullsized":"2024-09-14T11:53:07.177623+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.177534+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:21.980111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'245","reported_seq":862,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.133645+0000","last_change":"2024-09-14T11:52:51.133645+0000","last_active":"2024-09-14T11:52:51.133645+0000","last_peered":"2024-09-14T11:52:51.133645+0000","last_clean":"2024-09-14T11:52:51.133645+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:52:51.133645+0000","last_undegraded":"2024-09-14T11:52:51.133645+0000","last_fullsized":"2024-09-14T11:52:51.133645+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'245","last_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_deep_scrub":"263'245","last_deep_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.133522+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:35.776995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":23729,"num_write":1071,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.020147+0000","last_change":"2024-09-14T11:53:14.020147+0000","last_active":"2024-09-14T11:53:14.020147+0000","last_peered":"2024-09-14T11:53:14.020147+0000","last_clean":"2024-09-14T11:53:14.020147+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:53:14.020147+0000","last_undegraded":"2024-09-14T11:53:14.020147+0000","last_fullsized":"2024-09-14T11:53:14.020147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.020037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:43.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'151","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.179369+0000","last_change":"2024-09-14T11:53:18.179369+0000","last_active":"2024-09-14T11:53:18.179369+0000","last_peered":"2024-09-14T11:53:18.179369+0000","last_clean":"2024-09-14T11:53:18.179369+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:53:18.179369+0000","last_undegraded":"2024-09-14T11:53:18.179369+0000","last_fullsized":"2024-09-14T11:53:18.179369+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.179285+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:06.813662+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33350,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":317,"num_write":100,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.692287+0000","last_change":"2024-09-14T11:53:14.692236+0000","last_active":"2024-09-14T11:53:14.692287+0000","last_peered":"2024-09-14T11:53:14.692287+0000","last_clean":"2024-09-14T11:53:14.692287+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:53:14.692287+0000","last_undegraded":"2024-09-14T11:53:14.692287+0000","last_fullsized":"2024-09-14T11:53:14.692287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.692150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:07.310954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'125","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.376629+0000","last_change":"2024-09-14T11:53:25.376629+0000","last_active":"2024-09-14T11:53:25.376629+0000","last_peered":"2024-09-14T11:53:25.376629+0000","last_clean":"2024-09-14T11:53:25.376629+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:53:25.376629+0000","last_undegraded":"2024-09-14T11:53:25.376629+0000","last_fullsized":"2024-09-14T11:53:25.376629+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.376525+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:48.017199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'482","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.573570+0000","last_change":"2024-09-14T11:52:59.573570+0000","last_active":"2024-09-14T11:52:59.573570+0000","last_peered":"2024-09-14T11:52:59.573570+0000","last_clean":"2024-09-14T11:52:59.573570+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:52:59.573570+0000","last_undegraded":"2024-09-14T11:52:59.573570+0000","last_fullsized":"2024-09-14T11:52:59.573570+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'482","last_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_deep_scrub":"263'482","last_deep_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.573481+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:46.583273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'294","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.166071+0000","last_change":"2024-09-14T11:52:53.166071+0000","last_active":"2024-09-14T11:52:53.166071+0000","last_peered":"2024-09-14T11:52:53.166071+0000","last_clean":"2024-09-14T11:52:53.166071+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:52:53.166071+0000","last_undegraded":"2024-09-14T11:52:53.166071+0000","last_fullsized":"2024-09-14T11:52:53.166071+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.165977+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:14.077350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":821,"num_read_kb":27323,"num_write":1074,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.659489+0000","last_change":"2024-09-14T11:53:09.659489+0000","last_active":"2024-09-14T11:53:09.659489+0000","last_peered":"2024-09-14T11:53:09.659489+0000","last_clean":"2024-09-14T11:53:09.659489+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:53:09.659489+0000","last_undegraded":"2024-09-14T11:53:09.659489+0000","last_fullsized":"2024-09-14T11:53:09.659489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.659406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:21.088615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'76","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.011688+0000","last_change":"2024-09-14T11:53:19.011688+0000","last_active":"2024-09-14T11:53:19.011688+0000","last_peered":"2024-09-14T11:53:19.011688+0000","last_clean":"2024-09-14T11:53:19.011688+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:53:19.011688+0000","last_undegraded":"2024-09-14T11:53:19.011688+0000","last_fullsized":"2024-09-14T11:53:19.011688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.011587+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:34.369755+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.136517+0000","last_change":"2024-09-14T11:53:12.136517+0000","last_active":"2024-09-14T11:53:12.136517+0000","last_peered":"2024-09-14T11:53:12.136517+0000","last_clean":"2024-09-14T11:53:12.136517+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:53:12.136517+0000","last_undegraded":"2024-09-14T11:53:12.136517+0000","last_fullsized":"2024-09-14T11:53:12.136517+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.136418+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.248965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.303133+0000","last_change":"2024-09-14T11:53:25.303133+0000","last_active":"2024-09-14T11:53:25.303133+0000","last_peered":"2024-09-14T11:53:25.303133+0000","last_clean":"2024-09-14T11:53:25.303133+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:53:25.303133+0000","last_undegraded":"2024-09-14T11:53:25.303133+0000","last_fullsized":"2024-09-14T11:53:25.303133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.303031+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:08.353469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.967406+0000","last_change":"2024-09-14T11:53:02.967406+0000","last_active":"2024-09-14T11:53:02.967406+0000","last_peered":"2024-09-14T11:53:02.967406+0000","last_clean":"2024-09-14T11:53:02.967406+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:53:02.967406+0000","last_undegraded":"2024-09-14T11:53:02.967406+0000","last_fullsized":"2024-09-14T11:53:02.967406+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1013","last_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_deep_scrub":"263'1013","last_deep_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.967314+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:15.598856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'216","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.111172+0000","last_change":"2024-09-14T11:52:57.111172+0000","last_active":"2024-09-14T11:52:57.111172+0000","last_peered":"2024-09-14T11:52:57.111172+0000","last_clean":"2024-09-14T11:52:57.111172+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:52:57.111172+0000","last_undegraded":"2024-09-14T11:52:57.111172+0000","last_fullsized":"2024-09-14T11:52:57.111172+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.111027+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:22.998621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":12794,"num_write":1051,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.178019+0000","last_change":"2024-09-14T11:53:14.178019+0000","last_active":"2024-09-14T11:53:14.178019+0000","last_peered":"2024-09-14T11:53:14.178019+0000","last_clean":"2024-09-14T11:53:14.178019+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:53:14.178019+0000","last_undegraded":"2024-09-14T11:53:14.178019+0000","last_fullsized":"2024-09-14T11:53:14.178019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.177941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:58.565764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'177","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.383053+0000","last_change":"2024-09-14T11:53:18.383053+0000","last_active":"2024-09-14T11:53:18.383053+0000","last_peered":"2024-09-14T11:53:18.383053+0000","last_clean":"2024-09-14T11:53:18.383053+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:53:18.383053+0000","last_undegraded":"2024-09-14T11:53:18.383053+0000","last_fullsized":"2024-09-14T11:53:18.383053+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.382949+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:34.005583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":294,"num_write":122,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.160633+0000","last_change":"2024-09-14T11:53:20.160633+0000","last_active":"2024-09-14T11:53:20.160633+0000","last_peered":"2024-09-14T11:53:20.160633+0000","last_clean":"2024-09-14T11:53:20.160633+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:53:20.160633+0000","last_undegraded":"2024-09-14T11:53:20.160633+0000","last_fullsized":"2024-09-14T11:53:20.160633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.160545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:21.719505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'119","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.282076+0000","last_change":"2024-09-14T11:53:27.282076+0000","last_active":"2024-09-14T11:53:27.282076+0000","last_peered":"2024-09-14T11:53:27.282076+0000","last_clean":"2024-09-14T11:53:27.282076+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:53:27.282076+0000","last_undegraded":"2024-09-14T11:53:27.282076+0000","last_fullsized":"2024-09-14T11:53:27.282076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.281969+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:34.059929+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1158","reported_seq":2819,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.002594+0000","last_change":"2024-09-14T11:53:02.002594+0000","last_active":"2024-09-14T11:53:02.002594+0000","last_peered":"2024-09-14T11:53:02.002594+0000","last_clean":"2024-09-14T11:53:02.002594+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:53:02.002594+0000","last_undegraded":"2024-09-14T11:53:02.002594+0000","last_fullsized":"2024-09-14T11:53:02.002594+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.002510+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.793177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'199","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.195803+0000","last_change":"2024-09-14T11:52:59.195803+0000","last_active":"2024-09-14T11:52:59.195803+0000","last_peered":"2024-09-14T11:52:59.195803+0000","last_clean":"2024-09-14T11:52:59.195803+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:52:59.195803+0000","last_undegraded":"2024-09-14T11:52:59.195803+0000","last_fullsized":"2024-09-14T11:52:59.195803+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.195690+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:29.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":665,"num_read_kb":26583,"num_write":943,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.294788+0000","last_change":"2024-09-14T11:53:15.294788+0000","last_active":"2024-09-14T11:53:15.294788+0000","last_peered":"2024-09-14T11:53:15.294788+0000","last_clean":"2024-09-14T11:53:15.294788+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:53:15.294788+0000","last_undegraded":"2024-09-14T11:53:15.294788+0000","last_fullsized":"2024-09-14T11:53:15.294788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.294690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:16.105550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.127529+0000","last_change":"2024-09-14T11:53:15.127529+0000","last_active":"2024-09-14T11:53:15.127529+0000","last_peered":"2024-09-14T11:53:15.127529+0000","last_clean":"2024-09-14T11:53:15.127529+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:53:15.127529+0000","last_undegraded":"2024-09-14T11:53:15.127529+0000","last_fullsized":"2024-09-14T11:53:15.127529+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.127435+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:53.936595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":236,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.132137+0000","last_change":"2024-09-14T11:53:11.132137+0000","last_active":"2024-09-14T11:53:11.132137+0000","last_peered":"2024-09-14T11:53:11.132137+0000","last_clean":"2024-09-14T11:53:11.132137+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:53:11.132137+0000","last_undegraded":"2024-09-14T11:53:11.132137+0000","last_fullsized":"2024-09-14T11:53:11.132137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.132038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:40.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'126","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:03.116495+0000","last_change":"2024-09-14T11:11:14.887098+0000","last_active":"2024-09-14T11:51:03.116495+0000","last_peered":"2024-09-14T11:51:03.116495+0000","last_clean":"2024-09-14T11:51:03.116495+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:51:03.116495+0000","last_undegraded":"2024-09-14T11:51:03.116495+0000","last_fullsized":"2024-09-14T11:51:03.116495+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:13.663973+0000","last_clean_scrub_stamp":"2024-09-14T11:11:13.663973+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:00.806664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'509","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.192324+0000","last_change":"2024-09-14T11:53:06.192324+0000","last_active":"2024-09-14T11:53:06.192324+0000","last_peered":"2024-09-14T11:53:06.192324+0000","last_clean":"2024-09-14T11:53:06.192324+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:53:06.192324+0000","last_undegraded":"2024-09-14T11:53:06.192324+0000","last_fullsized":"2024-09-14T11:53:06.192324+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.192233+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.491268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'219","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.233234+0000","last_change":"2024-09-14T11:52:56.233144+0000","last_active":"2024-09-14T11:52:56.233234+0000","last_peered":"2024-09-14T11:52:56.233234+0000","last_clean":"2024-09-14T11:52:56.233234+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:56.233234+0000","last_undegraded":"2024-09-14T11:52:56.233234+0000","last_fullsized":"2024-09-14T11:52:56.233234+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.232989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:07.476932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":7926,"num_write":973,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.970245+0000","last_change":"2024-09-14T11:53:12.970245+0000","last_active":"2024-09-14T11:53:12.970245+0000","last_peered":"2024-09-14T11:53:12.970245+0000","last_clean":"2024-09-14T11:53:12.970245+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:53:12.970245+0000","last_undegraded":"2024-09-14T11:53:12.970245+0000","last_fullsized":"2024-09-14T11:53:12.970245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.970152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.911318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'110","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.124391+0000","last_change":"2024-09-14T11:53:22.124391+0000","last_active":"2024-09-14T11:53:22.124391+0000","last_peered":"2024-09-14T11:53:22.124391+0000","last_clean":"2024-09-14T11:53:22.124391+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:53:22.124391+0000","last_undegraded":"2024-09-14T11:53:22.124391+0000","last_fullsized":"2024-09-14T11:53:22.124391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.124277+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:22.955274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":208,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.012861+0000","last_change":"2024-09-14T11:53:20.012861+0000","last_active":"2024-09-14T11:53:20.012861+0000","last_peered":"2024-09-14T11:53:20.012861+0000","last_clean":"2024-09-14T11:53:20.012861+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:53:20.012861+0000","last_undegraded":"2024-09-14T11:53:20.012861+0000","last_fullsized":"2024-09-14T11:53:20.012861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.012748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:47.176018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'192","reported_seq":1650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.272832+0000","last_change":"2024-09-14T11:53:26.272832+0000","last_active":"2024-09-14T11:53:26.272832+0000","last_peered":"2024-09-14T11:53:26.272832+0000","last_clean":"2024-09-14T11:53:26.272832+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:53:26.272832+0000","last_undegraded":"2024-09-14T11:53:26.272832+0000","last_fullsized":"2024-09-14T11:53:26.272832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.272731+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:08.934882+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.047117+0000","last_change":"2024-09-14T11:53:01.047117+0000","last_active":"2024-09-14T11:53:01.047117+0000","last_peered":"2024-09-14T11:53:01.047117+0000","last_clean":"2024-09-14T11:53:01.047117+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:53:01.047117+0000","last_undegraded":"2024-09-14T11:53:01.047117+0000","last_fullsized":"2024-09-14T11:53:01.047117+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.047027+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:29.624414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'230","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.174275+0000","last_change":"2024-09-14T11:52:54.174275+0000","last_active":"2024-09-14T11:52:54.174275+0000","last_peered":"2024-09-14T11:52:54.174275+0000","last_clean":"2024-09-14T11:52:54.174275+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:52:54.174275+0000","last_undegraded":"2024-09-14T11:52:54.174275+0000","last_fullsized":"2024-09-14T11:52:54.174275+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.174100+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:15.196149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1057,"num_read_kb":144594,"num_write":1045,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.621816+0000","last_change":"2024-09-14T11:53:08.621816+0000","last_active":"2024-09-14T11:53:08.621816+0000","last_peered":"2024-09-14T11:53:08.621816+0000","last_clean":"2024-09-14T11:53:08.621816+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:53:08.621816+0000","last_undegraded":"2024-09-14T11:53:08.621816+0000","last_fullsized":"2024-09-14T11:53:08.621816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.621675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:07.357313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":743,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.983558+0000","last_change":"2024-09-14T11:53:16.983558+0000","last_active":"2024-09-14T11:53:16.983558+0000","last_peered":"2024-09-14T11:53:16.983558+0000","last_clean":"2024-09-14T11:53:16.983558+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:53:16.983558+0000","last_undegraded":"2024-09-14T11:53:16.983558+0000","last_fullsized":"2024-09-14T11:53:16.983558+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.983469+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:33.140461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":208,"num_write":106,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.118805+0000","last_change":"2024-09-14T11:53:22.118805+0000","last_active":"2024-09-14T11:53:22.118805+0000","last_peered":"2024-09-14T11:53:22.118805+0000","last_clean":"2024-09-14T11:53:22.118805+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:53:22.118805+0000","last_undegraded":"2024-09-14T11:53:22.118805+0000","last_fullsized":"2024-09-14T11:53:22.118805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.118721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:09.915267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'136","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.055980+0000","last_change":"2024-09-14T11:53:24.055980+0000","last_active":"2024-09-14T11:53:24.055980+0000","last_peered":"2024-09-14T11:53:24.055980+0000","last_clean":"2024-09-14T11:53:24.055980+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:53:24.055980+0000","last_undegraded":"2024-09-14T11:53:24.055980+0000","last_fullsized":"2024-09-14T11:53:24.055980+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.055885+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:02.367890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'852","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.568807+0000","last_change":"2024-09-14T11:53:05.568807+0000","last_active":"2024-09-14T11:53:05.568807+0000","last_peered":"2024-09-14T11:53:05.568807+0000","last_clean":"2024-09-14T11:53:05.568807+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:53:05.568807+0000","last_undegraded":"2024-09-14T11:53:05.568807+0000","last_fullsized":"2024-09-14T11:53:05.568807+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'852","last_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_deep_scrub":"263'852","last_deep_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.568712+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.647100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'248","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.065807+0000","last_change":"2024-09-14T11:52:56.065807+0000","last_active":"2024-09-14T11:52:56.065807+0000","last_peered":"2024-09-14T11:52:56.065807+0000","last_clean":"2024-09-14T11:52:56.065807+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:52:56.065807+0000","last_undegraded":"2024-09-14T11:52:56.065807+0000","last_fullsized":"2024-09-14T11:52:56.065807+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'248","last_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_deep_scrub":"263'248","last_deep_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.065655+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:38.524060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":737,"num_read_kb":42950,"num_write":1092,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'568","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.610451+0000","last_change":"2024-09-14T11:53:04.610451+0000","last_active":"2024-09-14T11:53:04.610451+0000","last_peered":"2024-09-14T11:53:04.610451+0000","last_clean":"2024-09-14T11:53:04.610451+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:53:04.610451+0000","last_undegraded":"2024-09-14T11:53:04.610451+0000","last_fullsized":"2024-09-14T11:53:04.610451+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'568","last_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_deep_scrub":"263'568","last_deep_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.610328+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:59.992487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1797,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'180","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.720382+0000","last_change":"2024-09-14T11:52:52.720382+0000","last_active":"2024-09-14T11:52:52.720382+0000","last_peered":"2024-09-14T11:52:52.720382+0000","last_clean":"2024-09-14T11:52:52.720382+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:52:52.720382+0000","last_undegraded":"2024-09-14T11:52:52.720382+0000","last_fullsized":"2024-09-14T11:52:52.720382+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.720305+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:22.441860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":43631,"num_write":872,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'531","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.174316+0000","last_change":"2024-09-14T11:53:06.174316+0000","last_active":"2024-09-14T11:53:06.174316+0000","last_peered":"2024-09-14T11:53:06.174316+0000","last_clean":"2024-09-14T11:53:06.174316+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:53:06.174316+0000","last_undegraded":"2024-09-14T11:53:06.174316+0000","last_fullsized":"2024-09-14T11:53:06.174316+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'531","last_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_deep_scrub":"263'531","last_deep_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.174226+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:29.796542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'217","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.151067+0000","last_change":"2024-09-14T11:52:58.151067+0000","last_active":"2024-09-14T11:52:58.151067+0000","last_peered":"2024-09-14T11:52:58.151067+0000","last_clean":"2024-09-14T11:52:58.151067+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:52:58.151067+0000","last_undegraded":"2024-09-14T11:52:58.151067+0000","last_fullsized":"2024-09-14T11:52:58.151067+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.150955+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:54.421678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":22878,"num_write":1010,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'805","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.635510+0000","last_change":"2024-09-14T11:53:03.635510+0000","last_active":"2024-09-14T11:53:03.635510+0000","last_peered":"2024-09-14T11:53:03.635510+0000","last_clean":"2024-09-14T11:53:03.635510+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:53:03.635510+0000","last_undegraded":"2024-09-14T11:53:03.635510+0000","last_fullsized":"2024-09-14T11:53:03.635510+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.635426+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:26.207368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.172379+0000","last_change":"2024-09-14T11:52:55.172379+0000","last_active":"2024-09-14T11:52:55.172379+0000","last_peered":"2024-09-14T11:52:55.172379+0000","last_clean":"2024-09-14T11:52:55.172379+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:52:55.172379+0000","last_undegraded":"2024-09-14T11:52:55.172379+0000","last_fullsized":"2024-09-14T11:52:55.172379+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.172292+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.954230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":47732,"num_write":877,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1009","reported_seq":2736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.107587+0000","last_change":"2024-09-14T11:53:09.107587+0000","last_active":"2024-09-14T11:53:09.107587+0000","last_peered":"2024-09-14T11:53:09.107587+0000","last_clean":"2024-09-14T11:53:09.107587+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:53:09.107587+0000","last_undegraded":"2024-09-14T11:53:09.107587+0000","last_fullsized":"2024-09-14T11:53:09.107587+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1009","last_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_deep_scrub":"263'1009","last_deep_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.107505+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:57.020223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'279","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.244702+0000","last_change":"2024-09-14T11:52:57.244702+0000","last_active":"2024-09-14T11:52:57.244702+0000","last_peered":"2024-09-14T11:52:57.244702+0000","last_clean":"2024-09-14T11:52:57.244702+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:57.244702+0000","last_undegraded":"2024-09-14T11:52:57.244702+0000","last_fullsized":"2024-09-14T11:52:57.244702+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.244601+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:06.713036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":719,"num_read_kb":31338,"num_write":1105,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'444","reported_seq":1991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.964108+0000","last_change":"2024-09-14T11:53:03.964108+0000","last_active":"2024-09-14T11:53:03.964108+0000","last_peered":"2024-09-14T11:53:03.964108+0000","last_clean":"2024-09-14T11:53:03.964108+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:53:03.964108+0000","last_undegraded":"2024-09-14T11:53:03.964108+0000","last_fullsized":"2024-09-14T11:53:03.964108+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.963982+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:15.186551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'261","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.641663+0000","last_change":"2024-09-14T11:52:53.641663+0000","last_active":"2024-09-14T11:52:53.641663+0000","last_peered":"2024-09-14T11:52:53.641663+0000","last_clean":"2024-09-14T11:52:53.641663+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:52:53.641663+0000","last_undegraded":"2024-09-14T11:52:53.641663+0000","last_fullsized":"2024-09-14T11:52:53.641663+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.641559+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:15.729013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1027,"num_read_kb":155043,"num_write":1124,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1176","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.128014+0000","last_change":"2024-09-14T11:53:08.128014+0000","last_active":"2024-09-14T11:53:08.128014+0000","last_peered":"2024-09-14T11:53:08.128014+0000","last_clean":"2024-09-14T11:53:08.128014+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:53:08.128014+0000","last_undegraded":"2024-09-14T11:53:08.128014+0000","last_fullsized":"2024-09-14T11:53:08.128014+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1176","last_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_deep_scrub":"263'1176","last_deep_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.127935+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:40.579497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'242","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094291+0000","last_change":"2024-09-14T11:52:57.094291+0000","last_active":"2024-09-14T11:52:57.094291+0000","last_peered":"2024-09-14T11:52:57.094291+0000","last_clean":"2024-09-14T11:52:57.094291+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:52:57.094291+0000","last_undegraded":"2024-09-14T11:52:57.094291+0000","last_fullsized":"2024-09-14T11:52:57.094291+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.094079+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:41.823322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159825,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":17781,"num_write":1116,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'429","reported_seq":1964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.075754+0000","last_change":"2024-09-14T11:53:01.075754+0000","last_active":"2024-09-14T11:53:01.075754+0000","last_peered":"2024-09-14T11:53:01.075754+0000","last_clean":"2024-09-14T11:53:01.075754+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:53:01.075754+0000","last_undegraded":"2024-09-14T11:53:01.075754+0000","last_fullsized":"2024-09-14T11:53:01.075754+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.075650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.154836+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'185","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.248333+0000","last_change":"2024-09-14T11:52:59.248333+0000","last_active":"2024-09-14T11:52:59.248333+0000","last_peered":"2024-09-14T11:52:59.248333+0000","last_clean":"2024-09-14T11:52:59.248333+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:52:59.248333+0000","last_undegraded":"2024-09-14T11:52:59.248333+0000","last_fullsized":"2024-09-14T11:52:59.248333+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.248194+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:41.711860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":12452,"num_write":860,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1183","reported_seq":2671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.137570+0000","last_change":"2024-09-14T11:53:05.137512+0000","last_active":"2024-09-14T11:53:05.137570+0000","last_peered":"2024-09-14T11:53:05.137570+0000","last_clean":"2024-09-14T11:53:05.137570+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:53:05.137570+0000","last_undegraded":"2024-09-14T11:53:05.137570+0000","last_fullsized":"2024-09-14T11:53:05.137570+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1183","last_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_deep_scrub":"263'1183","last_deep_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.137429+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:37.154275+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'246","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.181196+0000","last_change":"2024-09-14T11:53:00.181196+0000","last_active":"2024-09-14T11:53:00.181196+0000","last_peered":"2024-09-14T11:53:00.181196+0000","last_clean":"2024-09-14T11:53:00.181196+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:53:00.181196+0000","last_undegraded":"2024-09-14T11:53:00.181196+0000","last_fullsized":"2024-09-14T11:53:00.181196+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.181003+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:48.772246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":3825,"num_write":1017,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'761","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.984873+0000","last_change":"2024-09-14T11:53:05.984808+0000","last_active":"2024-09-14T11:53:05.984873+0000","last_peered":"2024-09-14T11:53:05.984873+0000","last_clean":"2024-09-14T11:53:05.984873+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:53:05.984873+0000","last_undegraded":"2024-09-14T11:53:05.984873+0000","last_fullsized":"2024-09-14T11:53:05.984873+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.984718+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.922626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'244","reported_seq":879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.260968+0000","last_change":"2024-09-14T11:52:58.260968+0000","last_active":"2024-09-14T11:52:58.260968+0000","last_peered":"2024-09-14T11:52:58.260968+0000","last_clean":"2024-09-14T11:52:58.260968+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:52:58.260968+0000","last_undegraded":"2024-09-14T11:52:58.260968+0000","last_fullsized":"2024-09-14T11:52:58.260968+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.260863+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:49.114336+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":9466,"num_write":1107,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.619266+0000","last_change":"2024-09-14T11:52:56.619266+0000","last_active":"2024-09-14T11:52:56.619266+0000","last_peered":"2024-09-14T11:52:56.619266+0000","last_clean":"2024-09-14T11:52:56.619266+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:52:56.619266+0000","last_undegraded":"2024-09-14T11:52:56.619266+0000","last_fullsized":"2024-09-14T11:52:56.619266+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'693","last_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_deep_scrub":"263'693","last_deep_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.619176+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:46.303405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'230","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.693886+0000","last_change":"2024-09-14T11:52:53.693886+0000","last_active":"2024-09-14T11:52:53.693886+0000","last_peered":"2024-09-14T11:52:53.693886+0000","last_clean":"2024-09-14T11:52:53.693886+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:52:53.693886+0000","last_undegraded":"2024-09-14T11:52:53.693886+0000","last_fullsized":"2024-09-14T11:52:53.693886+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.693782+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:02.123870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":774,"num_read_kb":20654,"num_write":1086,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'572","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.004654+0000","last_change":"2024-09-14T11:53:05.004654+0000","last_active":"2024-09-14T11:53:05.004654+0000","last_peered":"2024-09-14T11:53:05.004654+0000","last_clean":"2024-09-14T11:53:05.004654+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:53:05.004654+0000","last_undegraded":"2024-09-14T11:53:05.004654+0000","last_fullsized":"2024-09-14T11:53:05.004654+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'572","last_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_deep_scrub":"263'572","last_deep_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.004567+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:12.480296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'179","reported_seq":810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.170135+0000","last_change":"2024-09-14T11:52:56.170135+0000","last_active":"2024-09-14T11:52:56.170135+0000","last_peered":"2024-09-14T11:52:56.170135+0000","last_clean":"2024-09-14T11:52:56.170135+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:52:56.170135+0000","last_undegraded":"2024-09-14T11:52:56.170135+0000","last_fullsized":"2024-09-14T11:52:56.170135+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.169996+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:19.783821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254527,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":19362,"num_write":819,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'504","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.181330+0000","last_change":"2024-09-14T11:53:10.181330+0000","last_active":"2024-09-14T11:53:10.181330+0000","last_peered":"2024-09-14T11:53:10.181330+0000","last_clean":"2024-09-14T11:53:10.181330+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:53:10.181330+0000","last_undegraded":"2024-09-14T11:53:10.181330+0000","last_fullsized":"2024-09-14T11:53:10.181330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.181245+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:04.696409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'219","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073972+0000","last_change":"2024-09-14T11:52:54.073972+0000","last_active":"2024-09-14T11:52:54.073972+0000","last_peered":"2024-09-14T11:52:54.073972+0000","last_clean":"2024-09-14T11:52:54.073972+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:52:54.073972+0000","last_undegraded":"2024-09-14T11:52:54.073972+0000","last_fullsized":"2024-09-14T11:52:54.073972+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073820+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.734459+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152081,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":22963,"num_write":995,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1731","reported_seq":3543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.120989+0000","last_change":"2024-09-14T11:53:04.120989+0000","last_active":"2024-09-14T11:53:04.120989+0000","last_peered":"2024-09-14T11:53:04.120989+0000","last_clean":"2024-09-14T11:53:04.120989+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:53:04.120989+0000","last_undegraded":"2024-09-14T11:53:04.120989+0000","last_fullsized":"2024-09-14T11:53:04.120989+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1731","last_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_deep_scrub":"263'1731","last_deep_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.120897+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":1700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.055522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'220","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.202838+0000","last_change":"2024-09-14T11:53:09.202838+0000","last_active":"2024-09-14T11:53:09.202838+0000","last_peered":"2024-09-14T11:53:09.202838+0000","last_clean":"2024-09-14T11:53:09.202838+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:53:09.202838+0000","last_undegraded":"2024-09-14T11:53:09.202838+0000","last_fullsized":"2024-09-14T11:53:09.202838+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.202630+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:51.781845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":9299,"num_write":1026,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'392","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.127322+0000","last_change":"2024-09-14T11:53:10.127322+0000","last_active":"2024-09-14T11:53:10.127322+0000","last_peered":"2024-09-14T11:53:10.127322+0000","last_clean":"2024-09-14T11:53:10.127322+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:53:10.127322+0000","last_undegraded":"2024-09-14T11:53:10.127322+0000","last_fullsized":"2024-09-14T11:53:10.127322+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.127233+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:01.279892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648290+0000","last_change":"2024-09-14T11:52:54.648221+0000","last_active":"2024-09-14T11:52:54.648290+0000","last_peered":"2024-09-14T11:52:54.648290+0000","last_clean":"2024-09-14T11:52:54.648290+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:52:54.648290+0000","last_undegraded":"2024-09-14T11:52:54.648290+0000","last_fullsized":"2024-09-14T11:52:54.648290+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648125+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:31.594989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":67022,"num_write":1011,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'461","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.119760+0000","last_change":"2024-09-14T11:53:05.119760+0000","last_active":"2024-09-14T11:53:05.119760+0000","last_peered":"2024-09-14T11:53:05.119760+0000","last_clean":"2024-09-14T11:53:05.119760+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:53:05.119760+0000","last_undegraded":"2024-09-14T11:53:05.119760+0000","last_fullsized":"2024-09-14T11:53:05.119760+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'461","last_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_deep_scrub":"263'461","last_deep_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.119654+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:53.766096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'211","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.651909+0000","last_change":"2024-09-14T11:52:55.651909+0000","last_active":"2024-09-14T11:52:55.651909+0000","last_peered":"2024-09-14T11:52:55.651909+0000","last_clean":"2024-09-14T11:52:55.651909+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:52:55.651909+0000","last_undegraded":"2024-09-14T11:52:55.651909+0000","last_fullsized":"2024-09-14T11:52:55.651909+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.651812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:24.237587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":27752,"num_write":889,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'207","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.136326+0000","last_change":"2024-09-14T11:53:01.136253+0000","last_active":"2024-09-14T11:53:01.136326+0000","last_peered":"2024-09-14T11:53:01.136326+0000","last_clean":"2024-09-14T11:53:01.136326+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:53:01.136326+0000","last_undegraded":"2024-09-14T11:53:01.136326+0000","last_fullsized":"2024-09-14T11:53:01.136326+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.136124+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.376828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":2089,"num_write":994,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'476","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.095010+0000","last_change":"2024-09-14T11:53:06.095010+0000","last_active":"2024-09-14T11:53:06.095010+0000","last_peered":"2024-09-14T11:53:06.095010+0000","last_clean":"2024-09-14T11:53:06.095010+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:53:06.095010+0000","last_undegraded":"2024-09-14T11:53:06.095010+0000","last_fullsized":"2024-09-14T11:53:06.095010+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.094919+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:39.988396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":919,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'262","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.594608+0000","last_change":"2024-09-14T11:53:00.594508+0000","last_active":"2024-09-14T11:53:00.594608+0000","last_peered":"2024-09-14T11:53:00.594608+0000","last_clean":"2024-09-14T11:53:00.594608+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:53:00.594608+0000","last_undegraded":"2024-09-14T11:53:00.594608+0000","last_fullsized":"2024-09-14T11:53:00.594608+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.594344+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:04.083599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":42624,"num_write":1182,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'383","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.201899+0000","last_change":"2024-09-14T11:53:07.201899+0000","last_active":"2024-09-14T11:53:07.201899+0000","last_peered":"2024-09-14T11:53:07.201899+0000","last_clean":"2024-09-14T11:53:07.201899+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:53:07.201899+0000","last_undegraded":"2024-09-14T11:53:07.201899+0000","last_fullsized":"2024-09-14T11:53:07.201899+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.201806+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:07.993574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1566,"ondisk_log_size":1566,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":429920,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8367,"num_read_kb":10850,"num_write":5651,"num_write_kb":2859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701838,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2871,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4116,"ondisk_log_size":4116,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":29484888,"num_objects":168,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":42482,"num_read_kb":2539626,"num_write":64328,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41172992,"data_stored":41172992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168157,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":181387,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542663,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272784,"kb_used_data":11136,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94099056,"statfs":{"total":96636764160,"available":96357433344,"internally_reserved":0,"allocated":11403264,"data_stored":9409551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542663,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250432,"kb_used_data":8240,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94121408,"statfs":{"total":96636764160,"available":96380321792,"internally_reserved":0,"allocated":8437760,"data_stored":6489937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":247986630},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542661,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107580,"kb_used_data":8364,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":8564736,"data_stored":6565787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542661,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124444,"kb_used_data":8588,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94247396,"statfs":{"total":96636764160,"available":96509333504,"internally_reserved":0,"allocated":8794112,"data_stored":6869156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":118618566},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542660,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268396,"kb_used_data":8156,"kb_used_omap":1,"kb_used_meta":260222,"kb_avail":94103444,"statfs":{"total":96636764160,"available":96361926656,"internally_reserved":0,"allocated":8351744,"data_stored":6374693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":266467783},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542661,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94580,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94277260,"statfs":{"total":96636764160,"available":96539914240,"internally_reserved":0,"allocated":9474048,"data_stored":7547937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542661,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153580,"kb_used_data":10012,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94218260,"statfs":{"total":96636764160,"available":96479498240,"internally_reserved":0,"allocated":10252288,"data_stored":8286792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542662,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284668,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94087172,"statfs":{"total":96636764160,"available":96345264128,"internally_reserved":0,"allocated":10858496,"data_stored":8869545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6021120,"data_stored":6021120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6029312,"data_stored":6029312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4116480,"data_stored":4116480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4612096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":4308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4231168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":6561792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:33.467 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.467 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.467 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.467 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.467 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.468 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.469 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.470 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.471 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.472 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.473 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.474 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.475 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:26:00.989096+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=26, tm_sec=0, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.476 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.477 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:27:42.815576+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.477 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.477 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.477 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:27:45.848385+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=27, tm_sec=45, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.479 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.479 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.479 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.480 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:11:13.663973+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:33.480 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:53:53.482 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:53:53.820 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:53:53.836 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:53:53.839 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1551,"stamp":"2024-09-14T11:53:53.100289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30522513,"num_objects":632,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":299502,"num_read_kb":3128085,"num_write":146428,"num_write_kb":2544950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740828,"num_omap_keys":1783,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12709,"ondisk_log_size":12709,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523184,"kb_used_data":74352,"kb_used_omap":12,"kb_used_meta":1448691,"kb_avail":753451536,"statfs":{"total":773094113280,"available":771534372864,"internally_reserved":0,"allocated":76136448,"data_stored":60413398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1483460145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005243"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.268935+0000","last_change":"2024-09-14T11:53:39.268935+0000","last_active":"2024-09-14T11:53:39.268935+0000","last_peered":"2024-09-14T11:53:39.268935+0000","last_clean":"2024-09-14T11:53:39.268935+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:53:39.268935+0000","last_undegraded":"2024-09-14T11:53:39.268935+0000","last_fullsized":"2024-09-14T11:53:39.268935+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:39.268840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:39.268840+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.268840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.846487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.291534+0000","last_change":"2024-09-14T11:53:36.291534+0000","last_active":"2024-09-14T11:53:36.291534+0000","last_peered":"2024-09-14T11:53:36.291534+0000","last_clean":"2024-09-14T11:53:36.291534+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:53:36.291534+0000","last_undegraded":"2024-09-14T11:53:36.291534+0000","last_fullsized":"2024-09-14T11:53:36.291534+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:36.291426+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:36.291426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.291426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:25.769971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.276599+0000","last_change":"2024-09-14T11:53:39.276599+0000","last_active":"2024-09-14T11:53:39.276599+0000","last_peered":"2024-09-14T11:53:39.276599+0000","last_clean":"2024-09-14T11:53:39.276599+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:53:39.276599+0000","last_undegraded":"2024-09-14T11:53:39.276599+0000","last_fullsized":"2024-09-14T11:53:39.276599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:39.276509+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:39.276509+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.276509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:48.565240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.167519+0000","last_change":"2024-09-14T11:53:35.167519+0000","last_active":"2024-09-14T11:53:35.167519+0000","last_peered":"2024-09-14T11:53:35.167519+0000","last_clean":"2024-09-14T11:53:35.167519+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:53:35.167519+0000","last_undegraded":"2024-09-14T11:53:35.167519+0000","last_fullsized":"2024-09-14T11:53:35.167519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:53:35.167439+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:53:35.167439+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.167439+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:09.931336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.733072+0000","last_change":"2024-09-14T11:53:21.733014+0000","last_active":"2024-09-14T11:53:21.733072+0000","last_peered":"2024-09-14T11:53:21.733072+0000","last_clean":"2024-09-14T11:53:21.733072+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:53:21.733072+0000","last_undegraded":"2024-09-14T11:53:21.733072+0000","last_fullsized":"2024-09-14T11:53:21.733072+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.732931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:48.663290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.112664+0000","last_change":"2024-09-14T11:53:37.112664+0000","last_active":"2024-09-14T11:53:37.112664+0000","last_peered":"2024-09-14T11:53:37.112664+0000","last_clean":"2024-09-14T11:53:37.112664+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:53:37.112664+0000","last_undegraded":"2024-09-14T11:53:37.112664+0000","last_fullsized":"2024-09-14T11:53:37.112664+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:37.112565+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:37.112565+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.112565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:37.378624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.761554+0000","last_change":"2024-09-14T11:53:25.761554+0000","last_active":"2024-09-14T11:53:25.761554+0000","last_peered":"2024-09-14T11:53:25.761554+0000","last_clean":"2024-09-14T11:53:25.761554+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:53:25.761554+0000","last_undegraded":"2024-09-14T11:53:25.761554+0000","last_fullsized":"2024-09-14T11:53:25.761554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.761462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:51.621198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.588869+0000","last_change":"2024-09-14T11:53:13.588869+0000","last_active":"2024-09-14T11:53:13.588869+0000","last_peered":"2024-09-14T11:53:13.588869+0000","last_clean":"2024-09-14T11:53:13.588869+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:53:13.588869+0000","last_undegraded":"2024-09-14T11:53:13.588869+0000","last_fullsized":"2024-09-14T11:53:13.588869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.588787+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:59.522176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.148490+0000","last_change":"2024-09-14T11:53:28.148490+0000","last_active":"2024-09-14T11:53:28.148490+0000","last_peered":"2024-09-14T11:53:28.148490+0000","last_clean":"2024-09-14T11:53:28.148490+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:53:28.148490+0000","last_undegraded":"2024-09-14T11:53:28.148490+0000","last_fullsized":"2024-09-14T11:53:28.148490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.148399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:17.010275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'10","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.286174+0000","last_change":"2024-09-14T11:53:43.286174+0000","last_active":"2024-09-14T11:53:43.286174+0000","last_peered":"2024-09-14T11:53:43.286174+0000","last_clean":"2024-09-14T11:53:43.286174+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:53:43.286174+0000","last_undegraded":"2024-09-14T11:53:43.286174+0000","last_fullsized":"2024-09-14T11:53:43.286174+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:43.286075+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:43.286075+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.286075+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:21.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":15373,"num_write":10,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.676980+0000","last_change":"2024-09-14T11:53:17.676892+0000","last_active":"2024-09-14T11:53:17.676980+0000","last_peered":"2024-09-14T11:53:17.676980+0000","last_clean":"2024-09-14T11:53:17.676980+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:53:17.676980+0000","last_undegraded":"2024-09-14T11:53:17.676980+0000","last_fullsized":"2024-09-14T11:53:17.676980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.676763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:55.098276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.197119+0000","last_change":"2024-09-14T11:53:34.197119+0000","last_active":"2024-09-14T11:53:34.197119+0000","last_peered":"2024-09-14T11:53:34.197119+0000","last_clean":"2024-09-14T11:53:34.197119+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:53:34.197119+0000","last_undegraded":"2024-09-14T11:53:34.197119+0000","last_fullsized":"2024-09-14T11:53:34.197119+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:53:34.197029+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:53:34.197029+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.197029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:40.070115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:43.933161+0000","last_change":"2024-09-14T11:38:32.854417+0000","last_active":"2024-09-14T11:50:43.933161+0000","last_peered":"2024-09-14T11:50:43.933161+0000","last_clean":"2024-09-14T11:50:43.933161+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:50:43.933161+0000","last_undegraded":"2024-09-14T11:50:43.933161+0000","last_fullsized":"2024-09-14T11:50:43.933161+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.260272+0000","last_change":"2024-09-14T11:53:48.260272+0000","last_active":"2024-09-14T11:53:48.260272+0000","last_peered":"2024-09-14T11:53:48.260272+0000","last_clean":"2024-09-14T11:53:48.260272+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:53:48.260272+0000","last_undegraded":"2024-09-14T11:53:48.260272+0000","last_fullsized":"2024-09-14T11:53:48.260272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:53:48.260168+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:53:48.260168+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.260168+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:47.697791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.092915+0000","last_change":"2024-09-14T11:53:33.092915+0000","last_active":"2024-09-14T11:53:33.092915+0000","last_peered":"2024-09-14T11:53:33.092915+0000","last_clean":"2024-09-14T11:53:33.092915+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:53:33.092915+0000","last_undegraded":"2024-09-14T11:53:33.092915+0000","last_fullsized":"2024-09-14T11:53:33.092915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:33.092811+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:33.092811+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.092811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:17.690793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.236205+0000","last_change":"2024-09-14T11:53:38.236205+0000","last_active":"2024-09-14T11:53:38.236205+0000","last_peered":"2024-09-14T11:53:38.236205+0000","last_clean":"2024-09-14T11:53:38.236205+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:53:38.236205+0000","last_undegraded":"2024-09-14T11:53:38.236205+0000","last_fullsized":"2024-09-14T11:53:38.236205+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-14T11:53:38.236095+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-14T11:53:38.236095+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.236095+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:41.680178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932505+0000","last_change":"2024-09-14T11:38:32.856837+0000","last_active":"2024-09-14T11:50:38.932505+0000","last_peered":"2024-09-14T11:50:38.932505+0000","last_clean":"2024-09-14T11:50:38.932505+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:50:38.932505+0000","last_undegraded":"2024-09-14T11:50:38.932505+0000","last_fullsized":"2024-09-14T11:50:38.932505+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:26.034585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.279915+0000","last_change":"2024-09-14T11:53:33.279915+0000","last_active":"2024-09-14T11:53:33.279915+0000","last_peered":"2024-09-14T11:53:33.279915+0000","last_clean":"2024-09-14T11:53:33.279915+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:53:33.279915+0000","last_undegraded":"2024-09-14T11:53:33.279915+0000","last_fullsized":"2024-09-14T11:53:33.279915+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:33.279835+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:33.279835+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.279835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:24.327542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.273383+0000","last_change":"2024-09-14T11:53:40.273383+0000","last_active":"2024-09-14T11:53:40.273383+0000","last_peered":"2024-09-14T11:53:40.273383+0000","last_clean":"2024-09-14T11:53:40.273383+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:53:40.273383+0000","last_undegraded":"2024-09-14T11:53:40.273383+0000","last_fullsized":"2024-09-14T11:53:40.273383+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:40.273301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:40.273301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.273301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:48.524390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.221788+0000","last_change":"2024-09-14T11:53:37.221788+0000","last_active":"2024-09-14T11:53:37.221788+0000","last_peered":"2024-09-14T11:53:37.221788+0000","last_clean":"2024-09-14T11:53:37.221788+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:53:37.221788+0000","last_undegraded":"2024-09-14T11:53:37.221788+0000","last_fullsized":"2024-09-14T11:53:37.221788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-14T11:53:37.221704+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-14T11:53:37.221704+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.221704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:39.531965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.777792+0000","last_change":"2024-09-14T11:53:33.777792+0000","last_active":"2024-09-14T11:53:33.777792+0000","last_peered":"2024-09-14T11:53:33.777792+0000","last_clean":"2024-09-14T11:53:33.777792+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:53:33.777792+0000","last_undegraded":"2024-09-14T11:53:33.777792+0000","last_fullsized":"2024-09-14T11:53:33.777792+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:33.777723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:33.777723+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.777723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:51.890573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.186792+0000","last_change":"2024-09-14T11:53:26.186792+0000","last_active":"2024-09-14T11:53:26.186792+0000","last_peered":"2024-09-14T11:53:26.186792+0000","last_clean":"2024-09-14T11:53:26.186792+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:53:26.186792+0000","last_undegraded":"2024-09-14T11:53:26.186792+0000","last_fullsized":"2024-09-14T11:53:26.186792+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.186683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.326191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.114698+0000","last_change":"2024-09-14T11:53:31.114698+0000","last_active":"2024-09-14T11:53:31.114698+0000","last_peered":"2024-09-14T11:53:31.114698+0000","last_clean":"2024-09-14T11:53:31.114698+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:53:31.114698+0000","last_undegraded":"2024-09-14T11:53:31.114698+0000","last_fullsized":"2024-09-14T11:53:31.114698+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:31.114584+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:31.114584+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.114584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:48.525313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.164005+0000","last_change":"2024-09-14T11:53:19.163945+0000","last_active":"2024-09-14T11:53:19.164005+0000","last_peered":"2024-09-14T11:53:19.164005+0000","last_clean":"2024-09-14T11:53:19.164005+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:53:19.164005+0000","last_undegraded":"2024-09-14T11:53:19.164005+0000","last_fullsized":"2024-09-14T11:53:19.164005+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.163864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:12.503202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056038+0000","last_change":"2024-09-14T11:38:32.853155+0000","last_active":"2024-09-14T11:51:04.056038+0000","last_peered":"2024-09-14T11:51:04.056038+0000","last_clean":"2024-09-14T11:51:04.056038+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:51:04.056038+0000","last_undegraded":"2024-09-14T11:51:04.056038+0000","last_fullsized":"2024-09-14T11:51:04.056038+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'14","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.213836+0000","last_change":"2024-09-14T11:53:25.213836+0000","last_active":"2024-09-14T11:53:25.213836+0000","last_peered":"2024-09-14T11:53:25.213836+0000","last_clean":"2024-09-14T11:53:25.213836+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:53:25.213836+0000","last_undegraded":"2024-09-14T11:53:25.213836+0000","last_fullsized":"2024-09-14T11:53:25.213836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.213730+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:10.155497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19456,"num_write":24,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.097941+0000","last_change":"2024-09-14T11:53:32.097941+0000","last_active":"2024-09-14T11:53:32.097941+0000","last_peered":"2024-09-14T11:53:32.097941+0000","last_clean":"2024-09-14T11:53:32.097941+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:53:32.097941+0000","last_undegraded":"2024-09-14T11:53:32.097941+0000","last_fullsized":"2024-09-14T11:53:32.097941+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:53:32.097856+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:53:32.097856+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.097856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:34.270158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5174,"num_write":14,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.212192+0000","last_change":"2024-09-14T11:53:33.212192+0000","last_active":"2024-09-14T11:53:33.212192+0000","last_peered":"2024-09-14T11:53:33.212192+0000","last_clean":"2024-09-14T11:53:33.212192+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:53:33.212192+0000","last_undegraded":"2024-09-14T11:53:33.212192+0000","last_fullsized":"2024-09-14T11:53:33.212192+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-14T11:53:33.212071+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-14T11:53:33.212071+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.212071+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:31.092690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:51:04.056086+0000","last_change":"2024-09-14T11:38:32.857369+0000","last_active":"2024-09-14T11:51:04.056086+0000","last_peered":"2024-09-14T11:51:04.056086+0000","last_clean":"2024-09-14T11:51:04.056086+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:51:04.056086+0000","last_undegraded":"2024-09-14T11:51:04.056086+0000","last_fullsized":"2024-09-14T11:51:04.056086+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.289336+0000","last_change":"2024-09-14T11:53:35.289264+0000","last_active":"2024-09-14T11:53:35.289336+0000","last_peered":"2024-09-14T11:53:35.289336+0000","last_clean":"2024-09-14T11:53:35.289336+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:53:35.289336+0000","last_undegraded":"2024-09-14T11:53:35.289336+0000","last_fullsized":"2024-09-14T11:53:35.289336+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-14T11:53:35.289171+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-14T11:53:35.289171+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.289171+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:48.609988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.257639+0000","last_change":"2024-09-14T11:53:41.257639+0000","last_active":"2024-09-14T11:53:41.257639+0000","last_peered":"2024-09-14T11:53:41.257639+0000","last_clean":"2024-09-14T11:53:41.257639+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:53:41.257639+0000","last_undegraded":"2024-09-14T11:53:41.257639+0000","last_fullsized":"2024-09-14T11:53:41.257639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:41.257549+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:41.257549+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.257549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:00.033907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12280,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.762011+0000","last_change":"2024-09-14T11:53:24.762011+0000","last_active":"2024-09-14T11:53:24.762011+0000","last_peered":"2024-09-14T11:53:24.762011+0000","last_clean":"2024-09-14T11:53:24.762011+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:53:24.762011+0000","last_undegraded":"2024-09-14T11:53:24.762011+0000","last_fullsized":"2024-09-14T11:53:24.762011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.761926+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.782833+0000","last_change":"2024-09-14T11:53:32.782833+0000","last_active":"2024-09-14T11:53:32.782833+0000","last_peered":"2024-09-14T11:53:32.782833+0000","last_clean":"2024-09-14T11:53:32.782833+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:53:32.782833+0000","last_undegraded":"2024-09-14T11:53:32.782833+0000","last_fullsized":"2024-09-14T11:53:32.782833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:32.782743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:32.782743+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.782743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:29.482924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.269563+0000","last_change":"2024-09-14T11:53:46.269563+0000","last_active":"2024-09-14T11:53:46.269563+0000","last_peered":"2024-09-14T11:53:46.269563+0000","last_clean":"2024-09-14T11:53:46.269563+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:53:46.269563+0000","last_undegraded":"2024-09-14T11:53:46.269563+0000","last_fullsized":"2024-09-14T11:53:46.269563+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:46.269483+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:46.269483+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.269483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:13.195441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.350999+0000","last_change":"2024-09-14T11:53:31.350999+0000","last_active":"2024-09-14T11:53:31.350999+0000","last_peered":"2024-09-14T11:53:31.350999+0000","last_clean":"2024-09-14T11:53:31.350999+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:53:31.350999+0000","last_undegraded":"2024-09-14T11:53:31.350999+0000","last_fullsized":"2024-09-14T11:53:31.350999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:31.350902+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:31.350902+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.350902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:44.137144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.191156+0000","last_change":"2024-09-14T11:53:32.191156+0000","last_active":"2024-09-14T11:53:32.191156+0000","last_peered":"2024-09-14T11:53:32.191156+0000","last_clean":"2024-09-14T11:53:32.191156+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:53:32.191156+0000","last_undegraded":"2024-09-14T11:53:32.191156+0000","last_fullsized":"2024-09-14T11:53:32.191156+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:53:32.191054+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:53:32.191054+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.191054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:39.704680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.739702+0000","last_change":"2024-09-14T11:53:20.739702+0000","last_active":"2024-09-14T11:53:20.739702+0000","last_peered":"2024-09-14T11:53:20.739702+0000","last_clean":"2024-09-14T11:53:20.739702+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:53:20.739702+0000","last_undegraded":"2024-09-14T11:53:20.739702+0000","last_fullsized":"2024-09-14T11:53:20.739702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.739591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:32.573639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.236892+0000","last_change":"2024-09-14T11:53:44.236892+0000","last_active":"2024-09-14T11:53:44.236892+0000","last_peered":"2024-09-14T11:53:44.236892+0000","last_clean":"2024-09-14T11:53:44.236892+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:53:44.236892+0000","last_undegraded":"2024-09-14T11:53:44.236892+0000","last_fullsized":"2024-09-14T11:53:44.236892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:44.236806+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:44.236806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.236806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:58.026071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.309638+0000","last_change":"2024-09-14T11:53:38.309638+0000","last_active":"2024-09-14T11:53:38.309638+0000","last_peered":"2024-09-14T11:53:38.309638+0000","last_clean":"2024-09-14T11:53:38.309638+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:53:38.309638+0000","last_undegraded":"2024-09-14T11:53:38.309638+0000","last_fullsized":"2024-09-14T11:53:38.309638+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:53:38.309551+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:53:38.309551+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.309551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.910789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.257999+0000","last_change":"2024-09-14T11:53:36.257999+0000","last_active":"2024-09-14T11:53:36.257999+0000","last_peered":"2024-09-14T11:53:36.257999+0000","last_clean":"2024-09-14T11:53:36.257999+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:53:36.257999+0000","last_undegraded":"2024-09-14T11:53:36.257999+0000","last_fullsized":"2024-09-14T11:53:36.257999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:36.257919+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:36.257919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.257919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:38.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.257295+0000","last_change":"2024-09-14T11:53:48.257295+0000","last_active":"2024-09-14T11:53:48.257295+0000","last_peered":"2024-09-14T11:53:48.257295+0000","last_clean":"2024-09-14T11:53:48.257295+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:53:48.257295+0000","last_undegraded":"2024-09-14T11:53:48.257295+0000","last_fullsized":"2024-09-14T11:53:48.257295+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:48.257206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:48.257206+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.257206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:11.163206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.278152+0000","last_change":"2024-09-14T11:53:45.278152+0000","last_active":"2024-09-14T11:53:45.278152+0000","last_peered":"2024-09-14T11:53:45.278152+0000","last_clean":"2024-09-14T11:53:45.278152+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:53:45.278152+0000","last_undegraded":"2024-09-14T11:53:45.278152+0000","last_fullsized":"2024-09-14T11:53:45.278152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:45.278026+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:45.278026+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.278026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:58.007467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.627528+0000","last_change":"2024-09-14T11:53:15.627528+0000","last_active":"2024-09-14T11:53:15.627528+0000","last_peered":"2024-09-14T11:53:15.627528+0000","last_clean":"2024-09-14T11:53:15.627528+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:53:15.627528+0000","last_undegraded":"2024-09-14T11:53:15.627528+0000","last_fullsized":"2024-09-14T11:53:15.627528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.627437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.549615+0000","last_change":"2024-09-14T11:53:12.549615+0000","last_active":"2024-09-14T11:53:12.549615+0000","last_peered":"2024-09-14T11:53:12.549615+0000","last_clean":"2024-09-14T11:53:12.549615+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:53:12.549615+0000","last_undegraded":"2024-09-14T11:53:12.549615+0000","last_fullsized":"2024-09-14T11:53:12.549615+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.549522+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.167383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.262461+0000","last_change":"2024-09-14T11:53:38.262461+0000","last_active":"2024-09-14T11:53:38.262461+0000","last_peered":"2024-09-14T11:53:38.262461+0000","last_clean":"2024-09-14T11:53:38.262461+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:53:38.262461+0000","last_undegraded":"2024-09-14T11:53:38.262461+0000","last_fullsized":"2024-09-14T11:53:38.262461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:38.262369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:38.262369+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.262369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:01.619754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.034393+0000","last_change":"2024-09-14T11:53:39.034393+0000","last_active":"2024-09-14T11:53:39.034393+0000","last_peered":"2024-09-14T11:53:39.034393+0000","last_clean":"2024-09-14T11:53:39.034393+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:53:39.034393+0000","last_undegraded":"2024-09-14T11:53:39.034393+0000","last_fullsized":"2024-09-14T11:53:39.034393+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:39.034268+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:39.034268+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.034268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:36.678120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.290279+0000","last_change":"2024-09-14T11:53:39.290279+0000","last_active":"2024-09-14T11:53:39.290279+0000","last_peered":"2024-09-14T11:53:39.290279+0000","last_clean":"2024-09-14T11:53:39.290279+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:53:39.290279+0000","last_undegraded":"2024-09-14T11:53:39.290279+0000","last_fullsized":"2024-09-14T11:53:39.290279+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:39.290180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:39.290180+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.290180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:30.897809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.280249+0000","last_change":"2024-09-14T11:53:31.280249+0000","last_active":"2024-09-14T11:53:31.280249+0000","last_peered":"2024-09-14T11:53:31.280249+0000","last_clean":"2024-09-14T11:53:31.280249+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:53:31.280249+0000","last_undegraded":"2024-09-14T11:53:31.280249+0000","last_fullsized":"2024-09-14T11:53:31.280249+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:53:31.280166+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:53:31.280166+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.280166+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:31.394055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932512+0000","last_change":"2024-09-14T11:38:32.850607+0000","last_active":"2024-09-14T11:50:38.932512+0000","last_peered":"2024-09-14T11:50:38.932512+0000","last_clean":"2024-09-14T11:50:38.932512+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:50:38.932512+0000","last_undegraded":"2024-09-14T11:50:38.932512+0000","last_fullsized":"2024-09-14T11:50:38.932512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.725318+0000","last_change":"2024-09-14T11:53:30.725318+0000","last_active":"2024-09-14T11:53:30.725318+0000","last_peered":"2024-09-14T11:53:30.725318+0000","last_clean":"2024-09-14T11:53:30.725318+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:53:30.725318+0000","last_undegraded":"2024-09-14T11:53:30.725318+0000","last_fullsized":"2024-09-14T11:53:30.725318+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:30.725239+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:30.725239+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.725239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.836540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3076,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.142515+0000","last_change":"2024-09-14T11:53:30.142515+0000","last_active":"2024-09-14T11:53:30.142515+0000","last_peered":"2024-09-14T11:53:30.142515+0000","last_clean":"2024-09-14T11:53:30.142515+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:53:30.142515+0000","last_undegraded":"2024-09-14T11:53:30.142515+0000","last_fullsized":"2024-09-14T11:53:30.142515+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:53:30.142395+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:53:30.142395+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.142395+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:18.396082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.286203+0000","last_change":"2024-09-14T11:53:32.286203+0000","last_active":"2024-09-14T11:53:32.286203+0000","last_peered":"2024-09-14T11:53:32.286203+0000","last_clean":"2024-09-14T11:53:32.286203+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:53:32.286203+0000","last_undegraded":"2024-09-14T11:53:32.286203+0000","last_fullsized":"2024-09-14T11:53:32.286203+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T11:53:32.286094+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T11:53:32.286094+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.286094+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.169538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.327911+0000","last_change":"2024-09-14T11:53:48.327911+0000","last_active":"2024-09-14T11:53:48.327911+0000","last_peered":"2024-09-14T11:53:48.327911+0000","last_clean":"2024-09-14T11:53:48.327911+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:53:48.327911+0000","last_undegraded":"2024-09-14T11:53:48.327911+0000","last_fullsized":"2024-09-14T11:53:48.327911+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:48.327825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:48.327825+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.327825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:11.011540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.729932+0000","last_change":"2024-09-14T11:53:29.729932+0000","last_active":"2024-09-14T11:53:29.729932+0000","last_peered":"2024-09-14T11:53:29.729932+0000","last_clean":"2024-09-14T11:53:29.729932+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:53:29.729932+0000","last_undegraded":"2024-09-14T11:53:29.729932+0000","last_fullsized":"2024-09-14T11:53:29.729932+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:29.729825+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:29.729825+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.729825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:07.027942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.285407+0000","last_change":"2024-09-14T11:53:41.285407+0000","last_active":"2024-09-14T11:53:41.285407+0000","last_peered":"2024-09-14T11:53:41.285407+0000","last_clean":"2024-09-14T11:53:41.285407+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:53:41.285407+0000","last_undegraded":"2024-09-14T11:53:41.285407+0000","last_fullsized":"2024-09-14T11:53:41.285407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:41.285324+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:41.285324+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.285324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:37.987762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.238625+0000","last_change":"2024-09-14T11:53:31.238625+0000","last_active":"2024-09-14T11:53:31.238625+0000","last_peered":"2024-09-14T11:53:31.238625+0000","last_clean":"2024-09-14T11:53:31.238625+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:53:31.238625+0000","last_undegraded":"2024-09-14T11:53:31.238625+0000","last_fullsized":"2024-09-14T11:53:31.238625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:53:31.238550+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:53:31.238550+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.238550+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:36.113957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:18.930102+0000","last_change":"2024-09-14T11:38:32.850414+0000","last_active":"2024-09-14T11:50:18.930102+0000","last_peered":"2024-09-14T11:50:18.930102+0000","last_clean":"2024-09-14T11:50:18.930102+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:50:18.930102+0000","last_undegraded":"2024-09-14T11:50:18.930102+0000","last_fullsized":"2024-09-14T11:50:18.930102+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:09.152854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.252127+0000","last_change":"2024-09-14T11:53:47.252127+0000","last_active":"2024-09-14T11:53:47.252127+0000","last_peered":"2024-09-14T11:53:47.252127+0000","last_clean":"2024-09-14T11:53:47.252127+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:53:47.252127+0000","last_undegraded":"2024-09-14T11:53:47.252127+0000","last_fullsized":"2024-09-14T11:53:47.252127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.252016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.252016+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.252016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:30.835677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.152130+0000","last_change":"2024-09-14T11:53:22.152065+0000","last_active":"2024-09-14T11:53:22.152130+0000","last_peered":"2024-09-14T11:53:22.152130+0000","last_clean":"2024-09-14T11:53:22.152130+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:53:22.152130+0000","last_undegraded":"2024-09-14T11:53:22.152130+0000","last_fullsized":"2024-09-14T11:53:22.152130+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.151939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.121719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.081225+0000","last_change":"2024-09-14T11:53:28.081225+0000","last_active":"2024-09-14T11:53:28.081225+0000","last_peered":"2024-09-14T11:53:28.081225+0000","last_clean":"2024-09-14T11:53:28.081225+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:53:28.081225+0000","last_undegraded":"2024-09-14T11:53:28.081225+0000","last_fullsized":"2024-09-14T11:53:28.081225+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.081140+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:12.464070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":20,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:50:38.932488+0000","last_change":"2024-09-14T11:38:32.849628+0000","last_active":"2024-09-14T11:50:38.932488+0000","last_peered":"2024-09-14T11:50:38.932488+0000","last_clean":"2024-09-14T11:50:38.932488+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:50:38.932488+0000","last_undegraded":"2024-09-14T11:50:38.932488+0000","last_fullsized":"2024-09-14T11:50:38.932488+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'8","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.194215+0000","last_change":"2024-09-14T11:53:24.194095+0000","last_active":"2024-09-14T11:53:24.194215+0000","last_peered":"2024-09-14T11:53:24.194215+0000","last_clean":"2024-09-14T11:53:24.194215+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:53:24.194215+0000","last_undegraded":"2024-09-14T11:53:24.194215+0000","last_fullsized":"2024-09-14T11:53:24.194215+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.193998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:25.664721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":8,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.325232+0000","last_change":"2024-09-14T11:53:32.325232+0000","last_active":"2024-09-14T11:53:32.325232+0000","last_peered":"2024-09-14T11:53:32.325232+0000","last_clean":"2024-09-14T11:53:32.325232+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:53:32.325232+0000","last_undegraded":"2024-09-14T11:53:32.325232+0000","last_fullsized":"2024-09-14T11:53:32.325232+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:32.325106+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:32.325106+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.325106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:36.707398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.212510+0000","last_change":"2024-09-14T11:53:35.212510+0000","last_active":"2024-09-14T11:53:35.212510+0000","last_peered":"2024-09-14T11:53:35.212510+0000","last_clean":"2024-09-14T11:53:35.212510+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:53:35.212510+0000","last_undegraded":"2024-09-14T11:53:35.212510+0000","last_fullsized":"2024-09-14T11:53:35.212510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:53:35.212423+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:53:35.212423+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.212423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:52.340143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.717947+0000","last_change":"2024-09-14T11:53:18.717869+0000","last_active":"2024-09-14T11:53:18.717947+0000","last_peered":"2024-09-14T11:53:18.717947+0000","last_clean":"2024-09-14T11:53:18.717947+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:53:18.717947+0000","last_undegraded":"2024-09-14T11:53:18.717947+0000","last_fullsized":"2024-09-14T11:53:18.717947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.717779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.237449+0000","last_change":"2024-09-14T11:53:43.237449+0000","last_active":"2024-09-14T11:53:43.237449+0000","last_peered":"2024-09-14T11:53:43.237449+0000","last_clean":"2024-09-14T11:53:43.237449+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:53:43.237449+0000","last_undegraded":"2024-09-14T11:53:43.237449+0000","last_fullsized":"2024-09-14T11:53:43.237449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:43.237352+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:43.237352+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.237352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:28.229596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.314456+0000","last_change":"2024-09-14T11:53:37.314456+0000","last_active":"2024-09-14T11:53:37.314456+0000","last_peered":"2024-09-14T11:53:37.314456+0000","last_clean":"2024-09-14T11:53:37.314456+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:53:37.314456+0000","last_undegraded":"2024-09-14T11:53:37.314456+0000","last_fullsized":"2024-09-14T11:53:37.314456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:37.314359+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:37.314359+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.314359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:48.729888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21510,"num_write":20,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.233030+0000","last_change":"2024-09-14T11:53:32.233030+0000","last_active":"2024-09-14T11:53:32.233030+0000","last_peered":"2024-09-14T11:53:32.233030+0000","last_clean":"2024-09-14T11:53:32.233030+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:53:32.233030+0000","last_undegraded":"2024-09-14T11:53:32.233030+0000","last_fullsized":"2024-09-14T11:53:32.233030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:53:32.232936+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:53:32.232936+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.232936+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:03.754233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.335812+0000","last_change":"2024-09-14T11:53:45.335812+0000","last_active":"2024-09-14T11:53:45.335812+0000","last_peered":"2024-09-14T11:53:45.335812+0000","last_clean":"2024-09-14T11:53:45.335812+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:53:45.335812+0000","last_undegraded":"2024-09-14T11:53:45.335812+0000","last_fullsized":"2024-09-14T11:53:45.335812+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:45.335725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:45.335725+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.335725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:35.338850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.263238+0000","last_change":"2024-09-14T11:53:40.263238+0000","last_active":"2024-09-14T11:53:40.263238+0000","last_peered":"2024-09-14T11:53:40.263238+0000","last_clean":"2024-09-14T11:53:40.263238+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:53:40.263238+0000","last_undegraded":"2024-09-14T11:53:40.263238+0000","last_fullsized":"2024-09-14T11:53:40.263238+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:40.263146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:40.263146+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.263146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:09.116046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.663445+0000","last_change":"2024-09-14T11:53:16.663445+0000","last_active":"2024-09-14T11:53:16.663445+0000","last_peered":"2024-09-14T11:53:16.663445+0000","last_clean":"2024-09-14T11:53:16.663445+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:53:16.663445+0000","last_undegraded":"2024-09-14T11:53:16.663445+0000","last_fullsized":"2024-09-14T11:53:16.663445+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.663354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:23.071337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.384432+0000","last_change":"2024-09-14T11:53:29.384432+0000","last_active":"2024-09-14T11:53:29.384432+0000","last_peered":"2024-09-14T11:53:29.384432+0000","last_clean":"2024-09-14T11:53:29.384432+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:53:29.384432+0000","last_undegraded":"2024-09-14T11:53:29.384432+0000","last_fullsized":"2024-09-14T11:53:29.384432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T11:53:29.384333+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T11:53:29.384333+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.384333+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.253564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.160042+0000","last_change":"2024-09-14T11:53:27.159984+0000","last_active":"2024-09-14T11:53:27.160042+0000","last_peered":"2024-09-14T11:53:27.160042+0000","last_clean":"2024-09-14T11:53:27.160042+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:53:27.160042+0000","last_undegraded":"2024-09-14T11:53:27.160042+0000","last_fullsized":"2024-09-14T11:53:27.160042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.159896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:22.228903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.724293+0000","last_change":"2024-09-14T11:53:28.724293+0000","last_active":"2024-09-14T11:53:28.724293+0000","last_peered":"2024-09-14T11:53:28.724293+0000","last_clean":"2024-09-14T11:53:28.724293+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:53:28.724293+0000","last_undegraded":"2024-09-14T11:53:28.724293+0000","last_fullsized":"2024-09-14T11:53:28.724293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.724205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:53.783027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.252974+0000","last_change":"2024-09-14T11:53:38.252974+0000","last_active":"2024-09-14T11:53:38.252974+0000","last_peered":"2024-09-14T11:53:38.252974+0000","last_clean":"2024-09-14T11:53:38.252974+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:53:38.252974+0000","last_undegraded":"2024-09-14T11:53:38.252974+0000","last_fullsized":"2024-09-14T11:53:38.252974+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:38.252896+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:38.252896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.252896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:16.951537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.163194+0000","last_change":"2024-09-14T11:53:20.163194+0000","last_active":"2024-09-14T11:53:20.163194+0000","last_peered":"2024-09-14T11:53:20.163194+0000","last_clean":"2024-09-14T11:53:20.163194+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:53:20.163194+0000","last_undegraded":"2024-09-14T11:53:20.163194+0000","last_fullsized":"2024-09-14T11:53:20.163194+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.163114+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:11.811539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.350806+0000","last_change":"2024-09-14T11:53:44.350806+0000","last_active":"2024-09-14T11:53:44.350806+0000","last_peered":"2024-09-14T11:53:44.350806+0000","last_clean":"2024-09-14T11:53:44.350806+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:53:44.350806+0000","last_undegraded":"2024-09-14T11:53:44.350806+0000","last_fullsized":"2024-09-14T11:53:44.350806+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:44.350699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:44.350699+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.350699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:57.083322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.281031+0000","last_change":"2024-09-14T11:53:42.281031+0000","last_active":"2024-09-14T11:53:42.281031+0000","last_peered":"2024-09-14T11:53:42.281031+0000","last_clean":"2024-09-14T11:53:42.281031+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:53:42.281031+0000","last_undegraded":"2024-09-14T11:53:42.281031+0000","last_fullsized":"2024-09-14T11:53:42.281031+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:42.280931+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:42.280931+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.280931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.086850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.797058+0000","last_change":"2024-09-14T11:53:22.797058+0000","last_active":"2024-09-14T11:53:22.797058+0000","last_peered":"2024-09-14T11:53:22.797058+0000","last_clean":"2024-09-14T11:53:22.797058+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:53:22.797058+0000","last_undegraded":"2024-09-14T11:53:22.797058+0000","last_fullsized":"2024-09-14T11:53:22.797058+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.796963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:55.082758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.547416+0000","last_change":"2024-09-14T11:53:11.547416+0000","last_active":"2024-09-14T11:53:11.547416+0000","last_peered":"2024-09-14T11:53:11.547416+0000","last_clean":"2024-09-14T11:53:11.547416+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:53:11.547416+0000","last_undegraded":"2024-09-14T11:53:11.547416+0000","last_fullsized":"2024-09-14T11:53:11.547416+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.547332+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.246053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:49:48.925475+0000","last_change":"2024-09-14T11:38:32.854502+0000","last_active":"2024-09-14T11:49:48.925475+0000","last_peered":"2024-09-14T11:49:48.925475+0000","last_clean":"2024-09-14T11:49:48.925475+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:49:48.925475+0000","last_undegraded":"2024-09-14T11:49:48.925475+0000","last_fullsized":"2024-09-14T11:49:48.925475+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.818177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.818177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:32.325414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.092101+0000","last_change":"2024-09-14T11:53:36.092035+0000","last_active":"2024-09-14T11:53:36.092101+0000","last_peered":"2024-09-14T11:53:36.092101+0000","last_clean":"2024-09-14T11:53:36.092101+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:53:36.092101+0000","last_undegraded":"2024-09-14T11:53:36.092101+0000","last_fullsized":"2024-09-14T11:53:36.092101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:36.091944+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:36.091944+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.091944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:04.031148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6166,"num_write":6,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.205400+0000","last_change":"2024-09-14T11:53:36.205343+0000","last_active":"2024-09-14T11:53:36.205400+0000","last_peered":"2024-09-14T11:53:36.205400+0000","last_clean":"2024-09-14T11:53:36.205400+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:53:36.205400+0000","last_undegraded":"2024-09-14T11:53:36.205400+0000","last_fullsized":"2024-09-14T11:53:36.205400+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:36.205262+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:36.205262+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.205262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.244029+0000","last_change":"2024-09-14T11:53:30.244029+0000","last_active":"2024-09-14T11:53:30.244029+0000","last_peered":"2024-09-14T11:53:30.244029+0000","last_clean":"2024-09-14T11:53:30.244029+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:53:30.244029+0000","last_undegraded":"2024-09-14T11:53:30.244029+0000","last_fullsized":"2024-09-14T11:53:30.244029+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:53:30.243937+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:53:30.243937+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.243937+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:57.762844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.301436+0000","last_change":"2024-09-14T11:53:47.301436+0000","last_active":"2024-09-14T11:53:47.301436+0000","last_peered":"2024-09-14T11:53:47.301436+0000","last_clean":"2024-09-14T11:53:47.301436+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:53:47.301436+0000","last_undegraded":"2024-09-14T11:53:47.301436+0000","last_fullsized":"2024-09-14T11:53:47.301436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.301336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.301336+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.301336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:41.791728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.344533+0000","last_change":"2024-09-14T11:53:39.344463+0000","last_active":"2024-09-14T11:53:39.344533+0000","last_peered":"2024-09-14T11:53:39.344533+0000","last_clean":"2024-09-14T11:53:39.344533+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:53:39.344533+0000","last_undegraded":"2024-09-14T11:53:39.344533+0000","last_fullsized":"2024-09-14T11:53:39.344533+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:53:39.344376+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:53:39.344376+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.344376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:16.228806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.750144+0000","last_change":"2024-09-14T11:53:23.750077+0000","last_active":"2024-09-14T11:53:23.750144+0000","last_peered":"2024-09-14T11:53:23.750144+0000","last_clean":"2024-09-14T11:53:23.750144+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:53:23.750144+0000","last_undegraded":"2024-09-14T11:53:23.750144+0000","last_fullsized":"2024-09-14T11:53:23.750144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.749996+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:49.227281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4143,"num_write":14,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.264725+0000","last_change":"2024-09-14T11:53:30.264725+0000","last_active":"2024-09-14T11:53:30.264725+0000","last_peered":"2024-09-14T11:53:30.264725+0000","last_clean":"2024-09-14T11:53:30.264725+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:53:30.264725+0000","last_undegraded":"2024-09-14T11:53:30.264725+0000","last_fullsized":"2024-09-14T11:53:30.264725+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'54","last_scrub_stamp":"2024-09-14T11:53:30.264629+0000","last_deep_scrub":"263'54","last_deep_scrub_stamp":"2024-09-14T11:53:30.264629+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.264629+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:49.334114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.321857+0000","last_change":"2024-09-14T11:53:46.321857+0000","last_active":"2024-09-14T11:53:46.321857+0000","last_peered":"2024-09-14T11:53:46.321857+0000","last_clean":"2024-09-14T11:53:46.321857+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:53:46.321857+0000","last_undegraded":"2024-09-14T11:53:46.321857+0000","last_fullsized":"2024-09-14T11:53:46.321857+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:46.321738+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:46.321738+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.321738+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:04.189056+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.766402+0000","last_change":"2024-09-14T11:53:27.766402+0000","last_active":"2024-09-14T11:53:27.766402+0000","last_peered":"2024-09-14T11:53:27.766402+0000","last_clean":"2024-09-14T11:53:27.766402+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:53:27.766402+0000","last_undegraded":"2024-09-14T11:53:27.766402+0000","last_fullsized":"2024-09-14T11:53:27.766402+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.766298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:30.703536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.221384+0000","last_change":"2024-09-14T11:53:37.221315+0000","last_active":"2024-09-14T11:53:37.221384+0000","last_peered":"2024-09-14T11:53:37.221384+0000","last_clean":"2024-09-14T11:53:37.221384+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:53:37.221384+0000","last_undegraded":"2024-09-14T11:53:37.221384+0000","last_fullsized":"2024-09-14T11:53:37.221384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:37.221224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:37.221224+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.221224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:25.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.181040+0000","last_change":"2024-09-14T11:53:30.181040+0000","last_active":"2024-09-14T11:53:30.181040+0000","last_peered":"2024-09-14T11:53:30.181040+0000","last_clean":"2024-09-14T11:53:30.181040+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:53:30.181040+0000","last_undegraded":"2024-09-14T11:53:30.181040+0000","last_fullsized":"2024-09-14T11:53:30.181040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:30.180953+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:30.180953+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.180953+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:08.891640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.304470+0000","last_change":"2024-09-14T11:53:47.304470+0000","last_active":"2024-09-14T11:53:47.304470+0000","last_peered":"2024-09-14T11:53:47.304470+0000","last_clean":"2024-09-14T11:53:47.304470+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:53:47.304470+0000","last_undegraded":"2024-09-14T11:53:47.304470+0000","last_fullsized":"2024-09-14T11:53:47.304470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.304375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.304375+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.304375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:07.980584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.371976+0000","last_change":"2024-09-14T11:53:40.371908+0000","last_active":"2024-09-14T11:53:40.371976+0000","last_peered":"2024-09-14T11:53:40.371976+0000","last_clean":"2024-09-14T11:53:40.371976+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:53:40.371976+0000","last_undegraded":"2024-09-14T11:53:40.371976+0000","last_fullsized":"2024-09-14T11:53:40.371976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:40.371816+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:40.371816+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.371816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:56.488968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.127866+0000","last_change":"2024-09-14T11:53:29.127866+0000","last_active":"2024-09-14T11:53:29.127866+0000","last_peered":"2024-09-14T11:53:29.127866+0000","last_clean":"2024-09-14T11:53:29.127866+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:53:29.127866+0000","last_undegraded":"2024-09-14T11:53:29.127866+0000","last_fullsized":"2024-09-14T11:53:29.127866+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:53:29.127775+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:53:29.127775+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.127775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:24.770271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.155477+0000","last_change":"2024-09-14T11:53:18.155477+0000","last_active":"2024-09-14T11:53:18.155477+0000","last_peered":"2024-09-14T11:53:18.155477+0000","last_clean":"2024-09-14T11:53:18.155477+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:53:18.155477+0000","last_undegraded":"2024-09-14T11:53:18.155477+0000","last_fullsized":"2024-09-14T11:53:18.155477+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'62","last_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_deep_scrub":"263'62","last_deep_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.155393+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:37.081156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.368096+0000","last_change":"2024-09-14T11:53:42.368096+0000","last_active":"2024-09-14T11:53:42.368096+0000","last_peered":"2024-09-14T11:53:42.368096+0000","last_clean":"2024-09-14T11:53:42.368096+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:53:42.368096+0000","last_undegraded":"2024-09-14T11:53:42.368096+0000","last_fullsized":"2024-09-14T11:53:42.368096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:42.367996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:42.367996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.367996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:55.845584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.320242+0000","last_change":"2024-09-14T11:53:44.320242+0000","last_active":"2024-09-14T11:53:44.320242+0000","last_peered":"2024-09-14T11:53:44.320242+0000","last_clean":"2024-09-14T11:53:44.320242+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:53:44.320242+0000","last_undegraded":"2024-09-14T11:53:44.320242+0000","last_fullsized":"2024-09-14T11:53:44.320242+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:44.320156+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:44.320156+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.320156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:54.068601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.312423+0000","last_change":"2024-09-14T11:53:35.312423+0000","last_active":"2024-09-14T11:53:35.312423+0000","last_peered":"2024-09-14T11:53:35.312423+0000","last_clean":"2024-09-14T11:53:35.312423+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:53:35.312423+0000","last_undegraded":"2024-09-14T11:53:35.312423+0000","last_fullsized":"2024-09-14T11:53:35.312423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:53:35.312309+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:53:35.312309+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.312309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:43.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10258,"num_write":8,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.230745+0000","last_change":"2024-09-14T11:53:29.230745+0000","last_active":"2024-09-14T11:53:29.230745+0000","last_peered":"2024-09-14T11:53:29.230745+0000","last_clean":"2024-09-14T11:53:29.230745+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:53:29.230745+0000","last_undegraded":"2024-09-14T11:53:29.230745+0000","last_fullsized":"2024-09-14T11:53:29.230745+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:53:29.230662+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:53:29.230662+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.230662+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:15.109449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.279517+0000","last_change":"2024-09-14T11:53:37.279517+0000","last_active":"2024-09-14T11:53:37.279517+0000","last_peered":"2024-09-14T11:53:37.279517+0000","last_clean":"2024-09-14T11:53:37.279517+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:53:37.279517+0000","last_undegraded":"2024-09-14T11:53:37.279517+0000","last_fullsized":"2024-09-14T11:53:37.279517+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:37.279404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:37.279404+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.279404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:49.567549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.282196+0000","last_change":"2024-09-14T11:53:42.282196+0000","last_active":"2024-09-14T11:53:42.282196+0000","last_peered":"2024-09-14T11:53:42.282196+0000","last_clean":"2024-09-14T11:53:42.282196+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:53:42.282196+0000","last_undegraded":"2024-09-14T11:53:42.282196+0000","last_fullsized":"2024-09-14T11:53:42.282196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:42.282099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:42.282099+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.282099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.684676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.617156+0000","last_change":"2024-09-14T11:53:14.617156+0000","last_active":"2024-09-14T11:53:14.617156+0000","last_peered":"2024-09-14T11:53:14.617156+0000","last_clean":"2024-09-14T11:53:14.617156+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:53:14.617156+0000","last_undegraded":"2024-09-14T11:53:14.617156+0000","last_fullsized":"2024-09-14T11:53:14.617156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.617045+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:52.240454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4136,"num_write":12,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.172440+0000","last_change":"2024-09-14T11:53:17.172440+0000","last_active":"2024-09-14T11:53:17.172440+0000","last_peered":"2024-09-14T11:53:17.172440+0000","last_clean":"2024-09-14T11:53:17.172440+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:53:17.172440+0000","last_undegraded":"2024-09-14T11:53:17.172440+0000","last_fullsized":"2024-09-14T11:53:17.172440+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.172319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.845904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.747932+0000","last_change":"2024-09-14T11:53:31.747932+0000","last_active":"2024-09-14T11:53:31.747932+0000","last_peered":"2024-09-14T11:53:31.747932+0000","last_clean":"2024-09-14T11:53:31.747932+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:53:31.747932+0000","last_undegraded":"2024-09-14T11:53:31.747932+0000","last_fullsized":"2024-09-14T11:53:31.747932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:31.747819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:31.747819+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.747819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:20.635163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.323186+0000","last_change":"2024-09-14T11:53:41.323111+0000","last_active":"2024-09-14T11:53:41.323186+0000","last_peered":"2024-09-14T11:53:41.323186+0000","last_clean":"2024-09-14T11:53:41.323186+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:53:41.323186+0000","last_undegraded":"2024-09-14T11:53:41.323186+0000","last_fullsized":"2024-09-14T11:53:41.323186+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:41.322987+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:41.322987+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.322987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:46.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.398680+0000","last_change":"2024-09-14T11:53:30.398579+0000","last_active":"2024-09-14T11:53:30.398680+0000","last_peered":"2024-09-14T11:53:30.398680+0000","last_clean":"2024-09-14T11:53:30.398680+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:53:30.398680+0000","last_undegraded":"2024-09-14T11:53:30.398680+0000","last_fullsized":"2024-09-14T11:53:30.398680+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:30.398469+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:30.398469+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.398469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.051772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.288050+0000","last_change":"2024-09-14T11:53:29.288050+0000","last_active":"2024-09-14T11:53:29.288050+0000","last_peered":"2024-09-14T11:53:29.288050+0000","last_clean":"2024-09-14T11:53:29.288050+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:53:29.288050+0000","last_undegraded":"2024-09-14T11:53:29.288050+0000","last_fullsized":"2024-09-14T11:53:29.288050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:29.287960+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:29.287960+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.287960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.783501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.079224+0000","last_change":"2024-09-14T11:53:38.079224+0000","last_active":"2024-09-14T11:53:38.079224+0000","last_peered":"2024-09-14T11:53:38.079224+0000","last_clean":"2024-09-14T11:53:38.079224+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:53:38.079224+0000","last_undegraded":"2024-09-14T11:53:38.079224+0000","last_fullsized":"2024-09-14T11:53:38.079224+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:38.079136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:38.079136+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.079136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:13.899245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.077986+0000","last_change":"2024-09-14T11:53:35.077912+0000","last_active":"2024-09-14T11:53:35.077986+0000","last_peered":"2024-09-14T11:53:35.077986+0000","last_clean":"2024-09-14T11:53:35.077986+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:53:35.077986+0000","last_undegraded":"2024-09-14T11:53:35.077986+0000","last_fullsized":"2024-09-14T11:53:35.077986+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:35.077823+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:35.077823+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.077823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:51.780844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.294549+0000","last_change":"2024-09-14T11:53:36.294485+0000","last_active":"2024-09-14T11:53:36.294549+0000","last_peered":"2024-09-14T11:53:36.294549+0000","last_clean":"2024-09-14T11:53:36.294549+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:53:36.294549+0000","last_undegraded":"2024-09-14T11:53:36.294549+0000","last_fullsized":"2024-09-14T11:53:36.294549+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:36.294398+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:36.294398+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.294398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:46.664279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.828156+0000","last_change":"2024-09-14T11:53:20.828156+0000","last_active":"2024-09-14T11:53:20.828156+0000","last_peered":"2024-09-14T11:53:20.828156+0000","last_clean":"2024-09-14T11:53:20.828156+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:53:20.828156+0000","last_undegraded":"2024-09-14T11:53:20.828156+0000","last_fullsized":"2024-09-14T11:53:20.828156+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.828045+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:47.654466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.699227+0000","last_change":"2024-09-14T11:53:19.699168+0000","last_active":"2024-09-14T11:53:19.699227+0000","last_peered":"2024-09-14T11:53:19.699227+0000","last_clean":"2024-09-14T11:53:19.699227+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:53:19.699227+0000","last_undegraded":"2024-09-14T11:53:19.699227+0000","last_fullsized":"2024-09-14T11:53:19.699227+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.699072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:41.679367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.775884+0000","last_change":"2024-09-14T11:53:26.775884+0000","last_active":"2024-09-14T11:53:26.775884+0000","last_peered":"2024-09-14T11:53:26.775884+0000","last_clean":"2024-09-14T11:53:26.775884+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:53:26.775884+0000","last_undegraded":"2024-09-14T11:53:26.775884+0000","last_fullsized":"2024-09-14T11:53:26.775884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.775762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:28.794807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.311144+0000","last_change":"2024-09-14T11:53:33.311064+0000","last_active":"2024-09-14T11:53:33.311144+0000","last_peered":"2024-09-14T11:53:33.311144+0000","last_clean":"2024-09-14T11:53:33.311144+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:53:33.311144+0000","last_undegraded":"2024-09-14T11:53:33.311144+0000","last_fullsized":"2024-09-14T11:53:33.311144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:33.310933+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:33.310933+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.310933+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:19.245582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.396807+0000","last_change":"2024-09-14T11:53:28.396807+0000","last_active":"2024-09-14T11:53:28.396807+0000","last_peered":"2024-09-14T11:53:28.396807+0000","last_clean":"2024-09-14T11:53:28.396807+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:53:28.396807+0000","last_undegraded":"2024-09-14T11:53:28.396807+0000","last_fullsized":"2024-09-14T11:53:28.396807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.396726+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:24.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.316533+0000","last_change":"2024-09-14T11:53:46.316533+0000","last_active":"2024-09-14T11:53:46.316533+0000","last_peered":"2024-09-14T11:53:46.316533+0000","last_clean":"2024-09-14T11:53:46.316533+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:53:46.316533+0000","last_undegraded":"2024-09-14T11:53:46.316533+0000","last_fullsized":"2024-09-14T11:53:46.316533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:46.316451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:46.316451+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.316451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:57.826328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.264946+0000","last_change":"2024-09-14T11:53:34.264946+0000","last_active":"2024-09-14T11:53:34.264946+0000","last_peered":"2024-09-14T11:53:34.264946+0000","last_clean":"2024-09-14T11:53:34.264946+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:53:34.264946+0000","last_undegraded":"2024-09-14T11:53:34.264946+0000","last_fullsized":"2024-09-14T11:53:34.264946+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:34.264844+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:34.264844+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.264844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:24.472289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.321960+0000","last_change":"2024-09-14T11:53:34.321960+0000","last_active":"2024-09-14T11:53:34.321960+0000","last_peered":"2024-09-14T11:53:34.321960+0000","last_clean":"2024-09-14T11:53:34.321960+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:53:34.321960+0000","last_undegraded":"2024-09-14T11:53:34.321960+0000","last_fullsized":"2024-09-14T11:53:34.321960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:34.321875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:34.321875+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.321875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:40.068785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.065726+0000","last_change":"2024-09-14T11:53:26.065726+0000","last_active":"2024-09-14T11:53:26.065726+0000","last_peered":"2024-09-14T11:53:26.065726+0000","last_clean":"2024-09-14T11:53:26.065726+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:53:26.065726+0000","last_undegraded":"2024-09-14T11:53:26.065726+0000","last_fullsized":"2024-09-14T11:53:26.065726+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.065590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.826773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.351624+0000","last_change":"2024-09-14T11:53:45.351624+0000","last_active":"2024-09-14T11:53:45.351624+0000","last_peered":"2024-09-14T11:53:45.351624+0000","last_clean":"2024-09-14T11:53:45.351624+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:53:45.351624+0000","last_undegraded":"2024-09-14T11:53:45.351624+0000","last_fullsized":"2024-09-14T11:53:45.351624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:45.351526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:45.351526+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.351526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:59.537319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.177891+0000","last_change":"2024-09-14T11:53:23.177891+0000","last_active":"2024-09-14T11:53:23.177891+0000","last_peered":"2024-09-14T11:53:23.177891+0000","last_clean":"2024-09-14T11:53:23.177891+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:53:23.177891+0000","last_undegraded":"2024-09-14T11:53:23.177891+0000","last_fullsized":"2024-09-14T11:53:23.177891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.177795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:38.025123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.812440+0000","last_change":"2024-09-14T11:53:21.812440+0000","last_active":"2024-09-14T11:53:21.812440+0000","last_peered":"2024-09-14T11:53:21.812440+0000","last_clean":"2024-09-14T11:53:21.812440+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:53:21.812440+0000","last_undegraded":"2024-09-14T11:53:21.812440+0000","last_fullsized":"2024-09-14T11:53:21.812440+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.812301+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:47.150896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.199859+0000","last_change":"2024-09-14T11:53:16.199859+0000","last_active":"2024-09-14T11:53:16.199859+0000","last_peered":"2024-09-14T11:53:16.199859+0000","last_clean":"2024-09-14T11:53:16.199859+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:53:16.199859+0000","last_undegraded":"2024-09-14T11:53:16.199859+0000","last_fullsized":"2024-09-14T11:53:16.199859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.199776+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.362128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321703+0000","last_change":"2024-09-14T11:53:43.321703+0000","last_active":"2024-09-14T11:53:43.321703+0000","last_peered":"2024-09-14T11:53:43.321703+0000","last_clean":"2024-09-14T11:53:43.321703+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:53:43.321703+0000","last_undegraded":"2024-09-14T11:53:43.321703+0000","last_fullsized":"2024-09-14T11:53:43.321703+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:43.321615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:43.321615+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.321615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.866432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.088149+0000","last_change":"2024-09-14T11:53:34.088149+0000","last_active":"2024-09-14T11:53:34.088149+0000","last_peered":"2024-09-14T11:53:34.088149+0000","last_clean":"2024-09-14T11:53:34.088149+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:53:34.088149+0000","last_undegraded":"2024-09-14T11:53:34.088149+0000","last_fullsized":"2024-09-14T11:53:34.088149+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:34.088060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:34.088060+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.088060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:52.883096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.154587+0000","last_change":"2024-09-14T11:53:21.154587+0000","last_active":"2024-09-14T11:53:21.154587+0000","last_peered":"2024-09-14T11:53:21.154587+0000","last_clean":"2024-09-14T11:53:21.154587+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:53:21.154587+0000","last_undegraded":"2024-09-14T11:53:21.154587+0000","last_fullsized":"2024-09-14T11:53:21.154587+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.154476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:42.611630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10252,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.328533+0000","last_change":"2024-09-14T11:53:28.328533+0000","last_active":"2024-09-14T11:53:28.328533+0000","last_peered":"2024-09-14T11:53:28.328533+0000","last_clean":"2024-09-14T11:53:28.328533+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:53:28.328533+0000","last_undegraded":"2024-09-14T11:53:28.328533+0000","last_fullsized":"2024-09-14T11:53:28.328533+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.328421+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:54.143049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'219","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.104497+0000","last_change":"2024-09-14T11:53:04.104497+0000","last_active":"2024-09-14T11:53:04.104497+0000","last_peered":"2024-09-14T11:53:04.104497+0000","last_clean":"2024-09-14T11:53:04.104497+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:53:04.104497+0000","last_undegraded":"2024-09-14T11:53:04.104497+0000","last_fullsized":"2024-09-14T11:53:04.104497+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.104357+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:27.489992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":26852,"num_write":1005,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1172","reported_seq":2812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.163456+0000","last_change":"2024-09-14T11:53:09.163374+0000","last_active":"2024-09-14T11:53:09.163456+0000","last_peered":"2024-09-14T11:53:09.163456+0000","last_clean":"2024-09-14T11:53:09.163456+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:53:09.163456+0000","last_undegraded":"2024-09-14T11:53:09.163456+0000","last_fullsized":"2024-09-14T11:53:09.163456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1172","last_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_deep_scrub":"263'1172","last_deep_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.163255+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:51.571485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'198","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.685758+0000","last_change":"2024-09-14T11:52:55.685758+0000","last_active":"2024-09-14T11:52:55.685758+0000","last_peered":"2024-09-14T11:52:55.685758+0000","last_clean":"2024-09-14T11:52:55.685758+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:52:55.685758+0000","last_undegraded":"2024-09-14T11:52:55.685758+0000","last_fullsized":"2024-09-14T11:52:55.685758+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.685603+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:37.938060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":7476,"num_write":916,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.143787+0000","last_change":"2024-09-14T11:53:11.143695+0000","last_active":"2024-09-14T11:53:11.143787+0000","last_peered":"2024-09-14T11:53:11.143787+0000","last_clean":"2024-09-14T11:53:11.143787+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:53:11.143787+0000","last_undegraded":"2024-09-14T11:53:11.143787+0000","last_fullsized":"2024-09-14T11:53:11.143787+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.143584+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:47.330573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'223","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.173154+0000","last_change":"2024-09-14T11:52:58.173154+0000","last_active":"2024-09-14T11:52:58.173154+0000","last_peered":"2024-09-14T11:52:58.173154+0000","last_clean":"2024-09-14T11:52:58.173154+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:52:58.173154+0000","last_undegraded":"2024-09-14T11:52:58.173154+0000","last_fullsized":"2024-09-14T11:52:58.173154+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.172939+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:36.789370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":599,"num_read_kb":30059,"num_write":1074,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'881","reported_seq":2637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.959059+0000","last_change":"2024-09-14T11:53:08.958959+0000","last_active":"2024-09-14T11:53:08.959059+0000","last_peered":"2024-09-14T11:53:08.959059+0000","last_clean":"2024-09-14T11:53:08.959059+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:53:08.959059+0000","last_undegraded":"2024-09-14T11:53:08.959059+0000","last_fullsized":"2024-09-14T11:53:08.959059+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.958854+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:40.823184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'228","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.163179+0000","last_change":"2024-09-14T11:53:03.163088+0000","last_active":"2024-09-14T11:53:03.163179+0000","last_peered":"2024-09-14T11:53:03.163179+0000","last_clean":"2024-09-14T11:53:03.163179+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:53:03.163179+0000","last_undegraded":"2024-09-14T11:53:03.163179+0000","last_fullsized":"2024-09-14T11:53:03.163179+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.162958+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:03.455162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":74674,"num_write":901,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'394","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.059050+0000","last_change":"2024-09-14T11:53:07.058982+0000","last_active":"2024-09-14T11:53:07.059050+0000","last_peered":"2024-09-14T11:53:07.059050+0000","last_clean":"2024-09-14T11:53:07.059050+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:53:07.059050+0000","last_undegraded":"2024-09-14T11:53:07.059050+0000","last_fullsized":"2024-09-14T11:53:07.059050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.058896+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.485594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'244","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.132571+0000","last_change":"2024-09-14T11:53:07.132482+0000","last_active":"2024-09-14T11:53:07.132571+0000","last_peered":"2024-09-14T11:53:07.132571+0000","last_clean":"2024-09-14T11:53:07.132571+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:53:07.132571+0000","last_undegraded":"2024-09-14T11:53:07.132571+0000","last_fullsized":"2024-09-14T11:53:07.132571+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.132325+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:44.056191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":17405,"num_write":1116,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'823","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.080635+0000","last_change":"2024-09-14T11:53:03.080576+0000","last_active":"2024-09-14T11:53:03.080635+0000","last_peered":"2024-09-14T11:53:03.080635+0000","last_clean":"2024-09-14T11:53:03.080635+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:53:03.080635+0000","last_undegraded":"2024-09-14T11:53:03.080635+0000","last_fullsized":"2024-09-14T11:53:03.080635+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.080464+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:29.386530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'217","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.130009+0000","last_change":"2024-09-14T11:53:02.129946+0000","last_active":"2024-09-14T11:53:02.130009+0000","last_peered":"2024-09-14T11:53:02.130009+0000","last_clean":"2024-09-14T11:53:02.130009+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:53:02.130009+0000","last_undegraded":"2024-09-14T11:53:02.130009+0000","last_fullsized":"2024-09-14T11:53:02.130009+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.129833+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.366991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":70473,"num_write":980,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'498","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.966298+0000","last_change":"2024-09-14T11:53:09.966298+0000","last_active":"2024-09-14T11:53:09.966298+0000","last_peered":"2024-09-14T11:53:09.966298+0000","last_clean":"2024-09-14T11:53:09.966298+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:53:09.966298+0000","last_undegraded":"2024-09-14T11:53:09.966298+0000","last_fullsized":"2024-09-14T11:53:09.966298+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.966206+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:47.015458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'224","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.111977+0000","last_change":"2024-09-14T11:53:03.111904+0000","last_active":"2024-09-14T11:53:03.111977+0000","last_peered":"2024-09-14T11:53:03.111977+0000","last_clean":"2024-09-14T11:53:03.111977+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:53:03.111977+0000","last_undegraded":"2024-09-14T11:53:03.111977+0000","last_fullsized":"2024-09-14T11:53:03.111977+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.111777+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:53.985189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":632,"num_read_kb":10774,"num_write":1050,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'703","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.204946+0000","last_change":"2024-09-14T11:53:10.204946+0000","last_active":"2024-09-14T11:53:10.204946+0000","last_peered":"2024-09-14T11:53:10.204946+0000","last_clean":"2024-09-14T11:53:10.204946+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:53:10.204946+0000","last_undegraded":"2024-09-14T11:53:10.204946+0000","last_fullsized":"2024-09-14T11:53:10.204946+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.204838+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:48.344428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'235","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.227565+0000","last_change":"2024-09-14T11:53:01.227469+0000","last_active":"2024-09-14T11:53:01.227565+0000","last_peered":"2024-09-14T11:53:01.227565+0000","last_clean":"2024-09-14T11:53:01.227565+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:53:01.227565+0000","last_undegraded":"2024-09-14T11:53:01.227565+0000","last_fullsized":"2024-09-14T11:53:01.227565+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.227337+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:36.676072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1301,"num_read_kb":98345,"num_write":1096,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'785","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.459599+0000","last_change":"2024-09-14T11:53:06.459599+0000","last_active":"2024-09-14T11:53:06.459599+0000","last_peered":"2024-09-14T11:53:06.459599+0000","last_clean":"2024-09-14T11:53:06.459599+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:53:06.459599+0000","last_undegraded":"2024-09-14T11:53:06.459599+0000","last_fullsized":"2024-09-14T11:53:06.459599+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.459498+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:46.080698+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'849","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.977158+0000","last_change":"2024-09-14T11:53:06.977094+0000","last_active":"2024-09-14T11:53:06.977158+0000","last_peered":"2024-09-14T11:53:06.977158+0000","last_clean":"2024-09-14T11:53:06.977158+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:53:06.977158+0000","last_undegraded":"2024-09-14T11:53:06.977158+0000","last_fullsized":"2024-09-14T11:53:06.977158+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'849","last_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_deep_scrub":"263'849","last_deep_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.976996+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:52.713389+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'237","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.158616+0000","last_change":"2024-09-14T11:53:01.158616+0000","last_active":"2024-09-14T11:53:01.158616+0000","last_peered":"2024-09-14T11:53:01.158616+0000","last_clean":"2024-09-14T11:53:01.158616+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:53:01.158616+0000","last_undegraded":"2024-09-14T11:53:01.158616+0000","last_fullsized":"2024-09-14T11:53:01.158616+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.158497+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:17.980141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":29179,"num_write":1120,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.147798+0000","last_change":"2024-09-14T11:53:06.147735+0000","last_active":"2024-09-14T11:53:06.147798+0000","last_peered":"2024-09-14T11:53:06.147798+0000","last_clean":"2024-09-14T11:53:06.147798+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:53:06.147798+0000","last_undegraded":"2024-09-14T11:53:06.147798+0000","last_fullsized":"2024-09-14T11:53:06.147798+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'874","last_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_deep_scrub":"263'874","last_deep_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.147589+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:09.954332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.050944+0000","last_change":"2024-09-14T11:52:58.050944+0000","last_active":"2024-09-14T11:52:58.050944+0000","last_peered":"2024-09-14T11:52:58.050944+0000","last_clean":"2024-09-14T11:52:58.050944+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:52:58.050944+0000","last_undegraded":"2024-09-14T11:52:58.050944+0000","last_fullsized":"2024-09-14T11:52:58.050944+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.050832+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:44.576976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":818,"num_read_kb":241766,"num_write":938,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'520","reported_seq":2229,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.166364+0000","last_change":"2024-09-14T11:53:08.166308+0000","last_active":"2024-09-14T11:53:08.166364+0000","last_peered":"2024-09-14T11:53:08.166364+0000","last_clean":"2024-09-14T11:53:08.166364+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:53:08.166364+0000","last_undegraded":"2024-09-14T11:53:08.166364+0000","last_fullsized":"2024-09-14T11:53:08.166364+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.166227+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.323522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'271","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.033421+0000","last_change":"2024-09-14T11:52:55.033421+0000","last_active":"2024-09-14T11:52:55.033421+0000","last_peered":"2024-09-14T11:52:55.033421+0000","last_clean":"2024-09-14T11:52:55.033421+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:52:55.033421+0000","last_undegraded":"2024-09-14T11:52:55.033421+0000","last_fullsized":"2024-09-14T11:52:55.033421+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'271","last_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_deep_scrub":"263'271","last_deep_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.033320+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.632089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":32324,"num_write":1007,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'859","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.571925+0000","last_change":"2024-09-14T11:52:57.571925+0000","last_active":"2024-09-14T11:52:57.571925+0000","last_peered":"2024-09-14T11:52:57.571925+0000","last_clean":"2024-09-14T11:52:57.571925+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:52:57.571925+0000","last_undegraded":"2024-09-14T11:52:57.571925+0000","last_fullsized":"2024-09-14T11:52:57.571925+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'859","last_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_deep_scrub":"263'859","last_deep_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.571844+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:30.711939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'237","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.142508+0000","last_change":"2024-09-14T11:52:54.142508+0000","last_active":"2024-09-14T11:52:54.142508+0000","last_peered":"2024-09-14T11:52:54.142508+0000","last_clean":"2024-09-14T11:52:54.142508+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:52:54.142508+0000","last_undegraded":"2024-09-14T11:52:54.142508+0000","last_fullsized":"2024-09-14T11:52:54.142508+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.142380+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:13.742745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":18423,"num_write":1039,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1030","reported_seq":2690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.596255+0000","last_change":"2024-09-14T11:53:00.596255+0000","last_active":"2024-09-14T11:53:00.596255+0000","last_peered":"2024-09-14T11:53:00.596255+0000","last_clean":"2024-09-14T11:53:00.596255+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:53:00.596255+0000","last_undegraded":"2024-09-14T11:53:00.596255+0000","last_fullsized":"2024-09-14T11:53:00.596255+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1030","last_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_deep_scrub":"263'1030","last_deep_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.596176+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:15.754364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'208","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.216578+0000","last_change":"2024-09-14T11:53:00.216578+0000","last_active":"2024-09-14T11:53:00.216578+0000","last_peered":"2024-09-14T11:53:00.216578+0000","last_clean":"2024-09-14T11:53:00.216578+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:53:00.216578+0000","last_undegraded":"2024-09-14T11:53:00.216578+0000","last_fullsized":"2024-09-14T11:53:00.216578+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.216460+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:58.339356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":19801,"num_write":945,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'479","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.954376+0000","last_change":"2024-09-14T11:53:07.954376+0000","last_active":"2024-09-14T11:53:07.954376+0000","last_peered":"2024-09-14T11:53:07.954376+0000","last_clean":"2024-09-14T11:53:07.954376+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:53:07.954376+0000","last_undegraded":"2024-09-14T11:53:07.954376+0000","last_fullsized":"2024-09-14T11:53:07.954376+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.954280+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:48.601994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'231","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.176475+0000","last_change":"2024-09-14T11:52:57.176414+0000","last_active":"2024-09-14T11:52:57.176475+0000","last_peered":"2024-09-14T11:52:57.176475+0000","last_clean":"2024-09-14T11:52:57.176475+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:52:57.176475+0000","last_undegraded":"2024-09-14T11:52:57.176475+0000","last_fullsized":"2024-09-14T11:52:57.176475+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.176294+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:01.150031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1266,"num_read_kb":11303,"num_write":1123,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'138","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.065815+0000","last_change":"2024-09-14T11:53:25.065815+0000","last_active":"2024-09-14T11:53:25.065815+0000","last_peered":"2024-09-14T11:53:25.065815+0000","last_clean":"2024-09-14T11:53:25.065815+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:53:25.065815+0000","last_undegraded":"2024-09-14T11:53:25.065815+0000","last_fullsized":"2024-09-14T11:53:25.065815+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.065723+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:59.914655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'946","reported_seq":2828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.250749+0000","last_change":"2024-09-14T11:53:04.250658+0000","last_active":"2024-09-14T11:53:04.250749+0000","last_peered":"2024-09-14T11:53:04.250749+0000","last_clean":"2024-09-14T11:53:04.250749+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:53:04.250749+0000","last_undegraded":"2024-09-14T11:53:04.250749+0000","last_fullsized":"2024-09-14T11:53:04.250749+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'946","last_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_deep_scrub":"263'946","last_deep_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.250543+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":900,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:39.287226+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'233","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.164938+0000","last_change":"2024-09-14T11:53:00.164869+0000","last_active":"2024-09-14T11:53:00.164938+0000","last_peered":"2024-09-14T11:53:00.164938+0000","last_clean":"2024-09-14T11:53:00.164938+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:53:00.164938+0000","last_undegraded":"2024-09-14T11:53:00.164938+0000","last_fullsized":"2024-09-14T11:53:00.164938+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.164685+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:01.744253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368206,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":732,"num_read_kb":7795,"num_write":1213,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"263'4","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.236685+0000","last_change":"2024-09-14T11:53:13.236685+0000","last_active":"2024-09-14T11:53:13.236685+0000","last_peered":"2024-09-14T11:53:13.236685+0000","last_clean":"2024-09-14T11:53:13.236685+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:53:13.236685+0000","last_undegraded":"2024-09-14T11:53:13.236685+0000","last_fullsized":"2024-09-14T11:53:13.236685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.236601+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:46.099722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'194","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.123485+0000","last_change":"2024-09-14T11:53:14.123485+0000","last_active":"2024-09-14T11:53:14.123485+0000","last_peered":"2024-09-14T11:53:14.123485+0000","last_clean":"2024-09-14T11:53:14.123485+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:53:14.123485+0000","last_undegraded":"2024-09-14T11:53:14.123485+0000","last_fullsized":"2024-09-14T11:53:14.123485+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.123396+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.394550+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":349,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.282150+0000","last_change":"2024-09-14T11:53:23.282150+0000","last_active":"2024-09-14T11:53:23.282150+0000","last_peered":"2024-09-14T11:53:23.282150+0000","last_clean":"2024-09-14T11:53:23.282150+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:53:23.282150+0000","last_undegraded":"2024-09-14T11:53:23.282150+0000","last_fullsized":"2024-09-14T11:53:23.282150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.282066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:13.449577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2496","reported_seq":4324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.352817+0000","last_change":"2024-09-14T11:53:26.352817+0000","last_active":"2024-09-14T11:53:26.352817+0000","last_peered":"2024-09-14T11:53:26.352817+0000","last_clean":"2024-09-14T11:53:26.352817+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:53:26.352817+0000","last_undegraded":"2024-09-14T11:53:26.352817+0000","last_fullsized":"2024-09-14T11:53:26.352817+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2496","last_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_deep_scrub":"263'2496","last_deep_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.352725+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:36.910529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'508","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.160252+0000","last_change":"2024-09-14T11:53:05.160252+0000","last_active":"2024-09-14T11:53:05.160252+0000","last_peered":"2024-09-14T11:53:05.160252+0000","last_clean":"2024-09-14T11:53:05.160252+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:53:05.160252+0000","last_undegraded":"2024-09-14T11:53:05.160252+0000","last_fullsized":"2024-09-14T11:53:05.160252+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'508","last_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_deep_scrub":"263'508","last_deep_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.160161+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:03.024651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'190","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.226742+0000","last_change":"2024-09-14T11:52:50.226660+0000","last_active":"2024-09-14T11:52:50.226742+0000","last_peered":"2024-09-14T11:52:50.226742+0000","last_clean":"2024-09-14T11:52:50.226742+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:52:50.226742+0000","last_undegraded":"2024-09-14T11:52:50.226742+0000","last_fullsized":"2024-09-14T11:52:50.226742+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.226549+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:48.793214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":11633,"num_write":915,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.140960+0000","last_change":"2024-09-14T11:53:17.140902+0000","last_active":"2024-09-14T11:53:17.140960+0000","last_peered":"2024-09-14T11:53:17.140960+0000","last_clean":"2024-09-14T11:53:17.140960+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:53:17.140960+0000","last_undegraded":"2024-09-14T11:53:17.140960+0000","last_fullsized":"2024-09-14T11:53:17.140960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.140817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.091423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'95","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.975820+0000","last_change":"2024-09-14T11:53:17.975820+0000","last_active":"2024-09-14T11:53:17.975820+0000","last_peered":"2024-09-14T11:53:17.975820+0000","last_clean":"2024-09-14T11:53:17.975820+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:53:17.975820+0000","last_undegraded":"2024-09-14T11:53:17.975820+0000","last_fullsized":"2024-09-14T11:53:17.975820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.975694+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:23.245588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.095490+0000","last_change":"2024-09-14T11:53:22.095490+0000","last_active":"2024-09-14T11:53:22.095490+0000","last_peered":"2024-09-14T11:53:22.095490+0000","last_clean":"2024-09-14T11:53:22.095490+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:53:22.095490+0000","last_undegraded":"2024-09-14T11:53:22.095490+0000","last_fullsized":"2024-09-14T11:53:22.095490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.095388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:54.732324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'128","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.190251+0000","last_change":"2024-09-14T11:53:26.190188+0000","last_active":"2024-09-14T11:53:26.190251+0000","last_peered":"2024-09-14T11:53:26.190251+0000","last_clean":"2024-09-14T11:53:26.190251+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:53:26.190251+0000","last_undegraded":"2024-09-14T11:53:26.190251+0000","last_fullsized":"2024-09-14T11:53:26.190251+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.190093+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:42.068452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'394","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.123155+0000","last_change":"2024-09-14T11:53:02.123155+0000","last_active":"2024-09-14T11:53:02.123155+0000","last_peered":"2024-09-14T11:53:02.123155+0000","last_clean":"2024-09-14T11:53:02.123155+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:53:02.123155+0000","last_undegraded":"2024-09-14T11:53:02.123155+0000","last_fullsized":"2024-09-14T11:53:02.123155+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.123061+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:43.333665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094056+0000","last_change":"2024-09-14T11:52:57.093996+0000","last_active":"2024-09-14T11:52:57.094056+0000","last_peered":"2024-09-14T11:52:57.094056+0000","last_clean":"2024-09-14T11:52:57.094056+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:52:57.094056+0000","last_undegraded":"2024-09-14T11:52:57.094056+0000","last_fullsized":"2024-09-14T11:52:57.094056+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.093902+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.305587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":25054,"num_write":828,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.134952+0000","last_change":"2024-09-14T11:53:12.134952+0000","last_active":"2024-09-14T11:53:12.134952+0000","last_peered":"2024-09-14T11:53:12.134952+0000","last_clean":"2024-09-14T11:53:12.134952+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:53:12.134952+0000","last_undegraded":"2024-09-14T11:53:12.134952+0000","last_fullsized":"2024-09-14T11:53:12.134952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.134861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:32.227065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.523769+0000","last_change":"2024-09-14T11:53:08.523674+0000","last_active":"2024-09-14T11:53:08.523769+0000","last_peered":"2024-09-14T11:53:08.523769+0000","last_clean":"2024-09-14T11:53:08.523769+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:53:08.523769+0000","last_undegraded":"2024-09-14T11:53:08.523769+0000","last_fullsized":"2024-09-14T11:53:08.523769+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.523568+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:13.194309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.285964+0000","last_change":"2024-09-14T11:53:24.285964+0000","last_active":"2024-09-14T11:53:24.285964+0000","last_peered":"2024-09-14T11:53:24.285964+0000","last_clean":"2024-09-14T11:53:24.285964+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:53:24.285964+0000","last_undegraded":"2024-09-14T11:53:24.285964+0000","last_fullsized":"2024-09-14T11:53:24.285964+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.285877+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.843489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'260","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.096248+0000","last_change":"2024-09-14T11:53:27.096151+0000","last_active":"2024-09-14T11:53:27.096248+0000","last_peered":"2024-09-14T11:53:27.096248+0000","last_clean":"2024-09-14T11:53:27.096248+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:53:27.096248+0000","last_undegraded":"2024-09-14T11:53:27.096248+0000","last_fullsized":"2024-09-14T11:53:27.096248+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.096040+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:25.152267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'612","reported_seq":2281,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.242310+0000","last_change":"2024-09-14T11:53:05.242310+0000","last_active":"2024-09-14T11:53:05.242310+0000","last_peered":"2024-09-14T11:53:05.242310+0000","last_clean":"2024-09-14T11:53:05.242310+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:53:05.242310+0000","last_undegraded":"2024-09-14T11:53:05.242310+0000","last_fullsized":"2024-09-14T11:53:05.242310+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'612","last_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_deep_scrub":"263'612","last_deep_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.242215+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:11.508154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'257","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.040132+0000","last_change":"2024-09-14T11:52:53.040059+0000","last_active":"2024-09-14T11:52:53.040132+0000","last_peered":"2024-09-14T11:52:53.040132+0000","last_clean":"2024-09-14T11:52:53.040132+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:52:53.040132+0000","last_undegraded":"2024-09-14T11:52:53.040132+0000","last_fullsized":"2024-09-14T11:52:53.040132+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.039947+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:30.725773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1223,"num_read_kb":9329,"num_write":1113,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.268246+0000","last_change":"2024-09-14T11:53:14.268246+0000","last_active":"2024-09-14T11:53:14.268246+0000","last_peered":"2024-09-14T11:53:14.268246+0000","last_clean":"2024-09-14T11:53:14.268246+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:53:14.268246+0000","last_undegraded":"2024-09-14T11:53:14.268246+0000","last_fullsized":"2024-09-14T11:53:14.268246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.268157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:01.064220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'120","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.286387+0000","last_change":"2024-09-14T11:53:19.286387+0000","last_active":"2024-09-14T11:53:19.286387+0000","last_peered":"2024-09-14T11:53:19.286387+0000","last_clean":"2024-09-14T11:53:19.286387+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:53:19.286387+0000","last_undegraded":"2024-09-14T11:53:19.286387+0000","last_fullsized":"2024-09-14T11:53:19.286387+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.286298+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:51.574721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8244,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":211,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'820","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.115955+0000","last_change":"2024-09-14T11:53:26.115955+0000","last_active":"2024-09-14T11:53:26.115955+0000","last_peered":"2024-09-14T11:53:26.115955+0000","last_clean":"2024-09-14T11:53:26.115955+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:53:26.115955+0000","last_undegraded":"2024-09-14T11:53:26.115955+0000","last_fullsized":"2024-09-14T11:53:26.115955+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.115863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:09.612135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.160898+0000","last_change":"2024-09-14T11:53:04.160898+0000","last_active":"2024-09-14T11:53:04.160898+0000","last_peered":"2024-09-14T11:53:04.160898+0000","last_clean":"2024-09-14T11:53:04.160898+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:53:04.160898+0000","last_undegraded":"2024-09-14T11:53:04.160898+0000","last_fullsized":"2024-09-14T11:53:04.160898+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.160798+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:16.863145+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'224","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.129865+0000","last_change":"2024-09-14T11:52:58.129865+0000","last_active":"2024-09-14T11:52:58.129865+0000","last_peered":"2024-09-14T11:52:58.129865+0000","last_clean":"2024-09-14T11:52:58.129865+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:52:58.129865+0000","last_undegraded":"2024-09-14T11:52:58.129865+0000","last_fullsized":"2024-09-14T11:52:58.129865+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.129706+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:14.434843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079921,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":75141,"num_write":989,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.162665+0000","last_change":"2024-09-14T11:53:13.162665+0000","last_active":"2024-09-14T11:53:13.162665+0000","last_peered":"2024-09-14T11:53:13.162665+0000","last_clean":"2024-09-14T11:53:13.162665+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:53:13.162665+0000","last_undegraded":"2024-09-14T11:53:13.162665+0000","last_fullsized":"2024-09-14T11:53:13.162665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.162577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:39.747982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'212","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.338000+0000","last_change":"2024-09-14T11:53:16.338000+0000","last_active":"2024-09-14T11:53:16.338000+0000","last_peered":"2024-09-14T11:53:16.338000+0000","last_clean":"2024-09-14T11:53:16.338000+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:53:16.338000+0000","last_undegraded":"2024-09-14T11:53:16.338000+0000","last_fullsized":"2024-09-14T11:53:16.338000+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.337891+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:14.933423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":357,"num_write":162,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.782825+0000","last_change":"2024-09-14T11:53:19.782825+0000","last_active":"2024-09-14T11:53:19.782825+0000","last_peered":"2024-09-14T11:53:19.782825+0000","last_clean":"2024-09-14T11:53:19.782825+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:53:19.782825+0000","last_undegraded":"2024-09-14T11:53:19.782825+0000","last_fullsized":"2024-09-14T11:53:19.782825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.782705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'547","reported_seq":1357,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.384403+0000","last_change":"2024-09-14T11:53:22.384403+0000","last_active":"2024-09-14T11:53:22.384403+0000","last_peered":"2024-09-14T11:53:22.384403+0000","last_clean":"2024-09-14T11:53:22.384403+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:53:22.384403+0000","last_undegraded":"2024-09-14T11:53:22.384403+0000","last_fullsized":"2024-09-14T11:53:22.384403+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.384319+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:30.798105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'471","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.111042+0000","last_change":"2024-09-14T11:52:56.111042+0000","last_active":"2024-09-14T11:52:56.111042+0000","last_peered":"2024-09-14T11:52:56.111042+0000","last_clean":"2024-09-14T11:52:56.111042+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:52:56.111042+0000","last_undegraded":"2024-09-14T11:52:56.111042+0000","last_fullsized":"2024-09-14T11:52:56.111042+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.110952+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:29.334828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'226","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.097292+0000","last_change":"2024-09-14T11:52:56.097229+0000","last_active":"2024-09-14T11:52:56.097292+0000","last_peered":"2024-09-14T11:52:56.097292+0000","last_clean":"2024-09-14T11:52:56.097292+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:56.097292+0000","last_undegraded":"2024-09-14T11:52:56.097292+0000","last_fullsized":"2024-09-14T11:52:56.097292+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.097135+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:19.941231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":64064,"num_write":1014,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.588684+0000","last_change":"2024-09-14T11:53:02.588684+0000","last_active":"2024-09-14T11:53:02.588684+0000","last_peered":"2024-09-14T11:53:02.588684+0000","last_clean":"2024-09-14T11:53:02.588684+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:53:02.588684+0000","last_undegraded":"2024-09-14T11:53:02.588684+0000","last_fullsized":"2024-09-14T11:53:02.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.588602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:29.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'143","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.136485+0000","last_change":"2024-09-14T11:53:16.136485+0000","last_active":"2024-09-14T11:53:16.136485+0000","last_peered":"2024-09-14T11:53:16.136485+0000","last_clean":"2024-09-14T11:53:16.136485+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:53:16.136485+0000","last_undegraded":"2024-09-14T11:53:16.136485+0000","last_fullsized":"2024-09-14T11:53:16.136485+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.136400+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.731799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":213,"num_write":84,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.073259+0000","last_change":"2024-09-14T11:53:23.073259+0000","last_active":"2024-09-14T11:53:23.073259+0000","last_peered":"2024-09-14T11:53:23.073259+0000","last_clean":"2024-09-14T11:53:23.073259+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:53:23.073259+0000","last_undegraded":"2024-09-14T11:53:23.073259+0000","last_fullsized":"2024-09-14T11:53:23.073259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.073170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:23.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'123","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.181896+0000","last_change":"2024-09-14T11:53:15.181896+0000","last_active":"2024-09-14T11:53:15.181896+0000","last_peered":"2024-09-14T11:53:15.181896+0000","last_clean":"2024-09-14T11:53:15.181896+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:53:15.181896+0000","last_undegraded":"2024-09-14T11:53:15.181896+0000","last_fullsized":"2024-09-14T11:53:15.181896+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.181804+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:14.148465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'382","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.036223+0000","last_change":"2024-09-14T11:53:02.036223+0000","last_active":"2024-09-14T11:53:02.036223+0000","last_peered":"2024-09-14T11:53:02.036223+0000","last_clean":"2024-09-14T11:53:02.036223+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:53:02.036223+0000","last_undegraded":"2024-09-14T11:53:02.036223+0000","last_fullsized":"2024-09-14T11:53:02.036223+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.036135+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:25.081091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'225","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.154338+0000","last_change":"2024-09-14T11:52:59.154258+0000","last_active":"2024-09-14T11:52:59.154338+0000","last_peered":"2024-09-14T11:52:59.154338+0000","last_clean":"2024-09-14T11:52:59.154338+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:52:59.154338+0000","last_undegraded":"2024-09-14T11:52:59.154338+0000","last_fullsized":"2024-09-14T11:52:59.154338+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.154158+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:38.092830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":542,"num_read_kb":106193,"num_write":937,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.544626+0000","last_change":"2024-09-14T11:53:03.544626+0000","last_active":"2024-09-14T11:53:03.544626+0000","last_peered":"2024-09-14T11:53:03.544626+0000","last_clean":"2024-09-14T11:53:03.544626+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:53:03.544626+0000","last_undegraded":"2024-09-14T11:53:03.544626+0000","last_fullsized":"2024-09-14T11:53:03.544626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.544542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.748879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'166","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.261160+0000","last_change":"2024-09-14T11:53:17.261160+0000","last_active":"2024-09-14T11:53:17.261160+0000","last_peered":"2024-09-14T11:53:17.261160+0000","last_clean":"2024-09-14T11:53:17.261160+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:53:17.261160+0000","last_undegraded":"2024-09-14T11:53:17.261160+0000","last_fullsized":"2024-09-14T11:53:17.261160+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.261070+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:34.279643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":261,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'775","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.182129+0000","last_change":"2024-09-14T11:53:19.182129+0000","last_active":"2024-09-14T11:53:19.182129+0000","last_peered":"2024-09-14T11:53:19.182129+0000","last_clean":"2024-09-14T11:53:19.182129+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:53:19.182129+0000","last_undegraded":"2024-09-14T11:53:19.182129+0000","last_fullsized":"2024-09-14T11:53:19.182129+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.181998+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:38.184284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.106544+0000","last_change":"2024-09-14T11:53:23.106544+0000","last_active":"2024-09-14T11:53:23.106544+0000","last_peered":"2024-09-14T11:53:23.106544+0000","last_clean":"2024-09-14T11:53:23.106544+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:53:23.106544+0000","last_undegraded":"2024-09-14T11:53:23.106544+0000","last_fullsized":"2024-09-14T11:53:23.106544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.106462+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:40.912530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'570","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.186783+0000","last_change":"2024-09-14T11:53:00.186783+0000","last_active":"2024-09-14T11:53:00.186783+0000","last_peered":"2024-09-14T11:53:00.186783+0000","last_clean":"2024-09-14T11:53:00.186783+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:53:00.186783+0000","last_undegraded":"2024-09-14T11:53:00.186783+0000","last_fullsized":"2024-09-14T11:53:00.186783+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'570","last_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_deep_scrub":"263'570","last_deep_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.186701+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:41.511182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'207","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.111589+0000","last_change":"2024-09-14T11:52:55.111500+0000","last_active":"2024-09-14T11:52:55.111589+0000","last_peered":"2024-09-14T11:52:55.111589+0000","last_clean":"2024-09-14T11:52:55.111589+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:52:55.111589+0000","last_undegraded":"2024-09-14T11:52:55.111589+0000","last_fullsized":"2024-09-14T11:52:55.111589+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.111364+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:22.418671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":32215,"num_write":875,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.475652+0000","last_change":"2024-09-14T11:53:05.475652+0000","last_active":"2024-09-14T11:53:05.475652+0000","last_peered":"2024-09-14T11:53:05.475652+0000","last_clean":"2024-09-14T11:53:05.475652+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:53:05.475652+0000","last_undegraded":"2024-09-14T11:53:05.475652+0000","last_fullsized":"2024-09-14T11:53:05.475652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.475568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:15.444965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.098235+0000","last_change":"2024-09-14T11:53:12.098235+0000","last_active":"2024-09-14T11:53:12.098235+0000","last_peered":"2024-09-14T11:53:12.098235+0000","last_clean":"2024-09-14T11:53:12.098235+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:53:12.098235+0000","last_undegraded":"2024-09-14T11:53:12.098235+0000","last_fullsized":"2024-09-14T11:53:12.098235+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.098129+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:24.419869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13546,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":273,"num_read_kb":390,"num_write":132,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.508991+0000","last_change":"2024-09-14T11:53:09.508991+0000","last_active":"2024-09-14T11:53:09.508991+0000","last_peered":"2024-09-14T11:53:09.508991+0000","last_clean":"2024-09-14T11:53:09.508991+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:53:09.508991+0000","last_undegraded":"2024-09-14T11:53:09.508991+0000","last_fullsized":"2024-09-14T11:53:09.508991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.508870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:39.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.718255+0000","last_change":"2024-09-14T11:53:16.718255+0000","last_active":"2024-09-14T11:53:16.718255+0000","last_peered":"2024-09-14T11:53:16.718255+0000","last_clean":"2024-09-14T11:53:16.718255+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:53:16.718255+0000","last_undegraded":"2024-09-14T11:53:16.718255+0000","last_fullsized":"2024-09-14T11:53:16.718255+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.718166+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.547409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'811","reported_seq":2372,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.066558+0000","last_change":"2024-09-14T11:52:57.066558+0000","last_active":"2024-09-14T11:52:57.066558+0000","last_peered":"2024-09-14T11:52:57.066558+0000","last_clean":"2024-09-14T11:52:57.066558+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:52:57.066558+0000","last_undegraded":"2024-09-14T11:52:57.066558+0000","last_fullsized":"2024-09-14T11:52:57.066558+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.066478+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.841841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'187","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.216245+0000","last_change":"2024-09-14T11:52:51.216155+0000","last_active":"2024-09-14T11:52:51.216245+0000","last_peered":"2024-09-14T11:52:51.216245+0000","last_clean":"2024-09-14T11:52:51.216245+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:52:51.216245+0000","last_undegraded":"2024-09-14T11:52:51.216245+0000","last_fullsized":"2024-09-14T11:52:51.216245+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.216003+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.941139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":535,"num_read_kb":54806,"num_write":892,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.525107+0000","last_change":"2024-09-14T11:53:04.525107+0000","last_active":"2024-09-14T11:53:04.525107+0000","last_peered":"2024-09-14T11:53:04.525107+0000","last_clean":"2024-09-14T11:53:04.525107+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:53:04.525107+0000","last_undegraded":"2024-09-14T11:53:04.525107+0000","last_fullsized":"2024-09-14T11:53:04.525107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.525015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:40.108078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'144","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.962742+0000","last_change":"2024-09-14T11:53:15.962742+0000","last_active":"2024-09-14T11:53:15.962742+0000","last_peered":"2024-09-14T11:53:15.962742+0000","last_clean":"2024-09-14T11:53:15.962742+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:53:15.962742+0000","last_undegraded":"2024-09-14T11:53:15.962742+0000","last_fullsized":"2024-09-14T11:53:15.962742+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.962648+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.163212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5347,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":234,"num_write":162,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.122842+0000","last_change":"2024-09-14T11:53:17.122842+0000","last_active":"2024-09-14T11:53:17.122842+0000","last_peered":"2024-09-14T11:53:17.122842+0000","last_clean":"2024-09-14T11:53:17.122842+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:53:17.122842+0000","last_undegraded":"2024-09-14T11:53:17.122842+0000","last_fullsized":"2024-09-14T11:53:17.122842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.122746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:30.958511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'136","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.087070+0000","last_change":"2024-09-14T11:53:28.087070+0000","last_active":"2024-09-14T11:53:28.087070+0000","last_peered":"2024-09-14T11:53:28.087070+0000","last_clean":"2024-09-14T11:53:28.087070+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:53:28.087070+0000","last_undegraded":"2024-09-14T11:53:28.087070+0000","last_fullsized":"2024-09-14T11:53:28.087070+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.086985+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:09.791675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'617","reported_seq":2142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.075392+0000","last_change":"2024-09-14T11:52:58.075392+0000","last_active":"2024-09-14T11:52:58.075392+0000","last_peered":"2024-09-14T11:52:58.075392+0000","last_clean":"2024-09-14T11:52:58.075392+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:58.075392+0000","last_undegraded":"2024-09-14T11:52:58.075392+0000","last_fullsized":"2024-09-14T11:52:58.075392+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.075304+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:31.134395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'217","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.692209+0000","last_change":"2024-09-14T11:52:51.692109+0000","last_active":"2024-09-14T11:52:51.692209+0000","last_peered":"2024-09-14T11:52:51.692209+0000","last_clean":"2024-09-14T11:52:51.692209+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:52:51.692209+0000","last_undegraded":"2024-09-14T11:52:51.692209+0000","last_fullsized":"2024-09-14T11:52:51.692209+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.691968+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:42.697133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1166,"num_read_kb":81327,"num_write":1108,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.592370+0000","last_change":"2024-09-14T11:53:07.592370+0000","last_active":"2024-09-14T11:53:07.592370+0000","last_peered":"2024-09-14T11:53:07.592370+0000","last_clean":"2024-09-14T11:53:07.592370+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:53:07.592370+0000","last_undegraded":"2024-09-14T11:53:07.592370+0000","last_fullsized":"2024-09-14T11:53:07.592370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.592234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:13.451667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'195","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.475678+0000","last_change":"2024-09-14T11:53:07.475678+0000","last_active":"2024-09-14T11:53:07.475678+0000","last_peered":"2024-09-14T11:53:07.475678+0000","last_clean":"2024-09-14T11:53:07.475678+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:53:07.475678+0000","last_undegraded":"2024-09-14T11:53:07.475678+0000","last_fullsized":"2024-09-14T11:53:07.475678+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.475570+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:11.623372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8518,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":257,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'750","reported_seq":2417,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.521357+0000","last_change":"2024-09-14T11:53:10.521357+0000","last_active":"2024-09-14T11:53:10.521357+0000","last_peered":"2024-09-14T11:53:10.521357+0000","last_clean":"2024-09-14T11:53:10.521357+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:53:10.521357+0000","last_undegraded":"2024-09-14T11:53:10.521357+0000","last_fullsized":"2024-09-14T11:53:10.521357+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.521256+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.722472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.703637+0000","last_change":"2024-09-14T11:53:15.703637+0000","last_active":"2024-09-14T11:53:15.703637+0000","last_peered":"2024-09-14T11:53:15.703637+0000","last_clean":"2024-09-14T11:53:15.703637+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:53:15.703637+0000","last_undegraded":"2024-09-14T11:53:15.703637+0000","last_fullsized":"2024-09-14T11:53:15.703637+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.703534+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:51.533479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.086088+0000","last_change":"2024-09-14T11:53:00.086088+0000","last_active":"2024-09-14T11:53:00.086088+0000","last_peered":"2024-09-14T11:53:00.086088+0000","last_clean":"2024-09-14T11:53:00.086088+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:53:00.086088+0000","last_undegraded":"2024-09-14T11:53:00.086088+0000","last_fullsized":"2024-09-14T11:53:00.086088+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.085999+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:14.084510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'215","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.132110+0000","last_change":"2024-09-14T11:52:53.132110+0000","last_active":"2024-09-14T11:52:53.132110+0000","last_peered":"2024-09-14T11:52:53.132110+0000","last_clean":"2024-09-14T11:52:53.132110+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:53.132110+0000","last_undegraded":"2024-09-14T11:52:53.132110+0000","last_fullsized":"2024-09-14T11:52:53.132110+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.131957+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.645543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":783,"num_read_kb":15229,"num_write":1055,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.189264+0000","last_change":"2024-09-14T11:53:12.189264+0000","last_active":"2024-09-14T11:53:12.189264+0000","last_peered":"2024-09-14T11:53:12.189264+0000","last_clean":"2024-09-14T11:53:12.189264+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:53:12.189264+0000","last_undegraded":"2024-09-14T11:53:12.189264+0000","last_fullsized":"2024-09-14T11:53:12.189264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.189152+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:05.891449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'70","reported_seq":594,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.143795+0000","last_change":"2024-09-14T11:53:19.143795+0000","last_active":"2024-09-14T11:53:19.143795+0000","last_peered":"2024-09-14T11:53:19.143795+0000","last_clean":"2024-09-14T11:53:19.143795+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:53:19.143795+0000","last_undegraded":"2024-09-14T11:53:19.143795+0000","last_fullsized":"2024-09-14T11:53:19.143795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'70","last_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_deep_scrub":"263'70","last_deep_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.143710+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:32.602096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'768","reported_seq":2426,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.117368+0000","last_change":"2024-09-14T11:53:09.117368+0000","last_active":"2024-09-14T11:53:09.117368+0000","last_peered":"2024-09-14T11:53:09.117368+0000","last_clean":"2024-09-14T11:53:09.117368+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:53:09.117368+0000","last_undegraded":"2024-09-14T11:53:09.117368+0000","last_fullsized":"2024-09-14T11:53:09.117368+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.117283+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:44.960384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.092221+0000","last_change":"2024-09-14T11:53:23.092221+0000","last_active":"2024-09-14T11:53:23.092221+0000","last_peered":"2024-09-14T11:53:23.092221+0000","last_clean":"2024-09-14T11:53:23.092221+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:53:23.092221+0000","last_undegraded":"2024-09-14T11:53:23.092221+0000","last_fullsized":"2024-09-14T11:53:23.092221+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.092123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:11.099011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.564244+0000","last_change":"2024-09-14T11:53:01.564244+0000","last_active":"2024-09-14T11:53:01.564244+0000","last_peered":"2024-09-14T11:53:01.564244+0000","last_clean":"2024-09-14T11:53:01.564244+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:53:01.564244+0000","last_undegraded":"2024-09-14T11:53:01.564244+0000","last_fullsized":"2024-09-14T11:53:01.564244+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.564148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'201","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.211667+0000","last_change":"2024-09-14T11:52:52.211667+0000","last_active":"2024-09-14T11:52:52.211667+0000","last_peered":"2024-09-14T11:52:52.211667+0000","last_clean":"2024-09-14T11:52:52.211667+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:52:52.211667+0000","last_undegraded":"2024-09-14T11:52:52.211667+0000","last_fullsized":"2024-09-14T11:52:52.211667+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.211587+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:11.190379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":47606,"num_write":839,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.989761+0000","last_change":"2024-09-14T11:53:11.989761+0000","last_active":"2024-09-14T11:53:11.989761+0000","last_peered":"2024-09-14T11:53:11.989761+0000","last_clean":"2024-09-14T11:53:11.989761+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:53:11.989761+0000","last_undegraded":"2024-09-14T11:53:11.989761+0000","last_fullsized":"2024-09-14T11:53:11.989761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.989664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:25.415110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'232","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.436418+0000","last_change":"2024-09-14T11:53:19.436418+0000","last_active":"2024-09-14T11:53:19.436418+0000","last_peered":"2024-09-14T11:53:19.436418+0000","last_clean":"2024-09-14T11:53:19.436418+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:53:19.436418+0000","last_undegraded":"2024-09-14T11:53:19.436418+0000","last_fullsized":"2024-09-14T11:53:19.436418+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.436301+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:00.458988+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26161,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":914,"num_read_kb":1030,"num_write":1436,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.145378+0000","last_change":"2024-09-14T11:53:08.145378+0000","last_active":"2024-09-14T11:53:08.145378+0000","last_peered":"2024-09-14T11:53:08.145378+0000","last_clean":"2024-09-14T11:53:08.145378+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:53:08.145378+0000","last_undegraded":"2024-09-14T11:53:08.145378+0000","last_fullsized":"2024-09-14T11:53:08.145378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.745898+0000","last_change":"2024-09-14T11:53:17.745898+0000","last_active":"2024-09-14T11:53:17.745898+0000","last_peered":"2024-09-14T11:53:17.745898+0000","last_clean":"2024-09-14T11:53:17.745898+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:53:17.745898+0000","last_undegraded":"2024-09-14T11:53:17.745898+0000","last_fullsized":"2024-09-14T11:53:17.745898+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.745809+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:39.872828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.037506+0000","last_change":"2024-09-14T11:52:59.037506+0000","last_active":"2024-09-14T11:52:59.037506+0000","last_peered":"2024-09-14T11:52:59.037506+0000","last_clean":"2024-09-14T11:52:59.037506+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:52:59.037506+0000","last_undegraded":"2024-09-14T11:52:59.037506+0000","last_fullsized":"2024-09-14T11:52:59.037506+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'406","last_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_deep_scrub":"263'406","last_deep_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.037411+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:45.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.055848+0000","last_change":"2024-09-14T11:52:53.055791+0000","last_active":"2024-09-14T11:52:53.055848+0000","last_peered":"2024-09-14T11:52:53.055848+0000","last_clean":"2024-09-14T11:52:53.055848+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:52:53.055848+0000","last_undegraded":"2024-09-14T11:52:53.055848+0000","last_fullsized":"2024-09-14T11:52:53.055848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.055702+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:39.492461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073420+0000","last_change":"2024-09-14T11:52:54.073420+0000","last_active":"2024-09-14T11:52:54.073420+0000","last_peered":"2024-09-14T11:52:54.073420+0000","last_clean":"2024-09-14T11:52:54.073420+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:52:54.073420+0000","last_undegraded":"2024-09-14T11:52:54.073420+0000","last_fullsized":"2024-09-14T11:52:54.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:45.391206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.243231+0000","last_change":"2024-09-14T11:52:53.243231+0000","last_active":"2024-09-14T11:52:53.243231+0000","last_peered":"2024-09-14T11:52:53.243231+0000","last_clean":"2024-09-14T11:52:53.243231+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:52:53.243231+0000","last_undegraded":"2024-09-14T11:52:53.243231+0000","last_fullsized":"2024-09-14T11:52:53.243231+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.243044+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:20.104275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1045,"num_read_kb":764,"num_write":1140,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.176344+0000","last_change":"2024-09-14T11:53:08.176344+0000","last_active":"2024-09-14T11:53:08.176344+0000","last_peered":"2024-09-14T11:53:08.176344+0000","last_clean":"2024-09-14T11:53:08.176344+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:53:08.176344+0000","last_undegraded":"2024-09-14T11:53:08.176344+0000","last_fullsized":"2024-09-14T11:53:08.176344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.176258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:21.229609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'331","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.336879+0000","last_change":"2024-09-14T11:53:17.336879+0000","last_active":"2024-09-14T11:53:17.336879+0000","last_peered":"2024-09-14T11:53:17.336879+0000","last_clean":"2024-09-14T11:53:17.336879+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:53:17.336879+0000","last_undegraded":"2024-09-14T11:53:17.336879+0000","last_fullsized":"2024-09-14T11:53:17.336879+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.336772+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.322808+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134988,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":1074,"num_write":544,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107214,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.166171+0000","last_change":"2024-09-14T11:53:21.166171+0000","last_active":"2024-09-14T11:53:21.166171+0000","last_peered":"2024-09-14T11:53:21.166171+0000","last_clean":"2024-09-14T11:53:21.166171+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:53:21.166171+0000","last_undegraded":"2024-09-14T11:53:21.166171+0000","last_fullsized":"2024-09-14T11:53:21.166171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.166078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:24.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'197","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.181810+0000","last_change":"2024-09-14T11:53:13.181810+0000","last_active":"2024-09-14T11:53:13.181810+0000","last_peered":"2024-09-14T11:53:13.181810+0000","last_clean":"2024-09-14T11:53:13.181810+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:53:13.181810+0000","last_undegraded":"2024-09-14T11:53:13.181810+0000","last_fullsized":"2024-09-14T11:53:13.181810+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.181724+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:09.456237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'450","reported_seq":2105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.140049+0000","last_change":"2024-09-14T11:53:01.140049+0000","last_active":"2024-09-14T11:53:01.140049+0000","last_peered":"2024-09-14T11:53:01.140049+0000","last_clean":"2024-09-14T11:53:01.140049+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:53:01.140049+0000","last_undegraded":"2024-09-14T11:53:01.140049+0000","last_fullsized":"2024-09-14T11:53:01.140049+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.139965+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:32.411582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.036795+0000","last_change":"2024-09-14T11:52:54.036739+0000","last_active":"2024-09-14T11:52:54.036795+0000","last_peered":"2024-09-14T11:52:54.036795+0000","last_clean":"2024-09-14T11:52:54.036795+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:52:54.036795+0000","last_undegraded":"2024-09-14T11:52:54.036795+0000","last_fullsized":"2024-09-14T11:52:54.036795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.036632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:29.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'230","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.250978+0000","last_change":"2024-09-14T11:52:49.250978+0000","last_active":"2024-09-14T11:52:49.250978+0000","last_peered":"2024-09-14T11:52:49.250978+0000","last_clean":"2024-09-14T11:52:49.250978+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:49.250978+0000","last_undegraded":"2024-09-14T11:52:49.250978+0000","last_fullsized":"2024-09-14T11:52:49.250978+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.250850+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:59.097045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":610,"num_read_kb":5636,"num_write":1050,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.194649+0000","last_change":"2024-09-14T11:53:11.194649+0000","last_active":"2024-09-14T11:53:11.194649+0000","last_peered":"2024-09-14T11:53:11.194649+0000","last_clean":"2024-09-14T11:53:11.194649+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:53:11.194649+0000","last_undegraded":"2024-09-14T11:53:11.194649+0000","last_fullsized":"2024-09-14T11:53:11.194649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.194559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.510855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'867","reported_seq":2306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.686128+0000","last_change":"2024-09-14T11:53:11.686128+0000","last_active":"2024-09-14T11:53:11.686128+0000","last_peered":"2024-09-14T11:53:11.686128+0000","last_clean":"2024-09-14T11:53:11.686128+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:53:11.686128+0000","last_undegraded":"2024-09-14T11:53:11.686128+0000","last_fullsized":"2024-09-14T11:53:11.686128+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'867","last_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_deep_scrub":"263'867","last_deep_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.686006+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.101195+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20878,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1373,"num_write":272,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.287601+0000","last_change":"2024-09-14T11:53:20.287601+0000","last_active":"2024-09-14T11:53:20.287601+0000","last_peered":"2024-09-14T11:53:20.287601+0000","last_clean":"2024-09-14T11:53:20.287601+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:53:20.287601+0000","last_undegraded":"2024-09-14T11:53:20.287601+0000","last_fullsized":"2024-09-14T11:53:20.287601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.287514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.831683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.776959+0000","last_change":"2024-09-14T11:53:18.776959+0000","last_active":"2024-09-14T11:53:18.776959+0000","last_peered":"2024-09-14T11:53:18.776959+0000","last_clean":"2024-09-14T11:53:18.776959+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:53:18.776959+0000","last_undegraded":"2024-09-14T11:53:18.776959+0000","last_fullsized":"2024-09-14T11:53:18.776959+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.776875+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:11.227597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'428","reported_seq":1915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.640237+0000","last_change":"2024-09-14T11:52:57.640237+0000","last_active":"2024-09-14T11:52:57.640237+0000","last_peered":"2024-09-14T11:52:57.640237+0000","last_clean":"2024-09-14T11:52:57.640237+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:52:57.640237+0000","last_undegraded":"2024-09-14T11:52:57.640237+0000","last_fullsized":"2024-09-14T11:52:57.640237+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.640146+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:10.948568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.657825+0000","last_change":"2024-09-14T11:52:50.657825+0000","last_active":"2024-09-14T11:52:50.657825+0000","last_peered":"2024-09-14T11:52:50.657825+0000","last_clean":"2024-09-14T11:52:50.657825+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:52:50.657825+0000","last_undegraded":"2024-09-14T11:52:50.657825+0000","last_fullsized":"2024-09-14T11:52:50.657825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.657760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:14.569819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'208","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.653529+0000","last_change":"2024-09-14T11:52:50.653452+0000","last_active":"2024-09-14T11:52:50.653529+0000","last_peered":"2024-09-14T11:52:50.653529+0000","last_clean":"2024-09-14T11:52:50.653529+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:52:50.653529+0000","last_undegraded":"2024-09-14T11:52:50.653529+0000","last_fullsized":"2024-09-14T11:52:50.653529+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.653307+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:26.358362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":52749,"num_write":993,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.580907+0000","last_change":"2024-09-14T11:53:01.580907+0000","last_active":"2024-09-14T11:53:01.580907+0000","last_peered":"2024-09-14T11:53:01.580907+0000","last_clean":"2024-09-14T11:53:01.580907+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:53:01.580907+0000","last_undegraded":"2024-09-14T11:53:01.580907+0000","last_fullsized":"2024-09-14T11:53:01.580907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.580787+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:28.319926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'228","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.218442+0000","last_change":"2024-09-14T11:53:16.218442+0000","last_active":"2024-09-14T11:53:16.218442+0000","last_peered":"2024-09-14T11:53:16.218442+0000","last_clean":"2024-09-14T11:53:16.218442+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:53:16.218442+0000","last_undegraded":"2024-09-14T11:53:16.218442+0000","last_fullsized":"2024-09-14T11:53:16.218442+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.218353+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.126525+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.162973+0000","last_change":"2024-09-14T11:53:16.162973+0000","last_active":"2024-09-14T11:53:16.162973+0000","last_peered":"2024-09-14T11:53:16.162973+0000","last_clean":"2024-09-14T11:53:16.162973+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:53:16.162973+0000","last_undegraded":"2024-09-14T11:53:16.162973+0000","last_fullsized":"2024-09-14T11:53:16.162973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.162891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:17.105651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.090088+0000","last_change":"2024-09-14T11:53:27.090088+0000","last_active":"2024-09-14T11:53:27.090088+0000","last_peered":"2024-09-14T11:53:27.090088+0000","last_clean":"2024-09-14T11:53:27.090088+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:53:27.090088+0000","last_undegraded":"2024-09-14T11:53:27.090088+0000","last_fullsized":"2024-09-14T11:53:27.090088+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.089965+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:34.480113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'460","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.638836+0000","last_change":"2024-09-14T11:52:56.638836+0000","last_active":"2024-09-14T11:52:56.638836+0000","last_peered":"2024-09-14T11:52:56.638836+0000","last_clean":"2024-09-14T11:52:56.638836+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:52:56.638836+0000","last_undegraded":"2024-09-14T11:52:56.638836+0000","last_fullsized":"2024-09-14T11:52:56.638836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.638748+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:35.929585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.023077+0000","last_change":"2024-09-14T11:52:52.023077+0000","last_active":"2024-09-14T11:52:52.023077+0000","last_peered":"2024-09-14T11:52:52.023077+0000","last_clean":"2024-09-14T11:52:52.023077+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:52:52.023077+0000","last_undegraded":"2024-09-14T11:52:52.023077+0000","last_fullsized":"2024-09-14T11:52:52.023077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.022923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:46.997948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'183","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.093157+0000","last_change":"2024-09-14T11:52:52.093157+0000","last_active":"2024-09-14T11:52:52.093157+0000","last_peered":"2024-09-14T11:52:52.093157+0000","last_clean":"2024-09-14T11:52:52.093157+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:52:52.093157+0000","last_undegraded":"2024-09-14T11:52:52.093157+0000","last_fullsized":"2024-09-14T11:52:52.093157+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.093023+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:24.168597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":11748,"num_write":873,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.055602+0000","last_change":"2024-09-14T11:53:09.055602+0000","last_active":"2024-09-14T11:53:09.055602+0000","last_peered":"2024-09-14T11:53:09.055602+0000","last_clean":"2024-09-14T11:53:09.055602+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:53:09.055602+0000","last_undegraded":"2024-09-14T11:53:09.055602+0000","last_fullsized":"2024-09-14T11:53:09.055602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.055524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.648168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'133","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.182260+0000","last_change":"2024-09-14T11:53:14.182260+0000","last_active":"2024-09-14T11:53:14.182260+0000","last_peered":"2024-09-14T11:53:14.182260+0000","last_clean":"2024-09-14T11:53:14.182260+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:53:14.182260+0000","last_undegraded":"2024-09-14T11:53:14.182260+0000","last_fullsized":"2024-09-14T11:53:14.182260+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.182169+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.712494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.096626+0000","last_change":"2024-09-14T11:53:07.096626+0000","last_active":"2024-09-14T11:53:07.096626+0000","last_peered":"2024-09-14T11:53:07.096626+0000","last_clean":"2024-09-14T11:53:07.096626+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:53:07.096626+0000","last_undegraded":"2024-09-14T11:53:07.096626+0000","last_fullsized":"2024-09-14T11:53:07.096626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.096502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.402188+0000","last_change":"2024-09-14T11:53:23.402188+0000","last_active":"2024-09-14T11:53:23.402188+0000","last_peered":"2024-09-14T11:53:23.402188+0000","last_clean":"2024-09-14T11:53:23.402188+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:53:23.402188+0000","last_undegraded":"2024-09-14T11:53:23.402188+0000","last_fullsized":"2024-09-14T11:53:23.402188+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.402102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:13.285898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.620545+0000","last_change":"2024-09-14T11:52:59.620545+0000","last_active":"2024-09-14T11:52:59.620545+0000","last_peered":"2024-09-14T11:52:59.620545+0000","last_clean":"2024-09-14T11:52:59.620545+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:52:59.620545+0000","last_undegraded":"2024-09-14T11:52:59.620545+0000","last_fullsized":"2024-09-14T11:52:59.620545+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.620455+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.069591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'230","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.046740+0000","last_change":"2024-09-14T11:52:53.046663+0000","last_active":"2024-09-14T11:52:53.046740+0000","last_peered":"2024-09-14T11:52:53.046740+0000","last_clean":"2024-09-14T11:52:53.046740+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:52:53.046740+0000","last_undegraded":"2024-09-14T11:52:53.046740+0000","last_fullsized":"2024-09-14T11:52:53.046740+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.046573+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:56.461752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":621,"num_read_kb":15435,"num_write":887,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.655319+0000","last_change":"2024-09-14T11:52:49.655319+0000","last_active":"2024-09-14T11:52:49.655319+0000","last_peered":"2024-09-14T11:52:49.655319+0000","last_clean":"2024-09-14T11:52:49.655319+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:52:49.655319+0000","last_undegraded":"2024-09-14T11:52:49.655319+0000","last_fullsized":"2024-09-14T11:52:49.655319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.655243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:56.511174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.093954+0000","last_change":"2024-09-14T11:53:08.093954+0000","last_active":"2024-09-14T11:53:08.093954+0000","last_peered":"2024-09-14T11:53:08.093954+0000","last_clean":"2024-09-14T11:53:08.093954+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:53:08.093954+0000","last_undegraded":"2024-09-14T11:53:08.093954+0000","last_fullsized":"2024-09-14T11:53:08.093954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:08.707957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.094345+0000","last_change":"2024-09-14T11:53:11.094245+0000","last_active":"2024-09-14T11:53:11.094345+0000","last_peered":"2024-09-14T11:53:11.094345+0000","last_clean":"2024-09-14T11:53:11.094345+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:53:11.094345+0000","last_undegraded":"2024-09-14T11:53:11.094345+0000","last_fullsized":"2024-09-14T11:53:11.094345+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.094126+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:08.521028+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":423,"num_read_kb":619,"num_write":282,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.045776+0000","last_change":"2024-09-14T11:53:21.045776+0000","last_active":"2024-09-14T11:53:21.045776+0000","last_peered":"2024-09-14T11:53:21.045776+0000","last_clean":"2024-09-14T11:53:21.045776+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:53:21.045776+0000","last_undegraded":"2024-09-14T11:53:21.045776+0000","last_fullsized":"2024-09-14T11:53:21.045776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.045682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.343493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'214","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.181097+0000","last_change":"2024-09-14T11:53:25.181097+0000","last_active":"2024-09-14T11:53:25.181097+0000","last_peered":"2024-09-14T11:53:25.181097+0000","last_clean":"2024-09-14T11:53:25.181097+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:53:25.181097+0000","last_undegraded":"2024-09-14T11:53:25.181097+0000","last_fullsized":"2024-09-14T11:53:25.181097+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.180991+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:20.010846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'432","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.206365+0000","last_change":"2024-09-14T11:52:59.206365+0000","last_active":"2024-09-14T11:52:59.206365+0000","last_peered":"2024-09-14T11:52:59.206365+0000","last_clean":"2024-09-14T11:52:59.206365+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:59.206365+0000","last_undegraded":"2024-09-14T11:52:59.206365+0000","last_fullsized":"2024-09-14T11:52:59.206365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.206274+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:24.686804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'220","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.617381+0000","last_change":"2024-09-14T11:52:52.617381+0000","last_active":"2024-09-14T11:52:52.617381+0000","last_peered":"2024-09-14T11:52:52.617381+0000","last_clean":"2024-09-14T11:52:52.617381+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:52:52.617381+0000","last_undegraded":"2024-09-14T11:52:52.617381+0000","last_fullsized":"2024-09-14T11:52:52.617381+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.617251+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.949283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":606,"num_read_kb":78521,"num_write":1035,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.074859+0000","last_change":"2024-09-14T11:52:55.074859+0000","last_active":"2024-09-14T11:52:55.074859+0000","last_peered":"2024-09-14T11:52:55.074859+0000","last_clean":"2024-09-14T11:52:55.074859+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:52:55.074859+0000","last_undegraded":"2024-09-14T11:52:55.074859+0000","last_fullsized":"2024-09-14T11:52:55.074859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.074773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.397184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.051330+0000","last_change":"2024-09-14T11:53:04.051330+0000","last_active":"2024-09-14T11:53:04.051330+0000","last_peered":"2024-09-14T11:53:04.051330+0000","last_clean":"2024-09-14T11:53:04.051330+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:53:04.051330+0000","last_undegraded":"2024-09-14T11:53:04.051330+0000","last_fullsized":"2024-09-14T11:53:04.051330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.051237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.225013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.709019+0000","last_change":"2024-09-14T11:53:10.709019+0000","last_active":"2024-09-14T11:53:10.709019+0000","last_peered":"2024-09-14T11:53:10.709019+0000","last_clean":"2024-09-14T11:53:10.709019+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:53:10.709019+0000","last_undegraded":"2024-09-14T11:53:10.709019+0000","last_fullsized":"2024-09-14T11:53:10.709019+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.708910+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:06.343251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'804","reported_seq":4898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.425484+0000","last_change":"2024-09-14T11:53:20.425417+0000","last_active":"2024-09-14T11:53:20.425484+0000","last_peered":"2024-09-14T11:53:20.425484+0000","last_clean":"2024-09-14T11:53:20.425484+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:53:20.425484+0000","last_undegraded":"2024-09-14T11:53:20.425484+0000","last_fullsized":"2024-09-14T11:53:20.425484+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.425325+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:54.306099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'157","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.244973+0000","last_change":"2024-09-14T11:53:33.244973+0000","last_active":"2024-09-14T11:53:33.244973+0000","last_peered":"2024-09-14T11:53:33.244973+0000","last_clean":"2024-09-14T11:53:33.244973+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:53:33.244973+0000","last_undegraded":"2024-09-14T11:53:33.244973+0000","last_fullsized":"2024-09-14T11:53:33.244973+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-14T11:53:33.244901+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-14T11:53:33.244901+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.244901+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.219132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'342","reported_seq":1716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.566689+0000","last_change":"2024-09-14T11:52:58.566626+0000","last_active":"2024-09-14T11:52:58.566689+0000","last_peered":"2024-09-14T11:52:58.566689+0000","last_clean":"2024-09-14T11:52:58.566689+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:52:58.566689+0000","last_undegraded":"2024-09-14T11:52:58.566689+0000","last_fullsized":"2024-09-14T11:52:58.566689+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.566512+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:15.609009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'297","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.184746+0000","last_change":"2024-09-14T11:52:55.184746+0000","last_active":"2024-09-14T11:52:55.184746+0000","last_peered":"2024-09-14T11:52:55.184746+0000","last_clean":"2024-09-14T11:52:55.184746+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:52:55.184746+0000","last_undegraded":"2024-09-14T11:52:55.184746+0000","last_fullsized":"2024-09-14T11:52:55.184746+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.184619+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.242032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1185,"num_read_kb":53005,"num_write":1239,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.619046+0000","last_change":"2024-09-14T11:52:51.619046+0000","last_active":"2024-09-14T11:52:51.619046+0000","last_peered":"2024-09-14T11:52:51.619046+0000","last_clean":"2024-09-14T11:52:51.619046+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:52:51.619046+0000","last_undegraded":"2024-09-14T11:52:51.619046+0000","last_fullsized":"2024-09-14T11:52:51.619046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.618977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:09.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.970888+0000","last_change":"2024-09-14T11:53:10.970888+0000","last_active":"2024-09-14T11:53:10.970888+0000","last_peered":"2024-09-14T11:53:10.970888+0000","last_clean":"2024-09-14T11:53:10.970888+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:53:10.970888+0000","last_undegraded":"2024-09-14T11:53:10.970888+0000","last_fullsized":"2024-09-14T11:53:10.970888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.970798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:12.248353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'114","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.010145+0000","last_change":"2024-09-14T11:53:15.010145+0000","last_active":"2024-09-14T11:53:15.010145+0000","last_peered":"2024-09-14T11:53:15.010145+0000","last_clean":"2024-09-14T11:53:15.010145+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:53:15.010145+0000","last_undegraded":"2024-09-14T11:53:15.010145+0000","last_fullsized":"2024-09-14T11:53:15.010145+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.010051+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:26.337936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'821","reported_seq":4196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.105578+0000","last_change":"2024-09-14T11:53:25.105578+0000","last_active":"2024-09-14T11:53:25.105578+0000","last_peered":"2024-09-14T11:53:25.105578+0000","last_clean":"2024-09-14T11:53:25.105578+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:53:25.105578+0000","last_undegraded":"2024-09-14T11:53:25.105578+0000","last_fullsized":"2024-09-14T11:53:25.105578+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'821","last_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_deep_scrub":"263'821","last_deep_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.105499+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:28.204436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'302","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.148521+0000","last_change":"2024-09-14T11:53:24.148521+0000","last_active":"2024-09-14T11:53:24.148521+0000","last_peered":"2024-09-14T11:53:24.148521+0000","last_clean":"2024-09-14T11:53:24.148521+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:53:24.148521+0000","last_undegraded":"2024-09-14T11:53:24.148521+0000","last_fullsized":"2024-09-14T11:53:24.148521+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.148430+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:52.508148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'547","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.103069+0000","last_change":"2024-09-14T11:52:55.103069+0000","last_active":"2024-09-14T11:52:55.103069+0000","last_peered":"2024-09-14T11:52:55.103069+0000","last_clean":"2024-09-14T11:52:55.103069+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:52:55.103069+0000","last_undegraded":"2024-09-14T11:52:55.103069+0000","last_fullsized":"2024-09-14T11:52:55.103069+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.102970+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.863637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.184613+0000","last_change":"2024-09-14T11:52:51.184613+0000","last_active":"2024-09-14T11:52:51.184613+0000","last_peered":"2024-09-14T11:52:51.184613+0000","last_clean":"2024-09-14T11:52:51.184613+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:52:51.184613+0000","last_undegraded":"2024-09-14T11:52:51.184613+0000","last_fullsized":"2024-09-14T11:52:51.184613+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.184537+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:22.858482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":59716,"num_write":954,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.049162+0000","last_change":"2024-09-14T11:52:52.049162+0000","last_active":"2024-09-14T11:52:52.049162+0000","last_peered":"2024-09-14T11:52:52.049162+0000","last_clean":"2024-09-14T11:52:52.049162+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:52:52.049162+0000","last_undegraded":"2024-09-14T11:52:52.049162+0000","last_fullsized":"2024-09-14T11:52:52.049162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.049078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:46.676372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.152296+0000","last_change":"2024-09-14T11:53:13.152251+0000","last_active":"2024-09-14T11:53:13.152296+0000","last_peered":"2024-09-14T11:53:13.152296+0000","last_clean":"2024-09-14T11:53:13.152296+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:53:13.152296+0000","last_undegraded":"2024-09-14T11:53:13.152296+0000","last_fullsized":"2024-09-14T11:53:13.152296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.152189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.260123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'328","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.175445+0000","last_change":"2024-09-14T11:53:15.175445+0000","last_active":"2024-09-14T11:53:15.175445+0000","last_peered":"2024-09-14T11:53:15.175445+0000","last_clean":"2024-09-14T11:53:15.175445+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:53:15.175445+0000","last_undegraded":"2024-09-14T11:53:15.175445+0000","last_fullsized":"2024-09-14T11:53:15.175445+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.175339+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:47.661577+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":700,"num_write":238,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.156207+0000","last_change":"2024-09-14T11:53:20.156207+0000","last_active":"2024-09-14T11:53:20.156207+0000","last_peered":"2024-09-14T11:53:20.156207+0000","last_clean":"2024-09-14T11:53:20.156207+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:53:20.156207+0000","last_undegraded":"2024-09-14T11:53:20.156207+0000","last_fullsized":"2024-09-14T11:53:20.156207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.156101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:40.870675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'122","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.377574+0000","last_change":"2024-09-14T11:53:24.377574+0000","last_active":"2024-09-14T11:53:24.377574+0000","last_peered":"2024-09-14T11:53:24.377574+0000","last_clean":"2024-09-14T11:53:24.377574+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:53:24.377574+0000","last_undegraded":"2024-09-14T11:53:24.377574+0000","last_fullsized":"2024-09-14T11:53:24.377574+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.377480+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:39.476878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'146","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.213746+0000","last_change":"2024-09-14T11:53:28.213746+0000","last_active":"2024-09-14T11:53:28.213746+0000","last_peered":"2024-09-14T11:53:28.213746+0000","last_clean":"2024-09-14T11:53:28.213746+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:53:28.213746+0000","last_undegraded":"2024-09-14T11:53:28.213746+0000","last_fullsized":"2024-09-14T11:53:28.213746+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.213666+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.633390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'730","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.077001+0000","last_change":"2024-09-14T11:52:59.076916+0000","last_active":"2024-09-14T11:52:59.077001+0000","last_peered":"2024-09-14T11:52:59.077001+0000","last_clean":"2024-09-14T11:52:59.077001+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:59.077001+0000","last_undegraded":"2024-09-14T11:52:59.077001+0000","last_fullsized":"2024-09-14T11:52:59.077001+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'730","last_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_deep_scrub":"263'730","last_deep_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.076833+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:00.485111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'234","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648650+0000","last_change":"2024-09-14T11:52:54.648589+0000","last_active":"2024-09-14T11:52:54.648650+0000","last_peered":"2024-09-14T11:52:54.648650+0000","last_clean":"2024-09-14T11:52:54.648650+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:52:54.648650+0000","last_undegraded":"2024-09-14T11:52:54.648650+0000","last_fullsized":"2024-09-14T11:52:54.648650+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'234","last_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_deep_scrub":"263'234","last_deep_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648451+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.438311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":19030,"num_write":1058,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.567001+0000","last_change":"2024-09-14T11:53:06.566908+0000","last_active":"2024-09-14T11:53:06.567001+0000","last_peered":"2024-09-14T11:53:06.567001+0000","last_clean":"2024-09-14T11:53:06.567001+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:53:06.567001+0000","last_undegraded":"2024-09-14T11:53:06.567001+0000","last_fullsized":"2024-09-14T11:53:06.567001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.566787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:22.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.177257+0000","last_change":"2024-09-14T11:53:15.177257+0000","last_active":"2024-09-14T11:53:15.177257+0000","last_peered":"2024-09-14T11:53:15.177257+0000","last_clean":"2024-09-14T11:53:15.177257+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:53:15.177257+0000","last_undegraded":"2024-09-14T11:53:15.177257+0000","last_fullsized":"2024-09-14T11:53:15.177257+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.177164+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.136369+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.099503+0000","last_change":"2024-09-14T11:53:24.099503+0000","last_active":"2024-09-14T11:53:24.099503+0000","last_peered":"2024-09-14T11:53:24.099503+0000","last_clean":"2024-09-14T11:53:24.099503+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:53:24.099503+0000","last_undegraded":"2024-09-14T11:53:24.099503+0000","last_fullsized":"2024-09-14T11:53:24.099503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.099423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:22.546626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.197477+0000","last_change":"2024-09-14T11:53:34.197477+0000","last_active":"2024-09-14T11:53:34.197477+0000","last_peered":"2024-09-14T11:53:34.197477+0000","last_clean":"2024-09-14T11:53:34.197477+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:53:34.197477+0000","last_undegraded":"2024-09-14T11:53:34.197477+0000","last_fullsized":"2024-09-14T11:53:34.197477+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T11:53:34.197397+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T11:53:34.197397+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.197397+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:22.083165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'714","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.612425+0000","last_change":"2024-09-14T11:53:02.612361+0000","last_active":"2024-09-14T11:53:02.612425+0000","last_peered":"2024-09-14T11:53:02.612425+0000","last_clean":"2024-09-14T11:53:02.612425+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:53:02.612425+0000","last_undegraded":"2024-09-14T11:53:02.612425+0000","last_fullsized":"2024-09-14T11:53:02.612425+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'714","last_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_deep_scrub":"263'714","last_deep_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.612273+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:14.047702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'188","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.133662+0000","last_change":"2024-09-14T11:53:02.133662+0000","last_active":"2024-09-14T11:53:02.133662+0000","last_peered":"2024-09-14T11:53:02.133662+0000","last_clean":"2024-09-14T11:53:02.133662+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:53:02.133662+0000","last_undegraded":"2024-09-14T11:53:02.133662+0000","last_fullsized":"2024-09-14T11:53:02.133662+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.133543+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:44.205392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":26239,"num_write":895,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.095817+0000","last_change":"2024-09-14T11:53:11.095817+0000","last_active":"2024-09-14T11:53:11.095817+0000","last_peered":"2024-09-14T11:53:11.095817+0000","last_clean":"2024-09-14T11:53:11.095817+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:53:11.095817+0000","last_undegraded":"2024-09-14T11:53:11.095817+0000","last_fullsized":"2024-09-14T11:53:11.095817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.095748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:44.339265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'56","reported_seq":560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.134541+0000","last_change":"2024-09-14T11:53:13.134495+0000","last_active":"2024-09-14T11:53:13.134541+0000","last_peered":"2024-09-14T11:53:13.134541+0000","last_clean":"2024-09-14T11:53:13.134541+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:53:13.134541+0000","last_undegraded":"2024-09-14T11:53:13.134541+0000","last_fullsized":"2024-09-14T11:53:13.134541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'56","last_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_deep_scrub":"263'56","last_deep_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.134433+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:17.922011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.276886+0000","last_change":"2024-09-14T11:53:22.276886+0000","last_active":"2024-09-14T11:53:22.276886+0000","last_peered":"2024-09-14T11:53:22.276886+0000","last_clean":"2024-09-14T11:53:22.276886+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:53:22.276886+0000","last_undegraded":"2024-09-14T11:53:22.276886+0000","last_fullsized":"2024-09-14T11:53:22.276886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.276785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:00.923129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'196","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.178319+0000","last_change":"2024-09-14T11:53:27.178248+0000","last_active":"2024-09-14T11:53:27.178319+0000","last_peered":"2024-09-14T11:53:27.178319+0000","last_clean":"2024-09-14T11:53:27.178319+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:53:27.178319+0000","last_undegraded":"2024-09-14T11:53:27.178319+0000","last_fullsized":"2024-09-14T11:53:27.178319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.178165+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:20.272802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'490","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.224894+0000","last_change":"2024-09-14T11:53:03.224838+0000","last_active":"2024-09-14T11:53:03.224894+0000","last_peered":"2024-09-14T11:53:03.224894+0000","last_clean":"2024-09-14T11:53:03.224894+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:53:03.224894+0000","last_undegraded":"2024-09-14T11:53:03.224894+0000","last_fullsized":"2024-09-14T11:53:03.224894+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.224751+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:34.212444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'205","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.109079+0000","last_change":"2024-09-14T11:52:56.109079+0000","last_active":"2024-09-14T11:52:56.109079+0000","last_peered":"2024-09-14T11:52:56.109079+0000","last_clean":"2024-09-14T11:52:56.109079+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:52:56.109079+0000","last_undegraded":"2024-09-14T11:52:56.109079+0000","last_fullsized":"2024-09-14T11:52:56.109079+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.108961+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:38.858667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":474,"num_read_kb":67081,"num_write":927,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.152240+0000","last_change":"2024-09-14T11:53:12.152240+0000","last_active":"2024-09-14T11:53:12.152240+0000","last_peered":"2024-09-14T11:53:12.152240+0000","last_clean":"2024-09-14T11:53:12.152240+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:53:12.152240+0000","last_undegraded":"2024-09-14T11:53:12.152240+0000","last_fullsized":"2024-09-14T11:53:12.152240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.152139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:42.429598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'167","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.162673+0000","last_change":"2024-09-14T11:53:21.162673+0000","last_active":"2024-09-14T11:53:21.162673+0000","last_peered":"2024-09-14T11:53:21.162673+0000","last_clean":"2024-09-14T11:53:21.162673+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:53:21.162673+0000","last_undegraded":"2024-09-14T11:53:21.162673+0000","last_fullsized":"2024-09-14T11:53:21.162673+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.162567+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:31.657212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":278,"num_write":116,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.083218+0000","last_change":"2024-09-14T11:53:10.083150+0000","last_active":"2024-09-14T11:53:10.083218+0000","last_peered":"2024-09-14T11:53:10.083218+0000","last_clean":"2024-09-14T11:53:10.083218+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:53:10.083218+0000","last_undegraded":"2024-09-14T11:53:10.083218+0000","last_fullsized":"2024-09-14T11:53:10.083218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.083034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:04.878196+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'160","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.350996+0000","last_change":"2024-09-14T11:53:27.350930+0000","last_active":"2024-09-14T11:53:27.350996+0000","last_peered":"2024-09-14T11:53:27.350996+0000","last_clean":"2024-09-14T11:53:27.350996+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:53:27.350996+0000","last_undegraded":"2024-09-14T11:53:27.350996+0000","last_fullsized":"2024-09-14T11:53:27.350996+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'160","last_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_deep_scrub":"263'160","last_deep_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.350845+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:40.944695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1180","reported_seq":2930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.193367+0000","last_change":"2024-09-14T11:53:02.193307+0000","last_active":"2024-09-14T11:53:02.193367+0000","last_peered":"2024-09-14T11:53:02.193367+0000","last_clean":"2024-09-14T11:53:02.193367+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:53:02.193367+0000","last_undegraded":"2024-09-14T11:53:02.193367+0000","last_fullsized":"2024-09-14T11:53:02.193367+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1180","last_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_deep_scrub":"263'1180","last_deep_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.193183+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:52.922671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'190","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.177272+0000","last_change":"2024-09-14T11:52:52.177272+0000","last_active":"2024-09-14T11:52:52.177272+0000","last_peered":"2024-09-14T11:52:52.177272+0000","last_clean":"2024-09-14T11:52:52.177272+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:52:52.177272+0000","last_undegraded":"2024-09-14T11:52:52.177272+0000","last_fullsized":"2024-09-14T11:52:52.177272+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.177191+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.347583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":13209,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.059077+0000","last_change":"2024-09-14T11:53:05.059021+0000","last_active":"2024-09-14T11:53:05.059077+0000","last_peered":"2024-09-14T11:53:05.059077+0000","last_clean":"2024-09-14T11:53:05.059077+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:53:05.059077+0000","last_undegraded":"2024-09-14T11:53:05.059077+0000","last_fullsized":"2024-09-14T11:53:05.059077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.058935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.616585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'128","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.283758+0000","last_change":"2024-09-14T11:53:18.283758+0000","last_active":"2024-09-14T11:53:18.283758+0000","last_peered":"2024-09-14T11:53:18.283758+0000","last_clean":"2024-09-14T11:53:18.283758+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:53:18.283758+0000","last_undegraded":"2024-09-14T11:53:18.283758+0000","last_fullsized":"2024-09-14T11:53:18.283758+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.283644+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:20.993861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":210,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.167421+0000","last_change":"2024-09-14T11:53:18.167421+0000","last_active":"2024-09-14T11:53:18.167421+0000","last_peered":"2024-09-14T11:53:18.167421+0000","last_clean":"2024-09-14T11:53:18.167421+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:53:18.167421+0000","last_undegraded":"2024-09-14T11:53:18.167421+0000","last_fullsized":"2024-09-14T11:53:18.167421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.167336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:49.069995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1630","reported_seq":3338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.020929+0000","last_change":"2024-09-14T11:53:00.020929+0000","last_active":"2024-09-14T11:53:00.020929+0000","last_peered":"2024-09-14T11:53:00.020929+0000","last_clean":"2024-09-14T11:53:00.020929+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:53:00.020929+0000","last_undegraded":"2024-09-14T11:53:00.020929+0000","last_fullsized":"2024-09-14T11:53:00.020929+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1630","last_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_deep_scrub":"263'1630","last_deep_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.020831+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:01.658072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'230","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.223218+0000","last_change":"2024-09-14T11:52:54.223218+0000","last_active":"2024-09-14T11:52:54.223218+0000","last_peered":"2024-09-14T11:52:54.223218+0000","last_clean":"2024-09-14T11:52:54.223218+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:54.223218+0000","last_undegraded":"2024-09-14T11:52:54.223218+0000","last_fullsized":"2024-09-14T11:52:54.223218+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.223086+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:16.621473+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":62996,"num_write":1114,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.072476+0000","last_change":"2024-09-14T11:53:10.072366+0000","last_active":"2024-09-14T11:53:10.072476+0000","last_peered":"2024-09-14T11:53:10.072476+0000","last_clean":"2024-09-14T11:53:10.072476+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:53:10.072476+0000","last_undegraded":"2024-09-14T11:53:10.072476+0000","last_fullsized":"2024-09-14T11:53:10.072476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.072273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:53.959740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.646851+0000","last_change":"2024-09-14T11:53:12.646754+0000","last_active":"2024-09-14T11:53:12.646851+0000","last_peered":"2024-09-14T11:53:12.646851+0000","last_clean":"2024-09-14T11:53:12.646851+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:53:12.646851+0000","last_undegraded":"2024-09-14T11:53:12.646851+0000","last_fullsized":"2024-09-14T11:53:12.646851+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.646643+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:18.251475+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":490,"num_write":204,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.429725+0000","last_change":"2024-09-14T11:53:21.429630+0000","last_active":"2024-09-14T11:53:21.429725+0000","last_peered":"2024-09-14T11:53:21.429725+0000","last_clean":"2024-09-14T11:53:21.429725+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:53:21.429725+0000","last_undegraded":"2024-09-14T11:53:21.429725+0000","last_fullsized":"2024-09-14T11:53:21.429725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.429514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:02.974268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'166","reported_seq":684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.136731+0000","last_change":"2024-09-14T11:53:29.136731+0000","last_active":"2024-09-14T11:53:29.136731+0000","last_peered":"2024-09-14T11:53:29.136731+0000","last_clean":"2024-09-14T11:53:29.136731+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:53:29.136731+0000","last_undegraded":"2024-09-14T11:53:29.136731+0000","last_fullsized":"2024-09-14T11:53:29.136731+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:53:29.136643+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:53:29.136643+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.136643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:48.253911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'426","reported_seq":2040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.118762+0000","last_change":"2024-09-14T11:53:03.118696+0000","last_active":"2024-09-14T11:53:03.118762+0000","last_peered":"2024-09-14T11:53:03.118762+0000","last_clean":"2024-09-14T11:53:03.118762+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:53:03.118762+0000","last_undegraded":"2024-09-14T11:53:03.118762+0000","last_fullsized":"2024-09-14T11:53:03.118762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.118613+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.478029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'181","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.646490+0000","last_change":"2024-09-14T11:52:58.646490+0000","last_active":"2024-09-14T11:52:58.646490+0000","last_peered":"2024-09-14T11:52:58.646490+0000","last_clean":"2024-09-14T11:52:58.646490+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:52:58.646490+0000","last_undegraded":"2024-09-14T11:52:58.646490+0000","last_fullsized":"2024-09-14T11:52:58.646490+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.646391+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:28.666065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":12441,"num_write":906,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.108231+0000","last_change":"2024-09-14T11:53:06.108231+0000","last_active":"2024-09-14T11:53:06.108231+0000","last_peered":"2024-09-14T11:53:06.108231+0000","last_clean":"2024-09-14T11:53:06.108231+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:53:06.108231+0000","last_undegraded":"2024-09-14T11:53:06.108231+0000","last_fullsized":"2024-09-14T11:53:06.108231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.108140+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:42.873671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":1194,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'171","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.305984+0000","last_change":"2024-09-14T11:53:21.305912+0000","last_active":"2024-09-14T11:53:21.305984+0000","last_peered":"2024-09-14T11:53:21.305984+0000","last_clean":"2024-09-14T11:53:21.305984+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:53:21.305984+0000","last_undegraded":"2024-09-14T11:53:21.305984+0000","last_fullsized":"2024-09-14T11:53:21.305984+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.305812+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:16.144405+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9714,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":303,"num_write":148,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.665685+0000","last_change":"2024-09-14T11:53:13.665636+0000","last_active":"2024-09-14T11:53:13.665685+0000","last_peered":"2024-09-14T11:53:13.665685+0000","last_clean":"2024-09-14T11:53:13.665685+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:53:13.665685+0000","last_undegraded":"2024-09-14T11:53:13.665685+0000","last_fullsized":"2024-09-14T11:53:13.665685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.665547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:19.013303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'179","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.158325+0000","last_change":"2024-09-14T11:53:14.158325+0000","last_active":"2024-09-14T11:53:14.158325+0000","last_peered":"2024-09-14T11:53:14.158325+0000","last_clean":"2024-09-14T11:53:14.158325+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:53:14.158325+0000","last_undegraded":"2024-09-14T11:53:14.158325+0000","last_fullsized":"2024-09-14T11:53:14.158325+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.158221+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:36.491282+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'378","reported_seq":1791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.177685+0000","last_change":"2024-09-14T11:53:07.177623+0000","last_active":"2024-09-14T11:53:07.177685+0000","last_peered":"2024-09-14T11:53:07.177685+0000","last_clean":"2024-09-14T11:53:07.177685+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:53:07.177685+0000","last_undegraded":"2024-09-14T11:53:07.177685+0000","last_fullsized":"2024-09-14T11:53:07.177685+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.177534+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:21.980111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'245","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.133728+0000","last_change":"2024-09-14T11:52:51.133645+0000","last_active":"2024-09-14T11:52:51.133728+0000","last_peered":"2024-09-14T11:52:51.133728+0000","last_clean":"2024-09-14T11:52:51.133728+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:52:51.133728+0000","last_undegraded":"2024-09-14T11:52:51.133728+0000","last_fullsized":"2024-09-14T11:52:51.133728+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'245","last_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_deep_scrub":"263'245","last_deep_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.133522+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:35.776995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":23729,"num_write":1071,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.020228+0000","last_change":"2024-09-14T11:53:14.020147+0000","last_active":"2024-09-14T11:53:14.020228+0000","last_peered":"2024-09-14T11:53:14.020228+0000","last_clean":"2024-09-14T11:53:14.020228+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:53:14.020228+0000","last_undegraded":"2024-09-14T11:53:14.020228+0000","last_fullsized":"2024-09-14T11:53:14.020228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.020037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:43.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'151","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.179369+0000","last_change":"2024-09-14T11:53:18.179369+0000","last_active":"2024-09-14T11:53:18.179369+0000","last_peered":"2024-09-14T11:53:18.179369+0000","last_clean":"2024-09-14T11:53:18.179369+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:53:18.179369+0000","last_undegraded":"2024-09-14T11:53:18.179369+0000","last_fullsized":"2024-09-14T11:53:18.179369+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.179285+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:06.813662+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33350,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":317,"num_write":100,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.692287+0000","last_change":"2024-09-14T11:53:14.692236+0000","last_active":"2024-09-14T11:53:14.692287+0000","last_peered":"2024-09-14T11:53:14.692287+0000","last_clean":"2024-09-14T11:53:14.692287+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:53:14.692287+0000","last_undegraded":"2024-09-14T11:53:14.692287+0000","last_fullsized":"2024-09-14T11:53:14.692287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.692150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:07.310954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'125","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.376629+0000","last_change":"2024-09-14T11:53:25.376629+0000","last_active":"2024-09-14T11:53:25.376629+0000","last_peered":"2024-09-14T11:53:25.376629+0000","last_clean":"2024-09-14T11:53:25.376629+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:53:25.376629+0000","last_undegraded":"2024-09-14T11:53:25.376629+0000","last_fullsized":"2024-09-14T11:53:25.376629+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.376525+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:48.017199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'482","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.573625+0000","last_change":"2024-09-14T11:52:59.573570+0000","last_active":"2024-09-14T11:52:59.573625+0000","last_peered":"2024-09-14T11:52:59.573625+0000","last_clean":"2024-09-14T11:52:59.573625+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:52:59.573625+0000","last_undegraded":"2024-09-14T11:52:59.573625+0000","last_fullsized":"2024-09-14T11:52:59.573625+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'482","last_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_deep_scrub":"263'482","last_deep_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.573481+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:46.583273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'294","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.166128+0000","last_change":"2024-09-14T11:52:53.166071+0000","last_active":"2024-09-14T11:52:53.166128+0000","last_peered":"2024-09-14T11:52:53.166128+0000","last_clean":"2024-09-14T11:52:53.166128+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:52:53.166128+0000","last_undegraded":"2024-09-14T11:52:53.166128+0000","last_fullsized":"2024-09-14T11:52:53.166128+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.165977+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:14.077350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":821,"num_read_kb":27323,"num_write":1074,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.659560+0000","last_change":"2024-09-14T11:53:09.659489+0000","last_active":"2024-09-14T11:53:09.659560+0000","last_peered":"2024-09-14T11:53:09.659560+0000","last_clean":"2024-09-14T11:53:09.659560+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:53:09.659560+0000","last_undegraded":"2024-09-14T11:53:09.659560+0000","last_fullsized":"2024-09-14T11:53:09.659560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.659406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:21.088615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'76","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.011688+0000","last_change":"2024-09-14T11:53:19.011688+0000","last_active":"2024-09-14T11:53:19.011688+0000","last_peered":"2024-09-14T11:53:19.011688+0000","last_clean":"2024-09-14T11:53:19.011688+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:53:19.011688+0000","last_undegraded":"2024-09-14T11:53:19.011688+0000","last_fullsized":"2024-09-14T11:53:19.011688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.011587+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:34.369755+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.136517+0000","last_change":"2024-09-14T11:53:12.136517+0000","last_active":"2024-09-14T11:53:12.136517+0000","last_peered":"2024-09-14T11:53:12.136517+0000","last_clean":"2024-09-14T11:53:12.136517+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:53:12.136517+0000","last_undegraded":"2024-09-14T11:53:12.136517+0000","last_fullsized":"2024-09-14T11:53:12.136517+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.136418+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.248965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.303133+0000","last_change":"2024-09-14T11:53:25.303133+0000","last_active":"2024-09-14T11:53:25.303133+0000","last_peered":"2024-09-14T11:53:25.303133+0000","last_clean":"2024-09-14T11:53:25.303133+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:53:25.303133+0000","last_undegraded":"2024-09-14T11:53:25.303133+0000","last_fullsized":"2024-09-14T11:53:25.303133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.303031+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:08.353469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.967467+0000","last_change":"2024-09-14T11:53:02.967406+0000","last_active":"2024-09-14T11:53:02.967467+0000","last_peered":"2024-09-14T11:53:02.967467+0000","last_clean":"2024-09-14T11:53:02.967467+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:53:02.967467+0000","last_undegraded":"2024-09-14T11:53:02.967467+0000","last_fullsized":"2024-09-14T11:53:02.967467+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1013","last_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_deep_scrub":"263'1013","last_deep_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.967314+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:15.598856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'216","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.111255+0000","last_change":"2024-09-14T11:52:57.111172+0000","last_active":"2024-09-14T11:52:57.111255+0000","last_peered":"2024-09-14T11:52:57.111255+0000","last_clean":"2024-09-14T11:52:57.111255+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:52:57.111255+0000","last_undegraded":"2024-09-14T11:52:57.111255+0000","last_fullsized":"2024-09-14T11:52:57.111255+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.111027+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:22.998621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":12794,"num_write":1051,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.178083+0000","last_change":"2024-09-14T11:53:14.178019+0000","last_active":"2024-09-14T11:53:14.178083+0000","last_peered":"2024-09-14T11:53:14.178083+0000","last_clean":"2024-09-14T11:53:14.178083+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:53:14.178083+0000","last_undegraded":"2024-09-14T11:53:14.178083+0000","last_fullsized":"2024-09-14T11:53:14.178083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.177941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:58.565764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'177","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.383053+0000","last_change":"2024-09-14T11:53:18.383053+0000","last_active":"2024-09-14T11:53:18.383053+0000","last_peered":"2024-09-14T11:53:18.383053+0000","last_clean":"2024-09-14T11:53:18.383053+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:53:18.383053+0000","last_undegraded":"2024-09-14T11:53:18.383053+0000","last_fullsized":"2024-09-14T11:53:18.383053+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.382949+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:34.005583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":294,"num_write":122,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.160633+0000","last_change":"2024-09-14T11:53:20.160633+0000","last_active":"2024-09-14T11:53:20.160633+0000","last_peered":"2024-09-14T11:53:20.160633+0000","last_clean":"2024-09-14T11:53:20.160633+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:53:20.160633+0000","last_undegraded":"2024-09-14T11:53:20.160633+0000","last_fullsized":"2024-09-14T11:53:20.160633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.160545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:21.719505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'119","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.282076+0000","last_change":"2024-09-14T11:53:27.282076+0000","last_active":"2024-09-14T11:53:27.282076+0000","last_peered":"2024-09-14T11:53:27.282076+0000","last_clean":"2024-09-14T11:53:27.282076+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:53:27.282076+0000","last_undegraded":"2024-09-14T11:53:27.282076+0000","last_fullsized":"2024-09-14T11:53:27.282076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.281969+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:34.059929+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1158","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.002658+0000","last_change":"2024-09-14T11:53:02.002594+0000","last_active":"2024-09-14T11:53:02.002658+0000","last_peered":"2024-09-14T11:53:02.002658+0000","last_clean":"2024-09-14T11:53:02.002658+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:53:02.002658+0000","last_undegraded":"2024-09-14T11:53:02.002658+0000","last_fullsized":"2024-09-14T11:53:02.002658+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.002510+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.793177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'199","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.195865+0000","last_change":"2024-09-14T11:52:59.195803+0000","last_active":"2024-09-14T11:52:59.195865+0000","last_peered":"2024-09-14T11:52:59.195865+0000","last_clean":"2024-09-14T11:52:59.195865+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:52:59.195865+0000","last_undegraded":"2024-09-14T11:52:59.195865+0000","last_fullsized":"2024-09-14T11:52:59.195865+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.195690+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:29.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":665,"num_read_kb":26583,"num_write":943,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.294858+0000","last_change":"2024-09-14T11:53:15.294788+0000","last_active":"2024-09-14T11:53:15.294858+0000","last_peered":"2024-09-14T11:53:15.294858+0000","last_clean":"2024-09-14T11:53:15.294858+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:53:15.294858+0000","last_undegraded":"2024-09-14T11:53:15.294858+0000","last_fullsized":"2024-09-14T11:53:15.294858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.294690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:16.105550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.127529+0000","last_change":"2024-09-14T11:53:15.127529+0000","last_active":"2024-09-14T11:53:15.127529+0000","last_peered":"2024-09-14T11:53:15.127529+0000","last_clean":"2024-09-14T11:53:15.127529+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:53:15.127529+0000","last_undegraded":"2024-09-14T11:53:15.127529+0000","last_fullsized":"2024-09-14T11:53:15.127529+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.127435+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:53.936595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":236,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.132137+0000","last_change":"2024-09-14T11:53:11.132137+0000","last_active":"2024-09-14T11:53:11.132137+0000","last_peered":"2024-09-14T11:53:11.132137+0000","last_clean":"2024-09-14T11:53:11.132137+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:53:11.132137+0000","last_undegraded":"2024-09-14T11:53:11.132137+0000","last_fullsized":"2024-09-14T11:53:11.132137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.132038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:40.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'127","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.202529+0000","last_change":"2024-09-14T11:53:31.202529+0000","last_active":"2024-09-14T11:53:31.202529+0000","last_peered":"2024-09-14T11:53:31.202529+0000","last_clean":"2024-09-14T11:53:31.202529+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:53:31.202529+0000","last_undegraded":"2024-09-14T11:53:31.202529+0000","last_fullsized":"2024-09-14T11:53:31.202529+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T11:53:31.202451+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T11:53:31.202451+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.202451+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:02.593494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'509","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.192324+0000","last_change":"2024-09-14T11:53:06.192324+0000","last_active":"2024-09-14T11:53:06.192324+0000","last_peered":"2024-09-14T11:53:06.192324+0000","last_clean":"2024-09-14T11:53:06.192324+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:53:06.192324+0000","last_undegraded":"2024-09-14T11:53:06.192324+0000","last_fullsized":"2024-09-14T11:53:06.192324+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.192233+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.491268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'219","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.233234+0000","last_change":"2024-09-14T11:52:56.233144+0000","last_active":"2024-09-14T11:52:56.233234+0000","last_peered":"2024-09-14T11:52:56.233234+0000","last_clean":"2024-09-14T11:52:56.233234+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:56.233234+0000","last_undegraded":"2024-09-14T11:52:56.233234+0000","last_fullsized":"2024-09-14T11:52:56.233234+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.232989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:07.476932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":7926,"num_write":973,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.970245+0000","last_change":"2024-09-14T11:53:12.970245+0000","last_active":"2024-09-14T11:53:12.970245+0000","last_peered":"2024-09-14T11:53:12.970245+0000","last_clean":"2024-09-14T11:53:12.970245+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:53:12.970245+0000","last_undegraded":"2024-09-14T11:53:12.970245+0000","last_fullsized":"2024-09-14T11:53:12.970245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.970152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.911318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'110","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.124452+0000","last_change":"2024-09-14T11:53:22.124391+0000","last_active":"2024-09-14T11:53:22.124452+0000","last_peered":"2024-09-14T11:53:22.124452+0000","last_clean":"2024-09-14T11:53:22.124452+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:53:22.124452+0000","last_undegraded":"2024-09-14T11:53:22.124452+0000","last_fullsized":"2024-09-14T11:53:22.124452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.124277+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:22.955274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":208,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.012941+0000","last_change":"2024-09-14T11:53:20.012861+0000","last_active":"2024-09-14T11:53:20.012941+0000","last_peered":"2024-09-14T11:53:20.012941+0000","last_clean":"2024-09-14T11:53:20.012941+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:53:20.012941+0000","last_undegraded":"2024-09-14T11:53:20.012941+0000","last_fullsized":"2024-09-14T11:53:20.012941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.012748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:47.176018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'192","reported_seq":1650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.272832+0000","last_change":"2024-09-14T11:53:26.272832+0000","last_active":"2024-09-14T11:53:26.272832+0000","last_peered":"2024-09-14T11:53:26.272832+0000","last_clean":"2024-09-14T11:53:26.272832+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:53:26.272832+0000","last_undegraded":"2024-09-14T11:53:26.272832+0000","last_fullsized":"2024-09-14T11:53:26.272832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.272731+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:08.934882+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.047117+0000","last_change":"2024-09-14T11:53:01.047117+0000","last_active":"2024-09-14T11:53:01.047117+0000","last_peered":"2024-09-14T11:53:01.047117+0000","last_clean":"2024-09-14T11:53:01.047117+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:53:01.047117+0000","last_undegraded":"2024-09-14T11:53:01.047117+0000","last_fullsized":"2024-09-14T11:53:01.047117+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.047027+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:29.624414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'230","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.174275+0000","last_change":"2024-09-14T11:52:54.174275+0000","last_active":"2024-09-14T11:52:54.174275+0000","last_peered":"2024-09-14T11:52:54.174275+0000","last_clean":"2024-09-14T11:52:54.174275+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:52:54.174275+0000","last_undegraded":"2024-09-14T11:52:54.174275+0000","last_fullsized":"2024-09-14T11:52:54.174275+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.174100+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:15.196149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1057,"num_read_kb":144594,"num_write":1045,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.621816+0000","last_change":"2024-09-14T11:53:08.621816+0000","last_active":"2024-09-14T11:53:08.621816+0000","last_peered":"2024-09-14T11:53:08.621816+0000","last_clean":"2024-09-14T11:53:08.621816+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:53:08.621816+0000","last_undegraded":"2024-09-14T11:53:08.621816+0000","last_fullsized":"2024-09-14T11:53:08.621816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.621675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:07.357313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.983622+0000","last_change":"2024-09-14T11:53:16.983558+0000","last_active":"2024-09-14T11:53:16.983622+0000","last_peered":"2024-09-14T11:53:16.983622+0000","last_clean":"2024-09-14T11:53:16.983622+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:53:16.983622+0000","last_undegraded":"2024-09-14T11:53:16.983622+0000","last_fullsized":"2024-09-14T11:53:16.983622+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.983469+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:33.140461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":208,"num_write":106,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.118868+0000","last_change":"2024-09-14T11:53:22.118805+0000","last_active":"2024-09-14T11:53:22.118868+0000","last_peered":"2024-09-14T11:53:22.118868+0000","last_clean":"2024-09-14T11:53:22.118868+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:53:22.118868+0000","last_undegraded":"2024-09-14T11:53:22.118868+0000","last_fullsized":"2024-09-14T11:53:22.118868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.118721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:09.915267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'136","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.055980+0000","last_change":"2024-09-14T11:53:24.055980+0000","last_active":"2024-09-14T11:53:24.055980+0000","last_peered":"2024-09-14T11:53:24.055980+0000","last_clean":"2024-09-14T11:53:24.055980+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:53:24.055980+0000","last_undegraded":"2024-09-14T11:53:24.055980+0000","last_fullsized":"2024-09-14T11:53:24.055980+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.055885+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:02.367890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'852","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.568807+0000","last_change":"2024-09-14T11:53:05.568807+0000","last_active":"2024-09-14T11:53:05.568807+0000","last_peered":"2024-09-14T11:53:05.568807+0000","last_clean":"2024-09-14T11:53:05.568807+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:53:05.568807+0000","last_undegraded":"2024-09-14T11:53:05.568807+0000","last_fullsized":"2024-09-14T11:53:05.568807+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'852","last_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_deep_scrub":"263'852","last_deep_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.568712+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.647100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'248","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.065807+0000","last_change":"2024-09-14T11:52:56.065807+0000","last_active":"2024-09-14T11:52:56.065807+0000","last_peered":"2024-09-14T11:52:56.065807+0000","last_clean":"2024-09-14T11:52:56.065807+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:52:56.065807+0000","last_undegraded":"2024-09-14T11:52:56.065807+0000","last_fullsized":"2024-09-14T11:52:56.065807+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'248","last_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_deep_scrub":"263'248","last_deep_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.065655+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:38.524060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":737,"num_read_kb":42950,"num_write":1092,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'568","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.610451+0000","last_change":"2024-09-14T11:53:04.610451+0000","last_active":"2024-09-14T11:53:04.610451+0000","last_peered":"2024-09-14T11:53:04.610451+0000","last_clean":"2024-09-14T11:53:04.610451+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:53:04.610451+0000","last_undegraded":"2024-09-14T11:53:04.610451+0000","last_fullsized":"2024-09-14T11:53:04.610451+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'568","last_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_deep_scrub":"263'568","last_deep_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.610328+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:59.992487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1797,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'180","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.720382+0000","last_change":"2024-09-14T11:52:52.720382+0000","last_active":"2024-09-14T11:52:52.720382+0000","last_peered":"2024-09-14T11:52:52.720382+0000","last_clean":"2024-09-14T11:52:52.720382+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:52:52.720382+0000","last_undegraded":"2024-09-14T11:52:52.720382+0000","last_fullsized":"2024-09-14T11:52:52.720382+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.720305+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:22.441860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":43631,"num_write":872,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'531","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.174316+0000","last_change":"2024-09-14T11:53:06.174316+0000","last_active":"2024-09-14T11:53:06.174316+0000","last_peered":"2024-09-14T11:53:06.174316+0000","last_clean":"2024-09-14T11:53:06.174316+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:53:06.174316+0000","last_undegraded":"2024-09-14T11:53:06.174316+0000","last_fullsized":"2024-09-14T11:53:06.174316+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'531","last_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_deep_scrub":"263'531","last_deep_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.174226+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:29.796542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'217","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.151067+0000","last_change":"2024-09-14T11:52:58.151067+0000","last_active":"2024-09-14T11:52:58.151067+0000","last_peered":"2024-09-14T11:52:58.151067+0000","last_clean":"2024-09-14T11:52:58.151067+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:52:58.151067+0000","last_undegraded":"2024-09-14T11:52:58.151067+0000","last_fullsized":"2024-09-14T11:52:58.151067+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.150955+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:54.421678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":22878,"num_write":1010,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'805","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.635510+0000","last_change":"2024-09-14T11:53:03.635510+0000","last_active":"2024-09-14T11:53:03.635510+0000","last_peered":"2024-09-14T11:53:03.635510+0000","last_clean":"2024-09-14T11:53:03.635510+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:53:03.635510+0000","last_undegraded":"2024-09-14T11:53:03.635510+0000","last_fullsized":"2024-09-14T11:53:03.635510+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.635426+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:26.207368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.172379+0000","last_change":"2024-09-14T11:52:55.172379+0000","last_active":"2024-09-14T11:52:55.172379+0000","last_peered":"2024-09-14T11:52:55.172379+0000","last_clean":"2024-09-14T11:52:55.172379+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:52:55.172379+0000","last_undegraded":"2024-09-14T11:52:55.172379+0000","last_fullsized":"2024-09-14T11:52:55.172379+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.172292+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.954230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":47732,"num_write":877,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1009","reported_seq":2736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.107587+0000","last_change":"2024-09-14T11:53:09.107587+0000","last_active":"2024-09-14T11:53:09.107587+0000","last_peered":"2024-09-14T11:53:09.107587+0000","last_clean":"2024-09-14T11:53:09.107587+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:53:09.107587+0000","last_undegraded":"2024-09-14T11:53:09.107587+0000","last_fullsized":"2024-09-14T11:53:09.107587+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1009","last_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_deep_scrub":"263'1009","last_deep_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.107505+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:57.020223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'279","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.244702+0000","last_change":"2024-09-14T11:52:57.244702+0000","last_active":"2024-09-14T11:52:57.244702+0000","last_peered":"2024-09-14T11:52:57.244702+0000","last_clean":"2024-09-14T11:52:57.244702+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:57.244702+0000","last_undegraded":"2024-09-14T11:52:57.244702+0000","last_fullsized":"2024-09-14T11:52:57.244702+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.244601+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:06.713036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":719,"num_read_kb":31338,"num_write":1105,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'444","reported_seq":1991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.964108+0000","last_change":"2024-09-14T11:53:03.964108+0000","last_active":"2024-09-14T11:53:03.964108+0000","last_peered":"2024-09-14T11:53:03.964108+0000","last_clean":"2024-09-14T11:53:03.964108+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:53:03.964108+0000","last_undegraded":"2024-09-14T11:53:03.964108+0000","last_fullsized":"2024-09-14T11:53:03.964108+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.963982+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:15.186551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'261","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.641663+0000","last_change":"2024-09-14T11:52:53.641663+0000","last_active":"2024-09-14T11:52:53.641663+0000","last_peered":"2024-09-14T11:52:53.641663+0000","last_clean":"2024-09-14T11:52:53.641663+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:52:53.641663+0000","last_undegraded":"2024-09-14T11:52:53.641663+0000","last_fullsized":"2024-09-14T11:52:53.641663+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.641559+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:15.729013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1027,"num_read_kb":155043,"num_write":1124,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1176","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.128014+0000","last_change":"2024-09-14T11:53:08.128014+0000","last_active":"2024-09-14T11:53:08.128014+0000","last_peered":"2024-09-14T11:53:08.128014+0000","last_clean":"2024-09-14T11:53:08.128014+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:53:08.128014+0000","last_undegraded":"2024-09-14T11:53:08.128014+0000","last_fullsized":"2024-09-14T11:53:08.128014+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1176","last_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_deep_scrub":"263'1176","last_deep_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.127935+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:40.579497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'242","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094291+0000","last_change":"2024-09-14T11:52:57.094291+0000","last_active":"2024-09-14T11:52:57.094291+0000","last_peered":"2024-09-14T11:52:57.094291+0000","last_clean":"2024-09-14T11:52:57.094291+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:52:57.094291+0000","last_undegraded":"2024-09-14T11:52:57.094291+0000","last_fullsized":"2024-09-14T11:52:57.094291+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.094079+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:41.823322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159825,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":17781,"num_write":1116,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'429","reported_seq":1964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.075754+0000","last_change":"2024-09-14T11:53:01.075754+0000","last_active":"2024-09-14T11:53:01.075754+0000","last_peered":"2024-09-14T11:53:01.075754+0000","last_clean":"2024-09-14T11:53:01.075754+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:53:01.075754+0000","last_undegraded":"2024-09-14T11:53:01.075754+0000","last_fullsized":"2024-09-14T11:53:01.075754+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.075650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.154836+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'185","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.248333+0000","last_change":"2024-09-14T11:52:59.248333+0000","last_active":"2024-09-14T11:52:59.248333+0000","last_peered":"2024-09-14T11:52:59.248333+0000","last_clean":"2024-09-14T11:52:59.248333+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:52:59.248333+0000","last_undegraded":"2024-09-14T11:52:59.248333+0000","last_fullsized":"2024-09-14T11:52:59.248333+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.248194+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:41.711860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":12452,"num_write":860,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1183","reported_seq":2671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.137570+0000","last_change":"2024-09-14T11:53:05.137512+0000","last_active":"2024-09-14T11:53:05.137570+0000","last_peered":"2024-09-14T11:53:05.137570+0000","last_clean":"2024-09-14T11:53:05.137570+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:53:05.137570+0000","last_undegraded":"2024-09-14T11:53:05.137570+0000","last_fullsized":"2024-09-14T11:53:05.137570+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1183","last_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_deep_scrub":"263'1183","last_deep_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.137429+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:37.154275+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'246","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.181196+0000","last_change":"2024-09-14T11:53:00.181196+0000","last_active":"2024-09-14T11:53:00.181196+0000","last_peered":"2024-09-14T11:53:00.181196+0000","last_clean":"2024-09-14T11:53:00.181196+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:53:00.181196+0000","last_undegraded":"2024-09-14T11:53:00.181196+0000","last_fullsized":"2024-09-14T11:53:00.181196+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.181003+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:48.772246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":3825,"num_write":1017,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'761","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.984873+0000","last_change":"2024-09-14T11:53:05.984808+0000","last_active":"2024-09-14T11:53:05.984873+0000","last_peered":"2024-09-14T11:53:05.984873+0000","last_clean":"2024-09-14T11:53:05.984873+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:53:05.984873+0000","last_undegraded":"2024-09-14T11:53:05.984873+0000","last_fullsized":"2024-09-14T11:53:05.984873+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.984718+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.922626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'244","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.261037+0000","last_change":"2024-09-14T11:52:58.260968+0000","last_active":"2024-09-14T11:52:58.261037+0000","last_peered":"2024-09-14T11:52:58.261037+0000","last_clean":"2024-09-14T11:52:58.261037+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:52:58.261037+0000","last_undegraded":"2024-09-14T11:52:58.261037+0000","last_fullsized":"2024-09-14T11:52:58.261037+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.260863+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:49.114336+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":9466,"num_write":1107,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.619266+0000","last_change":"2024-09-14T11:52:56.619266+0000","last_active":"2024-09-14T11:52:56.619266+0000","last_peered":"2024-09-14T11:52:56.619266+0000","last_clean":"2024-09-14T11:52:56.619266+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:52:56.619266+0000","last_undegraded":"2024-09-14T11:52:56.619266+0000","last_fullsized":"2024-09-14T11:52:56.619266+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'693","last_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_deep_scrub":"263'693","last_deep_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.619176+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:46.303405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'230","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.693886+0000","last_change":"2024-09-14T11:52:53.693886+0000","last_active":"2024-09-14T11:52:53.693886+0000","last_peered":"2024-09-14T11:52:53.693886+0000","last_clean":"2024-09-14T11:52:53.693886+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:52:53.693886+0000","last_undegraded":"2024-09-14T11:52:53.693886+0000","last_fullsized":"2024-09-14T11:52:53.693886+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.693782+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:02.123870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":774,"num_read_kb":20654,"num_write":1086,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'572","reported_seq":2101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.004654+0000","last_change":"2024-09-14T11:53:05.004654+0000","last_active":"2024-09-14T11:53:05.004654+0000","last_peered":"2024-09-14T11:53:05.004654+0000","last_clean":"2024-09-14T11:53:05.004654+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:53:05.004654+0000","last_undegraded":"2024-09-14T11:53:05.004654+0000","last_fullsized":"2024-09-14T11:53:05.004654+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'572","last_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_deep_scrub":"263'572","last_deep_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.004567+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:12.480296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'179","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.170219+0000","last_change":"2024-09-14T11:52:56.170135+0000","last_active":"2024-09-14T11:52:56.170219+0000","last_peered":"2024-09-14T11:52:56.170219+0000","last_clean":"2024-09-14T11:52:56.170219+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:52:56.170219+0000","last_undegraded":"2024-09-14T11:52:56.170219+0000","last_fullsized":"2024-09-14T11:52:56.170219+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.169996+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:19.783821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254527,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":19362,"num_write":819,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'504","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.181330+0000","last_change":"2024-09-14T11:53:10.181330+0000","last_active":"2024-09-14T11:53:10.181330+0000","last_peered":"2024-09-14T11:53:10.181330+0000","last_clean":"2024-09-14T11:53:10.181330+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:53:10.181330+0000","last_undegraded":"2024-09-14T11:53:10.181330+0000","last_fullsized":"2024-09-14T11:53:10.181330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.181245+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:04.696409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'219","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.074057+0000","last_change":"2024-09-14T11:52:54.073972+0000","last_active":"2024-09-14T11:52:54.074057+0000","last_peered":"2024-09-14T11:52:54.074057+0000","last_clean":"2024-09-14T11:52:54.074057+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:52:54.074057+0000","last_undegraded":"2024-09-14T11:52:54.074057+0000","last_fullsized":"2024-09-14T11:52:54.074057+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073820+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.734459+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152081,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":22963,"num_write":995,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1731","reported_seq":3543,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.120989+0000","last_change":"2024-09-14T11:53:04.120989+0000","last_active":"2024-09-14T11:53:04.120989+0000","last_peered":"2024-09-14T11:53:04.120989+0000","last_clean":"2024-09-14T11:53:04.120989+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:53:04.120989+0000","last_undegraded":"2024-09-14T11:53:04.120989+0000","last_fullsized":"2024-09-14T11:53:04.120989+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1731","last_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_deep_scrub":"263'1731","last_deep_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.120897+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":1700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.055522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'220","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.202838+0000","last_change":"2024-09-14T11:53:09.202838+0000","last_active":"2024-09-14T11:53:09.202838+0000","last_peered":"2024-09-14T11:53:09.202838+0000","last_clean":"2024-09-14T11:53:09.202838+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:53:09.202838+0000","last_undegraded":"2024-09-14T11:53:09.202838+0000","last_fullsized":"2024-09-14T11:53:09.202838+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.202630+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:51.781845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":9299,"num_write":1026,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'392","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.127322+0000","last_change":"2024-09-14T11:53:10.127322+0000","last_active":"2024-09-14T11:53:10.127322+0000","last_peered":"2024-09-14T11:53:10.127322+0000","last_clean":"2024-09-14T11:53:10.127322+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:53:10.127322+0000","last_undegraded":"2024-09-14T11:53:10.127322+0000","last_fullsized":"2024-09-14T11:53:10.127322+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.127233+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:01.279892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648290+0000","last_change":"2024-09-14T11:52:54.648221+0000","last_active":"2024-09-14T11:52:54.648290+0000","last_peered":"2024-09-14T11:52:54.648290+0000","last_clean":"2024-09-14T11:52:54.648290+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:52:54.648290+0000","last_undegraded":"2024-09-14T11:52:54.648290+0000","last_fullsized":"2024-09-14T11:52:54.648290+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648125+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:31.594989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":67022,"num_write":1011,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'461","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.119760+0000","last_change":"2024-09-14T11:53:05.119760+0000","last_active":"2024-09-14T11:53:05.119760+0000","last_peered":"2024-09-14T11:53:05.119760+0000","last_clean":"2024-09-14T11:53:05.119760+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:53:05.119760+0000","last_undegraded":"2024-09-14T11:53:05.119760+0000","last_fullsized":"2024-09-14T11:53:05.119760+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'461","last_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_deep_scrub":"263'461","last_deep_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.119654+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:53.766096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'211","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.651967+0000","last_change":"2024-09-14T11:52:55.651909+0000","last_active":"2024-09-14T11:52:55.651967+0000","last_peered":"2024-09-14T11:52:55.651967+0000","last_clean":"2024-09-14T11:52:55.651967+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:52:55.651967+0000","last_undegraded":"2024-09-14T11:52:55.651967+0000","last_fullsized":"2024-09-14T11:52:55.651967+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.651812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:24.237587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":27752,"num_write":889,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'207","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.136326+0000","last_change":"2024-09-14T11:53:01.136253+0000","last_active":"2024-09-14T11:53:01.136326+0000","last_peered":"2024-09-14T11:53:01.136326+0000","last_clean":"2024-09-14T11:53:01.136326+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:53:01.136326+0000","last_undegraded":"2024-09-14T11:53:01.136326+0000","last_fullsized":"2024-09-14T11:53:01.136326+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.136124+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.376828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":2089,"num_write":994,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'476","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.095010+0000","last_change":"2024-09-14T11:53:06.095010+0000","last_active":"2024-09-14T11:53:06.095010+0000","last_peered":"2024-09-14T11:53:06.095010+0000","last_clean":"2024-09-14T11:53:06.095010+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:53:06.095010+0000","last_undegraded":"2024-09-14T11:53:06.095010+0000","last_fullsized":"2024-09-14T11:53:06.095010+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.094919+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:39.988396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":919,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'262","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.594608+0000","last_change":"2024-09-14T11:53:00.594508+0000","last_active":"2024-09-14T11:53:00.594608+0000","last_peered":"2024-09-14T11:53:00.594608+0000","last_clean":"2024-09-14T11:53:00.594608+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:53:00.594608+0000","last_undegraded":"2024-09-14T11:53:00.594608+0000","last_fullsized":"2024-09-14T11:53:00.594608+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.594344+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:04.083599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":42624,"num_write":1182,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'383","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.201899+0000","last_change":"2024-09-14T11:53:07.201899+0000","last_active":"2024-09-14T11:53:07.201899+0000","last_peered":"2024-09-14T11:53:07.201899+0000","last_clean":"2024-09-14T11:53:07.201899+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:53:07.201899+0000","last_undegraded":"2024-09-14T11:53:07.201899+0000","last_fullsized":"2024-09-14T11:53:07.201899+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.201806+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:07.993574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1574,"ondisk_log_size":1574,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":429920,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8367,"num_read_kb":10850,"num_write":5651,"num_write_kb":2859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701838,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2871,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4116,"ondisk_log_size":4116,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":29484888,"num_objects":168,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":42482,"num_read_kb":2539626,"num_write":64328,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41172992,"data_stored":41172992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168157,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":181387,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542667,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272784,"kb_used_data":11136,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94099056,"statfs":{"total":96636764160,"available":96357433344,"internally_reserved":0,"allocated":11403264,"data_stored":9409551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542667,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250432,"kb_used_data":8240,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94121408,"statfs":{"total":96636764160,"available":96380321792,"internally_reserved":0,"allocated":8437760,"data_stored":6489937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":247986630},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542665,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107580,"kb_used_data":8364,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":8564736,"data_stored":6565787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542665,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107804,"kb_used_data":8588,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264036,"statfs":{"total":96636764160,"available":96526372864,"internally_reserved":0,"allocated":8794112,"data_stored":6869156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542664,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251756,"kb_used_data":8156,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94120084,"statfs":{"total":96636764160,"available":96378966016,"internally_reserved":0,"allocated":8351744,"data_stored":6374693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542665,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94580,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94277260,"statfs":{"total":96636764160,"available":96539914240,"internally_reserved":0,"allocated":9474048,"data_stored":7547937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542665,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153580,"kb_used_data":10012,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94218260,"statfs":{"total":96636764160,"available":96479498240,"internally_reserved":0,"allocated":10252288,"data_stored":8286792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542666,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284668,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94087172,"statfs":{"total":96636764160,"available":96345264128,"internally_reserved":0,"allocated":10858496,"data_stored":8869545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6021120,"data_stored":6021120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6029312,"data_stored":6029312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4116480,"data_stored":4116480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4612096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":4308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4231168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":6561792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:53:53.855 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.856 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.856 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.856 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.856 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.857 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.857 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.857 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:38:31.818177+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=38, tm_sec=31, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=52, tm_sec=47, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:53:53.861 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:54:13.863 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:54:14.200 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-09-14T11:54:14.217 INFO:teuthology.orchestra.run.smithi130.stderr:dumped all 2024-09-14T11:54:14.220 INFO:teuthology.orchestra.run.smithi130.stdout:{"pg_ready":true,"pg_map":{"version":1561,"stamp":"2024-09-14T11:54:13.108915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30522513,"num_objects":632,"num_object_clones":0,"num_object_copies":1600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":632,"num_whiteouts":0,"num_read":299502,"num_read_kb":3128085,"num_write":146428,"num_write_kb":2544950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":199,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741392,"num_omap_keys":1789,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12712,"ondisk_log_size":12712,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1523184,"kb_used_data":74352,"kb_used_omap":12,"kb_used_meta":1448691,"kb_avail":753451536,"statfs":{"total":773094113280,"available":771534372864,"internally_reserved":0,"allocated":76136448,"data_stored":60413398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1483460145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004698"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.268935+0000","last_change":"2024-09-14T11:53:39.268935+0000","last_active":"2024-09-14T11:53:39.268935+0000","last_peered":"2024-09-14T11:53:39.268935+0000","last_clean":"2024-09-14T11:53:39.268935+0000","last_became_active":"2024-09-14T11:38:32.849504+0000","last_became_peered":"2024-09-14T11:38:32.849504+0000","last_unstale":"2024-09-14T11:53:39.268935+0000","last_undegraded":"2024-09-14T11:53:39.268935+0000","last_fullsized":"2024-09-14T11:53:39.268935+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:39.268840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:39.268840+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.268840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:16.846487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.291534+0000","last_change":"2024-09-14T11:53:36.291534+0000","last_active":"2024-09-14T11:53:36.291534+0000","last_peered":"2024-09-14T11:53:36.291534+0000","last_clean":"2024-09-14T11:53:36.291534+0000","last_became_active":"2024-09-14T11:27:46.879026+0000","last_became_peered":"2024-09-14T11:27:46.879026+0000","last_unstale":"2024-09-14T11:53:36.291534+0000","last_undegraded":"2024-09-14T11:53:36.291534+0000","last_fullsized":"2024-09-14T11:53:36.291534+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:36.291426+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:36.291426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.291426+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:25.769971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.276599+0000","last_change":"2024-09-14T11:53:39.276599+0000","last_active":"2024-09-14T11:53:39.276599+0000","last_peered":"2024-09-14T11:53:39.276599+0000","last_clean":"2024-09-14T11:53:39.276599+0000","last_became_active":"2024-09-14T11:27:43.844960+0000","last_became_peered":"2024-09-14T11:27:43.844960+0000","last_unstale":"2024-09-14T11:53:39.276599+0000","last_undegraded":"2024-09-14T11:53:39.276599+0000","last_fullsized":"2024-09-14T11:53:39.276599+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:39.276509+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:39.276509+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.276509+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:48.565240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":7172,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'25","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.167519+0000","last_change":"2024-09-14T11:53:35.167519+0000","last_active":"2024-09-14T11:53:35.167519+0000","last_peered":"2024-09-14T11:53:35.167519+0000","last_clean":"2024-09-14T11:53:35.167519+0000","last_became_active":"2024-09-14T11:26:02.012637+0000","last_became_peered":"2024-09-14T11:26:02.012637+0000","last_unstale":"2024-09-14T11:53:35.167519+0000","last_undegraded":"2024-09-14T11:53:35.167519+0000","last_fullsized":"2024-09-14T11:53:35.167519+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:53:35.167439+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:53:35.167439+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.167439+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:09.931336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":122,"num_write":67,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.733072+0000","last_change":"2024-09-14T11:53:21.733014+0000","last_active":"2024-09-14T11:53:21.733072+0000","last_peered":"2024-09-14T11:53:21.733072+0000","last_clean":"2024-09-14T11:53:21.733072+0000","last_became_active":"2024-09-14T11:38:32.848684+0000","last_became_peered":"2024-09-14T11:38:32.848684+0000","last_unstale":"2024-09-14T11:53:21.733072+0000","last_undegraded":"2024-09-14T11:53:21.733072+0000","last_fullsized":"2024-09-14T11:53:21.733072+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.732931+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.732931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:48.663290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.112664+0000","last_change":"2024-09-14T11:53:37.112664+0000","last_active":"2024-09-14T11:53:37.112664+0000","last_peered":"2024-09-14T11:53:37.112664+0000","last_clean":"2024-09-14T11:53:37.112664+0000","last_became_active":"2024-09-14T11:27:46.879063+0000","last_became_peered":"2024-09-14T11:27:46.879063+0000","last_unstale":"2024-09-14T11:53:37.112664+0000","last_undegraded":"2024-09-14T11:53:37.112664+0000","last_fullsized":"2024-09-14T11:53:37.112664+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:37.112565+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:37.112565+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.112565+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:37.378624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.761554+0000","last_change":"2024-09-14T11:53:25.761554+0000","last_active":"2024-09-14T11:53:25.761554+0000","last_peered":"2024-09-14T11:53:25.761554+0000","last_clean":"2024-09-14T11:53:25.761554+0000","last_became_active":"2024-09-14T11:27:43.844301+0000","last_became_peered":"2024-09-14T11:27:43.844301+0000","last_unstale":"2024-09-14T11:53:25.761554+0000","last_undegraded":"2024-09-14T11:53:25.761554+0000","last_fullsized":"2024-09-14T11:53:25.761554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:53:25.761462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.761462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:51.621198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'37","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.588923+0000","last_change":"2024-09-14T11:53:13.588869+0000","last_active":"2024-09-14T11:53:13.588923+0000","last_peered":"2024-09-14T11:53:13.588923+0000","last_clean":"2024-09-14T11:53:13.588923+0000","last_became_active":"2024-09-14T11:26:02.011213+0000","last_became_peered":"2024-09-14T11:26:02.011213+0000","last_unstale":"2024-09-14T11:53:13.588923+0000","last_undegraded":"2024-09-14T11:53:13.588923+0000","last_fullsized":"2024-09-14T11:53:13.588923+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-14T11:53:13.588787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.588787+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:59.522176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":293,"num_read_kb":190,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.148490+0000","last_change":"2024-09-14T11:53:28.148490+0000","last_active":"2024-09-14T11:53:28.148490+0000","last_peered":"2024-09-14T11:53:28.148490+0000","last_clean":"2024-09-14T11:53:28.148490+0000","last_became_active":"2024-09-14T11:38:32.844527+0000","last_became_peered":"2024-09-14T11:38:32.844527+0000","last_unstale":"2024-09-14T11:53:28.148490+0000","last_undegraded":"2024-09-14T11:53:28.148490+0000","last_fullsized":"2024-09-14T11:53:28.148490+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:28.148399+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.148399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:17.010275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"263'10","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.286174+0000","last_change":"2024-09-14T11:53:43.286174+0000","last_active":"2024-09-14T11:53:43.286174+0000","last_peered":"2024-09-14T11:53:43.286174+0000","last_clean":"2024-09-14T11:53:43.286174+0000","last_became_active":"2024-09-14T11:27:47.189236+0000","last_became_peered":"2024-09-14T11:27:47.189236+0000","last_unstale":"2024-09-14T11:53:43.286174+0000","last_undegraded":"2024-09-14T11:53:43.286174+0000","last_fullsized":"2024-09-14T11:53:43.286174+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:43.286075+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:43.286075+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.286075+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:21.486018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":15373,"num_write":10,"num_write_kb":9231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.676980+0000","last_change":"2024-09-14T11:53:17.676892+0000","last_active":"2024-09-14T11:53:17.676980+0000","last_peered":"2024-09-14T11:53:17.676980+0000","last_clean":"2024-09-14T11:53:17.676980+0000","last_became_active":"2024-09-14T11:27:43.839154+0000","last_became_peered":"2024-09-14T11:27:43.839154+0000","last_unstale":"2024-09-14T11:53:17.676980+0000","last_undegraded":"2024-09-14T11:53:17.676980+0000","last_fullsized":"2024-09-14T11:53:17.676980+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:17.676763+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.676763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:55.098276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"260'6","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.197119+0000","last_change":"2024-09-14T11:53:34.197119+0000","last_active":"2024-09-14T11:53:34.197119+0000","last_peered":"2024-09-14T11:53:34.197119+0000","last_clean":"2024-09-14T11:53:34.197119+0000","last_became_active":"2024-09-14T11:26:02.014804+0000","last_became_peered":"2024-09-14T11:26:02.014804+0000","last_unstale":"2024-09-14T11:53:34.197119+0000","last_undegraded":"2024-09-14T11:53:34.197119+0000","last_fullsized":"2024-09-14T11:53:34.197119+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:53:34.197029+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:53:34.197029+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.197029+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:40.070115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:51.231668+0000","last_change":"2024-09-14T11:53:51.231668+0000","last_active":"2024-09-14T11:53:51.231668+0000","last_peered":"2024-09-14T11:53:51.231668+0000","last_clean":"2024-09-14T11:53:51.231668+0000","last_became_active":"2024-09-14T11:38:32.854026+0000","last_became_peered":"2024-09-14T11:38:32.854026+0000","last_unstale":"2024-09-14T11:53:51.231668+0000","last_undegraded":"2024-09-14T11:53:51.231668+0000","last_fullsized":"2024-09-14T11:53:51.231668+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:51.231583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:51.231583+0000","last_clean_scrub_stamp":"2024-09-14T11:53:51.231583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:10.385409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.260391+0000","last_change":"2024-09-14T11:53:48.260272+0000","last_active":"2024-09-14T11:53:48.260391+0000","last_peered":"2024-09-14T11:53:48.260391+0000","last_clean":"2024-09-14T11:53:48.260391+0000","last_became_active":"2024-09-14T11:27:47.186945+0000","last_became_peered":"2024-09-14T11:27:47.186945+0000","last_unstale":"2024-09-14T11:53:48.260391+0000","last_undegraded":"2024-09-14T11:53:48.260391+0000","last_fullsized":"2024-09-14T11:53:48.260391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:53:48.260168+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:53:48.260168+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.260168+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:47.697791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":10,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.092915+0000","last_change":"2024-09-14T11:53:33.092915+0000","last_active":"2024-09-14T11:53:33.092915+0000","last_peered":"2024-09-14T11:53:33.092915+0000","last_clean":"2024-09-14T11:53:33.092915+0000","last_became_active":"2024-09-14T11:27:43.841589+0000","last_became_peered":"2024-09-14T11:27:43.841589+0000","last_unstale":"2024-09-14T11:53:33.092915+0000","last_undegraded":"2024-09-14T11:53:33.092915+0000","last_fullsized":"2024-09-14T11:53:33.092915+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:33.092811+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:33.092811+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.092811+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:17.690793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'42","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.236205+0000","last_change":"2024-09-14T11:53:38.236205+0000","last_active":"2024-09-14T11:53:38.236205+0000","last_peered":"2024-09-14T11:53:38.236205+0000","last_clean":"2024-09-14T11:53:38.236205+0000","last_became_active":"2024-09-14T11:26:02.013721+0000","last_became_peered":"2024-09-14T11:26:02.013721+0000","last_unstale":"2024-09-14T11:53:38.236205+0000","last_undegraded":"2024-09-14T11:53:38.236205+0000","last_fullsized":"2024-09-14T11:53:38.236205+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-14T11:53:38.236095+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-14T11:53:38.236095+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.236095+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:41.680178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":346,"num_read_kb":231,"num_write":104,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:53.278432+0000","last_change":"2024-09-14T11:53:53.278432+0000","last_active":"2024-09-14T11:53:53.278432+0000","last_peered":"2024-09-14T11:53:53.278432+0000","last_clean":"2024-09-14T11:53:53.278432+0000","last_became_active":"2024-09-14T11:38:32.856422+0000","last_became_peered":"2024-09-14T11:38:32.856422+0000","last_unstale":"2024-09-14T11:53:53.278432+0000","last_undegraded":"2024-09-14T11:53:53.278432+0000","last_fullsized":"2024-09-14T11:53:53.278432+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:53.278338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:53.278338+0000","last_clean_scrub_stamp":"2024-09-14T11:53:53.278338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:18.168733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.279915+0000","last_change":"2024-09-14T11:53:33.279915+0000","last_active":"2024-09-14T11:53:33.279915+0000","last_peered":"2024-09-14T11:53:33.279915+0000","last_clean":"2024-09-14T11:53:33.279915+0000","last_became_active":"2024-09-14T11:27:46.876344+0000","last_became_peered":"2024-09-14T11:27:46.876344+0000","last_unstale":"2024-09-14T11:53:33.279915+0000","last_undegraded":"2024-09-14T11:53:33.279915+0000","last_fullsized":"2024-09-14T11:53:33.279915+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:33.279835+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:33.279835+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.279835+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:24.327542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.273383+0000","last_change":"2024-09-14T11:53:40.273383+0000","last_active":"2024-09-14T11:53:40.273383+0000","last_peered":"2024-09-14T11:53:40.273383+0000","last_clean":"2024-09-14T11:53:40.273383+0000","last_became_active":"2024-09-14T11:27:43.843670+0000","last_became_peered":"2024-09-14T11:27:43.843670+0000","last_unstale":"2024-09-14T11:53:40.273383+0000","last_undegraded":"2024-09-14T11:53:40.273383+0000","last_fullsized":"2024-09-14T11:53:40.273383+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:40.273301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:40.273301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.273301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:48.524390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"263'52","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.221788+0000","last_change":"2024-09-14T11:53:37.221788+0000","last_active":"2024-09-14T11:53:37.221788+0000","last_peered":"2024-09-14T11:53:37.221788+0000","last_clean":"2024-09-14T11:53:37.221788+0000","last_became_active":"2024-09-14T11:26:02.016385+0000","last_became_peered":"2024-09-14T11:26:02.016385+0000","last_unstale":"2024-09-14T11:53:37.221788+0000","last_undegraded":"2024-09-14T11:53:37.221788+0000","last_fullsized":"2024-09-14T11:53:37.221788+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'52","last_scrub_stamp":"2024-09-14T11:53:37.221704+0000","last_deep_scrub":"263'52","last_deep_scrub_stamp":"2024-09-14T11:53:37.221704+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.221704+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:39.531965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":414,"num_read_kb":285,"num_write":132,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.777792+0000","last_change":"2024-09-14T11:53:33.777792+0000","last_active":"2024-09-14T11:53:33.777792+0000","last_peered":"2024-09-14T11:53:33.777792+0000","last_clean":"2024-09-14T11:53:33.777792+0000","last_became_active":"2024-09-14T11:38:32.853043+0000","last_became_peered":"2024-09-14T11:38:32.853043+0000","last_unstale":"2024-09-14T11:53:33.777792+0000","last_undegraded":"2024-09-14T11:53:33.777792+0000","last_fullsized":"2024-09-14T11:53:33.777792+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:33.777723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:33.777723+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.777723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:51.890573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.186792+0000","last_change":"2024-09-14T11:53:26.186792+0000","last_active":"2024-09-14T11:53:26.186792+0000","last_peered":"2024-09-14T11:53:26.186792+0000","last_clean":"2024-09-14T11:53:26.186792+0000","last_became_active":"2024-09-14T11:27:46.877187+0000","last_became_peered":"2024-09-14T11:27:46.877187+0000","last_unstale":"2024-09-14T11:53:26.186792+0000","last_undegraded":"2024-09-14T11:53:26.186792+0000","last_fullsized":"2024-09-14T11:53:26.186792+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:26.186683+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.186683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:23.326191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.114698+0000","last_change":"2024-09-14T11:53:31.114698+0000","last_active":"2024-09-14T11:53:31.114698+0000","last_peered":"2024-09-14T11:53:31.114698+0000","last_clean":"2024-09-14T11:53:31.114698+0000","last_became_active":"2024-09-14T11:27:43.847013+0000","last_became_peered":"2024-09-14T11:27:43.847013+0000","last_unstale":"2024-09-14T11:53:31.114698+0000","last_undegraded":"2024-09-14T11:53:31.114698+0000","last_fullsized":"2024-09-14T11:53:31.114698+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:31.114584+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:31.114584+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.114584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:48.525313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'119","reported_seq":407,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.164005+0000","last_change":"2024-09-14T11:53:19.163945+0000","last_active":"2024-09-14T11:53:19.164005+0000","last_peered":"2024-09-14T11:53:19.164005+0000","last_clean":"2024-09-14T11:53:19.164005+0000","last_became_active":"2024-09-14T11:26:02.016295+0000","last_became_peered":"2024-09-14T11:26:02.016295+0000","last_unstale":"2024-09-14T11:53:19.164005+0000","last_undegraded":"2024-09-14T11:53:19.164005+0000","last_fullsized":"2024-09-14T11:53:19.164005+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:19.163864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.163864+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:12.503202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1131,"num_read_kb":881,"num_write":257,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.210755+0000","last_change":"2024-09-14T11:53:49.210755+0000","last_active":"2024-09-14T11:53:49.210755+0000","last_peered":"2024-09-14T11:53:49.210755+0000","last_clean":"2024-09-14T11:53:49.210755+0000","last_became_active":"2024-09-14T11:38:32.852884+0000","last_became_peered":"2024-09-14T11:38:32.852884+0000","last_unstale":"2024-09-14T11:53:49.210755+0000","last_undegraded":"2024-09-14T11:53:49.210755+0000","last_fullsized":"2024-09-14T11:53:49.210755+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:49.210660+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:49.210660+0000","last_clean_scrub_stamp":"2024-09-14T11:53:49.210660+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:10.314539+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"263'14","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.213836+0000","last_change":"2024-09-14T11:53:25.213836+0000","last_active":"2024-09-14T11:53:25.213836+0000","last_peered":"2024-09-14T11:53:25.213836+0000","last_clean":"2024-09-14T11:53:25.213836+0000","last_became_active":"2024-09-14T11:27:46.886166+0000","last_became_peered":"2024-09-14T11:27:46.886166+0000","last_unstale":"2024-09-14T11:53:25.213836+0000","last_undegraded":"2024-09-14T11:53:25.213836+0000","last_fullsized":"2024-09-14T11:53:25.213836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:53:25.213730+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.213730+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:10.155497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":19456,"num_write":24,"num_write_kb":10236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.097941+0000","last_change":"2024-09-14T11:53:32.097941+0000","last_active":"2024-09-14T11:53:32.097941+0000","last_peered":"2024-09-14T11:53:32.097941+0000","last_clean":"2024-09-14T11:53:32.097941+0000","last_became_active":"2024-09-14T11:27:43.844188+0000","last_became_peered":"2024-09-14T11:27:43.844188+0000","last_unstale":"2024-09-14T11:53:32.097941+0000","last_undegraded":"2024-09-14T11:53:32.097941+0000","last_fullsized":"2024-09-14T11:53:32.097941+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:53:32.097856+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:53:32.097856+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.097856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:34.270158+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5174,"num_write":14,"num_write_kb":9270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'46","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.212192+0000","last_change":"2024-09-14T11:53:33.212192+0000","last_active":"2024-09-14T11:53:33.212192+0000","last_peered":"2024-09-14T11:53:33.212192+0000","last_clean":"2024-09-14T11:53:33.212192+0000","last_became_active":"2024-09-14T11:26:02.014618+0000","last_became_peered":"2024-09-14T11:26:02.014618+0000","last_unstale":"2024-09-14T11:53:33.212192+0000","last_undegraded":"2024-09-14T11:53:33.212192+0000","last_fullsized":"2024-09-14T11:53:33.212192+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-14T11:53:33.212071+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-14T11:53:33.212071+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.212071+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:31.092690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":224,"num_write":122,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.199465+0000","last_change":"2024-09-14T11:53:50.199465+0000","last_active":"2024-09-14T11:53:50.199465+0000","last_peered":"2024-09-14T11:53:50.199465+0000","last_clean":"2024-09-14T11:53:50.199465+0000","last_became_active":"2024-09-14T11:38:32.857077+0000","last_became_peered":"2024-09-14T11:38:32.857077+0000","last_unstale":"2024-09-14T11:53:50.199465+0000","last_undegraded":"2024-09-14T11:53:50.199465+0000","last_fullsized":"2024-09-14T11:53:50.199465+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:50.199375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:50.199375+0000","last_clean_scrub_stamp":"2024-09-14T11:53:50.199375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:40.054820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"260'9","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.289336+0000","last_change":"2024-09-14T11:53:35.289264+0000","last_active":"2024-09-14T11:53:35.289336+0000","last_peered":"2024-09-14T11:53:35.289336+0000","last_clean":"2024-09-14T11:53:35.289336+0000","last_became_active":"2024-09-14T11:28:38.964138+0000","last_became_peered":"2024-09-14T11:28:38.964138+0000","last_unstale":"2024-09-14T11:53:35.289336+0000","last_undegraded":"2024-09-14T11:53:35.289336+0000","last_fullsized":"2024-09-14T11:53:35.289336+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'9","last_scrub_stamp":"2024-09-14T11:53:35.289171+0000","last_deep_scrub":"260'9","last_deep_scrub_stamp":"2024-09-14T11:53:35.289171+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.289171+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:48.609988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5124,"num_write":14,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"263'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.257639+0000","last_change":"2024-09-14T11:53:41.257639+0000","last_active":"2024-09-14T11:53:41.257639+0000","last_peered":"2024-09-14T11:53:41.257639+0000","last_clean":"2024-09-14T11:53:41.257639+0000","last_became_active":"2024-09-14T11:27:43.844834+0000","last_became_peered":"2024-09-14T11:27:43.844834+0000","last_unstale":"2024-09-14T11:53:41.257639+0000","last_undegraded":"2024-09-14T11:53:41.257639+0000","last_fullsized":"2024-09-14T11:53:41.257639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:41.257549+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:41.257549+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.257549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:00.033907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12280,"num_write":6,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'42","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.762011+0000","last_change":"2024-09-14T11:53:24.762011+0000","last_active":"2024-09-14T11:53:24.762011+0000","last_peered":"2024-09-14T11:53:24.762011+0000","last_clean":"2024-09-14T11:53:24.762011+0000","last_became_active":"2024-09-14T11:26:02.017778+0000","last_became_peered":"2024-09-14T11:26:02.017778+0000","last_unstale":"2024-09-14T11:53:24.762011+0000","last_undegraded":"2024-09-14T11:53:24.762011+0000","last_fullsized":"2024-09-14T11:53:24.762011+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-14T11:53:24.761926+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.761926+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:38.699880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":337,"num_read_kb":219,"num_write":107,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.782833+0000","last_change":"2024-09-14T11:53:32.782833+0000","last_active":"2024-09-14T11:53:32.782833+0000","last_peered":"2024-09-14T11:53:32.782833+0000","last_clean":"2024-09-14T11:53:32.782833+0000","last_became_active":"2024-09-14T11:38:32.845925+0000","last_became_peered":"2024-09-14T11:38:32.845925+0000","last_unstale":"2024-09-14T11:53:32.782833+0000","last_undegraded":"2024-09-14T11:53:32.782833+0000","last_fullsized":"2024-09-14T11:53:32.782833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:32.782743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:32.782743+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.782743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:29.482924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.269563+0000","last_change":"2024-09-14T11:53:46.269563+0000","last_active":"2024-09-14T11:53:46.269563+0000","last_peered":"2024-09-14T11:53:46.269563+0000","last_clean":"2024-09-14T11:53:46.269563+0000","last_became_active":"2024-09-14T11:27:47.186865+0000","last_became_peered":"2024-09-14T11:27:47.186865+0000","last_unstale":"2024-09-14T11:53:46.269563+0000","last_undegraded":"2024-09-14T11:53:46.269563+0000","last_fullsized":"2024-09-14T11:53:46.269563+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:46.269483+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:46.269483+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.269483+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:13.195441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.350999+0000","last_change":"2024-09-14T11:53:31.350999+0000","last_active":"2024-09-14T11:53:31.350999+0000","last_peered":"2024-09-14T11:53:31.350999+0000","last_clean":"2024-09-14T11:53:31.350999+0000","last_became_active":"2024-09-14T11:27:43.842910+0000","last_became_peered":"2024-09-14T11:27:43.842910+0000","last_unstale":"2024-09-14T11:53:31.350999+0000","last_undegraded":"2024-09-14T11:53:31.350999+0000","last_fullsized":"2024-09-14T11:53:31.350999+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:31.350902+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:31.350902+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.350902+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:44.137144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.191156+0000","last_change":"2024-09-14T11:53:32.191156+0000","last_active":"2024-09-14T11:53:32.191156+0000","last_peered":"2024-09-14T11:53:32.191156+0000","last_clean":"2024-09-14T11:53:32.191156+0000","last_became_active":"2024-09-14T11:26:02.014748+0000","last_became_peered":"2024-09-14T11:26:02.014748+0000","last_unstale":"2024-09-14T11:53:32.191156+0000","last_undegraded":"2024-09-14T11:53:32.191156+0000","last_fullsized":"2024-09-14T11:53:32.191156+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:53:32.191054+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:53:32.191054+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.191054+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:39.704680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":146,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.739702+0000","last_change":"2024-09-14T11:53:20.739702+0000","last_active":"2024-09-14T11:53:20.739702+0000","last_peered":"2024-09-14T11:53:20.739702+0000","last_clean":"2024-09-14T11:53:20.739702+0000","last_became_active":"2024-09-14T11:38:32.848024+0000","last_became_peered":"2024-09-14T11:38:32.848024+0000","last_unstale":"2024-09-14T11:53:20.739702+0000","last_undegraded":"2024-09-14T11:53:20.739702+0000","last_fullsized":"2024-09-14T11:53:20.739702+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:20.739591+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.739591+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:32.573639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.236892+0000","last_change":"2024-09-14T11:53:44.236892+0000","last_active":"2024-09-14T11:53:44.236892+0000","last_peered":"2024-09-14T11:53:44.236892+0000","last_clean":"2024-09-14T11:53:44.236892+0000","last_became_active":"2024-09-14T11:27:47.187771+0000","last_became_peered":"2024-09-14T11:27:47.187771+0000","last_unstale":"2024-09-14T11:53:44.236892+0000","last_undegraded":"2024-09-14T11:53:44.236892+0000","last_fullsized":"2024-09-14T11:53:44.236892+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:44.236806+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:44.236806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.236806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:58.026071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.309638+0000","last_change":"2024-09-14T11:53:38.309638+0000","last_active":"2024-09-14T11:53:38.309638+0000","last_peered":"2024-09-14T11:53:38.309638+0000","last_clean":"2024-09-14T11:53:38.309638+0000","last_became_active":"2024-09-14T11:27:43.840275+0000","last_became_peered":"2024-09-14T11:27:43.840275+0000","last_unstale":"2024-09-14T11:53:38.309638+0000","last_undegraded":"2024-09-14T11:53:38.309638+0000","last_fullsized":"2024-09-14T11:53:38.309638+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:53:38.309551+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:53:38.309551+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.309551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.910789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5122,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'29","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.257999+0000","last_change":"2024-09-14T11:53:36.257999+0000","last_active":"2024-09-14T11:53:36.257999+0000","last_peered":"2024-09-14T11:53:36.257999+0000","last_clean":"2024-09-14T11:53:36.257999+0000","last_became_active":"2024-09-14T11:26:02.013669+0000","last_became_peered":"2024-09-14T11:26:02.013669+0000","last_unstale":"2024-09-14T11:53:36.257999+0000","last_undegraded":"2024-09-14T11:53:36.257999+0000","last_fullsized":"2024-09-14T11:53:36.257999+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:36.257919+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:36.257919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.257919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:38.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":163,"num_write":69,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.257295+0000","last_change":"2024-09-14T11:53:48.257295+0000","last_active":"2024-09-14T11:53:48.257295+0000","last_peered":"2024-09-14T11:53:48.257295+0000","last_clean":"2024-09-14T11:53:48.257295+0000","last_became_active":"2024-09-14T11:38:32.851436+0000","last_became_peered":"2024-09-14T11:38:32.851436+0000","last_unstale":"2024-09-14T11:53:48.257295+0000","last_undegraded":"2024-09-14T11:53:48.257295+0000","last_fullsized":"2024-09-14T11:53:48.257295+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:48.257206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:48.257206+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.257206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:11.163206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.278152+0000","last_change":"2024-09-14T11:53:45.278152+0000","last_active":"2024-09-14T11:53:45.278152+0000","last_peered":"2024-09-14T11:53:45.278152+0000","last_clean":"2024-09-14T11:53:45.278152+0000","last_became_active":"2024-09-14T11:27:47.188383+0000","last_became_peered":"2024-09-14T11:27:47.188383+0000","last_unstale":"2024-09-14T11:53:45.278152+0000","last_undegraded":"2024-09-14T11:53:45.278152+0000","last_fullsized":"2024-09-14T11:53:45.278152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:45.278026+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:45.278026+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.278026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:58.007467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.627528+0000","last_change":"2024-09-14T11:53:15.627528+0000","last_active":"2024-09-14T11:53:15.627528+0000","last_peered":"2024-09-14T11:53:15.627528+0000","last_clean":"2024-09-14T11:53:15.627528+0000","last_became_active":"2024-09-14T11:27:43.833467+0000","last_became_peered":"2024-09-14T11:27:43.833467+0000","last_unstale":"2024-09-14T11:53:15.627528+0000","last_undegraded":"2024-09-14T11:53:15.627528+0000","last_fullsized":"2024-09-14T11:53:15.627528+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.627437+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.627437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:58.857830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"260'22","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.549615+0000","last_change":"2024-09-14T11:53:12.549615+0000","last_active":"2024-09-14T11:53:12.549615+0000","last_peered":"2024-09-14T11:53:12.549615+0000","last_clean":"2024-09-14T11:53:12.549615+0000","last_became_active":"2024-09-14T11:26:02.016387+0000","last_became_peered":"2024-09-14T11:26:02.016387+0000","last_unstale":"2024-09-14T11:53:12.549615+0000","last_undegraded":"2024-09-14T11:53:12.549615+0000","last_fullsized":"2024-09-14T11:53:12.549615+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:53:12.549522+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.549522+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:50.167383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":127,"num_write":52,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.262461+0000","last_change":"2024-09-14T11:53:38.262461+0000","last_active":"2024-09-14T11:53:38.262461+0000","last_peered":"2024-09-14T11:53:38.262461+0000","last_clean":"2024-09-14T11:53:38.262461+0000","last_became_active":"2024-09-14T11:38:32.849071+0000","last_became_peered":"2024-09-14T11:38:32.849071+0000","last_unstale":"2024-09-14T11:53:38.262461+0000","last_undegraded":"2024-09-14T11:53:38.262461+0000","last_fullsized":"2024-09-14T11:53:38.262461+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:38.262369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:38.262369+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.262369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:38:01.619754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.034393+0000","last_change":"2024-09-14T11:53:39.034393+0000","last_active":"2024-09-14T11:53:39.034393+0000","last_peered":"2024-09-14T11:53:39.034393+0000","last_clean":"2024-09-14T11:53:39.034393+0000","last_became_active":"2024-09-14T11:27:46.878897+0000","last_became_peered":"2024-09-14T11:27:46.878897+0000","last_unstale":"2024-09-14T11:53:39.034393+0000","last_undegraded":"2024-09-14T11:53:39.034393+0000","last_fullsized":"2024-09-14T11:53:39.034393+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:39.034268+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:39.034268+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.034268+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:36.678120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.290279+0000","last_change":"2024-09-14T11:53:39.290279+0000","last_active":"2024-09-14T11:53:39.290279+0000","last_peered":"2024-09-14T11:53:39.290279+0000","last_clean":"2024-09-14T11:53:39.290279+0000","last_became_active":"2024-09-14T11:27:43.847125+0000","last_became_peered":"2024-09-14T11:27:43.847125+0000","last_unstale":"2024-09-14T11:53:39.290279+0000","last_undegraded":"2024-09-14T11:53:39.290279+0000","last_fullsized":"2024-09-14T11:53:39.290279+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:39.290180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:39.290180+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.290180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:30.897809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'47","reported_seq":183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.280317+0000","last_change":"2024-09-14T11:53:31.280249+0000","last_active":"2024-09-14T11:53:31.280317+0000","last_peered":"2024-09-14T11:53:31.280317+0000","last_clean":"2024-09-14T11:53:31.280317+0000","last_became_active":"2024-09-14T11:26:02.013917+0000","last_became_peered":"2024-09-14T11:26:02.013917+0000","last_unstale":"2024-09-14T11:53:31.280317+0000","last_undegraded":"2024-09-14T11:53:31.280317+0000","last_fullsized":"2024-09-14T11:53:31.280317+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-14T11:53:31.280166+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-14T11:53:31.280166+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.280166+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:31.394055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":287,"num_write":112,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.238831+0000","last_change":"2024-09-14T11:53:52.238831+0000","last_active":"2024-09-14T11:53:52.238831+0000","last_peered":"2024-09-14T11:53:52.238831+0000","last_clean":"2024-09-14T11:53:52.238831+0000","last_became_active":"2024-09-14T11:38:32.850123+0000","last_became_peered":"2024-09-14T11:38:32.850123+0000","last_unstale":"2024-09-14T11:53:52.238831+0000","last_undegraded":"2024-09-14T11:53:52.238831+0000","last_fullsized":"2024-09-14T11:53:52.238831+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:52.238729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:52.238729+0000","last_clean_scrub_stamp":"2024-09-14T11:53:52.238729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:42.565803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.725318+0000","last_change":"2024-09-14T11:53:30.725318+0000","last_active":"2024-09-14T11:53:30.725318+0000","last_peered":"2024-09-14T11:53:30.725318+0000","last_clean":"2024-09-14T11:53:30.725318+0000","last_became_active":"2024-09-14T11:27:46.877475+0000","last_became_peered":"2024-09-14T11:27:46.877475+0000","last_unstale":"2024-09-14T11:53:30.725318+0000","last_undegraded":"2024-09-14T11:53:30.725318+0000","last_fullsized":"2024-09-14T11:53:30.725318+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:30.725239+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:30.725239+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.725239+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:14.836540+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3076,"num_write":4,"num_write_kb":2052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.142515+0000","last_change":"2024-09-14T11:53:30.142515+0000","last_active":"2024-09-14T11:53:30.142515+0000","last_peered":"2024-09-14T11:53:30.142515+0000","last_clean":"2024-09-14T11:53:30.142515+0000","last_became_active":"2024-09-14T11:27:43.841087+0000","last_became_peered":"2024-09-14T11:27:43.841087+0000","last_unstale":"2024-09-14T11:53:30.142515+0000","last_undegraded":"2024-09-14T11:53:30.142515+0000","last_fullsized":"2024-09-14T11:53:30.142515+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:53:30.142395+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:53:30.142395+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.142395+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:18.396082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'36","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.286304+0000","last_change":"2024-09-14T11:53:32.286203+0000","last_active":"2024-09-14T11:53:32.286304+0000","last_peered":"2024-09-14T11:53:32.286304+0000","last_clean":"2024-09-14T11:53:32.286304+0000","last_became_active":"2024-09-14T11:26:02.015059+0000","last_became_peered":"2024-09-14T11:26:02.015059+0000","last_unstale":"2024-09-14T11:53:32.286304+0000","last_undegraded":"2024-09-14T11:53:32.286304+0000","last_fullsized":"2024-09-14T11:53:32.286304+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T11:53:32.286094+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T11:53:32.286094+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.286094+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.169538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":294,"num_read_kb":168,"num_write":90,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:48.327911+0000","last_change":"2024-09-14T11:53:48.327911+0000","last_active":"2024-09-14T11:53:48.327911+0000","last_peered":"2024-09-14T11:53:48.327911+0000","last_clean":"2024-09-14T11:53:48.327911+0000","last_became_active":"2024-09-14T11:38:32.853948+0000","last_became_peered":"2024-09-14T11:38:32.853948+0000","last_unstale":"2024-09-14T11:53:48.327911+0000","last_undegraded":"2024-09-14T11:53:48.327911+0000","last_fullsized":"2024-09-14T11:53:48.327911+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:48.327825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:48.327825+0000","last_clean_scrub_stamp":"2024-09-14T11:53:48.327825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:11.011540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.729932+0000","last_change":"2024-09-14T11:53:29.729932+0000","last_active":"2024-09-14T11:53:29.729932+0000","last_peered":"2024-09-14T11:53:29.729932+0000","last_clean":"2024-09-14T11:53:29.729932+0000","last_became_active":"2024-09-14T11:27:46.879216+0000","last_became_peered":"2024-09-14T11:27:46.879216+0000","last_unstale":"2024-09-14T11:53:29.729932+0000","last_undegraded":"2024-09-14T11:53:29.729932+0000","last_fullsized":"2024-09-14T11:53:29.729932+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:29.729825+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:29.729825+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.729825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:07.027942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2056,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.285407+0000","last_change":"2024-09-14T11:53:41.285407+0000","last_active":"2024-09-14T11:53:41.285407+0000","last_peered":"2024-09-14T11:53:41.285407+0000","last_clean":"2024-09-14T11:53:41.285407+0000","last_became_active":"2024-09-14T11:27:43.832775+0000","last_became_peered":"2024-09-14T11:27:43.832775+0000","last_unstale":"2024-09-14T11:53:41.285407+0000","last_undegraded":"2024-09-14T11:53:41.285407+0000","last_fullsized":"2024-09-14T11:53:41.285407+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:41.285324+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:41.285324+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.285324+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:29:37.987762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":10,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'16","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.238686+0000","last_change":"2024-09-14T11:53:31.238625+0000","last_active":"2024-09-14T11:53:31.238686+0000","last_peered":"2024-09-14T11:53:31.238686+0000","last_clean":"2024-09-14T11:53:31.238686+0000","last_became_active":"2024-09-14T11:26:02.012248+0000","last_became_peered":"2024-09-14T11:26:02.012248+0000","last_unstale":"2024-09-14T11:53:31.238686+0000","last_undegraded":"2024-09-14T11:53:31.238686+0000","last_fullsized":"2024-09-14T11:53:31.238686+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:53:31.238550+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:53:31.238550+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.238550+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:36.113957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":76,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.283863+0000","last_change":"2024-09-14T11:53:49.283863+0000","last_active":"2024-09-14T11:53:49.283863+0000","last_peered":"2024-09-14T11:53:49.283863+0000","last_clean":"2024-09-14T11:53:49.283863+0000","last_became_active":"2024-09-14T11:38:32.850131+0000","last_became_peered":"2024-09-14T11:38:32.850131+0000","last_unstale":"2024-09-14T11:53:49.283863+0000","last_undegraded":"2024-09-14T11:53:49.283863+0000","last_fullsized":"2024-09-14T11:53:49.283863+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:49.283775+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:49.283775+0000","last_clean_scrub_stamp":"2024-09-14T11:53:49.283775+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:04.989737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.252127+0000","last_change":"2024-09-14T11:53:47.252127+0000","last_active":"2024-09-14T11:53:47.252127+0000","last_peered":"2024-09-14T11:53:47.252127+0000","last_clean":"2024-09-14T11:53:47.252127+0000","last_became_active":"2024-09-14T11:27:46.881614+0000","last_became_peered":"2024-09-14T11:27:46.881614+0000","last_unstale":"2024-09-14T11:53:47.252127+0000","last_undegraded":"2024-09-14T11:53:47.252127+0000","last_fullsized":"2024-09-14T11:53:47.252127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.252016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.252016+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.252016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:30.835677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.152130+0000","last_change":"2024-09-14T11:53:22.152065+0000","last_active":"2024-09-14T11:53:22.152130+0000","last_peered":"2024-09-14T11:53:22.152130+0000","last_clean":"2024-09-14T11:53:22.152130+0000","last_became_active":"2024-09-14T11:27:43.841525+0000","last_became_peered":"2024-09-14T11:27:43.841525+0000","last_unstale":"2024-09-14T11:53:22.152130+0000","last_undegraded":"2024-09-14T11:53:22.152130+0000","last_fullsized":"2024-09-14T11:53:22.152130+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:22.151939+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.151939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.121719+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'16","reported_seq":98,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.081298+0000","last_change":"2024-09-14T11:53:28.081225+0000","last_active":"2024-09-14T11:53:28.081298+0000","last_peered":"2024-09-14T11:53:28.081298+0000","last_clean":"2024-09-14T11:53:28.081298+0000","last_became_active":"2024-09-14T11:26:02.016891+0000","last_became_peered":"2024-09-14T11:26:02.016891+0000","last_unstale":"2024-09-14T11:53:28.081298+0000","last_undegraded":"2024-09-14T11:53:28.081298+0000","last_fullsized":"2024-09-14T11:53:28.081298+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:53:28.081140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.081140+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:12.464070+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":70,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:50.260185+0000","last_change":"2024-09-14T11:53:50.260185+0000","last_active":"2024-09-14T11:53:50.260185+0000","last_peered":"2024-09-14T11:53:50.260185+0000","last_clean":"2024-09-14T11:53:50.260185+0000","last_became_active":"2024-09-14T11:38:32.849322+0000","last_became_peered":"2024-09-14T11:38:32.849322+0000","last_unstale":"2024-09-14T11:53:50.260185+0000","last_undegraded":"2024-09-14T11:53:50.260185+0000","last_fullsized":"2024-09-14T11:53:50.260185+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:50.260090+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:50.260090+0000","last_clean_scrub_stamp":"2024-09-14T11:53:50.260090+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:49.423228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"263'8","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.194215+0000","last_change":"2024-09-14T11:53:24.194095+0000","last_active":"2024-09-14T11:53:24.194215+0000","last_peered":"2024-09-14T11:53:24.194215+0000","last_clean":"2024-09-14T11:53:24.194215+0000","last_became_active":"2024-09-14T11:27:46.877835+0000","last_became_peered":"2024-09-14T11:27:46.877835+0000","last_unstale":"2024-09-14T11:53:24.194215+0000","last_undegraded":"2024-09-14T11:53:24.194215+0000","last_fullsized":"2024-09-14T11:53:24.194215+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:53:24.193998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.193998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:25.664721+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8188,"num_write":8,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"260'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.325232+0000","last_change":"2024-09-14T11:53:32.325232+0000","last_active":"2024-09-14T11:53:32.325232+0000","last_peered":"2024-09-14T11:53:32.325232+0000","last_clean":"2024-09-14T11:53:32.325232+0000","last_became_active":"2024-09-14T11:27:43.841954+0000","last_became_peered":"2024-09-14T11:27:43.841954+0000","last_unstale":"2024-09-14T11:53:32.325232+0000","last_undegraded":"2024-09-14T11:53:32.325232+0000","last_fullsized":"2024-09-14T11:53:32.325232+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:32.325106+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:32.325106+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.325106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:36.707398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"260'22","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.212592+0000","last_change":"2024-09-14T11:53:35.212510+0000","last_active":"2024-09-14T11:53:35.212592+0000","last_peered":"2024-09-14T11:53:35.212592+0000","last_clean":"2024-09-14T11:53:35.212592+0000","last_became_active":"2024-09-14T11:26:02.017550+0000","last_became_peered":"2024-09-14T11:26:02.017550+0000","last_unstale":"2024-09-14T11:53:35.212592+0000","last_undegraded":"2024-09-14T11:53:35.212592+0000","last_fullsized":"2024-09-14T11:53:35.212592+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'22","last_scrub_stamp":"2024-09-14T11:53:35.212423+0000","last_deep_scrub":"260'22","last_deep_scrub_stamp":"2024-09-14T11:53:35.212423+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.212423+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:52.340143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":110,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.717947+0000","last_change":"2024-09-14T11:53:18.717869+0000","last_active":"2024-09-14T11:53:18.717947+0000","last_peered":"2024-09-14T11:53:18.717947+0000","last_clean":"2024-09-14T11:53:18.717947+0000","last_became_active":"2024-09-14T11:38:32.848490+0000","last_became_peered":"2024-09-14T11:38:32.848490+0000","last_unstale":"2024-09-14T11:53:18.717947+0000","last_undegraded":"2024-09-14T11:53:18.717947+0000","last_fullsized":"2024-09-14T11:53:18.717947+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.717779+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.717779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.843164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.237449+0000","last_change":"2024-09-14T11:53:43.237449+0000","last_active":"2024-09-14T11:53:43.237449+0000","last_peered":"2024-09-14T11:53:43.237449+0000","last_clean":"2024-09-14T11:53:43.237449+0000","last_became_active":"2024-09-14T11:27:46.878960+0000","last_became_peered":"2024-09-14T11:27:46.878960+0000","last_unstale":"2024-09-14T11:53:43.237449+0000","last_undegraded":"2024-09-14T11:53:43.237449+0000","last_fullsized":"2024-09-14T11:53:43.237449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:43.237352+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:43.237352+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.237352+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:28.229596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'10","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.314456+0000","last_change":"2024-09-14T11:53:37.314456+0000","last_active":"2024-09-14T11:53:37.314456+0000","last_peered":"2024-09-14T11:53:37.314456+0000","last_clean":"2024-09-14T11:53:37.314456+0000","last_became_active":"2024-09-14T11:27:43.837977+0000","last_became_peered":"2024-09-14T11:27:43.837977+0000","last_unstale":"2024-09-14T11:53:37.314456+0000","last_undegraded":"2024-09-14T11:53:37.314456+0000","last_fullsized":"2024-09-14T11:53:37.314456+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:37.314359+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:37.314359+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.314359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:48.729888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":21510,"num_write":20,"num_write_kb":9220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'12","reported_seq":88,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:32.233030+0000","last_change":"2024-09-14T11:53:32.233030+0000","last_active":"2024-09-14T11:53:32.233030+0000","last_peered":"2024-09-14T11:53:32.233030+0000","last_clean":"2024-09-14T11:53:32.233030+0000","last_became_active":"2024-09-14T11:26:02.012606+0000","last_became_peered":"2024-09-14T11:26:02.012606+0000","last_unstale":"2024-09-14T11:53:32.233030+0000","last_undegraded":"2024-09-14T11:53:32.233030+0000","last_fullsized":"2024-09-14T11:53:32.233030+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:53:32.232936+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:53:32.232936+0000","last_clean_scrub_stamp":"2024-09-14T11:53:32.232936+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:03.754233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.335812+0000","last_change":"2024-09-14T11:53:45.335812+0000","last_active":"2024-09-14T11:53:45.335812+0000","last_peered":"2024-09-14T11:53:45.335812+0000","last_clean":"2024-09-14T11:53:45.335812+0000","last_became_active":"2024-09-14T11:38:32.849509+0000","last_became_peered":"2024-09-14T11:38:32.849509+0000","last_unstale":"2024-09-14T11:53:45.335812+0000","last_undegraded":"2024-09-14T11:53:45.335812+0000","last_fullsized":"2024-09-14T11:53:45.335812+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:45.335725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:45.335725+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.335725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:35.338850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.263238+0000","last_change":"2024-09-14T11:53:40.263238+0000","last_active":"2024-09-14T11:53:40.263238+0000","last_peered":"2024-09-14T11:53:40.263238+0000","last_clean":"2024-09-14T11:53:40.263238+0000","last_became_active":"2024-09-14T11:27:46.874814+0000","last_became_peered":"2024-09-14T11:27:46.874814+0000","last_unstale":"2024-09-14T11:53:40.263238+0000","last_undegraded":"2024-09-14T11:53:40.263238+0000","last_fullsized":"2024-09-14T11:53:40.263238+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:40.263146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:40.263146+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.263146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:09.116046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.663445+0000","last_change":"2024-09-14T11:53:16.663445+0000","last_active":"2024-09-14T11:53:16.663445+0000","last_peered":"2024-09-14T11:53:16.663445+0000","last_clean":"2024-09-14T11:53:16.663445+0000","last_became_active":"2024-09-14T11:27:43.841631+0000","last_became_peered":"2024-09-14T11:27:43.841631+0000","last_unstale":"2024-09-14T11:53:16.663445+0000","last_undegraded":"2024-09-14T11:53:16.663445+0000","last_fullsized":"2024-09-14T11:53:16.663445+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.663354+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.663354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:23.071337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.384432+0000","last_change":"2024-09-14T11:53:29.384432+0000","last_active":"2024-09-14T11:53:29.384432+0000","last_peered":"2024-09-14T11:53:29.384432+0000","last_clean":"2024-09-14T11:53:29.384432+0000","last_became_active":"2024-09-14T11:26:02.018400+0000","last_became_peered":"2024-09-14T11:26:02.018400+0000","last_unstale":"2024-09-14T11:53:29.384432+0000","last_undegraded":"2024-09-14T11:53:29.384432+0000","last_fullsized":"2024-09-14T11:53:29.384432+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'20","last_scrub_stamp":"2024-09-14T11:53:29.384333+0000","last_deep_scrub":"263'20","last_deep_scrub_stamp":"2024-09-14T11:53:29.384333+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.384333+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:30.253564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":95,"num_write":50,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.160042+0000","last_change":"2024-09-14T11:53:27.159984+0000","last_active":"2024-09-14T11:53:27.160042+0000","last_peered":"2024-09-14T11:53:27.160042+0000","last_clean":"2024-09-14T11:53:27.160042+0000","last_became_active":"2024-09-14T11:38:32.850065+0000","last_became_peered":"2024-09-14T11:38:32.850065+0000","last_unstale":"2024-09-14T11:53:27.160042+0000","last_undegraded":"2024-09-14T11:53:27.160042+0000","last_fullsized":"2024-09-14T11:53:27.160042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:27.159896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.159896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:22.228903+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.724293+0000","last_change":"2024-09-14T11:53:28.724293+0000","last_active":"2024-09-14T11:53:28.724293+0000","last_peered":"2024-09-14T11:53:28.724293+0000","last_clean":"2024-09-14T11:53:28.724293+0000","last_became_active":"2024-09-14T11:27:47.189247+0000","last_became_peered":"2024-09-14T11:27:47.189247+0000","last_unstale":"2024-09-14T11:53:28.724293+0000","last_undegraded":"2024-09-14T11:53:28.724293+0000","last_fullsized":"2024-09-14T11:53:28.724293+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:28.724205+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.724205+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:53.783027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5124,"num_write":4,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.252974+0000","last_change":"2024-09-14T11:53:38.252974+0000","last_active":"2024-09-14T11:53:38.252974+0000","last_peered":"2024-09-14T11:53:38.252974+0000","last_clean":"2024-09-14T11:53:38.252974+0000","last_became_active":"2024-09-14T11:27:43.845169+0000","last_became_peered":"2024-09-14T11:27:43.845169+0000","last_unstale":"2024-09-14T11:53:38.252974+0000","last_undegraded":"2024-09-14T11:53:38.252974+0000","last_fullsized":"2024-09-14T11:53:38.252974+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:38.252896+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:38.252896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.252896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:16.951537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"263'39","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.163194+0000","last_change":"2024-09-14T11:53:20.163194+0000","last_active":"2024-09-14T11:53:20.163194+0000","last_peered":"2024-09-14T11:53:20.163194+0000","last_clean":"2024-09-14T11:53:20.163194+0000","last_became_active":"2024-09-14T11:26:02.014219+0000","last_became_peered":"2024-09-14T11:26:02.014219+0000","last_unstale":"2024-09-14T11:53:20.163194+0000","last_undegraded":"2024-09-14T11:53:20.163194+0000","last_fullsized":"2024-09-14T11:53:20.163194+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-14T11:53:20.163114+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.163114+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:11.811539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":296,"num_read_kb":186,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.350806+0000","last_change":"2024-09-14T11:53:44.350806+0000","last_active":"2024-09-14T11:53:44.350806+0000","last_peered":"2024-09-14T11:53:44.350806+0000","last_clean":"2024-09-14T11:53:44.350806+0000","last_became_active":"2024-09-14T11:38:32.850242+0000","last_became_peered":"2024-09-14T11:38:32.850242+0000","last_unstale":"2024-09-14T11:53:44.350806+0000","last_undegraded":"2024-09-14T11:53:44.350806+0000","last_fullsized":"2024-09-14T11:53:44.350806+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:44.350699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:44.350699+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.350699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:57.083322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.281031+0000","last_change":"2024-09-14T11:53:42.281031+0000","last_active":"2024-09-14T11:53:42.281031+0000","last_peered":"2024-09-14T11:53:42.281031+0000","last_clean":"2024-09-14T11:53:42.281031+0000","last_became_active":"2024-09-14T11:27:46.876251+0000","last_became_peered":"2024-09-14T11:27:46.876251+0000","last_unstale":"2024-09-14T11:53:42.281031+0000","last_undegraded":"2024-09-14T11:53:42.281031+0000","last_fullsized":"2024-09-14T11:53:42.281031+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:42.280931+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:42.280931+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.280931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:13.086850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4112,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.797058+0000","last_change":"2024-09-14T11:53:22.797058+0000","last_active":"2024-09-14T11:53:22.797058+0000","last_peered":"2024-09-14T11:53:22.797058+0000","last_clean":"2024-09-14T11:53:22.797058+0000","last_became_active":"2024-09-14T11:27:43.842526+0000","last_became_peered":"2024-09-14T11:27:43.842526+0000","last_unstale":"2024-09-14T11:53:22.797058+0000","last_undegraded":"2024-09-14T11:53:22.797058+0000","last_fullsized":"2024-09-14T11:53:22.797058+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.796963+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.796963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:55.082758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.547416+0000","last_change":"2024-09-14T11:53:11.547416+0000","last_active":"2024-09-14T11:53:11.547416+0000","last_peered":"2024-09-14T11:53:11.547416+0000","last_clean":"2024-09-14T11:53:11.547416+0000","last_became_active":"2024-09-14T11:26:02.008877+0000","last_became_peered":"2024-09-14T11:26:02.008877+0000","last_unstale":"2024-09-14T11:53:11.547416+0000","last_undegraded":"2024-09-14T11:53:11.547416+0000","last_fullsized":"2024-09-14T11:53:11.547416+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:53:11.547332+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.547332+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:08.246053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":175,"num_write":75,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:49.283726+0000","last_change":"2024-09-14T11:53:49.283726+0000","last_active":"2024-09-14T11:53:49.283726+0000","last_peered":"2024-09-14T11:53:49.283726+0000","last_clean":"2024-09-14T11:53:49.283726+0000","last_became_active":"2024-09-14T11:38:32.854215+0000","last_became_peered":"2024-09-14T11:38:32.854215+0000","last_unstale":"2024-09-14T11:53:49.283726+0000","last_undegraded":"2024-09-14T11:53:49.283726+0000","last_fullsized":"2024-09-14T11:53:49.283726+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:49.283596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:49.283596+0000","last_clean_scrub_stamp":"2024-09-14T11:53:49.283596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:18.500103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.092101+0000","last_change":"2024-09-14T11:53:36.092035+0000","last_active":"2024-09-14T11:53:36.092101+0000","last_peered":"2024-09-14T11:53:36.092101+0000","last_clean":"2024-09-14T11:53:36.092101+0000","last_became_active":"2024-09-14T11:27:46.881059+0000","last_became_peered":"2024-09-14T11:27:46.881059+0000","last_unstale":"2024-09-14T11:53:36.092101+0000","last_undegraded":"2024-09-14T11:53:36.092101+0000","last_fullsized":"2024-09-14T11:53:36.092101+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:36.091944+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:36.091944+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.091944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:04.031148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":6166,"num_write":6,"num_write_kb":4108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.205400+0000","last_change":"2024-09-14T11:53:36.205343+0000","last_active":"2024-09-14T11:53:36.205400+0000","last_peered":"2024-09-14T11:53:36.205400+0000","last_clean":"2024-09-14T11:53:36.205400+0000","last_became_active":"2024-09-14T11:27:43.842256+0000","last_became_peered":"2024-09-14T11:27:43.842256+0000","last_unstale":"2024-09-14T11:53:36.205400+0000","last_undegraded":"2024-09-14T11:53:36.205400+0000","last_fullsized":"2024-09-14T11:53:36.205400+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:36.205262+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:36.205262+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.205262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:55.331608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'18","reported_seq":100,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.244029+0000","last_change":"2024-09-14T11:53:30.244029+0000","last_active":"2024-09-14T11:53:30.244029+0000","last_peered":"2024-09-14T11:53:30.244029+0000","last_clean":"2024-09-14T11:53:30.244029+0000","last_became_active":"2024-09-14T11:26:02.014916+0000","last_became_peered":"2024-09-14T11:26:02.014916+0000","last_unstale":"2024-09-14T11:53:30.244029+0000","last_undegraded":"2024-09-14T11:53:30.244029+0000","last_fullsized":"2024-09-14T11:53:30.244029+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:53:30.243937+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:53:30.243937+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.243937+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:57.762844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":80,"num_write":50,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.301436+0000","last_change":"2024-09-14T11:53:47.301436+0000","last_active":"2024-09-14T11:53:47.301436+0000","last_peered":"2024-09-14T11:53:47.301436+0000","last_clean":"2024-09-14T11:53:47.301436+0000","last_became_active":"2024-09-14T11:38:32.848286+0000","last_became_peered":"2024-09-14T11:38:32.848286+0000","last_unstale":"2024-09-14T11:53:47.301436+0000","last_undegraded":"2024-09-14T11:53:47.301436+0000","last_fullsized":"2024-09-14T11:53:47.301436+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.301336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.301336+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.301336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:41.791728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:39.344533+0000","last_change":"2024-09-14T11:53:39.344463+0000","last_active":"2024-09-14T11:53:39.344533+0000","last_peered":"2024-09-14T11:53:39.344533+0000","last_clean":"2024-09-14T11:53:39.344533+0000","last_became_active":"2024-09-14T11:27:47.186695+0000","last_became_peered":"2024-09-14T11:27:47.186695+0000","last_unstale":"2024-09-14T11:53:39.344533+0000","last_undegraded":"2024-09-14T11:53:39.344533+0000","last_fullsized":"2024-09-14T11:53:39.344533+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:53:39.344376+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:53:39.344376+0000","last_clean_scrub_stamp":"2024-09-14T11:53:39.344376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:16.228806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.750144+0000","last_change":"2024-09-14T11:53:23.750077+0000","last_active":"2024-09-14T11:53:23.750144+0000","last_peered":"2024-09-14T11:53:23.750144+0000","last_clean":"2024-09-14T11:53:23.750144+0000","last_became_active":"2024-09-14T11:27:43.843243+0000","last_became_peered":"2024-09-14T11:27:43.843243+0000","last_unstale":"2024-09-14T11:53:23.750144+0000","last_undegraded":"2024-09-14T11:53:23.750144+0000","last_fullsized":"2024-09-14T11:53:23.750144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:53:23.749996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.749996+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:49.227281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4143,"num_write":14,"num_write_kb":7207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"263'54","reported_seq":193,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.264725+0000","last_change":"2024-09-14T11:53:30.264725+0000","last_active":"2024-09-14T11:53:30.264725+0000","last_peered":"2024-09-14T11:53:30.264725+0000","last_clean":"2024-09-14T11:53:30.264725+0000","last_became_active":"2024-09-14T11:26:02.013523+0000","last_became_peered":"2024-09-14T11:26:02.013523+0000","last_unstale":"2024-09-14T11:53:30.264725+0000","last_undegraded":"2024-09-14T11:53:30.264725+0000","last_fullsized":"2024-09-14T11:53:30.264725+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'54","last_scrub_stamp":"2024-09-14T11:53:30.264629+0000","last_deep_scrub":"263'54","last_deep_scrub_stamp":"2024-09-14T11:53:30.264629+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.264629+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:49.334114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":396,"num_read_kb":263,"num_write":155,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":29,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.321857+0000","last_change":"2024-09-14T11:53:46.321857+0000","last_active":"2024-09-14T11:53:46.321857+0000","last_peered":"2024-09-14T11:53:46.321857+0000","last_clean":"2024-09-14T11:53:46.321857+0000","last_became_active":"2024-09-14T11:38:32.851269+0000","last_became_peered":"2024-09-14T11:38:32.851269+0000","last_unstale":"2024-09-14T11:53:46.321857+0000","last_undegraded":"2024-09-14T11:53:46.321857+0000","last_fullsized":"2024-09-14T11:53:46.321857+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:46.321738+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:46.321738+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.321738+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:04.189056+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.766402+0000","last_change":"2024-09-14T11:53:27.766402+0000","last_active":"2024-09-14T11:53:27.766402+0000","last_peered":"2024-09-14T11:53:27.766402+0000","last_clean":"2024-09-14T11:53:27.766402+0000","last_became_active":"2024-09-14T11:27:46.881343+0000","last_became_peered":"2024-09-14T11:27:46.881343+0000","last_unstale":"2024-09-14T11:53:27.766402+0000","last_undegraded":"2024-09-14T11:53:27.766402+0000","last_fullsized":"2024-09-14T11:53:27.766402+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:27.766298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.766298+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:30.703536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.221384+0000","last_change":"2024-09-14T11:53:37.221315+0000","last_active":"2024-09-14T11:53:37.221384+0000","last_peered":"2024-09-14T11:53:37.221384+0000","last_clean":"2024-09-14T11:53:37.221384+0000","last_became_active":"2024-09-14T11:27:43.846954+0000","last_became_peered":"2024-09-14T11:27:43.846954+0000","last_unstale":"2024-09-14T11:53:37.221384+0000","last_undegraded":"2024-09-14T11:53:37.221384+0000","last_fullsized":"2024-09-14T11:53:37.221384+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:37.221224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:37.221224+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.221224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:25.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'10","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.181040+0000","last_change":"2024-09-14T11:53:30.181040+0000","last_active":"2024-09-14T11:53:30.181040+0000","last_peered":"2024-09-14T11:53:30.181040+0000","last_clean":"2024-09-14T11:53:30.181040+0000","last_became_active":"2024-09-14T11:26:02.006142+0000","last_became_peered":"2024-09-14T11:26:02.006142+0000","last_unstale":"2024-09-14T11:53:30.181040+0000","last_undegraded":"2024-09-14T11:53:30.181040+0000","last_fullsized":"2024-09-14T11:53:30.181040+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:53:30.180953+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:53:30.180953+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.180953+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:08.891640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":50,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":27,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:47.304470+0000","last_change":"2024-09-14T11:53:47.304470+0000","last_active":"2024-09-14T11:53:47.304470+0000","last_peered":"2024-09-14T11:53:47.304470+0000","last_clean":"2024-09-14T11:53:47.304470+0000","last_became_active":"2024-09-14T11:38:32.849338+0000","last_became_peered":"2024-09-14T11:38:32.849338+0000","last_unstale":"2024-09-14T11:53:47.304470+0000","last_undegraded":"2024-09-14T11:53:47.304470+0000","last_fullsized":"2024-09-14T11:53:47.304470+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:47.304375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:47.304375+0000","last_clean_scrub_stamp":"2024-09-14T11:53:47.304375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:07.980584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:40.371976+0000","last_change":"2024-09-14T11:53:40.371908+0000","last_active":"2024-09-14T11:53:40.371976+0000","last_peered":"2024-09-14T11:53:40.371976+0000","last_clean":"2024-09-14T11:53:40.371976+0000","last_became_active":"2024-09-14T11:27:46.881215+0000","last_became_peered":"2024-09-14T11:27:46.881215+0000","last_unstale":"2024-09-14T11:53:40.371976+0000","last_undegraded":"2024-09-14T11:53:40.371976+0000","last_fullsized":"2024-09-14T11:53:40.371976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:40.371816+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:40.371816+0000","last_clean_scrub_stamp":"2024-09-14T11:53:40.371816+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:56.488968+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"260'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.127866+0000","last_change":"2024-09-14T11:53:29.127866+0000","last_active":"2024-09-14T11:53:29.127866+0000","last_peered":"2024-09-14T11:53:29.127866+0000","last_clean":"2024-09-14T11:53:29.127866+0000","last_became_active":"2024-09-14T11:27:43.843845+0000","last_became_peered":"2024-09-14T11:27:43.843845+0000","last_unstale":"2024-09-14T11:53:29.127866+0000","last_undegraded":"2024-09-14T11:53:29.127866+0000","last_fullsized":"2024-09-14T11:53:29.127866+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-14T11:53:29.127775+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-14T11:53:29.127775+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.127775+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:24.770271+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16370,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'62","reported_seq":225,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.155477+0000","last_change":"2024-09-14T11:53:18.155477+0000","last_active":"2024-09-14T11:53:18.155477+0000","last_peered":"2024-09-14T11:53:18.155477+0000","last_clean":"2024-09-14T11:53:18.155477+0000","last_became_active":"2024-09-14T11:26:02.015204+0000","last_became_peered":"2024-09-14T11:26:02.015204+0000","last_unstale":"2024-09-14T11:53:18.155477+0000","last_undegraded":"2024-09-14T11:53:18.155477+0000","last_fullsized":"2024-09-14T11:53:18.155477+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'62","last_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_deep_scrub":"263'62","last_deep_scrub_stamp":"2024-09-14T11:53:18.155393+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.155393+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:37.081156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":486,"num_read_kb":319,"num_write":160,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.368096+0000","last_change":"2024-09-14T11:53:42.368096+0000","last_active":"2024-09-14T11:53:42.368096+0000","last_peered":"2024-09-14T11:53:42.368096+0000","last_clean":"2024-09-14T11:53:42.368096+0000","last_became_active":"2024-09-14T11:38:32.849546+0000","last_became_peered":"2024-09-14T11:38:32.849546+0000","last_unstale":"2024-09-14T11:53:42.368096+0000","last_undegraded":"2024-09-14T11:53:42.368096+0000","last_fullsized":"2024-09-14T11:53:42.368096+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:42.367996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:42.367996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.367996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:55.845584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:44.320242+0000","last_change":"2024-09-14T11:53:44.320242+0000","last_active":"2024-09-14T11:53:44.320242+0000","last_peered":"2024-09-14T11:53:44.320242+0000","last_clean":"2024-09-14T11:53:44.320242+0000","last_became_active":"2024-09-14T11:27:46.873438+0000","last_became_peered":"2024-09-14T11:27:46.873438+0000","last_unstale":"2024-09-14T11:53:44.320242+0000","last_undegraded":"2024-09-14T11:53:44.320242+0000","last_fullsized":"2024-09-14T11:53:44.320242+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:53:44.320156+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:53:44.320156+0000","last_clean_scrub_stamp":"2024-09-14T11:53:44.320156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:54.068601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":12378,"num_write":6,"num_write_kb":4142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.312423+0000","last_change":"2024-09-14T11:53:35.312423+0000","last_active":"2024-09-14T11:53:35.312423+0000","last_peered":"2024-09-14T11:53:35.312423+0000","last_clean":"2024-09-14T11:53:35.312423+0000","last_became_active":"2024-09-14T11:27:43.842274+0000","last_became_peered":"2024-09-14T11:27:43.842274+0000","last_unstale":"2024-09-14T11:53:35.312423+0000","last_undegraded":"2024-09-14T11:53:35.312423+0000","last_fullsized":"2024-09-14T11:53:35.312423+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:53:35.312309+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:53:35.312309+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.312309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:43.188346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10258,"num_write":8,"num_write_kb":8200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'23","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.230745+0000","last_change":"2024-09-14T11:53:29.230745+0000","last_active":"2024-09-14T11:53:29.230745+0000","last_peered":"2024-09-14T11:53:29.230745+0000","last_clean":"2024-09-14T11:53:29.230745+0000","last_became_active":"2024-09-14T11:26:02.012774+0000","last_became_peered":"2024-09-14T11:26:02.012774+0000","last_unstale":"2024-09-14T11:53:29.230745+0000","last_undegraded":"2024-09-14T11:53:29.230745+0000","last_fullsized":"2024-09-14T11:53:29.230745+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-14T11:53:29.230662+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-14T11:53:29.230662+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.230662+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:15.109449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":112,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:37.279517+0000","last_change":"2024-09-14T11:53:37.279517+0000","last_active":"2024-09-14T11:53:37.279517+0000","last_peered":"2024-09-14T11:53:37.279517+0000","last_clean":"2024-09-14T11:53:37.279517+0000","last_became_active":"2024-09-14T11:38:32.856689+0000","last_became_peered":"2024-09-14T11:38:32.856689+0000","last_unstale":"2024-09-14T11:53:37.279517+0000","last_undegraded":"2024-09-14T11:53:37.279517+0000","last_fullsized":"2024-09-14T11:53:37.279517+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:37.279404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:37.279404+0000","last_clean_scrub_stamp":"2024-09-14T11:53:37.279404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:49.567549+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:42.282196+0000","last_change":"2024-09-14T11:53:42.282196+0000","last_active":"2024-09-14T11:53:42.282196+0000","last_peered":"2024-09-14T11:53:42.282196+0000","last_clean":"2024-09-14T11:53:42.282196+0000","last_became_active":"2024-09-14T11:27:47.187139+0000","last_became_peered":"2024-09-14T11:27:47.187139+0000","last_unstale":"2024-09-14T11:53:42.282196+0000","last_undegraded":"2024-09-14T11:53:42.282196+0000","last_fullsized":"2024-09-14T11:53:42.282196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:42.282099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:42.282099+0000","last_clean_scrub_stamp":"2024-09-14T11:53:42.282099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:19.684676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.617156+0000","last_change":"2024-09-14T11:53:14.617156+0000","last_active":"2024-09-14T11:53:14.617156+0000","last_peered":"2024-09-14T11:53:14.617156+0000","last_clean":"2024-09-14T11:53:14.617156+0000","last_became_active":"2024-09-14T11:27:43.842311+0000","last_became_peered":"2024-09-14T11:27:43.842311+0000","last_unstale":"2024-09-14T11:53:14.617156+0000","last_undegraded":"2024-09-14T11:53:14.617156+0000","last_fullsized":"2024-09-14T11:53:14.617156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:53:14.617045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.617045+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:52.240454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4136,"num_write":12,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'279","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.172440+0000","last_change":"2024-09-14T11:53:17.172440+0000","last_active":"2024-09-14T11:53:17.172440+0000","last_peered":"2024-09-14T11:53:17.172440+0000","last_clean":"2024-09-14T11:53:17.172440+0000","last_became_active":"2024-09-14T11:26:02.017632+0000","last_became_peered":"2024-09-14T11:26:02.017632+0000","last_unstale":"2024-09-14T11:53:17.172440+0000","last_undegraded":"2024-09-14T11:53:17.172440+0000","last_fullsized":"2024-09-14T11:53:17.172440+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:53:17.172319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.172319+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:21.845904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2596,"num_read_kb":3474,"num_write":554,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.747932+0000","last_change":"2024-09-14T11:53:31.747932+0000","last_active":"2024-09-14T11:53:31.747932+0000","last_peered":"2024-09-14T11:53:31.747932+0000","last_clean":"2024-09-14T11:53:31.747932+0000","last_became_active":"2024-09-14T11:38:32.855058+0000","last_became_peered":"2024-09-14T11:38:32.855058+0000","last_unstale":"2024-09-14T11:53:31.747932+0000","last_undegraded":"2024-09-14T11:53:31.747932+0000","last_fullsized":"2024-09-14T11:53:31.747932+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:31.747819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:31.747819+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.747819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:20.635163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:41.323186+0000","last_change":"2024-09-14T11:53:41.323111+0000","last_active":"2024-09-14T11:53:41.323186+0000","last_peered":"2024-09-14T11:53:41.323186+0000","last_clean":"2024-09-14T11:53:41.323186+0000","last_became_active":"2024-09-14T11:27:47.187626+0000","last_became_peered":"2024-09-14T11:27:47.187626+0000","last_unstale":"2024-09-14T11:53:41.323186+0000","last_undegraded":"2024-09-14T11:53:41.323186+0000","last_fullsized":"2024-09-14T11:53:41.323186+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:53:41.322987+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:53:41.322987+0000","last_clean_scrub_stamp":"2024-09-14T11:53:41.322987+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:46.466984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:30.398680+0000","last_change":"2024-09-14T11:53:30.398579+0000","last_active":"2024-09-14T11:53:30.398680+0000","last_peered":"2024-09-14T11:53:30.398680+0000","last_clean":"2024-09-14T11:53:30.398680+0000","last_became_active":"2024-09-14T11:27:43.839178+0000","last_became_peered":"2024-09-14T11:27:43.839178+0000","last_unstale":"2024-09-14T11:53:30.398680+0000","last_undegraded":"2024-09-14T11:53:30.398680+0000","last_fullsized":"2024-09-14T11:53:30.398680+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:30.398469+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:30.398469+0000","last_clean_scrub_stamp":"2024-09-14T11:53:30.398469+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:15.051772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'29","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.288050+0000","last_change":"2024-09-14T11:53:29.288050+0000","last_active":"2024-09-14T11:53:29.288050+0000","last_peered":"2024-09-14T11:53:29.288050+0000","last_clean":"2024-09-14T11:53:29.288050+0000","last_became_active":"2024-09-14T11:26:02.019274+0000","last_became_peered":"2024-09-14T11:26:02.019274+0000","last_unstale":"2024-09-14T11:53:29.288050+0000","last_undegraded":"2024-09-14T11:53:29.288050+0000","last_fullsized":"2024-09-14T11:53:29.288050+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:29.287960+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:29.287960+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.287960+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.783501+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":243,"num_read_kb":171,"num_write":78,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:38.079224+0000","last_change":"2024-09-14T11:53:38.079224+0000","last_active":"2024-09-14T11:53:38.079224+0000","last_peered":"2024-09-14T11:53:38.079224+0000","last_clean":"2024-09-14T11:53:38.079224+0000","last_became_active":"2024-09-14T11:38:32.848128+0000","last_became_peered":"2024-09-14T11:38:32.848128+0000","last_unstale":"2024-09-14T11:53:38.079224+0000","last_undegraded":"2024-09-14T11:53:38.079224+0000","last_fullsized":"2024-09-14T11:53:38.079224+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:38.079136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:38.079136+0000","last_clean_scrub_stamp":"2024-09-14T11:53:38.079136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:13.899245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:35.077986+0000","last_change":"2024-09-14T11:53:35.077912+0000","last_active":"2024-09-14T11:53:35.077986+0000","last_peered":"2024-09-14T11:53:35.077986+0000","last_clean":"2024-09-14T11:53:35.077986+0000","last_became_active":"2024-09-14T11:27:46.878041+0000","last_became_peered":"2024-09-14T11:27:46.878041+0000","last_unstale":"2024-09-14T11:53:35.077986+0000","last_undegraded":"2024-09-14T11:53:35.077986+0000","last_fullsized":"2024-09-14T11:53:35.077986+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:35.077823+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:35.077823+0000","last_clean_scrub_stamp":"2024-09-14T11:53:35.077823+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:51.780844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:36.294549+0000","last_change":"2024-09-14T11:53:36.294485+0000","last_active":"2024-09-14T11:53:36.294549+0000","last_peered":"2024-09-14T11:53:36.294549+0000","last_clean":"2024-09-14T11:53:36.294549+0000","last_became_active":"2024-09-14T11:27:43.829547+0000","last_became_peered":"2024-09-14T11:27:43.829547+0000","last_unstale":"2024-09-14T11:53:36.294549+0000","last_undegraded":"2024-09-14T11:53:36.294549+0000","last_fullsized":"2024-09-14T11:53:36.294549+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:36.294398+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:36.294398+0000","last_clean_scrub_stamp":"2024-09-14T11:53:36.294398+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:46.664279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'11","reported_seq":86,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.828156+0000","last_change":"2024-09-14T11:53:20.828156+0000","last_active":"2024-09-14T11:53:20.828156+0000","last_peered":"2024-09-14T11:53:20.828156+0000","last_clean":"2024-09-14T11:53:20.828156+0000","last_became_active":"2024-09-14T11:26:02.016825+0000","last_became_peered":"2024-09-14T11:26:02.016825+0000","last_unstale":"2024-09-14T11:53:20.828156+0000","last_undegraded":"2024-09-14T11:53:20.828156+0000","last_fullsized":"2024-09-14T11:53:20.828156+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:53:20.828045+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.828045+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:47.654466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":56,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.699227+0000","last_change":"2024-09-14T11:53:19.699168+0000","last_active":"2024-09-14T11:53:19.699227+0000","last_peered":"2024-09-14T11:53:19.699227+0000","last_clean":"2024-09-14T11:53:19.699227+0000","last_became_active":"2024-09-14T11:38:32.849326+0000","last_became_peered":"2024-09-14T11:38:32.849326+0000","last_unstale":"2024-09-14T11:53:19.699227+0000","last_undegraded":"2024-09-14T11:53:19.699227+0000","last_fullsized":"2024-09-14T11:53:19.699227+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:19.699072+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.699072+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:41.679367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.775884+0000","last_change":"2024-09-14T11:53:26.775884+0000","last_active":"2024-09-14T11:53:26.775884+0000","last_peered":"2024-09-14T11:53:26.775884+0000","last_clean":"2024-09-14T11:53:26.775884+0000","last_became_active":"2024-09-14T11:27:46.881550+0000","last_became_peered":"2024-09-14T11:27:46.881550+0000","last_unstale":"2024-09-14T11:53:26.775884+0000","last_undegraded":"2024-09-14T11:53:26.775884+0000","last_fullsized":"2024-09-14T11:53:26.775884+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:26.775762+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.775762+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:28.794807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.311144+0000","last_change":"2024-09-14T11:53:33.311064+0000","last_active":"2024-09-14T11:53:33.311144+0000","last_peered":"2024-09-14T11:53:33.311144+0000","last_clean":"2024-09-14T11:53:33.311144+0000","last_became_active":"2024-09-14T11:27:43.843556+0000","last_became_peered":"2024-09-14T11:27:43.843556+0000","last_unstale":"2024-09-14T11:53:33.311144+0000","last_undegraded":"2024-09-14T11:53:33.311144+0000","last_fullsized":"2024-09-14T11:53:33.311144+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:33.310933+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:33.310933+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.310933+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:19.245582+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'29","reported_seq":137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.396807+0000","last_change":"2024-09-14T11:53:28.396807+0000","last_active":"2024-09-14T11:53:28.396807+0000","last_peered":"2024-09-14T11:53:28.396807+0000","last_clean":"2024-09-14T11:53:28.396807+0000","last_became_active":"2024-09-14T11:26:02.004296+0000","last_became_peered":"2024-09-14T11:26:02.004296+0000","last_unstale":"2024-09-14T11:53:28.396807+0000","last_undegraded":"2024-09-14T11:53:28.396807+0000","last_fullsized":"2024-09-14T11:53:28.396807+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-14T11:53:28.396726+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.396726+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:24.769786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":256,"num_read_kb":184,"num_write":65,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:46.316533+0000","last_change":"2024-09-14T11:53:46.316533+0000","last_active":"2024-09-14T11:53:46.316533+0000","last_peered":"2024-09-14T11:53:46.316533+0000","last_clean":"2024-09-14T11:53:46.316533+0000","last_became_active":"2024-09-14T11:38:32.850080+0000","last_became_peered":"2024-09-14T11:38:32.850080+0000","last_unstale":"2024-09-14T11:53:46.316533+0000","last_undegraded":"2024-09-14T11:53:46.316533+0000","last_fullsized":"2024-09-14T11:53:46.316533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:46.316451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:46.316451+0000","last_clean_scrub_stamp":"2024-09-14T11:53:46.316451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:57.826328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.265038+0000","last_change":"2024-09-14T11:53:34.264946+0000","last_active":"2024-09-14T11:53:34.265038+0000","last_peered":"2024-09-14T11:53:34.265038+0000","last_clean":"2024-09-14T11:53:34.265038+0000","last_became_active":"2024-09-14T11:27:46.882424+0000","last_became_peered":"2024-09-14T11:27:46.882424+0000","last_unstale":"2024-09-14T11:53:34.265038+0000","last_undegraded":"2024-09-14T11:53:34.265038+0000","last_fullsized":"2024-09-14T11:53:34.265038+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:53:34.264844+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:53:34.264844+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.264844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:24.472289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4104,"num_write":4,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.321960+0000","last_change":"2024-09-14T11:53:34.321960+0000","last_active":"2024-09-14T11:53:34.321960+0000","last_peered":"2024-09-14T11:53:34.321960+0000","last_clean":"2024-09-14T11:53:34.321960+0000","last_became_active":"2024-09-14T11:27:43.835303+0000","last_became_peered":"2024-09-14T11:27:43.835303+0000","last_unstale":"2024-09-14T11:53:34.321960+0000","last_undegraded":"2024-09-14T11:53:34.321960+0000","last_fullsized":"2024-09-14T11:53:34.321960+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:34.321875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:34.321875+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.321875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:40.068785+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'43","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.065726+0000","last_change":"2024-09-14T11:53:26.065726+0000","last_active":"2024-09-14T11:53:26.065726+0000","last_peered":"2024-09-14T11:53:26.065726+0000","last_clean":"2024-09-14T11:53:26.065726+0000","last_became_active":"2024-09-14T11:26:02.017036+0000","last_became_peered":"2024-09-14T11:26:02.017036+0000","last_unstale":"2024-09-14T11:53:26.065726+0000","last_undegraded":"2024-09-14T11:53:26.065726+0000","last_fullsized":"2024-09-14T11:53:26.065726+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'43","last_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_deep_scrub":"263'43","last_deep_scrub_stamp":"2024-09-14T11:53:26.065590+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.065590+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:44.826773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":238,"num_write":104,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:45.351624+0000","last_change":"2024-09-14T11:53:45.351624+0000","last_active":"2024-09-14T11:53:45.351624+0000","last_peered":"2024-09-14T11:53:45.351624+0000","last_clean":"2024-09-14T11:53:45.351624+0000","last_became_active":"2024-09-14T11:38:32.851222+0000","last_became_peered":"2024-09-14T11:38:32.851222+0000","last_unstale":"2024-09-14T11:53:45.351624+0000","last_undegraded":"2024-09-14T11:53:45.351624+0000","last_fullsized":"2024-09-14T11:53:45.351624+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:45.351526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:45.351526+0000","last_clean_scrub_stamp":"2024-09-14T11:53:45.351526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:59.537319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.177891+0000","last_change":"2024-09-14T11:53:23.177891+0000","last_active":"2024-09-14T11:53:23.177891+0000","last_peered":"2024-09-14T11:53:23.177891+0000","last_clean":"2024-09-14T11:53:23.177891+0000","last_became_active":"2024-09-14T11:27:46.880628+0000","last_became_peered":"2024-09-14T11:27:46.880628+0000","last_unstale":"2024-09-14T11:53:23.177891+0000","last_undegraded":"2024-09-14T11:53:23.177891+0000","last_fullsized":"2024-09-14T11:53:23.177891+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.177795+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.177795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:38.025123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.812440+0000","last_change":"2024-09-14T11:53:21.812440+0000","last_active":"2024-09-14T11:53:21.812440+0000","last_peered":"2024-09-14T11:53:21.812440+0000","last_clean":"2024-09-14T11:53:21.812440+0000","last_became_active":"2024-09-14T11:27:43.841033+0000","last_became_peered":"2024-09-14T11:27:43.841033+0000","last_unstale":"2024-09-14T11:53:21.812440+0000","last_undegraded":"2024-09-14T11:53:21.812440+0000","last_fullsized":"2024-09-14T11:53:21.812440+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:53:21.812301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.812301+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:47.150896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'28","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.199859+0000","last_change":"2024-09-14T11:53:16.199859+0000","last_active":"2024-09-14T11:53:16.199859+0000","last_peered":"2024-09-14T11:53:16.199859+0000","last_clean":"2024-09-14T11:53:16.199859+0000","last_became_active":"2024-09-14T11:26:02.016551+0000","last_became_peered":"2024-09-14T11:26:02.016551+0000","last_unstale":"2024-09-14T11:53:16.199859+0000","last_undegraded":"2024-09-14T11:53:16.199859+0000","last_fullsized":"2024-09-14T11:53:16.199859+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:53:16.199776+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.199776+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:00.362128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":172,"num_write":66,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:43.321703+0000","last_change":"2024-09-14T11:53:43.321703+0000","last_active":"2024-09-14T11:53:43.321703+0000","last_peered":"2024-09-14T11:53:43.321703+0000","last_clean":"2024-09-14T11:53:43.321703+0000","last_became_active":"2024-09-14T11:38:32.852282+0000","last_became_peered":"2024-09-14T11:38:32.852282+0000","last_unstale":"2024-09-14T11:53:43.321703+0000","last_undegraded":"2024-09-14T11:53:43.321703+0000","last_fullsized":"2024-09-14T11:53:43.321703+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:43.321615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:43.321615+0000","last_clean_scrub_stamp":"2024-09-14T11:53:43.321615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:25.866432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.088149+0000","last_change":"2024-09-14T11:53:34.088149+0000","last_active":"2024-09-14T11:53:34.088149+0000","last_peered":"2024-09-14T11:53:34.088149+0000","last_clean":"2024-09-14T11:53:34.088149+0000","last_became_active":"2024-09-14T11:27:46.882370+0000","last_became_peered":"2024-09-14T11:27:46.882370+0000","last_unstale":"2024-09-14T11:53:34.088149+0000","last_undegraded":"2024-09-14T11:53:34.088149+0000","last_fullsized":"2024-09-14T11:53:34.088149+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:34.088060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:34.088060+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.088060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:52.883096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.154587+0000","last_change":"2024-09-14T11:53:21.154587+0000","last_active":"2024-09-14T11:53:21.154587+0000","last_peered":"2024-09-14T11:53:21.154587+0000","last_clean":"2024-09-14T11:53:21.154587+0000","last_became_active":"2024-09-14T11:27:43.841144+0000","last_became_peered":"2024-09-14T11:27:43.841144+0000","last_unstale":"2024-09-14T11:53:21.154587+0000","last_undegraded":"2024-09-14T11:53:21.154587+0000","last_fullsized":"2024-09-14T11:53:21.154587+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:21.154476+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.154476+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:42.611630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10252,"num_write":4,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'25","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.328629+0000","last_change":"2024-09-14T11:53:28.328533+0000","last_active":"2024-09-14T11:53:28.328629+0000","last_peered":"2024-09-14T11:53:28.328629+0000","last_clean":"2024-09-14T11:53:28.328629+0000","last_became_active":"2024-09-14T11:26:02.020077+0000","last_became_peered":"2024-09-14T11:26:02.020077+0000","last_unstale":"2024-09-14T11:53:28.328629+0000","last_undegraded":"2024-09-14T11:53:28.328629+0000","last_fullsized":"2024-09-14T11:53:28.328629+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:53:28.328421+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.328421+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:54.143049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":113,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'219","reported_seq":852,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.104497+0000","last_change":"2024-09-14T11:53:04.104497+0000","last_active":"2024-09-14T11:53:04.104497+0000","last_peered":"2024-09-14T11:53:04.104497+0000","last_clean":"2024-09-14T11:53:04.104497+0000","last_became_active":"2024-09-14T11:11:04.664674+0000","last_became_peered":"2024-09-14T11:11:04.664674+0000","last_unstale":"2024-09-14T11:53:04.104497+0000","last_undegraded":"2024-09-14T11:53:04.104497+0000","last_fullsized":"2024-09-14T11:53:04.104497+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:53:04.104357+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.104357+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:27.489992+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":26852,"num_write":1005,"num_write_kb":37122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'1172","reported_seq":2812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.163456+0000","last_change":"2024-09-14T11:53:09.163374+0000","last_active":"2024-09-14T11:53:09.163456+0000","last_peered":"2024-09-14T11:53:09.163456+0000","last_clean":"2024-09-14T11:53:09.163456+0000","last_became_active":"2024-09-14T11:11:06.652354+0000","last_became_peered":"2024-09-14T11:11:06.652354+0000","last_unstale":"2024-09-14T11:53:09.163456+0000","last_undegraded":"2024-09-14T11:53:09.163456+0000","last_fullsized":"2024-09-14T11:53:09.163456+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1172","last_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_deep_scrub":"263'1172","last_deep_scrub_stamp":"2024-09-14T11:53:09.163255+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.163255+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:51.571485+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5507,"num_read_kb":4881,"num_write":1613,"num_write_kb":667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2554,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'198","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.685758+0000","last_change":"2024-09-14T11:52:55.685758+0000","last_active":"2024-09-14T11:52:55.685758+0000","last_peered":"2024-09-14T11:52:55.685758+0000","last_clean":"2024-09-14T11:52:55.685758+0000","last_became_active":"2024-09-14T11:11:04.653736+0000","last_became_peered":"2024-09-14T11:11:04.653736+0000","last_unstale":"2024-09-14T11:52:55.685758+0000","last_undegraded":"2024-09-14T11:52:55.685758+0000","last_fullsized":"2024-09-14T11:52:55.685758+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:52:55.685603+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.685603+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:37.938060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":7476,"num_write":916,"num_write_kb":31861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'453","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.143787+0000","last_change":"2024-09-14T11:53:11.143695+0000","last_active":"2024-09-14T11:53:11.143787+0000","last_peered":"2024-09-14T11:53:11.143787+0000","last_clean":"2024-09-14T11:53:11.143787+0000","last_became_active":"2024-09-14T11:11:06.658936+0000","last_became_peered":"2024-09-14T11:11:06.658936+0000","last_unstale":"2024-09-14T11:53:11.143787+0000","last_undegraded":"2024-09-14T11:53:11.143787+0000","last_fullsized":"2024-09-14T11:53:11.143787+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'453","last_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_deep_scrub":"263'453","last_deep_scrub_stamp":"2024-09-14T11:53:11.143584+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.143584+0000","objects_scrubbed":4,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:47.330573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2417,"num_read_kb":2284,"num_write":514,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'223","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.173154+0000","last_change":"2024-09-14T11:52:58.173154+0000","last_active":"2024-09-14T11:52:58.173154+0000","last_peered":"2024-09-14T11:52:58.173154+0000","last_clean":"2024-09-14T11:52:58.173154+0000","last_became_active":"2024-09-14T11:11:04.651076+0000","last_became_peered":"2024-09-14T11:11:04.651076+0000","last_unstale":"2024-09-14T11:52:58.173154+0000","last_undegraded":"2024-09-14T11:52:58.173154+0000","last_fullsized":"2024-09-14T11:52:58.173154+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'223","last_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_deep_scrub":"263'223","last_deep_scrub_stamp":"2024-09-14T11:52:58.172939+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.172939+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:36.789370+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3239709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":599,"num_read_kb":30059,"num_write":1074,"num_write_kb":29527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'881","reported_seq":2637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.959059+0000","last_change":"2024-09-14T11:53:08.958959+0000","last_active":"2024-09-14T11:53:08.959059+0000","last_peered":"2024-09-14T11:53:08.959059+0000","last_clean":"2024-09-14T11:53:08.959059+0000","last_became_active":"2024-09-14T11:11:06.647100+0000","last_became_peered":"2024-09-14T11:11:06.647100+0000","last_unstale":"2024-09-14T11:53:08.959059+0000","last_undegraded":"2024-09-14T11:53:08.959059+0000","last_fullsized":"2024-09-14T11:53:08.959059+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'881","last_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_deep_scrub":"263'881","last_deep_scrub_stamp":"2024-09-14T11:53:08.958854+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.958854+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":800,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:40.823184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4232,"num_read_kb":3832,"num_write":1134,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'228","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.163179+0000","last_change":"2024-09-14T11:53:03.163088+0000","last_active":"2024-09-14T11:53:03.163179+0000","last_peered":"2024-09-14T11:53:03.163179+0000","last_clean":"2024-09-14T11:53:03.163179+0000","last_became_active":"2024-09-14T11:11:04.652972+0000","last_became_peered":"2024-09-14T11:11:04.652972+0000","last_unstale":"2024-09-14T11:53:03.163179+0000","last_undegraded":"2024-09-14T11:53:03.163179+0000","last_fullsized":"2024-09-14T11:53:03.163179+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:03.162958+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.162958+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:03.455162+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":738,"num_read_kb":74674,"num_write":901,"num_write_kb":36670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'394","reported_seq":1947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.059050+0000","last_change":"2024-09-14T11:53:07.058982+0000","last_active":"2024-09-14T11:53:07.059050+0000","last_peered":"2024-09-14T11:53:07.059050+0000","last_clean":"2024-09-14T11:53:07.059050+0000","last_became_active":"2024-09-14T11:11:06.651184+0000","last_became_peered":"2024-09-14T11:11:06.651184+0000","last_unstale":"2024-09-14T11:53:07.059050+0000","last_undegraded":"2024-09-14T11:53:07.059050+0000","last_fullsized":"2024-09-14T11:53:07.059050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:07.058896+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.058896+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:33.485594+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2330,"num_read_kb":2231,"num_write":445,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'244","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.132571+0000","last_change":"2024-09-14T11:53:07.132482+0000","last_active":"2024-09-14T11:53:07.132571+0000","last_peered":"2024-09-14T11:53:07.132571+0000","last_clean":"2024-09-14T11:53:07.132571+0000","last_became_active":"2024-09-14T11:11:04.664303+0000","last_became_peered":"2024-09-14T11:11:04.664303+0000","last_unstale":"2024-09-14T11:53:07.132571+0000","last_undegraded":"2024-09-14T11:53:07.132571+0000","last_fullsized":"2024-09-14T11:53:07.132571+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:53:07.132325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.132325+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:44.056191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":17405,"num_write":1116,"num_write_kb":38462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'823","reported_seq":2493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.080635+0000","last_change":"2024-09-14T11:53:03.080576+0000","last_active":"2024-09-14T11:53:03.080635+0000","last_peered":"2024-09-14T11:53:03.080635+0000","last_clean":"2024-09-14T11:53:03.080635+0000","last_became_active":"2024-09-14T11:11:06.657028+0000","last_became_peered":"2024-09-14T11:11:06.657028+0000","last_unstale":"2024-09-14T11:53:03.080635+0000","last_undegraded":"2024-09-14T11:53:03.080635+0000","last_fullsized":"2024-09-14T11:53:03.080635+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'823","last_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_deep_scrub":"263'823","last_deep_scrub_stamp":"2024-09-14T11:53:03.080464+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.080464+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":800,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:29.386530+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4034,"num_read_kb":3648,"num_write":1086,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'217","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.130009+0000","last_change":"2024-09-14T11:53:02.129946+0000","last_active":"2024-09-14T11:53:02.130009+0000","last_peered":"2024-09-14T11:53:02.130009+0000","last_clean":"2024-09-14T11:53:02.130009+0000","last_became_active":"2024-09-14T11:11:04.664063+0000","last_became_peered":"2024-09-14T11:11:04.664063+0000","last_unstale":"2024-09-14T11:53:02.130009+0000","last_undegraded":"2024-09-14T11:53:02.130009+0000","last_fullsized":"2024-09-14T11:53:02.130009+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:53:02.129833+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.129833+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:16.366991+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":70473,"num_write":980,"num_write_kb":37544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'498","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.966298+0000","last_change":"2024-09-14T11:53:09.966298+0000","last_active":"2024-09-14T11:53:09.966298+0000","last_peered":"2024-09-14T11:53:09.966298+0000","last_clean":"2024-09-14T11:53:09.966298+0000","last_became_active":"2024-09-14T11:11:06.646345+0000","last_became_peered":"2024-09-14T11:11:06.646345+0000","last_unstale":"2024-09-14T11:53:09.966298+0000","last_undegraded":"2024-09-14T11:53:09.966298+0000","last_fullsized":"2024-09-14T11:53:09.966298+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'498","last_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_deep_scrub":"263'498","last_deep_scrub_stamp":"2024-09-14T11:53:09.966206+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.966206+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:47.015458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2664,"num_read_kb":2492,"num_write":637,"num_write_kb":216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'224","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.111977+0000","last_change":"2024-09-14T11:53:03.111904+0000","last_active":"2024-09-14T11:53:03.111977+0000","last_peered":"2024-09-14T11:53:03.111977+0000","last_clean":"2024-09-14T11:53:03.111977+0000","last_became_active":"2024-09-14T11:11:04.665039+0000","last_became_peered":"2024-09-14T11:11:04.665039+0000","last_unstale":"2024-09-14T11:53:03.111977+0000","last_undegraded":"2024-09-14T11:53:03.111977+0000","last_fullsized":"2024-09-14T11:53:03.111977+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:53:03.111777+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.111777+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:53.985189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":632,"num_read_kb":10774,"num_write":1050,"num_write_kb":28900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'703","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.204946+0000","last_change":"2024-09-14T11:53:10.204946+0000","last_active":"2024-09-14T11:53:10.204946+0000","last_peered":"2024-09-14T11:53:10.204946+0000","last_clean":"2024-09-14T11:53:10.204946+0000","last_became_active":"2024-09-14T11:11:06.661099+0000","last_became_peered":"2024-09-14T11:11:06.661099+0000","last_unstale":"2024-09-14T11:53:10.204946+0000","last_undegraded":"2024-09-14T11:53:10.204946+0000","last_fullsized":"2024-09-14T11:53:10.204946+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'703","last_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_deep_scrub":"263'703","last_deep_scrub_stamp":"2024-09-14T11:53:10.204838+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.204838+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:48.344428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3499,"num_read_kb":3165,"num_write":918,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'235","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.227565+0000","last_change":"2024-09-14T11:53:01.227469+0000","last_active":"2024-09-14T11:53:01.227565+0000","last_peered":"2024-09-14T11:53:01.227565+0000","last_clean":"2024-09-14T11:53:01.227565+0000","last_became_active":"2024-09-14T11:11:04.640228+0000","last_became_peered":"2024-09-14T11:11:04.640228+0000","last_unstale":"2024-09-14T11:53:01.227565+0000","last_undegraded":"2024-09-14T11:53:01.227565+0000","last_fullsized":"2024-09-14T11:53:01.227565+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-14T11:53:01.227337+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.227337+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:36.676072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1301,"num_read_kb":98345,"num_write":1096,"num_write_kb":41492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'785","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.459599+0000","last_change":"2024-09-14T11:53:06.459599+0000","last_active":"2024-09-14T11:53:06.459599+0000","last_peered":"2024-09-14T11:53:06.459599+0000","last_clean":"2024-09-14T11:53:06.459599+0000","last_became_active":"2024-09-14T11:11:06.661149+0000","last_became_peered":"2024-09-14T11:11:06.661149+0000","last_unstale":"2024-09-14T11:53:06.459599+0000","last_undegraded":"2024-09-14T11:53:06.459599+0000","last_fullsized":"2024-09-14T11:53:06.459599+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'785","last_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_deep_scrub":"263'785","last_deep_scrub_stamp":"2024-09-14T11:53:06.459498+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.459498+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:46.080698+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3761,"num_read_kb":3398,"num_write":1019,"num_write_kb":369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'849","reported_seq":2388,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.977158+0000","last_change":"2024-09-14T11:53:06.977094+0000","last_active":"2024-09-14T11:53:06.977158+0000","last_peered":"2024-09-14T11:53:06.977158+0000","last_clean":"2024-09-14T11:53:06.977158+0000","last_became_active":"2024-09-14T11:11:06.647114+0000","last_became_peered":"2024-09-14T11:11:06.647114+0000","last_unstale":"2024-09-14T11:53:06.977158+0000","last_undegraded":"2024-09-14T11:53:06.977158+0000","last_fullsized":"2024-09-14T11:53:06.977158+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'849","last_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_deep_scrub":"263'849","last_deep_scrub_stamp":"2024-09-14T11:53:06.976996+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.976996+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":800,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:52.713389+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3999,"num_read_kb":3577,"num_write":1133,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'237","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.158616+0000","last_change":"2024-09-14T11:53:01.158616+0000","last_active":"2024-09-14T11:53:01.158616+0000","last_peered":"2024-09-14T11:53:01.158616+0000","last_clean":"2024-09-14T11:53:01.158616+0000","last_became_active":"2024-09-14T11:11:04.663614+0000","last_became_peered":"2024-09-14T11:11:04.663614+0000","last_unstale":"2024-09-14T11:53:01.158616+0000","last_undegraded":"2024-09-14T11:53:01.158616+0000","last_fullsized":"2024-09-14T11:53:01.158616+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:53:01.158497+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.158497+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:17.980141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":29179,"num_write":1120,"num_write_kb":14448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'874","reported_seq":2536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.147798+0000","last_change":"2024-09-14T11:53:06.147735+0000","last_active":"2024-09-14T11:53:06.147798+0000","last_peered":"2024-09-14T11:53:06.147798+0000","last_clean":"2024-09-14T11:53:06.147798+0000","last_became_active":"2024-09-14T11:11:06.658995+0000","last_became_peered":"2024-09-14T11:11:06.658995+0000","last_unstale":"2024-09-14T11:53:06.147798+0000","last_undegraded":"2024-09-14T11:53:06.147798+0000","last_fullsized":"2024-09-14T11:53:06.147798+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'874","last_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_deep_scrub":"263'874","last_deep_scrub_stamp":"2024-09-14T11:53:06.147589+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.147589+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:09.954332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4055,"num_read_kb":3660,"num_write":1105,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'233","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.050944+0000","last_change":"2024-09-14T11:52:58.050944+0000","last_active":"2024-09-14T11:52:58.050944+0000","last_peered":"2024-09-14T11:52:58.050944+0000","last_clean":"2024-09-14T11:52:58.050944+0000","last_became_active":"2024-09-14T11:11:04.664233+0000","last_became_peered":"2024-09-14T11:11:04.664233+0000","last_unstale":"2024-09-14T11:52:58.050944+0000","last_undegraded":"2024-09-14T11:52:58.050944+0000","last_fullsized":"2024-09-14T11:52:58.050944+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:52:58.050832+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.050832+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:44.576976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":818,"num_read_kb":241766,"num_write":938,"num_write_kb":59778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'520","reported_seq":2229,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.166364+0000","last_change":"2024-09-14T11:53:08.166308+0000","last_active":"2024-09-14T11:53:08.166364+0000","last_peered":"2024-09-14T11:53:08.166364+0000","last_clean":"2024-09-14T11:53:08.166364+0000","last_became_active":"2024-09-14T11:11:06.655923+0000","last_became_peered":"2024-09-14T11:11:06.655923+0000","last_unstale":"2024-09-14T11:53:08.166364+0000","last_undegraded":"2024-09-14T11:53:08.166364+0000","last_fullsized":"2024-09-14T11:53:08.166364+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-14T11:53:08.166227+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.166227+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:38.323522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2756,"num_read_kb":2595,"num_write":614,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'271","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.033421+0000","last_change":"2024-09-14T11:52:55.033421+0000","last_active":"2024-09-14T11:52:55.033421+0000","last_peered":"2024-09-14T11:52:55.033421+0000","last_clean":"2024-09-14T11:52:55.033421+0000","last_became_active":"2024-09-14T11:11:04.661185+0000","last_became_peered":"2024-09-14T11:11:04.661185+0000","last_unstale":"2024-09-14T11:52:55.033421+0000","last_undegraded":"2024-09-14T11:52:55.033421+0000","last_fullsized":"2024-09-14T11:52:55.033421+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'271","last_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_deep_scrub":"263'271","last_deep_scrub_stamp":"2024-09-14T11:52:55.033320+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.033320+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:45.632089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":32324,"num_write":1007,"num_write_kb":52511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'859","reported_seq":2402,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.571925+0000","last_change":"2024-09-14T11:52:57.571925+0000","last_active":"2024-09-14T11:52:57.571925+0000","last_peered":"2024-09-14T11:52:57.571925+0000","last_clean":"2024-09-14T11:52:57.571925+0000","last_became_active":"2024-09-14T11:11:06.659595+0000","last_became_peered":"2024-09-14T11:11:06.659595+0000","last_unstale":"2024-09-14T11:52:57.571925+0000","last_undegraded":"2024-09-14T11:52:57.571925+0000","last_fullsized":"2024-09-14T11:52:57.571925+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'859","last_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_deep_scrub":"263'859","last_deep_scrub_stamp":"2024-09-14T11:52:57.571844+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.571844+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:30.711939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4027,"num_read_kb":3594,"num_write":1150,"num_write_kb":463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'237","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.142508+0000","last_change":"2024-09-14T11:52:54.142508+0000","last_active":"2024-09-14T11:52:54.142508+0000","last_peered":"2024-09-14T11:52:54.142508+0000","last_clean":"2024-09-14T11:52:54.142508+0000","last_became_active":"2024-09-14T11:11:04.651243+0000","last_became_peered":"2024-09-14T11:11:04.651243+0000","last_unstale":"2024-09-14T11:52:54.142508+0000","last_undegraded":"2024-09-14T11:52:54.142508+0000","last_fullsized":"2024-09-14T11:52:54.142508+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-14T11:52:54.142380+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.142380+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:13.742745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":716,"num_read_kb":18423,"num_write":1039,"num_write_kb":39214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'1030","reported_seq":2690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.596255+0000","last_change":"2024-09-14T11:53:00.596255+0000","last_active":"2024-09-14T11:53:00.596255+0000","last_peered":"2024-09-14T11:53:00.596255+0000","last_clean":"2024-09-14T11:53:00.596255+0000","last_became_active":"2024-09-14T11:11:06.659029+0000","last_became_peered":"2024-09-14T11:11:06.659029+0000","last_unstale":"2024-09-14T11:53:00.596255+0000","last_undegraded":"2024-09-14T11:53:00.596255+0000","last_fullsized":"2024-09-14T11:53:00.596255+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1030","last_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_deep_scrub":"263'1030","last_deep_scrub_stamp":"2024-09-14T11:53:00.596176+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.596176+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1000,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:15.754364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5016,"num_read_kb":4557,"num_write":1486,"num_write_kb":600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2262,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'208","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.216578+0000","last_change":"2024-09-14T11:53:00.216578+0000","last_active":"2024-09-14T11:53:00.216578+0000","last_peered":"2024-09-14T11:53:00.216578+0000","last_clean":"2024-09-14T11:53:00.216578+0000","last_became_active":"2024-09-14T11:11:04.655976+0000","last_became_peered":"2024-09-14T11:11:04.655976+0000","last_unstale":"2024-09-14T11:53:00.216578+0000","last_undegraded":"2024-09-14T11:53:00.216578+0000","last_fullsized":"2024-09-14T11:53:00.216578+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:53:00.216460+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.216460+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:58.339356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":562,"num_read_kb":19801,"num_write":945,"num_write_kb":26290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'479","reported_seq":2051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.954376+0000","last_change":"2024-09-14T11:53:07.954376+0000","last_active":"2024-09-14T11:53:07.954376+0000","last_peered":"2024-09-14T11:53:07.954376+0000","last_clean":"2024-09-14T11:53:07.954376+0000","last_became_active":"2024-09-14T11:11:06.651123+0000","last_became_peered":"2024-09-14T11:11:06.651123+0000","last_unstale":"2024-09-14T11:53:07.954376+0000","last_undegraded":"2024-09-14T11:53:07.954376+0000","last_fullsized":"2024-09-14T11:53:07.954376+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'479","last_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_deep_scrub":"263'479","last_deep_scrub_stamp":"2024-09-14T11:53:07.954280+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.954280+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:48.601994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2506,"num_read_kb":2339,"num_write":546,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'231","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.176475+0000","last_change":"2024-09-14T11:52:57.176414+0000","last_active":"2024-09-14T11:52:57.176475+0000","last_peered":"2024-09-14T11:52:57.176475+0000","last_clean":"2024-09-14T11:52:57.176475+0000","last_became_active":"2024-09-14T11:11:04.653606+0000","last_became_peered":"2024-09-14T11:11:04.653606+0000","last_unstale":"2024-09-14T11:52:57.176475+0000","last_undegraded":"2024-09-14T11:52:57.176475+0000","last_fullsized":"2024-09-14T11:52:57.176475+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'231","last_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_deep_scrub":"263'231","last_deep_scrub_stamp":"2024-09-14T11:52:57.176294+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.176294+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:01.150031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1266,"num_read_kb":11303,"num_write":1123,"num_write_kb":35841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'138","reported_seq":644,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.065815+0000","last_change":"2024-09-14T11:53:25.065815+0000","last_active":"2024-09-14T11:53:25.065815+0000","last_peered":"2024-09-14T11:53:25.065815+0000","last_clean":"2024-09-14T11:53:25.065815+0000","last_became_active":"2024-09-14T11:11:14.694212+0000","last_became_peered":"2024-09-14T11:11:14.694212+0000","last_unstale":"2024-09-14T11:53:25.065815+0000","last_undegraded":"2024-09-14T11:53:25.065815+0000","last_fullsized":"2024-09-14T11:53:25.065815+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-14T11:53:25.065723+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.065723+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:59.914655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":310,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'946","reported_seq":2828,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.250749+0000","last_change":"2024-09-14T11:53:04.250658+0000","last_active":"2024-09-14T11:53:04.250749+0000","last_peered":"2024-09-14T11:53:04.250749+0000","last_clean":"2024-09-14T11:53:04.250749+0000","last_became_active":"2024-09-14T11:11:06.651651+0000","last_became_peered":"2024-09-14T11:11:06.651651+0000","last_unstale":"2024-09-14T11:53:04.250749+0000","last_undegraded":"2024-09-14T11:53:04.250749+0000","last_fullsized":"2024-09-14T11:53:04.250749+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'946","last_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_deep_scrub":"263'946","last_deep_scrub_stamp":"2024-09-14T11:53:04.250543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.250543+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":900,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:39.287226+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4762,"num_read_kb":4332,"num_write":1238,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'233","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.164938+0000","last_change":"2024-09-14T11:53:00.164869+0000","last_active":"2024-09-14T11:53:00.164938+0000","last_peered":"2024-09-14T11:53:00.164938+0000","last_clean":"2024-09-14T11:53:00.164938+0000","last_became_active":"2024-09-14T11:11:04.656155+0000","last_became_peered":"2024-09-14T11:11:04.656155+0000","last_unstale":"2024-09-14T11:53:00.164938+0000","last_undegraded":"2024-09-14T11:53:00.164938+0000","last_fullsized":"2024-09-14T11:53:00.164938+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'233","last_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_deep_scrub":"263'233","last_deep_scrub_stamp":"2024-09-14T11:53:00.164685+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.164685+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:01.744253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1368206,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":732,"num_read_kb":7795,"num_write":1213,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"263'4","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.236685+0000","last_change":"2024-09-14T11:53:13.236685+0000","last_active":"2024-09-14T11:53:13.236685+0000","last_peered":"2024-09-14T11:53:13.236685+0000","last_clean":"2024-09-14T11:53:13.236685+0000","last_became_active":"2024-09-14T11:11:08.655892+0000","last_became_peered":"2024-09-14T11:11:08.655892+0000","last_unstale":"2024-09-14T11:53:13.236685+0000","last_undegraded":"2024-09-14T11:53:13.236685+0000","last_fullsized":"2024-09-14T11:53:13.236685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:13.236601+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.236601+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:46.099722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'194","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.123485+0000","last_change":"2024-09-14T11:53:14.123485+0000","last_active":"2024-09-14T11:53:14.123485+0000","last_peered":"2024-09-14T11:53:14.123485+0000","last_clean":"2024-09-14T11:53:14.123485+0000","last_became_active":"2024-09-14T11:11:10.669076+0000","last_became_peered":"2024-09-14T11:11:10.669076+0000","last_unstale":"2024-09-14T11:53:14.123485+0000","last_undegraded":"2024-09-14T11:53:14.123485+0000","last_fullsized":"2024-09-14T11:53:14.123485+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'194","last_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_deep_scrub":"263'194","last_deep_scrub_stamp":"2024-09-14T11:53:14.123396+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.123396+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.394550+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15472,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":260,"num_read_kb":349,"num_write":152,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.282150+0000","last_change":"2024-09-14T11:53:23.282150+0000","last_active":"2024-09-14T11:53:23.282150+0000","last_peered":"2024-09-14T11:53:23.282150+0000","last_clean":"2024-09-14T11:53:23.282150+0000","last_became_active":"2024-09-14T11:11:12.678313+0000","last_became_peered":"2024-09-14T11:11:12.678313+0000","last_unstale":"2024-09-14T11:53:23.282150+0000","last_undegraded":"2024-09-14T11:53:23.282150+0000","last_fullsized":"2024-09-14T11:53:23.282150+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.282066+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.282066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:13.449577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2496","reported_seq":4324,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.352817+0000","last_change":"2024-09-14T11:53:26.352817+0000","last_active":"2024-09-14T11:53:26.352817+0000","last_peered":"2024-09-14T11:53:26.352817+0000","last_clean":"2024-09-14T11:53:26.352817+0000","last_became_active":"2024-09-14T11:11:14.691559+0000","last_became_peered":"2024-09-14T11:11:14.691559+0000","last_unstale":"2024-09-14T11:53:26.352817+0000","last_undegraded":"2024-09-14T11:53:26.352817+0000","last_fullsized":"2024-09-14T11:53:26.352817+0000","mapping_epoch":35,"log_start":"263'2400","ondisk_log_start":"263'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2496","last_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_deep_scrub":"263'2496","last_deep_scrub_stamp":"2024-09-14T11:53:26.352725+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.352725+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":2400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:36.910529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6192,"num_read_kb":6192,"num_write":5051,"num_write_kb":1849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'508","reported_seq":2080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.160252+0000","last_change":"2024-09-14T11:53:05.160252+0000","last_active":"2024-09-14T11:53:05.160252+0000","last_peered":"2024-09-14T11:53:05.160252+0000","last_clean":"2024-09-14T11:53:05.160252+0000","last_became_active":"2024-09-14T11:11:06.652675+0000","last_became_peered":"2024-09-14T11:11:06.652675+0000","last_unstale":"2024-09-14T11:53:05.160252+0000","last_undegraded":"2024-09-14T11:53:05.160252+0000","last_fullsized":"2024-09-14T11:53:05.160252+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'508","last_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_deep_scrub":"263'508","last_deep_scrub_stamp":"2024-09-14T11:53:05.160161+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.160161+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:03.024651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2664,"num_read_kb":2491,"num_write":637,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'190","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.226742+0000","last_change":"2024-09-14T11:52:50.226660+0000","last_active":"2024-09-14T11:52:50.226742+0000","last_peered":"2024-09-14T11:52:50.226742+0000","last_clean":"2024-09-14T11:52:50.226742+0000","last_became_active":"2024-09-14T11:11:04.656864+0000","last_became_peered":"2024-09-14T11:11:04.656864+0000","last_unstale":"2024-09-14T11:52:50.226742+0000","last_undegraded":"2024-09-14T11:52:50.226742+0000","last_fullsized":"2024-09-14T11:52:50.226742+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:50.226549+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.226549+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:48.793214+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":11633,"num_write":915,"num_write_kb":22573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.140960+0000","last_change":"2024-09-14T11:53:17.140902+0000","last_active":"2024-09-14T11:53:17.140960+0000","last_peered":"2024-09-14T11:53:17.140960+0000","last_clean":"2024-09-14T11:53:17.140960+0000","last_became_active":"2024-09-14T11:11:08.651251+0000","last_became_peered":"2024-09-14T11:11:08.651251+0000","last_unstale":"2024-09-14T11:53:17.140960+0000","last_undegraded":"2024-09-14T11:53:17.140960+0000","last_fullsized":"2024-09-14T11:53:17.140960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.140817+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.140817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:47.091423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'95","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.975820+0000","last_change":"2024-09-14T11:53:17.975820+0000","last_active":"2024-09-14T11:53:17.975820+0000","last_peered":"2024-09-14T11:53:17.975820+0000","last_clean":"2024-09-14T11:53:17.975820+0000","last_became_active":"2024-09-14T11:11:10.665344+0000","last_became_peered":"2024-09-14T11:11:10.665344+0000","last_unstale":"2024-09-14T11:53:17.975820+0000","last_undegraded":"2024-09-14T11:53:17.975820+0000","last_fullsized":"2024-09-14T11:53:17.975820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:53:17.975694+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.975694+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:23.245588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.095490+0000","last_change":"2024-09-14T11:53:22.095490+0000","last_active":"2024-09-14T11:53:22.095490+0000","last_peered":"2024-09-14T11:53:22.095490+0000","last_clean":"2024-09-14T11:53:22.095490+0000","last_became_active":"2024-09-14T11:11:12.680465+0000","last_became_peered":"2024-09-14T11:11:12.680465+0000","last_unstale":"2024-09-14T11:53:22.095490+0000","last_undegraded":"2024-09-14T11:53:22.095490+0000","last_fullsized":"2024-09-14T11:53:22.095490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.095388+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.095388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:54.732324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'128","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.190251+0000","last_change":"2024-09-14T11:53:26.190188+0000","last_active":"2024-09-14T11:53:26.190251+0000","last_peered":"2024-09-14T11:53:26.190251+0000","last_clean":"2024-09-14T11:53:26.190251+0000","last_became_active":"2024-09-14T11:11:14.688154+0000","last_became_peered":"2024-09-14T11:11:14.688154+0000","last_unstale":"2024-09-14T11:53:26.190251+0000","last_undegraded":"2024-09-14T11:53:26.190251+0000","last_fullsized":"2024-09-14T11:53:26.190251+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:26.190093+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.190093+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:42.068452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":122,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'394","reported_seq":2056,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.123155+0000","last_change":"2024-09-14T11:53:02.123155+0000","last_active":"2024-09-14T11:53:02.123155+0000","last_peered":"2024-09-14T11:53:02.123155+0000","last_clean":"2024-09-14T11:53:02.123155+0000","last_became_active":"2024-09-14T11:11:06.646956+0000","last_became_peered":"2024-09-14T11:11:06.646956+0000","last_unstale":"2024-09-14T11:53:02.123155+0000","last_undegraded":"2024-09-14T11:53:02.123155+0000","last_fullsized":"2024-09-14T11:53:02.123155+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'394","last_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_deep_scrub":"263'394","last_deep_scrub_stamp":"2024-09-14T11:53:02.123061+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.123061+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:43.333665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2418,"num_read_kb":2341,"num_write":432,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'186","reported_seq":785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094056+0000","last_change":"2024-09-14T11:52:57.093996+0000","last_active":"2024-09-14T11:52:57.094056+0000","last_peered":"2024-09-14T11:52:57.094056+0000","last_clean":"2024-09-14T11:52:57.094056+0000","last_became_active":"2024-09-14T11:11:04.664359+0000","last_became_peered":"2024-09-14T11:11:04.664359+0000","last_unstale":"2024-09-14T11:52:57.094056+0000","last_undegraded":"2024-09-14T11:52:57.094056+0000","last_fullsized":"2024-09-14T11:52:57.094056+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'186","last_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_deep_scrub":"263'186","last_deep_scrub_stamp":"2024-09-14T11:52:57.093902+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.093902+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:27.305587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":464,"num_read_kb":25054,"num_write":828,"num_write_kb":42202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.134952+0000","last_change":"2024-09-14T11:53:12.134952+0000","last_active":"2024-09-14T11:53:12.134952+0000","last_peered":"2024-09-14T11:53:12.134952+0000","last_clean":"2024-09-14T11:53:12.134952+0000","last_became_active":"2024-09-14T11:11:08.651292+0000","last_became_peered":"2024-09-14T11:11:08.651292+0000","last_unstale":"2024-09-14T11:53:12.134952+0000","last_undegraded":"2024-09-14T11:53:12.134952+0000","last_fullsized":"2024-09-14T11:53:12.134952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.134861+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.134861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:32.227065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'119","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.523769+0000","last_change":"2024-09-14T11:53:08.523674+0000","last_active":"2024-09-14T11:53:08.523769+0000","last_peered":"2024-09-14T11:53:08.523769+0000","last_clean":"2024-09-14T11:53:08.523769+0000","last_became_active":"2024-09-14T11:11:10.667152+0000","last_became_peered":"2024-09-14T11:11:10.667152+0000","last_unstale":"2024-09-14T11:53:08.523769+0000","last_undegraded":"2024-09-14T11:53:08.523769+0000","last_fullsized":"2024-09-14T11:53:08.523769+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:08.523568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.523568+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:13.194309+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":118,"num_write":84,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'766","reported_seq":2160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.285964+0000","last_change":"2024-09-14T11:53:24.285964+0000","last_active":"2024-09-14T11:53:24.285964+0000","last_peered":"2024-09-14T11:53:24.285964+0000","last_clean":"2024-09-14T11:53:24.285964+0000","last_became_active":"2024-09-14T11:11:12.682174+0000","last_became_peered":"2024-09-14T11:11:12.682174+0000","last_unstale":"2024-09-14T11:53:24.285964+0000","last_undegraded":"2024-09-14T11:53:24.285964+0000","last_fullsized":"2024-09-14T11:53:24.285964+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'766","last_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_deep_scrub":"263'766","last_deep_scrub_stamp":"2024-09-14T11:53:24.285877+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.285877+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:46.843489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'260","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.096248+0000","last_change":"2024-09-14T11:53:27.096151+0000","last_active":"2024-09-14T11:53:27.096248+0000","last_peered":"2024-09-14T11:53:27.096248+0000","last_clean":"2024-09-14T11:53:27.096248+0000","last_became_active":"2024-09-14T11:11:14.886355+0000","last_became_peered":"2024-09-14T11:11:14.886355+0000","last_unstale":"2024-09-14T11:53:27.096248+0000","last_undegraded":"2024-09-14T11:53:27.096248+0000","last_fullsized":"2024-09-14T11:53:27.096248+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-14T11:53:27.096040+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.096040+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:25.152267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":587,"num_write":546,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'612","reported_seq":2281,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.242310+0000","last_change":"2024-09-14T11:53:05.242310+0000","last_active":"2024-09-14T11:53:05.242310+0000","last_peered":"2024-09-14T11:53:05.242310+0000","last_clean":"2024-09-14T11:53:05.242310+0000","last_became_active":"2024-09-14T11:11:06.654898+0000","last_became_peered":"2024-09-14T11:11:06.654898+0000","last_unstale":"2024-09-14T11:53:05.242310+0000","last_undegraded":"2024-09-14T11:53:05.242310+0000","last_fullsized":"2024-09-14T11:53:05.242310+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'612","last_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_deep_scrub":"263'612","last_deep_scrub_stamp":"2024-09-14T11:53:05.242215+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.242215+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:11.508154+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3266,"num_read_kb":3006,"num_write":821,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'257","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.040132+0000","last_change":"2024-09-14T11:52:53.040059+0000","last_active":"2024-09-14T11:52:53.040132+0000","last_peered":"2024-09-14T11:52:53.040132+0000","last_clean":"2024-09-14T11:52:53.040132+0000","last_became_active":"2024-09-14T11:11:04.660257+0000","last_became_peered":"2024-09-14T11:11:04.660257+0000","last_unstale":"2024-09-14T11:52:53.040132+0000","last_undegraded":"2024-09-14T11:52:53.040132+0000","last_fullsized":"2024-09-14T11:52:53.040132+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-14T11:52:53.039947+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.039947+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:30.725773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159796,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1223,"num_read_kb":9329,"num_write":1113,"num_write_kb":18554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.268246+0000","last_change":"2024-09-14T11:53:14.268246+0000","last_active":"2024-09-14T11:53:14.268246+0000","last_peered":"2024-09-14T11:53:14.268246+0000","last_clean":"2024-09-14T11:53:14.268246+0000","last_became_active":"2024-09-14T11:11:08.658650+0000","last_became_peered":"2024-09-14T11:11:08.658650+0000","last_unstale":"2024-09-14T11:53:14.268246+0000","last_undegraded":"2024-09-14T11:53:14.268246+0000","last_fullsized":"2024-09-14T11:53:14.268246+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.268157+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.268157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:01.064220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'120","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.286387+0000","last_change":"2024-09-14T11:53:19.286387+0000","last_active":"2024-09-14T11:53:19.286387+0000","last_peered":"2024-09-14T11:53:19.286387+0000","last_clean":"2024-09-14T11:53:19.286387+0000","last_became_active":"2024-09-14T11:11:10.882919+0000","last_became_peered":"2024-09-14T11:11:10.882919+0000","last_unstale":"2024-09-14T11:53:19.286387+0000","last_undegraded":"2024-09-14T11:53:19.286387+0000","last_fullsized":"2024-09-14T11:53:19.286387+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'120","last_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_deep_scrub":"263'120","last_deep_scrub_stamp":"2024-09-14T11:53:19.286298+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.286298+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:51.574721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8244,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":158,"num_read_kb":211,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'820","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.115955+0000","last_change":"2024-09-14T11:53:26.115955+0000","last_active":"2024-09-14T11:53:26.115955+0000","last_peered":"2024-09-14T11:53:26.115955+0000","last_clean":"2024-09-14T11:53:26.115955+0000","last_became_active":"2024-09-14T11:11:12.683284+0000","last_became_peered":"2024-09-14T11:11:12.683284+0000","last_unstale":"2024-09-14T11:53:26.115955+0000","last_undegraded":"2024-09-14T11:53:26.115955+0000","last_fullsized":"2024-09-14T11:53:26.115955+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'820","last_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_deep_scrub":"263'820","last_deep_scrub_stamp":"2024-09-14T11:53:26.115863+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.115863+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:09.612135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'480","reported_seq":2091,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.160898+0000","last_change":"2024-09-14T11:53:04.160898+0000","last_active":"2024-09-14T11:53:04.160898+0000","last_peered":"2024-09-14T11:53:04.160898+0000","last_clean":"2024-09-14T11:53:04.160898+0000","last_became_active":"2024-09-14T11:11:06.651016+0000","last_became_peered":"2024-09-14T11:11:06.651016+0000","last_unstale":"2024-09-14T11:53:04.160898+0000","last_undegraded":"2024-09-14T11:53:04.160898+0000","last_fullsized":"2024-09-14T11:53:04.160898+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'480","last_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_deep_scrub":"263'480","last_deep_scrub_stamp":"2024-09-14T11:53:04.160798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.160798+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:16.863145+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2496,"num_read_kb":2347,"num_write":555,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'224","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.129944+0000","last_change":"2024-09-14T11:52:58.129865+0000","last_active":"2024-09-14T11:52:58.129944+0000","last_peered":"2024-09-14T11:52:58.129944+0000","last_clean":"2024-09-14T11:52:58.129944+0000","last_became_active":"2024-09-14T11:11:04.664695+0000","last_became_peered":"2024-09-14T11:11:04.664695+0000","last_unstale":"2024-09-14T11:52:58.129944+0000","last_undegraded":"2024-09-14T11:52:58.129944+0000","last_fullsized":"2024-09-14T11:52:58.129944+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-14T11:52:58.129706+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.129706+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:14.434843+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079921,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":611,"num_read_kb":75141,"num_write":989,"num_write_kb":30234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.162665+0000","last_change":"2024-09-14T11:53:13.162665+0000","last_active":"2024-09-14T11:53:13.162665+0000","last_peered":"2024-09-14T11:53:13.162665+0000","last_clean":"2024-09-14T11:53:13.162665+0000","last_became_active":"2024-09-14T11:11:08.659342+0000","last_became_peered":"2024-09-14T11:11:08.659342+0000","last_unstale":"2024-09-14T11:53:13.162665+0000","last_undegraded":"2024-09-14T11:53:13.162665+0000","last_fullsized":"2024-09-14T11:53:13.162665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.162577+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.162577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:39.747982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'212","reported_seq":824,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.338000+0000","last_change":"2024-09-14T11:53:16.338000+0000","last_active":"2024-09-14T11:53:16.338000+0000","last_peered":"2024-09-14T11:53:16.338000+0000","last_clean":"2024-09-14T11:53:16.338000+0000","last_became_active":"2024-09-14T11:11:10.882862+0000","last_became_peered":"2024-09-14T11:11:10.882862+0000","last_unstale":"2024-09-14T11:53:16.338000+0000","last_undegraded":"2024-09-14T11:53:16.338000+0000","last_fullsized":"2024-09-14T11:53:16.338000+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:16.337891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.337891+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:14.933423+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12894,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":281,"num_read_kb":357,"num_write":162,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.782894+0000","last_change":"2024-09-14T11:53:19.782825+0000","last_active":"2024-09-14T11:53:19.782894+0000","last_peered":"2024-09-14T11:53:19.782894+0000","last_clean":"2024-09-14T11:53:19.782894+0000","last_became_active":"2024-09-14T11:11:12.678224+0000","last_became_peered":"2024-09-14T11:11:12.678224+0000","last_unstale":"2024-09-14T11:53:19.782894+0000","last_undegraded":"2024-09-14T11:53:19.782894+0000","last_fullsized":"2024-09-14T11:53:19.782894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:19.782705+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.782705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:53.976396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'547","reported_seq":1357,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.384403+0000","last_change":"2024-09-14T11:53:22.384403+0000","last_active":"2024-09-14T11:53:22.384403+0000","last_peered":"2024-09-14T11:53:22.384403+0000","last_clean":"2024-09-14T11:53:22.384403+0000","last_became_active":"2024-09-14T11:11:14.691505+0000","last_became_peered":"2024-09-14T11:11:14.691505+0000","last_unstale":"2024-09-14T11:53:22.384403+0000","last_undegraded":"2024-09-14T11:53:22.384403+0000","last_fullsized":"2024-09-14T11:53:22.384403+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:53:22.384319+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.384319+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:30.798105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1256,"num_read_kb":1255,"num_write":1119,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'471","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.111042+0000","last_change":"2024-09-14T11:52:56.111042+0000","last_active":"2024-09-14T11:52:56.111042+0000","last_peered":"2024-09-14T11:52:56.111042+0000","last_clean":"2024-09-14T11:52:56.111042+0000","last_became_active":"2024-09-14T11:11:06.650687+0000","last_became_peered":"2024-09-14T11:11:06.650687+0000","last_unstale":"2024-09-14T11:52:56.111042+0000","last_undegraded":"2024-09-14T11:52:56.111042+0000","last_fullsized":"2024-09-14T11:52:56.111042+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:52:56.110952+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.110952+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:29.334828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2554,"num_read_kb":2382,"num_write":556,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'226","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.097292+0000","last_change":"2024-09-14T11:52:56.097229+0000","last_active":"2024-09-14T11:52:56.097292+0000","last_peered":"2024-09-14T11:52:56.097292+0000","last_clean":"2024-09-14T11:52:56.097292+0000","last_became_active":"2024-09-14T11:11:04.653357+0000","last_became_peered":"2024-09-14T11:11:04.653357+0000","last_unstale":"2024-09-14T11:52:56.097292+0000","last_undegraded":"2024-09-14T11:52:56.097292+0000","last_fullsized":"2024-09-14T11:52:56.097292+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'226","last_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_deep_scrub":"263'226","last_deep_scrub_stamp":"2024-09-14T11:52:56.097135+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.097135+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:19.941231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":589,"num_read_kb":64064,"num_write":1014,"num_write_kb":22634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.588684+0000","last_change":"2024-09-14T11:53:02.588684+0000","last_active":"2024-09-14T11:53:02.588684+0000","last_peered":"2024-09-14T11:53:02.588684+0000","last_clean":"2024-09-14T11:53:02.588684+0000","last_became_active":"2024-09-14T11:11:08.650455+0000","last_became_peered":"2024-09-14T11:11:08.650455+0000","last_unstale":"2024-09-14T11:53:02.588684+0000","last_undegraded":"2024-09-14T11:53:02.588684+0000","last_fullsized":"2024-09-14T11:53:02.588684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:02.588602+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.588602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:29.731864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'143","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.136546+0000","last_change":"2024-09-14T11:53:16.136485+0000","last_active":"2024-09-14T11:53:16.136546+0000","last_peered":"2024-09-14T11:53:16.136546+0000","last_clean":"2024-09-14T11:53:16.136546+0000","last_became_active":"2024-09-14T11:11:10.668924+0000","last_became_peered":"2024-09-14T11:11:10.668924+0000","last_unstale":"2024-09-14T11:53:16.136546+0000","last_undegraded":"2024-09-14T11:53:16.136546+0000","last_fullsized":"2024-09-14T11:53:16.136546+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:53:16.136400+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.136400+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:37.731799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6234,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":213,"num_write":84,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.073259+0000","last_change":"2024-09-14T11:53:23.073259+0000","last_active":"2024-09-14T11:53:23.073259+0000","last_peered":"2024-09-14T11:53:23.073259+0000","last_clean":"2024-09-14T11:53:23.073259+0000","last_became_active":"2024-09-14T11:11:12.676877+0000","last_became_peered":"2024-09-14T11:11:12.676877+0000","last_unstale":"2024-09-14T11:53:23.073259+0000","last_undegraded":"2024-09-14T11:53:23.073259+0000","last_fullsized":"2024-09-14T11:53:23.073259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:23.073170+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.073170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:23.706992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'123","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.181896+0000","last_change":"2024-09-14T11:53:15.181896+0000","last_active":"2024-09-14T11:53:15.181896+0000","last_peered":"2024-09-14T11:53:15.181896+0000","last_clean":"2024-09-14T11:53:15.181896+0000","last_became_active":"2024-09-14T11:11:14.693159+0000","last_became_peered":"2024-09-14T11:11:14.693159+0000","last_unstale":"2024-09-14T11:53:15.181896+0000","last_undegraded":"2024-09-14T11:53:15.181896+0000","last_fullsized":"2024-09-14T11:53:15.181896+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:53:15.181804+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.181804+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:14.148465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1274,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":151,"num_write":317,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'382","reported_seq":1953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.036223+0000","last_change":"2024-09-14T11:53:02.036223+0000","last_active":"2024-09-14T11:53:02.036223+0000","last_peered":"2024-09-14T11:53:02.036223+0000","last_clean":"2024-09-14T11:53:02.036223+0000","last_became_active":"2024-09-14T11:11:06.659914+0000","last_became_peered":"2024-09-14T11:11:06.659914+0000","last_unstale":"2024-09-14T11:53:02.036223+0000","last_undegraded":"2024-09-14T11:53:02.036223+0000","last_fullsized":"2024-09-14T11:53:02.036223+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'382","last_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_deep_scrub":"263'382","last_deep_scrub_stamp":"2024-09-14T11:53:02.036135+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.036135+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:25.081091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2281,"num_read_kb":2186,"num_write":443,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'225","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.154338+0000","last_change":"2024-09-14T11:52:59.154258+0000","last_active":"2024-09-14T11:52:59.154338+0000","last_peered":"2024-09-14T11:52:59.154338+0000","last_clean":"2024-09-14T11:52:59.154338+0000","last_became_active":"2024-09-14T11:11:04.667717+0000","last_became_peered":"2024-09-14T11:11:04.667717+0000","last_unstale":"2024-09-14T11:52:59.154338+0000","last_undegraded":"2024-09-14T11:52:59.154338+0000","last_fullsized":"2024-09-14T11:52:59.154338+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'225","last_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_deep_scrub":"263'225","last_deep_scrub_stamp":"2024-09-14T11:52:59.154158+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.154158+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:38.092830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":542,"num_read_kb":106193,"num_write":937,"num_write_kb":53758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.544682+0000","last_change":"2024-09-14T11:53:03.544626+0000","last_active":"2024-09-14T11:53:03.544682+0000","last_peered":"2024-09-14T11:53:03.544682+0000","last_clean":"2024-09-14T11:53:03.544682+0000","last_became_active":"2024-09-14T11:11:08.655595+0000","last_became_peered":"2024-09-14T11:11:08.655595+0000","last_unstale":"2024-09-14T11:53:03.544682+0000","last_undegraded":"2024-09-14T11:53:03.544682+0000","last_fullsized":"2024-09-14T11:53:03.544682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:03.544542+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.544542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:11.748879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'166","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.261160+0000","last_change":"2024-09-14T11:53:17.261160+0000","last_active":"2024-09-14T11:53:17.261160+0000","last_peered":"2024-09-14T11:53:17.261160+0000","last_clean":"2024-09-14T11:53:17.261160+0000","last_became_active":"2024-09-14T11:11:10.670672+0000","last_became_peered":"2024-09-14T11:11:10.670672+0000","last_unstale":"2024-09-14T11:53:17.261160+0000","last_undegraded":"2024-09-14T11:53:17.261160+0000","last_fullsized":"2024-09-14T11:53:17.261160+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:53:17.261070+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.261070+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:34.279643+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":200,"num_read_kb":261,"num_write":108,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'775","reported_seq":2261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.182129+0000","last_change":"2024-09-14T11:53:19.182129+0000","last_active":"2024-09-14T11:53:19.182129+0000","last_peered":"2024-09-14T11:53:19.182129+0000","last_clean":"2024-09-14T11:53:19.182129+0000","last_became_active":"2024-09-14T11:11:12.682549+0000","last_became_peered":"2024-09-14T11:11:12.682549+0000","last_unstale":"2024-09-14T11:53:19.182129+0000","last_undegraded":"2024-09-14T11:53:19.182129+0000","last_fullsized":"2024-09-14T11:53:19.182129+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'775","last_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_deep_scrub":"263'775","last_deep_scrub_stamp":"2024-09-14T11:53:19.181998+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.181998+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:38.184284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'128","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.106544+0000","last_change":"2024-09-14T11:53:23.106544+0000","last_active":"2024-09-14T11:53:23.106544+0000","last_peered":"2024-09-14T11:53:23.106544+0000","last_clean":"2024-09-14T11:53:23.106544+0000","last_became_active":"2024-09-14T11:11:14.690917+0000","last_became_peered":"2024-09-14T11:11:14.690917+0000","last_unstale":"2024-09-14T11:53:23.106544+0000","last_undegraded":"2024-09-14T11:53:23.106544+0000","last_fullsized":"2024-09-14T11:53:23.106544+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:23.106462+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.106462+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:40.912530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":156,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'570","reported_seq":2343,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.186838+0000","last_change":"2024-09-14T11:53:00.186783+0000","last_active":"2024-09-14T11:53:00.186838+0000","last_peered":"2024-09-14T11:53:00.186838+0000","last_clean":"2024-09-14T11:53:00.186838+0000","last_became_active":"2024-09-14T11:11:06.649459+0000","last_became_peered":"2024-09-14T11:11:06.649459+0000","last_unstale":"2024-09-14T11:53:00.186838+0000","last_undegraded":"2024-09-14T11:53:00.186838+0000","last_fullsized":"2024-09-14T11:53:00.186838+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'570","last_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_deep_scrub":"263'570","last_deep_scrub_stamp":"2024-09-14T11:53:00.186701+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.186701+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:41.511182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3094,"num_read_kb":2883,"num_write":688,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2296,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'207","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.111589+0000","last_change":"2024-09-14T11:52:55.111500+0000","last_active":"2024-09-14T11:52:55.111589+0000","last_peered":"2024-09-14T11:52:55.111589+0000","last_clean":"2024-09-14T11:52:55.111589+0000","last_became_active":"2024-09-14T11:11:04.660233+0000","last_became_peered":"2024-09-14T11:11:04.660233+0000","last_unstale":"2024-09-14T11:52:55.111589+0000","last_undegraded":"2024-09-14T11:52:55.111589+0000","last_fullsized":"2024-09-14T11:52:55.111589+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:55.111364+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.111364+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:22.418671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":459,"num_read_kb":32215,"num_write":875,"num_write_kb":43769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.475652+0000","last_change":"2024-09-14T11:53:05.475652+0000","last_active":"2024-09-14T11:53:05.475652+0000","last_peered":"2024-09-14T11:53:05.475652+0000","last_clean":"2024-09-14T11:53:05.475652+0000","last_became_active":"2024-09-14T11:11:08.657427+0000","last_became_peered":"2024-09-14T11:11:08.657427+0000","last_unstale":"2024-09-14T11:53:05.475652+0000","last_undegraded":"2024-09-14T11:53:05.475652+0000","last_fullsized":"2024-09-14T11:53:05.475652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.475568+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.475568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:15.444965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'193","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.098235+0000","last_change":"2024-09-14T11:53:12.098235+0000","last_active":"2024-09-14T11:53:12.098235+0000","last_peered":"2024-09-14T11:53:12.098235+0000","last_clean":"2024-09-14T11:53:12.098235+0000","last_became_active":"2024-09-14T11:11:10.668301+0000","last_became_peered":"2024-09-14T11:11:10.668301+0000","last_unstale":"2024-09-14T11:53:12.098235+0000","last_undegraded":"2024-09-14T11:53:12.098235+0000","last_fullsized":"2024-09-14T11:53:12.098235+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:53:12.098129+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.098129+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:24.419869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13546,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":273,"num_read_kb":390,"num_write":132,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.508991+0000","last_change":"2024-09-14T11:53:09.508991+0000","last_active":"2024-09-14T11:53:09.508991+0000","last_peered":"2024-09-14T11:53:09.508991+0000","last_clean":"2024-09-14T11:53:09.508991+0000","last_became_active":"2024-09-14T11:11:12.682499+0000","last_became_peered":"2024-09-14T11:11:12.682499+0000","last_unstale":"2024-09-14T11:53:09.508991+0000","last_undegraded":"2024-09-14T11:53:09.508991+0000","last_fullsized":"2024-09-14T11:53:09.508991+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.508870+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.508870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:39.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'139","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.718255+0000","last_change":"2024-09-14T11:53:16.718255+0000","last_active":"2024-09-14T11:53:16.718255+0000","last_peered":"2024-09-14T11:53:16.718255+0000","last_clean":"2024-09-14T11:53:16.718255+0000","last_became_active":"2024-09-14T11:11:14.694425+0000","last_became_peered":"2024-09-14T11:11:14.694425+0000","last_unstale":"2024-09-14T11:53:16.718255+0000","last_undegraded":"2024-09-14T11:53:16.718255+0000","last_fullsized":"2024-09-14T11:53:16.718255+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'139","last_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_deep_scrub":"263'139","last_deep_scrub_stamp":"2024-09-14T11:53:16.718166+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.718166+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.547409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1319,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":152,"num_write":308,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'811","reported_seq":2373,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.066619+0000","last_change":"2024-09-14T11:52:57.066558+0000","last_active":"2024-09-14T11:52:57.066619+0000","last_peered":"2024-09-14T11:52:57.066619+0000","last_clean":"2024-09-14T11:52:57.066619+0000","last_became_active":"2024-09-14T11:11:06.651691+0000","last_became_peered":"2024-09-14T11:11:06.651691+0000","last_unstale":"2024-09-14T11:52:57.066619+0000","last_undegraded":"2024-09-14T11:52:57.066619+0000","last_fullsized":"2024-09-14T11:52:57.066619+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'811","last_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_deep_scrub":"263'811","last_deep_scrub_stamp":"2024-09-14T11:52:57.066478+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.066478+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:49.841841+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3567,"num_write":1054,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'187","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.216245+0000","last_change":"2024-09-14T11:52:51.216155+0000","last_active":"2024-09-14T11:52:51.216245+0000","last_peered":"2024-09-14T11:52:51.216245+0000","last_clean":"2024-09-14T11:52:51.216245+0000","last_became_active":"2024-09-14T11:11:37.864654+0000","last_became_peered":"2024-09-14T11:11:37.864654+0000","last_unstale":"2024-09-14T11:52:51.216245+0000","last_undegraded":"2024-09-14T11:52:51.216245+0000","last_fullsized":"2024-09-14T11:52:51.216245+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-14T11:52:51.216003+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.216003+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:26.941139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":535,"num_read_kb":54806,"num_write":892,"num_write_kb":47234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,7],"acting":[3,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.525174+0000","last_change":"2024-09-14T11:53:04.525107+0000","last_active":"2024-09-14T11:53:04.525174+0000","last_peered":"2024-09-14T11:53:04.525174+0000","last_clean":"2024-09-14T11:53:04.525174+0000","last_became_active":"2024-09-14T11:11:08.653645+0000","last_became_peered":"2024-09-14T11:11:08.653645+0000","last_unstale":"2024-09-14T11:53:04.525174+0000","last_undegraded":"2024-09-14T11:53:04.525174+0000","last_fullsized":"2024-09-14T11:53:04.525174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.525015+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.525015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:40.108078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'144","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.962801+0000","last_change":"2024-09-14T11:53:15.962742+0000","last_active":"2024-09-14T11:53:15.962801+0000","last_peered":"2024-09-14T11:53:15.962801+0000","last_clean":"2024-09-14T11:53:15.962801+0000","last_became_active":"2024-09-14T11:11:10.665583+0000","last_became_peered":"2024-09-14T11:11:10.665583+0000","last_unstale":"2024-09-14T11:53:15.962801+0000","last_undegraded":"2024-09-14T11:53:15.962801+0000","last_fullsized":"2024-09-14T11:53:15.962801+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-14T11:53:15.962648+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.962648+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:19.163212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5347,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":234,"num_write":162,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.122926+0000","last_change":"2024-09-14T11:53:17.122842+0000","last_active":"2024-09-14T11:53:17.122926+0000","last_peered":"2024-09-14T11:53:17.122926+0000","last_clean":"2024-09-14T11:53:17.122926+0000","last_became_active":"2024-09-14T11:11:12.679727+0000","last_became_peered":"2024-09-14T11:11:12.679727+0000","last_unstale":"2024-09-14T11:53:17.122926+0000","last_undegraded":"2024-09-14T11:53:17.122926+0000","last_fullsized":"2024-09-14T11:53:17.122926+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:17.122746+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.122746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:30.958511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'136","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.087070+0000","last_change":"2024-09-14T11:53:28.087070+0000","last_active":"2024-09-14T11:53:28.087070+0000","last_peered":"2024-09-14T11:53:28.087070+0000","last_clean":"2024-09-14T11:53:28.087070+0000","last_became_active":"2024-09-14T11:11:14.690631+0000","last_became_peered":"2024-09-14T11:11:14.690631+0000","last_unstale":"2024-09-14T11:53:28.087070+0000","last_undegraded":"2024-09-14T11:53:28.087070+0000","last_fullsized":"2024-09-14T11:53:28.087070+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:28.086985+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.086985+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:09.791675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":149,"num_read_kb":135,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'617","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.075457+0000","last_change":"2024-09-14T11:52:58.075392+0000","last_active":"2024-09-14T11:52:58.075457+0000","last_peered":"2024-09-14T11:52:58.075457+0000","last_clean":"2024-09-14T11:52:58.075457+0000","last_became_active":"2024-09-14T11:11:06.651205+0000","last_became_peered":"2024-09-14T11:11:06.651205+0000","last_unstale":"2024-09-14T11:52:58.075457+0000","last_undegraded":"2024-09-14T11:52:58.075457+0000","last_fullsized":"2024-09-14T11:52:58.075457+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'617","last_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_deep_scrub":"263'617","last_deep_scrub_stamp":"2024-09-14T11:52:58.075304+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.075304+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:31.134395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3126,"num_read_kb":2804,"num_write":827,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'217","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.692209+0000","last_change":"2024-09-14T11:52:51.692109+0000","last_active":"2024-09-14T11:52:51.692209+0000","last_peered":"2024-09-14T11:52:51.692209+0000","last_clean":"2024-09-14T11:52:51.692209+0000","last_became_active":"2024-09-14T11:11:37.865684+0000","last_became_peered":"2024-09-14T11:11:37.865684+0000","last_unstale":"2024-09-14T11:52:51.692209+0000","last_undegraded":"2024-09-14T11:52:51.692209+0000","last_fullsized":"2024-09-14T11:52:51.692209+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:51.691968+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.691968+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:42.697133+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1166,"num_read_kb":81327,"num_write":1108,"num_write_kb":30848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,7],"acting":[2,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.592420+0000","last_change":"2024-09-14T11:53:07.592370+0000","last_active":"2024-09-14T11:53:07.592420+0000","last_peered":"2024-09-14T11:53:07.592420+0000","last_clean":"2024-09-14T11:53:07.592420+0000","last_became_active":"2024-09-14T11:11:08.657475+0000","last_became_peered":"2024-09-14T11:11:08.657475+0000","last_unstale":"2024-09-14T11:53:07.592420+0000","last_undegraded":"2024-09-14T11:53:07.592420+0000","last_fullsized":"2024-09-14T11:53:07.592420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.592234+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.592234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:13.451667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'195","reported_seq":782,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.475753+0000","last_change":"2024-09-14T11:53:07.475678+0000","last_active":"2024-09-14T11:53:07.475753+0000","last_peered":"2024-09-14T11:53:07.475753+0000","last_clean":"2024-09-14T11:53:07.475753+0000","last_became_active":"2024-09-14T11:11:10.669248+0000","last_became_peered":"2024-09-14T11:11:10.669248+0000","last_unstale":"2024-09-14T11:53:07.475753+0000","last_undegraded":"2024-09-14T11:53:07.475753+0000","last_fullsized":"2024-09-14T11:53:07.475753+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-14T11:53:07.475570+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.475570+0000","objects_scrubbed":7,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:11.623372+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8518,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":218,"num_read_kb":257,"num_write":130,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'750","reported_seq":2418,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.521474+0000","last_change":"2024-09-14T11:53:10.521357+0000","last_active":"2024-09-14T11:53:10.521474+0000","last_peered":"2024-09-14T11:53:10.521474+0000","last_clean":"2024-09-14T11:53:10.521474+0000","last_became_active":"2024-09-14T11:11:12.679986+0000","last_became_peered":"2024-09-14T11:11:12.679986+0000","last_unstale":"2024-09-14T11:53:10.521474+0000","last_undegraded":"2024-09-14T11:53:10.521474+0000","last_fullsized":"2024-09-14T11:53:10.521474+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'750","last_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_deep_scrub":"263'750","last_deep_scrub_stamp":"2024-09-14T11:53:10.521256+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.521256+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.722472+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'117","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.703637+0000","last_change":"2024-09-14T11:53:15.703637+0000","last_active":"2024-09-14T11:53:15.703637+0000","last_peered":"2024-09-14T11:53:15.703637+0000","last_clean":"2024-09-14T11:53:15.703637+0000","last_became_active":"2024-09-14T11:11:14.693876+0000","last_became_peered":"2024-09-14T11:11:14.693876+0000","last_unstale":"2024-09-14T11:53:15.703637+0000","last_undegraded":"2024-09-14T11:53:15.703637+0000","last_fullsized":"2024-09-14T11:53:15.703637+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'117","last_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_deep_scrub":"263'117","last_deep_scrub_stamp":"2024-09-14T11:53:15.703534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.703534+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:51.533479+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'497","reported_seq":1946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.086146+0000","last_change":"2024-09-14T11:53:00.086088+0000","last_active":"2024-09-14T11:53:00.086146+0000","last_peered":"2024-09-14T11:53:00.086146+0000","last_clean":"2024-09-14T11:53:00.086146+0000","last_became_active":"2024-09-14T11:11:06.653561+0000","last_became_peered":"2024-09-14T11:11:06.653561+0000","last_unstale":"2024-09-14T11:53:00.086146+0000","last_undegraded":"2024-09-14T11:53:00.086146+0000","last_fullsized":"2024-09-14T11:53:00.086146+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'497","last_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_deep_scrub":"263'497","last_deep_scrub_stamp":"2024-09-14T11:53:00.085999+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.085999+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:14.084510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2582,"num_read_kb":2365,"num_write":633,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'215","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.132110+0000","last_change":"2024-09-14T11:52:53.132110+0000","last_active":"2024-09-14T11:52:53.132110+0000","last_peered":"2024-09-14T11:52:53.132110+0000","last_clean":"2024-09-14T11:52:53.132110+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:53.132110+0000","last_undegraded":"2024-09-14T11:52:53.132110+0000","last_fullsized":"2024-09-14T11:52:53.132110+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'215","last_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_deep_scrub":"263'215","last_deep_scrub_stamp":"2024-09-14T11:52:53.131957+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.131957+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.645543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079944,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":783,"num_read_kb":15229,"num_write":1055,"num_write_kb":18745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.189347+0000","last_change":"2024-09-14T11:53:12.189264+0000","last_active":"2024-09-14T11:53:12.189347+0000","last_peered":"2024-09-14T11:53:12.189347+0000","last_clean":"2024-09-14T11:53:12.189347+0000","last_became_active":"2024-09-14T11:11:08.657380+0000","last_became_peered":"2024-09-14T11:11:08.657380+0000","last_unstale":"2024-09-14T11:53:12.189347+0000","last_undegraded":"2024-09-14T11:53:12.189347+0000","last_fullsized":"2024-09-14T11:53:12.189347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:53:12.189152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.189152+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:05.891449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":954,"num_read_kb":954,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'70","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.143867+0000","last_change":"2024-09-14T11:53:19.143795+0000","last_active":"2024-09-14T11:53:19.143867+0000","last_peered":"2024-09-14T11:53:19.143867+0000","last_clean":"2024-09-14T11:53:19.143867+0000","last_became_active":"2024-09-14T11:11:10.882801+0000","last_became_peered":"2024-09-14T11:11:10.882801+0000","last_unstale":"2024-09-14T11:53:19.143867+0000","last_undegraded":"2024-09-14T11:53:19.143867+0000","last_fullsized":"2024-09-14T11:53:19.143867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'70","last_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_deep_scrub":"263'70","last_deep_scrub_stamp":"2024-09-14T11:53:19.143710+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.143710+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:32.602096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":71,"num_write":52,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'768","reported_seq":2427,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.117443+0000","last_change":"2024-09-14T11:53:09.117368+0000","last_active":"2024-09-14T11:53:09.117443+0000","last_peered":"2024-09-14T11:53:09.117443+0000","last_clean":"2024-09-14T11:53:09.117443+0000","last_became_active":"2024-09-14T11:11:12.682693+0000","last_became_peered":"2024-09-14T11:11:12.682693+0000","last_unstale":"2024-09-14T11:53:09.117443+0000","last_undegraded":"2024-09-14T11:53:09.117443+0000","last_fullsized":"2024-09-14T11:53:09.117443+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:53:09.117283+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.117283+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:44.960384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'129","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.092221+0000","last_change":"2024-09-14T11:53:23.092221+0000","last_active":"2024-09-14T11:53:23.092221+0000","last_peered":"2024-09-14T11:53:23.092221+0000","last_clean":"2024-09-14T11:53:23.092221+0000","last_became_active":"2024-09-14T11:11:14.696778+0000","last_became_peered":"2024-09-14T11:11:14.696778+0000","last_unstale":"2024-09-14T11:53:23.092221+0000","last_undegraded":"2024-09-14T11:53:23.092221+0000","last_fullsized":"2024-09-14T11:53:23.092221+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-14T11:53:23.092123+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.092123+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:11.099011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":126,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'459","reported_seq":2022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.564335+0000","last_change":"2024-09-14T11:53:01.564244+0000","last_active":"2024-09-14T11:53:01.564335+0000","last_peered":"2024-09-14T11:53:01.564335+0000","last_clean":"2024-09-14T11:53:01.564335+0000","last_became_active":"2024-09-14T11:11:06.660824+0000","last_became_peered":"2024-09-14T11:11:06.660824+0000","last_unstale":"2024-09-14T11:53:01.564335+0000","last_undegraded":"2024-09-14T11:53:01.564335+0000","last_fullsized":"2024-09-14T11:53:01.564335+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'459","last_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_deep_scrub":"263'459","last_deep_scrub_stamp":"2024-09-14T11:53:01.564148+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.564148+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:59.274317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2415,"num_read_kb":2270,"num_write":549,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'201","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.211667+0000","last_change":"2024-09-14T11:52:52.211667+0000","last_active":"2024-09-14T11:52:52.211667+0000","last_peered":"2024-09-14T11:52:52.211667+0000","last_clean":"2024-09-14T11:52:52.211667+0000","last_became_active":"2024-09-14T11:11:04.652064+0000","last_became_peered":"2024-09-14T11:11:04.652064+0000","last_unstale":"2024-09-14T11:52:52.211667+0000","last_undegraded":"2024-09-14T11:52:52.211667+0000","last_fullsized":"2024-09-14T11:52:52.211667+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'201","last_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_deep_scrub":"263'201","last_deep_scrub_stamp":"2024-09-14T11:52:52.211587+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.211587+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:11.190379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":47606,"num_write":839,"num_write_kb":33125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.989831+0000","last_change":"2024-09-14T11:53:11.989761+0000","last_active":"2024-09-14T11:53:11.989831+0000","last_peered":"2024-09-14T11:53:11.989831+0000","last_clean":"2024-09-14T11:53:11.989831+0000","last_became_active":"2024-09-14T11:11:08.650923+0000","last_became_peered":"2024-09-14T11:11:08.650923+0000","last_unstale":"2024-09-14T11:53:11.989831+0000","last_undegraded":"2024-09-14T11:53:11.989831+0000","last_fullsized":"2024-09-14T11:53:11.989831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.989664+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.989664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:25.415110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'232","reported_seq":839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.436479+0000","last_change":"2024-09-14T11:53:19.436418+0000","last_active":"2024-09-14T11:53:19.436479+0000","last_peered":"2024-09-14T11:53:19.436479+0000","last_clean":"2024-09-14T11:53:19.436479+0000","last_became_active":"2024-09-14T11:11:10.671409+0000","last_became_peered":"2024-09-14T11:11:10.671409+0000","last_unstale":"2024-09-14T11:53:19.436479+0000","last_undegraded":"2024-09-14T11:53:19.436479+0000","last_fullsized":"2024-09-14T11:53:19.436479+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-14T11:53:19.436301+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.436301+0000","objects_scrubbed":9,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:00.458988+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26161,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":914,"num_read_kb":1030,"num_write":1436,"num_write_kb":1318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.145445+0000","last_change":"2024-09-14T11:53:08.145378+0000","last_active":"2024-09-14T11:53:08.145445+0000","last_peered":"2024-09-14T11:53:08.145445+0000","last_clean":"2024-09-14T11:53:08.145445+0000","last_became_active":"2024-09-14T11:11:12.685120+0000","last_became_peered":"2024-09-14T11:11:12.685120+0000","last_unstale":"2024-09-14T11:53:08.145445+0000","last_undegraded":"2024-09-14T11:53:08.145445+0000","last_fullsized":"2024-09-14T11:53:08.145445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.145290+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.145290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:35.085689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.745898+0000","last_change":"2024-09-14T11:53:17.745898+0000","last_active":"2024-09-14T11:53:17.745898+0000","last_peered":"2024-09-14T11:53:17.745898+0000","last_clean":"2024-09-14T11:53:17.745898+0000","last_became_active":"2024-09-14T11:11:14.690991+0000","last_became_peered":"2024-09-14T11:11:14.690991+0000","last_unstale":"2024-09-14T11:53:17.745898+0000","last_undegraded":"2024-09-14T11:53:17.745898+0000","last_fullsized":"2024-09-14T11:53:17.745898+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:17.745809+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.745809+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:39.872828+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":260,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'406","reported_seq":1870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.037506+0000","last_change":"2024-09-14T11:52:59.037506+0000","last_active":"2024-09-14T11:52:59.037506+0000","last_peered":"2024-09-14T11:52:59.037506+0000","last_clean":"2024-09-14T11:52:59.037506+0000","last_became_active":"2024-09-14T11:11:06.651752+0000","last_became_peered":"2024-09-14T11:11:06.651752+0000","last_unstale":"2024-09-14T11:52:59.037506+0000","last_undegraded":"2024-09-14T11:52:59.037506+0000","last_fullsized":"2024-09-14T11:52:59.037506+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'406","last_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_deep_scrub":"263'406","last_deep_scrub_stamp":"2024-09-14T11:52:59.037411+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.037411+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:45.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2159,"num_read_kb":2035,"num_write":475,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.055848+0000","last_change":"2024-09-14T11:52:53.055791+0000","last_active":"2024-09-14T11:52:53.055848+0000","last_peered":"2024-09-14T11:52:53.055848+0000","last_clean":"2024-09-14T11:52:53.055848+0000","last_became_active":"2024-09-14T11:10:45.304849+0000","last_became_peered":"2024-09-14T11:10:45.304849+0000","last_unstale":"2024-09-14T11:52:53.055848+0000","last_undegraded":"2024-09-14T11:52:53.055848+0000","last_fullsized":"2024-09-14T11:52:53.055848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:52:53.055702+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.055702+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:39.492461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":530,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.073420+0000","last_change":"2024-09-14T11:52:54.073420+0000","last_active":"2024-09-14T11:52:54.073420+0000","last_peered":"2024-09-14T11:52:54.073420+0000","last_clean":"2024-09-14T11:52:54.073420+0000","last_became_active":"2024-09-14T11:10:51.331822+0000","last_became_peered":"2024-09-14T11:10:51.331822+0000","last_unstale":"2024-09-14T11:52:54.073420+0000","last_undegraded":"2024-09-14T11:52:54.073420+0000","last_fullsized":"2024-09-14T11:52:54.073420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:52:54.073323+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073323+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:45.391206+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00051002000000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'318","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.243231+0000","last_change":"2024-09-14T11:52:53.243231+0000","last_active":"2024-09-14T11:52:53.243231+0000","last_peered":"2024-09-14T11:52:53.243231+0000","last_clean":"2024-09-14T11:52:53.243231+0000","last_became_active":"2024-09-14T11:11:04.653222+0000","last_became_peered":"2024-09-14T11:11:04.653222+0000","last_unstale":"2024-09-14T11:52:53.243231+0000","last_undegraded":"2024-09-14T11:52:53.243231+0000","last_fullsized":"2024-09-14T11:52:53.243231+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:52:53.243044+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.243044+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:20.104275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1045,"num_read_kb":764,"num_write":1140,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.176344+0000","last_change":"2024-09-14T11:53:08.176344+0000","last_active":"2024-09-14T11:53:08.176344+0000","last_peered":"2024-09-14T11:53:08.176344+0000","last_clean":"2024-09-14T11:53:08.176344+0000","last_became_active":"2024-09-14T11:11:08.651492+0000","last_became_peered":"2024-09-14T11:11:08.651492+0000","last_unstale":"2024-09-14T11:53:08.176344+0000","last_undegraded":"2024-09-14T11:53:08.176344+0000","last_fullsized":"2024-09-14T11:53:08.176344+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.176258+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.176258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:21.229609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'331","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:17.336879+0000","last_change":"2024-09-14T11:53:17.336879+0000","last_active":"2024-09-14T11:53:17.336879+0000","last_peered":"2024-09-14T11:53:17.336879+0000","last_clean":"2024-09-14T11:53:17.336879+0000","last_became_active":"2024-09-14T11:11:10.670835+0000","last_became_peered":"2024-09-14T11:11:10.670835+0000","last_unstale":"2024-09-14T11:53:17.336879+0000","last_undegraded":"2024-09-14T11:53:17.336879+0000","last_fullsized":"2024-09-14T11:53:17.336879+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:53:17.336772+0000","last_clean_scrub_stamp":"2024-09-14T11:53:17.336772+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.322808+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134988,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":607,"num_read_kb":1074,"num_write":544,"num_write_kb":492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":107214,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.166171+0000","last_change":"2024-09-14T11:53:21.166171+0000","last_active":"2024-09-14T11:53:21.166171+0000","last_peered":"2024-09-14T11:53:21.166171+0000","last_clean":"2024-09-14T11:53:21.166171+0000","last_became_active":"2024-09-14T11:11:12.679181+0000","last_became_peered":"2024-09-14T11:11:12.679181+0000","last_unstale":"2024-09-14T11:53:21.166171+0000","last_undegraded":"2024-09-14T11:53:21.166171+0000","last_fullsized":"2024-09-14T11:53:21.166171+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.166078+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.166078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:24.323597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'197","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.181810+0000","last_change":"2024-09-14T11:53:13.181810+0000","last_active":"2024-09-14T11:53:13.181810+0000","last_peered":"2024-09-14T11:53:13.181810+0000","last_clean":"2024-09-14T11:53:13.181810+0000","last_became_active":"2024-09-14T11:11:14.691427+0000","last_became_peered":"2024-09-14T11:11:14.691427+0000","last_unstale":"2024-09-14T11:53:13.181810+0000","last_undegraded":"2024-09-14T11:53:13.181810+0000","last_fullsized":"2024-09-14T11:53:13.181810+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:53:13.181724+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.181724+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:09.456237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":427,"num_read_kb":422,"num_write":408,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'450","reported_seq":2105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.140049+0000","last_change":"2024-09-14T11:53:01.140049+0000","last_active":"2024-09-14T11:53:01.140049+0000","last_peered":"2024-09-14T11:53:01.140049+0000","last_clean":"2024-09-14T11:53:01.140049+0000","last_became_active":"2024-09-14T11:11:06.653438+0000","last_became_peered":"2024-09-14T11:11:06.653438+0000","last_unstale":"2024-09-14T11:53:01.140049+0000","last_undegraded":"2024-09-14T11:53:01.140049+0000","last_fullsized":"2024-09-14T11:53:01.140049+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'450","last_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_deep_scrub":"263'450","last_deep_scrub_stamp":"2024-09-14T11:53:01.139965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.139965+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:32.411582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2569,"num_read_kb":2429,"num_write":523,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.036795+0000","last_change":"2024-09-14T11:52:54.036739+0000","last_active":"2024-09-14T11:52:54.036795+0000","last_peered":"2024-09-14T11:52:54.036795+0000","last_clean":"2024-09-14T11:52:54.036795+0000","last_became_active":"2024-09-14T11:10:51.332833+0000","last_became_peered":"2024-09-14T11:10:51.332833+0000","last_unstale":"2024-09-14T11:52:54.036795+0000","last_undegraded":"2024-09-14T11:52:54.036795+0000","last_fullsized":"2024-09-14T11:52:54.036795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:54.036632+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.036632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:29.609026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053903700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'230","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.250978+0000","last_change":"2024-09-14T11:52:49.250978+0000","last_active":"2024-09-14T11:52:49.250978+0000","last_peered":"2024-09-14T11:52:49.250978+0000","last_clean":"2024-09-14T11:52:49.250978+0000","last_became_active":"2024-09-14T11:11:04.646826+0000","last_became_peered":"2024-09-14T11:11:04.646826+0000","last_unstale":"2024-09-14T11:52:49.250978+0000","last_undegraded":"2024-09-14T11:52:49.250978+0000","last_fullsized":"2024-09-14T11:52:49.250978+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:49.250850+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.250850+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:59.097045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":610,"num_read_kb":5636,"num_write":1050,"num_write_kb":29474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.194649+0000","last_change":"2024-09-14T11:53:11.194649+0000","last_active":"2024-09-14T11:53:11.194649+0000","last_peered":"2024-09-14T11:53:11.194649+0000","last_clean":"2024-09-14T11:53:11.194649+0000","last_became_active":"2024-09-14T11:11:08.653046+0000","last_became_peered":"2024-09-14T11:11:08.653046+0000","last_unstale":"2024-09-14T11:53:11.194649+0000","last_undegraded":"2024-09-14T11:53:11.194649+0000","last_fullsized":"2024-09-14T11:53:11.194649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.194559+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.194559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:38.510855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'867","reported_seq":2306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.686128+0000","last_change":"2024-09-14T11:53:11.686128+0000","last_active":"2024-09-14T11:53:11.686128+0000","last_peered":"2024-09-14T11:53:11.686128+0000","last_clean":"2024-09-14T11:53:11.686128+0000","last_became_active":"2024-09-14T11:11:10.667920+0000","last_became_peered":"2024-09-14T11:11:10.667920+0000","last_unstale":"2024-09-14T11:53:11.686128+0000","last_undegraded":"2024-09-14T11:53:11.686128+0000","last_fullsized":"2024-09-14T11:53:11.686128+0000","mapping_epoch":31,"log_start":"263'800","ondisk_log_start":"263'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'867","last_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_deep_scrub":"263'867","last_deep_scrub_stamp":"2024-09-14T11:53:11.686006+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.686006+0000","objects_scrubbed":11,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:43.101195+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20878,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1167,"num_read_kb":1373,"num_write":272,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.287601+0000","last_change":"2024-09-14T11:53:20.287601+0000","last_active":"2024-09-14T11:53:20.287601+0000","last_peered":"2024-09-14T11:53:20.287601+0000","last_clean":"2024-09-14T11:53:20.287601+0000","last_became_active":"2024-09-14T11:11:12.677268+0000","last_became_peered":"2024-09-14T11:11:12.677268+0000","last_unstale":"2024-09-14T11:53:20.287601+0000","last_undegraded":"2024-09-14T11:53:20.287601+0000","last_fullsized":"2024-09-14T11:53:20.287601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.287514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.287514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:06.831683+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'131","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.776959+0000","last_change":"2024-09-14T11:53:18.776959+0000","last_active":"2024-09-14T11:53:18.776959+0000","last_peered":"2024-09-14T11:53:18.776959+0000","last_clean":"2024-09-14T11:53:18.776959+0000","last_became_active":"2024-09-14T11:11:14.883440+0000","last_became_peered":"2024-09-14T11:11:14.883440+0000","last_unstale":"2024-09-14T11:53:18.776959+0000","last_undegraded":"2024-09-14T11:53:18.776959+0000","last_fullsized":"2024-09-14T11:53:18.776959+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-14T11:53:18.776875+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.776875+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:11.227597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":157,"num_read_kb":146,"num_write":318,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'428","reported_seq":1915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.640237+0000","last_change":"2024-09-14T11:52:57.640237+0000","last_active":"2024-09-14T11:52:57.640237+0000","last_peered":"2024-09-14T11:52:57.640237+0000","last_clean":"2024-09-14T11:52:57.640237+0000","last_became_active":"2024-09-14T11:11:06.661105+0000","last_became_peered":"2024-09-14T11:11:06.661105+0000","last_unstale":"2024-09-14T11:52:57.640237+0000","last_undegraded":"2024-09-14T11:52:57.640237+0000","last_fullsized":"2024-09-14T11:52:57.640237+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'428","last_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_deep_scrub":"263'428","last_deep_scrub_stamp":"2024-09-14T11:52:57.640146+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.640146+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:10.948568+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2200,"num_read_kb":2073,"num_write":482,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.657825+0000","last_change":"2024-09-14T11:52:50.657825+0000","last_active":"2024-09-14T11:52:50.657825+0000","last_peered":"2024-09-14T11:52:50.657825+0000","last_clean":"2024-09-14T11:52:50.657825+0000","last_became_active":"2024-09-14T11:10:51.331473+0000","last_became_peered":"2024-09-14T11:10:51.331473+0000","last_unstale":"2024-09-14T11:52:50.657825+0000","last_undegraded":"2024-09-14T11:52:50.657825+0000","last_fullsized":"2024-09-14T11:52:50.657825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:50.657760+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.657760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:14.569819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051673799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'208","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:50.653529+0000","last_change":"2024-09-14T11:52:50.653452+0000","last_active":"2024-09-14T11:52:50.653529+0000","last_peered":"2024-09-14T11:52:50.653529+0000","last_clean":"2024-09-14T11:52:50.653529+0000","last_became_active":"2024-09-14T11:11:04.649912+0000","last_became_peered":"2024-09-14T11:11:04.649912+0000","last_unstale":"2024-09-14T11:52:50.653529+0000","last_undegraded":"2024-09-14T11:52:50.653529+0000","last_fullsized":"2024-09-14T11:52:50.653529+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'208","last_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_deep_scrub":"263'208","last_deep_scrub_stamp":"2024-09-14T11:52:50.653307+0000","last_clean_scrub_stamp":"2024-09-14T11:52:50.653307+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:26.358362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":52749,"num_write":993,"num_write_kb":19914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.580907+0000","last_change":"2024-09-14T11:53:01.580907+0000","last_active":"2024-09-14T11:53:01.580907+0000","last_peered":"2024-09-14T11:53:01.580907+0000","last_clean":"2024-09-14T11:53:01.580907+0000","last_became_active":"2024-09-14T11:11:08.653449+0000","last_became_peered":"2024-09-14T11:11:08.653449+0000","last_unstale":"2024-09-14T11:53:01.580907+0000","last_undegraded":"2024-09-14T11:53:01.580907+0000","last_fullsized":"2024-09-14T11:53:01.580907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:01.580787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.580787+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:28.319926+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'228","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.218442+0000","last_change":"2024-09-14T11:53:16.218442+0000","last_active":"2024-09-14T11:53:16.218442+0000","last_peered":"2024-09-14T11:53:16.218442+0000","last_clean":"2024-09-14T11:53:16.218442+0000","last_became_active":"2024-09-14T11:11:10.885308+0000","last_became_peered":"2024-09-14T11:11:10.885308+0000","last_unstale":"2024-09-14T11:53:16.218442+0000","last_undegraded":"2024-09-14T11:53:16.218442+0000","last_fullsized":"2024-09-14T11:53:16.218442+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:53:16.218353+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.218353+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.126525+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":169,"num_write":145,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.162973+0000","last_change":"2024-09-14T11:53:16.162973+0000","last_active":"2024-09-14T11:53:16.162973+0000","last_peered":"2024-09-14T11:53:16.162973+0000","last_clean":"2024-09-14T11:53:16.162973+0000","last_became_active":"2024-09-14T11:11:12.679197+0000","last_became_peered":"2024-09-14T11:11:12.679197+0000","last_unstale":"2024-09-14T11:53:16.162973+0000","last_undegraded":"2024-09-14T11:53:16.162973+0000","last_fullsized":"2024-09-14T11:53:16.162973+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:16.162891+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.162891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:17.105651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'252","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.090169+0000","last_change":"2024-09-14T11:53:27.090088+0000","last_active":"2024-09-14T11:53:27.090169+0000","last_peered":"2024-09-14T11:53:27.090169+0000","last_clean":"2024-09-14T11:53:27.090169+0000","last_became_active":"2024-09-14T11:11:14.691637+0000","last_became_peered":"2024-09-14T11:11:14.691637+0000","last_unstale":"2024-09-14T11:53:27.090169+0000","last_undegraded":"2024-09-14T11:53:27.090169+0000","last_fullsized":"2024-09-14T11:53:27.090169+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'252","last_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_deep_scrub":"263'252","last_deep_scrub_stamp":"2024-09-14T11:53:27.089965+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.089965+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:34.480113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":481,"num_read_kb":505,"num_write":560,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'460","reported_seq":2053,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.638836+0000","last_change":"2024-09-14T11:52:56.638836+0000","last_active":"2024-09-14T11:52:56.638836+0000","last_peered":"2024-09-14T11:52:56.638836+0000","last_clean":"2024-09-14T11:52:56.638836+0000","last_became_active":"2024-09-14T11:11:06.652207+0000","last_became_peered":"2024-09-14T11:11:06.652207+0000","last_unstale":"2024-09-14T11:52:56.638836+0000","last_undegraded":"2024-09-14T11:52:56.638836+0000","last_fullsized":"2024-09-14T11:52:56.638836+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'460","last_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_deep_scrub":"263'460","last_deep_scrub_stamp":"2024-09-14T11:52:56.638748+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.638748+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:35.929585+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2534,"num_read_kb":2382,"num_write":568,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.023077+0000","last_change":"2024-09-14T11:52:52.023077+0000","last_active":"2024-09-14T11:52:52.023077+0000","last_peered":"2024-09-14T11:52:52.023077+0000","last_clean":"2024-09-14T11:52:52.023077+0000","last_became_active":"2024-09-14T11:10:51.333058+0000","last_became_peered":"2024-09-14T11:10:51.333058+0000","last_unstale":"2024-09-14T11:52:52.023077+0000","last_undegraded":"2024-09-14T11:52:52.023077+0000","last_fullsized":"2024-09-14T11:52:52.023077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:52:52.022923+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.022923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:46.997948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0011515099999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'183","reported_seq":793,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.093157+0000","last_change":"2024-09-14T11:52:52.093157+0000","last_active":"2024-09-14T11:52:52.093157+0000","last_peered":"2024-09-14T11:52:52.093157+0000","last_clean":"2024-09-14T11:52:52.093157+0000","last_became_active":"2024-09-14T11:11:04.651993+0000","last_became_peered":"2024-09-14T11:11:04.651993+0000","last_unstale":"2024-09-14T11:52:52.093157+0000","last_undegraded":"2024-09-14T11:52:52.093157+0000","last_fullsized":"2024-09-14T11:52:52.093157+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'183","last_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_deep_scrub":"263'183","last_deep_scrub_stamp":"2024-09-14T11:52:52.093023+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.093023+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:24.168597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":532,"num_read_kb":11748,"num_write":873,"num_write_kb":36301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.055602+0000","last_change":"2024-09-14T11:53:09.055602+0000","last_active":"2024-09-14T11:53:09.055602+0000","last_peered":"2024-09-14T11:53:09.055602+0000","last_clean":"2024-09-14T11:53:09.055602+0000","last_became_active":"2024-09-14T11:11:08.655965+0000","last_became_peered":"2024-09-14T11:11:08.655965+0000","last_unstale":"2024-09-14T11:53:09.055602+0000","last_undegraded":"2024-09-14T11:53:09.055602+0000","last_fullsized":"2024-09-14T11:53:09.055602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.055524+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.055524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:28.648168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'133","reported_seq":679,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.182260+0000","last_change":"2024-09-14T11:53:14.182260+0000","last_active":"2024-09-14T11:53:14.182260+0000","last_peered":"2024-09-14T11:53:14.182260+0000","last_clean":"2024-09-14T11:53:14.182260+0000","last_became_active":"2024-09-14T11:11:10.667762+0000","last_became_peered":"2024-09-14T11:11:10.667762+0000","last_unstale":"2024-09-14T11:53:14.182260+0000","last_undegraded":"2024-09-14T11:53:14.182260+0000","last_fullsized":"2024-09-14T11:53:14.182260+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:53:14.182169+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.182169+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:42.712494+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":139,"num_read_kb":133,"num_write":98,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.096626+0000","last_change":"2024-09-14T11:53:07.096626+0000","last_active":"2024-09-14T11:53:07.096626+0000","last_peered":"2024-09-14T11:53:07.096626+0000","last_clean":"2024-09-14T11:53:07.096626+0000","last_became_active":"2024-09-14T11:11:12.681599+0000","last_became_peered":"2024-09-14T11:11:12.681599+0000","last_unstale":"2024-09-14T11:53:07.096626+0000","last_undegraded":"2024-09-14T11:53:07.096626+0000","last_fullsized":"2024-09-14T11:53:07.096626+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:07.096502+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.096502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.092367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'147","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:23.402188+0000","last_change":"2024-09-14T11:53:23.402188+0000","last_active":"2024-09-14T11:53:23.402188+0000","last_peered":"2024-09-14T11:53:23.402188+0000","last_clean":"2024-09-14T11:53:23.402188+0000","last_became_active":"2024-09-14T11:11:14.690907+0000","last_became_peered":"2024-09-14T11:11:14.690907+0000","last_unstale":"2024-09-14T11:53:23.402188+0000","last_undegraded":"2024-09-14T11:53:23.402188+0000","last_fullsized":"2024-09-14T11:53:23.402188+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T11:53:23.402102+0000","last_clean_scrub_stamp":"2024-09-14T11:53:23.402102+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:13.285898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":262,"num_write":316,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'755","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.620545+0000","last_change":"2024-09-14T11:52:59.620545+0000","last_active":"2024-09-14T11:52:59.620545+0000","last_peered":"2024-09-14T11:52:59.620545+0000","last_clean":"2024-09-14T11:52:59.620545+0000","last_became_active":"2024-09-14T11:11:06.661057+0000","last_became_peered":"2024-09-14T11:11:06.661057+0000","last_unstale":"2024-09-14T11:52:59.620545+0000","last_undegraded":"2024-09-14T11:52:59.620545+0000","last_fullsized":"2024-09-14T11:52:59.620545+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'755","last_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_deep_scrub":"263'755","last_deep_scrub_stamp":"2024-09-14T11:52:59.620455+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.620455+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:01.069591+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3469,"num_read_kb":3097,"num_write":996,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'230","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.046740+0000","last_change":"2024-09-14T11:52:53.046663+0000","last_active":"2024-09-14T11:52:53.046740+0000","last_peered":"2024-09-14T11:52:53.046740+0000","last_clean":"2024-09-14T11:52:53.046740+0000","last_became_active":"2024-09-14T11:11:04.654360+0000","last_became_peered":"2024-09-14T11:11:04.654360+0000","last_unstale":"2024-09-14T11:52:53.046740+0000","last_undegraded":"2024-09-14T11:52:53.046740+0000","last_fullsized":"2024-09-14T11:52:53.046740+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.046573+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.046573+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:56.461752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":621,"num_read_kb":15435,"num_write":887,"num_write_kb":22315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:49.655319+0000","last_change":"2024-09-14T11:52:49.655319+0000","last_active":"2024-09-14T11:52:49.655319+0000","last_peered":"2024-09-14T11:52:49.655319+0000","last_clean":"2024-09-14T11:52:49.655319+0000","last_became_active":"2024-09-14T11:10:51.332497+0000","last_became_peered":"2024-09-14T11:10:51.332497+0000","last_unstale":"2024-09-14T11:52:49.655319+0000","last_undegraded":"2024-09-14T11:52:49.655319+0000","last_fullsized":"2024-09-14T11:52:49.655319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:49.655243+0000","last_clean_scrub_stamp":"2024-09-14T11:52:49.655243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:56.511174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054992300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.093954+0000","last_change":"2024-09-14T11:53:08.093954+0000","last_active":"2024-09-14T11:53:08.093954+0000","last_peered":"2024-09-14T11:53:08.093954+0000","last_clean":"2024-09-14T11:53:08.093954+0000","last_became_active":"2024-09-14T11:11:08.652847+0000","last_became_peered":"2024-09-14T11:11:08.652847+0000","last_unstale":"2024-09-14T11:53:08.093954+0000","last_undegraded":"2024-09-14T11:53:08.093954+0000","last_fullsized":"2024-09-14T11:53:08.093954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:08.093864+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.093864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:08.707957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'301","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.094345+0000","last_change":"2024-09-14T11:53:11.094245+0000","last_active":"2024-09-14T11:53:11.094345+0000","last_peered":"2024-09-14T11:53:11.094345+0000","last_clean":"2024-09-14T11:53:11.094345+0000","last_became_active":"2024-09-14T11:11:10.669716+0000","last_became_peered":"2024-09-14T11:11:10.669716+0000","last_unstale":"2024-09-14T11:53:11.094345+0000","last_undegraded":"2024-09-14T11:53:11.094345+0000","last_fullsized":"2024-09-14T11:53:11.094345+0000","mapping_epoch":31,"log_start":"260'200","ondisk_log_start":"260'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'301","last_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_deep_scrub":"263'301","last_deep_scrub_stamp":"2024-09-14T11:53:11.094126+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.094126+0000","objects_scrubbed":9,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:08.521028+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24729,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":423,"num_read_kb":619,"num_write":282,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.045776+0000","last_change":"2024-09-14T11:53:21.045776+0000","last_active":"2024-09-14T11:53:21.045776+0000","last_peered":"2024-09-14T11:53:21.045776+0000","last_clean":"2024-09-14T11:53:21.045776+0000","last_became_active":"2024-09-14T11:11:12.678765+0000","last_became_peered":"2024-09-14T11:11:12.678765+0000","last_unstale":"2024-09-14T11:53:21.045776+0000","last_undegraded":"2024-09-14T11:53:21.045776+0000","last_fullsized":"2024-09-14T11:53:21.045776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.045682+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.045682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:44.343493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'214","reported_seq":759,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.181217+0000","last_change":"2024-09-14T11:53:25.181097+0000","last_active":"2024-09-14T11:53:25.181217+0000","last_peered":"2024-09-14T11:53:25.181217+0000","last_clean":"2024-09-14T11:53:25.181217+0000","last_became_active":"2024-09-14T11:11:14.886247+0000","last_became_peered":"2024-09-14T11:11:14.886247+0000","last_unstale":"2024-09-14T11:53:25.181217+0000","last_undegraded":"2024-09-14T11:53:25.181217+0000","last_fullsized":"2024-09-14T11:53:25.181217+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'214","last_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_deep_scrub":"263'214","last_deep_scrub_stamp":"2024-09-14T11:53:25.180991+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.180991+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:20.010846+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":742,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":353,"num_read_kb":305,"num_write":498,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'432","reported_seq":1941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.206365+0000","last_change":"2024-09-14T11:52:59.206365+0000","last_active":"2024-09-14T11:52:59.206365+0000","last_peered":"2024-09-14T11:52:59.206365+0000","last_clean":"2024-09-14T11:52:59.206365+0000","last_became_active":"2024-09-14T11:11:06.654456+0000","last_became_peered":"2024-09-14T11:11:06.654456+0000","last_unstale":"2024-09-14T11:52:59.206365+0000","last_undegraded":"2024-09-14T11:52:59.206365+0000","last_fullsized":"2024-09-14T11:52:59.206365+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-14T11:52:59.206274+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.206274+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:24.686804+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2275,"num_write":552,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'220","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.617381+0000","last_change":"2024-09-14T11:52:52.617381+0000","last_active":"2024-09-14T11:52:52.617381+0000","last_peered":"2024-09-14T11:52:52.617381+0000","last_clean":"2024-09-14T11:52:52.617381+0000","last_became_active":"2024-09-14T11:11:04.642350+0000","last_became_peered":"2024-09-14T11:11:04.642350+0000","last_unstale":"2024-09-14T11:52:52.617381+0000","last_undegraded":"2024-09-14T11:52:52.617381+0000","last_fullsized":"2024-09-14T11:52:52.617381+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:52:52.617251+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.617251+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:22.949283+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":606,"num_read_kb":78521,"num_write":1035,"num_write_kb":46774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.074859+0000","last_change":"2024-09-14T11:52:55.074859+0000","last_active":"2024-09-14T11:52:55.074859+0000","last_peered":"2024-09-14T11:52:55.074859+0000","last_clean":"2024-09-14T11:52:55.074859+0000","last_became_active":"2024-09-14T11:10:51.331145+0000","last_became_peered":"2024-09-14T11:10:51.331145+0000","last_unstale":"2024-09-14T11:52:55.074859+0000","last_undegraded":"2024-09-14T11:52:55.074859+0000","last_fullsized":"2024-09-14T11:52:55.074859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:55.074773+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.074773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:28.397184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00047480500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.051330+0000","last_change":"2024-09-14T11:53:04.051330+0000","last_active":"2024-09-14T11:53:04.051330+0000","last_peered":"2024-09-14T11:53:04.051330+0000","last_clean":"2024-09-14T11:53:04.051330+0000","last_became_active":"2024-09-14T11:11:08.650705+0000","last_became_peered":"2024-09-14T11:11:08.650705+0000","last_unstale":"2024-09-14T11:53:04.051330+0000","last_undegraded":"2024-09-14T11:53:04.051330+0000","last_fullsized":"2024-09-14T11:53:04.051330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:04.051237+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.051237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.225013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'163","reported_seq":726,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.709019+0000","last_change":"2024-09-14T11:53:10.709019+0000","last_active":"2024-09-14T11:53:10.709019+0000","last_peered":"2024-09-14T11:53:10.709019+0000","last_clean":"2024-09-14T11:53:10.709019+0000","last_became_active":"2024-09-14T11:11:10.882880+0000","last_became_peered":"2024-09-14T11:11:10.882880+0000","last_unstale":"2024-09-14T11:53:10.709019+0000","last_undegraded":"2024-09-14T11:53:10.709019+0000","last_fullsized":"2024-09-14T11:53:10.709019+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'163","last_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_deep_scrub":"263'163","last_deep_scrub_stamp":"2024-09-14T11:53:10.708910+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.708910+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:06.343251+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":130,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'804","reported_seq":4898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.425484+0000","last_change":"2024-09-14T11:53:20.425417+0000","last_active":"2024-09-14T11:53:20.425484+0000","last_peered":"2024-09-14T11:53:20.425484+0000","last_clean":"2024-09-14T11:53:20.425484+0000","last_became_active":"2024-09-14T11:11:12.682543+0000","last_became_peered":"2024-09-14T11:11:12.682543+0000","last_unstale":"2024-09-14T11:53:20.425484+0000","last_undegraded":"2024-09-14T11:53:20.425484+0000","last_fullsized":"2024-09-14T11:53:20.425484+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'804","last_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_deep_scrub":"263'804","last_deep_scrub_stamp":"2024-09-14T11:53:20.425325+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.425325+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:54.306099+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'157","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:33.245026+0000","last_change":"2024-09-14T11:53:33.244973+0000","last_active":"2024-09-14T11:53:33.245026+0000","last_peered":"2024-09-14T11:53:33.245026+0000","last_clean":"2024-09-14T11:53:33.245026+0000","last_became_active":"2024-09-14T11:11:14.883409+0000","last_became_peered":"2024-09-14T11:11:14.883409+0000","last_unstale":"2024-09-14T11:53:33.245026+0000","last_undegraded":"2024-09-14T11:53:33.245026+0000","last_fullsized":"2024-09-14T11:53:33.245026+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-14T11:53:33.244901+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-14T11:53:33.244901+0000","last_clean_scrub_stamp":"2024-09-14T11:53:33.244901+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:57.219132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":943,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":255,"num_read_kb":219,"num_write":395,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'342","reported_seq":1716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.566689+0000","last_change":"2024-09-14T11:52:58.566626+0000","last_active":"2024-09-14T11:52:58.566689+0000","last_peered":"2024-09-14T11:52:58.566689+0000","last_clean":"2024-09-14T11:52:58.566689+0000","last_became_active":"2024-09-14T11:11:37.864489+0000","last_became_peered":"2024-09-14T11:11:37.864489+0000","last_unstale":"2024-09-14T11:52:58.566689+0000","last_undegraded":"2024-09-14T11:52:58.566689+0000","last_fullsized":"2024-09-14T11:52:58.566689+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:52:58.566512+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.566512+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:15.609009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1883,"num_read_kb":1797,"num_write":392,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"263'297","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.184746+0000","last_change":"2024-09-14T11:52:55.184746+0000","last_active":"2024-09-14T11:52:55.184746+0000","last_peered":"2024-09-14T11:52:55.184746+0000","last_clean":"2024-09-14T11:52:55.184746+0000","last_became_active":"2024-09-14T11:11:04.646177+0000","last_became_peered":"2024-09-14T11:11:04.646177+0000","last_unstale":"2024-09-14T11:52:55.184746+0000","last_undegraded":"2024-09-14T11:52:55.184746+0000","last_fullsized":"2024-09-14T11:52:55.184746+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'297","last_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_deep_scrub":"263'297","last_deep_scrub_stamp":"2024-09-14T11:52:55.184619+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.184619+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:18:08.242032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079932,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1185,"num_read_kb":53005,"num_write":1239,"num_write_kb":39287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.619046+0000","last_change":"2024-09-14T11:52:51.619046+0000","last_active":"2024-09-14T11:52:51.619046+0000","last_peered":"2024-09-14T11:52:51.619046+0000","last_clean":"2024-09-14T11:52:51.619046+0000","last_became_active":"2024-09-14T11:10:51.331775+0000","last_became_peered":"2024-09-14T11:10:51.331775+0000","last_unstale":"2024-09-14T11:52:51.619046+0000","last_undegraded":"2024-09-14T11:52:51.619046+0000","last_fullsized":"2024-09-14T11:52:51.619046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:51.618977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.618977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:09.050923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047005400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.970888+0000","last_change":"2024-09-14T11:53:10.970888+0000","last_active":"2024-09-14T11:53:10.970888+0000","last_peered":"2024-09-14T11:53:10.970888+0000","last_clean":"2024-09-14T11:53:10.970888+0000","last_became_active":"2024-09-14T11:11:08.648788+0000","last_became_peered":"2024-09-14T11:11:08.648788+0000","last_unstale":"2024-09-14T11:53:10.970888+0000","last_undegraded":"2024-09-14T11:53:10.970888+0000","last_fullsized":"2024-09-14T11:53:10.970888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.970798+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.970798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:12.248353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'114","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.010145+0000","last_change":"2024-09-14T11:53:15.010145+0000","last_active":"2024-09-14T11:53:15.010145+0000","last_peered":"2024-09-14T11:53:15.010145+0000","last_clean":"2024-09-14T11:53:15.010145+0000","last_became_active":"2024-09-14T11:11:10.671016+0000","last_became_peered":"2024-09-14T11:11:10.671016+0000","last_unstale":"2024-09-14T11:53:15.010145+0000","last_undegraded":"2024-09-14T11:53:15.010145+0000","last_fullsized":"2024-09-14T11:53:15.010145+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'114","last_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_deep_scrub":"263'114","last_deep_scrub_stamp":"2024-09-14T11:53:15.010051+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.010051+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:26.337936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'821","reported_seq":4196,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.105578+0000","last_change":"2024-09-14T11:53:25.105578+0000","last_active":"2024-09-14T11:53:25.105578+0000","last_peered":"2024-09-14T11:53:25.105578+0000","last_clean":"2024-09-14T11:53:25.105578+0000","last_became_active":"2024-09-14T11:11:12.678386+0000","last_became_peered":"2024-09-14T11:11:12.678386+0000","last_unstale":"2024-09-14T11:53:25.105578+0000","last_undegraded":"2024-09-14T11:53:25.105578+0000","last_fullsized":"2024-09-14T11:53:25.105578+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'821","last_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_deep_scrub":"263'821","last_deep_scrub_stamp":"2024-09-14T11:53:25.105499+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.105499+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:28.204436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'302","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.148573+0000","last_change":"2024-09-14T11:53:24.148521+0000","last_active":"2024-09-14T11:53:24.148573+0000","last_peered":"2024-09-14T11:53:24.148573+0000","last_clean":"2024-09-14T11:53:24.148573+0000","last_became_active":"2024-09-14T11:11:14.686448+0000","last_became_peered":"2024-09-14T11:11:14.686448+0000","last_unstale":"2024-09-14T11:53:24.148573+0000","last_undegraded":"2024-09-14T11:53:24.148573+0000","last_fullsized":"2024-09-14T11:53:24.148573+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:53:24.148430+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.148430+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:52.508148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":431,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'547","reported_seq":2472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.103069+0000","last_change":"2024-09-14T11:52:55.103069+0000","last_active":"2024-09-14T11:52:55.103069+0000","last_peered":"2024-09-14T11:52:55.103069+0000","last_clean":"2024-09-14T11:52:55.103069+0000","last_became_active":"2024-09-14T11:11:06.654771+0000","last_became_peered":"2024-09-14T11:11:06.654771+0000","last_unstale":"2024-09-14T11:52:55.103069+0000","last_undegraded":"2024-09-14T11:52:55.103069+0000","last_fullsized":"2024-09-14T11:52:55.103069+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'547","last_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_deep_scrub":"263'547","last_deep_scrub_stamp":"2024-09-14T11:52:55.102970+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.102970+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:56.863637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3238,"num_read_kb":3061,"num_write":642,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'207","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.184613+0000","last_change":"2024-09-14T11:52:51.184613+0000","last_active":"2024-09-14T11:52:51.184613+0000","last_peered":"2024-09-14T11:52:51.184613+0000","last_clean":"2024-09-14T11:52:51.184613+0000","last_became_active":"2024-09-14T11:11:04.652929+0000","last_became_peered":"2024-09-14T11:11:04.652929+0000","last_unstale":"2024-09-14T11:52:51.184613+0000","last_undegraded":"2024-09-14T11:52:51.184613+0000","last_fullsized":"2024-09-14T11:52:51.184613+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:52:51.184537+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.184537+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:22.858482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":549,"num_read_kb":59716,"num_write":954,"num_write_kb":34076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.049162+0000","last_change":"2024-09-14T11:52:52.049162+0000","last_active":"2024-09-14T11:52:52.049162+0000","last_peered":"2024-09-14T11:52:52.049162+0000","last_clean":"2024-09-14T11:52:52.049162+0000","last_became_active":"2024-09-14T11:10:51.325586+0000","last_became_peered":"2024-09-14T11:10:51.325586+0000","last_unstale":"2024-09-14T11:52:52.049162+0000","last_undegraded":"2024-09-14T11:52:52.049162+0000","last_fullsized":"2024-09-14T11:52:52.049162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:52:52.049078+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.049078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:46.676372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052571900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.152296+0000","last_change":"2024-09-14T11:53:13.152251+0000","last_active":"2024-09-14T11:53:13.152296+0000","last_peered":"2024-09-14T11:53:13.152296+0000","last_clean":"2024-09-14T11:53:13.152296+0000","last_became_active":"2024-09-14T11:11:08.656036+0000","last_became_peered":"2024-09-14T11:11:08.656036+0000","last_unstale":"2024-09-14T11:53:13.152296+0000","last_undegraded":"2024-09-14T11:53:13.152296+0000","last_fullsized":"2024-09-14T11:53:13.152296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.152189+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.152189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:49.260123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'328","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.175445+0000","last_change":"2024-09-14T11:53:15.175445+0000","last_active":"2024-09-14T11:53:15.175445+0000","last_peered":"2024-09-14T11:53:15.175445+0000","last_clean":"2024-09-14T11:53:15.175445+0000","last_became_active":"2024-09-14T11:11:10.882900+0000","last_became_peered":"2024-09-14T11:11:10.882900+0000","last_unstale":"2024-09-14T11:53:15.175445+0000","last_undegraded":"2024-09-14T11:53:15.175445+0000","last_fullsized":"2024-09-14T11:53:15.175445+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:53:15.175339+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.175339+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:47.661577+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26143,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":468,"num_read_kb":700,"num_write":238,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.156207+0000","last_change":"2024-09-14T11:53:20.156207+0000","last_active":"2024-09-14T11:53:20.156207+0000","last_peered":"2024-09-14T11:53:20.156207+0000","last_clean":"2024-09-14T11:53:20.156207+0000","last_became_active":"2024-09-14T11:11:12.682616+0000","last_became_peered":"2024-09-14T11:11:12.682616+0000","last_unstale":"2024-09-14T11:53:20.156207+0000","last_undegraded":"2024-09-14T11:53:20.156207+0000","last_fullsized":"2024-09-14T11:53:20.156207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.156101+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.156101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:40.870675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'122","reported_seq":618,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.377684+0000","last_change":"2024-09-14T11:53:24.377574+0000","last_active":"2024-09-14T11:53:24.377684+0000","last_peered":"2024-09-14T11:53:24.377684+0000","last_clean":"2024-09-14T11:53:24.377684+0000","last_became_active":"2024-09-14T11:11:14.691284+0000","last_became_peered":"2024-09-14T11:11:14.691284+0000","last_unstale":"2024-09-14T11:53:24.377684+0000","last_undegraded":"2024-09-14T11:53:24.377684+0000","last_fullsized":"2024-09-14T11:53:24.377684+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-14T11:53:24.377480+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.377480+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:39.476878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":108,"num_write":281,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'146","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:28.213746+0000","last_change":"2024-09-14T11:53:28.213746+0000","last_active":"2024-09-14T11:53:28.213746+0000","last_peered":"2024-09-14T11:53:28.213746+0000","last_clean":"2024-09-14T11:53:28.213746+0000","last_became_active":"2024-09-14T11:11:14.690993+0000","last_became_peered":"2024-09-14T11:11:14.690993+0000","last_unstale":"2024-09-14T11:53:28.213746+0000","last_undegraded":"2024-09-14T11:53:28.213746+0000","last_fullsized":"2024-09-14T11:53:28.213746+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:53:28.213666+0000","last_clean_scrub_stamp":"2024-09-14T11:53:28.213666+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:14.633390+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":236,"num_read_kb":228,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'730","reported_seq":2284,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.077001+0000","last_change":"2024-09-14T11:52:59.076916+0000","last_active":"2024-09-14T11:52:59.077001+0000","last_peered":"2024-09-14T11:52:59.077001+0000","last_clean":"2024-09-14T11:52:59.077001+0000","last_became_active":"2024-09-14T11:11:06.653268+0000","last_became_peered":"2024-09-14T11:11:06.653268+0000","last_unstale":"2024-09-14T11:52:59.077001+0000","last_undegraded":"2024-09-14T11:52:59.077001+0000","last_fullsized":"2024-09-14T11:52:59.077001+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'730","last_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_deep_scrub":"263'730","last_deep_scrub_stamp":"2024-09-14T11:52:59.076833+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.076833+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:00.485111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3707,"num_read_kb":3372,"num_write":961,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'234","reported_seq":847,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648650+0000","last_change":"2024-09-14T11:52:54.648589+0000","last_active":"2024-09-14T11:52:54.648650+0000","last_peered":"2024-09-14T11:52:54.648650+0000","last_clean":"2024-09-14T11:52:54.648650+0000","last_became_active":"2024-09-14T11:11:38.680447+0000","last_became_peered":"2024-09-14T11:11:38.680447+0000","last_unstale":"2024-09-14T11:52:54.648650+0000","last_undegraded":"2024-09-14T11:52:54.648650+0000","last_fullsized":"2024-09-14T11:52:54.648650+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'234","last_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_deep_scrub":"263'234","last_deep_scrub_stamp":"2024-09-14T11:52:54.648451+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648451+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:30.438311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":666,"num_read_kb":19030,"num_write":1058,"num_write_kb":32515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,2,6],"acting":[1,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.567001+0000","last_change":"2024-09-14T11:53:06.566908+0000","last_active":"2024-09-14T11:53:06.567001+0000","last_peered":"2024-09-14T11:53:06.567001+0000","last_clean":"2024-09-14T11:53:06.567001+0000","last_became_active":"2024-09-14T11:11:08.652722+0000","last_became_peered":"2024-09-14T11:11:08.652722+0000","last_unstale":"2024-09-14T11:53:06.567001+0000","last_undegraded":"2024-09-14T11:53:06.567001+0000","last_fullsized":"2024-09-14T11:53:06.567001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:06.566787+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.566787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:22.611301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'145","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.177257+0000","last_change":"2024-09-14T11:53:15.177257+0000","last_active":"2024-09-14T11:53:15.177257+0000","last_peered":"2024-09-14T11:53:15.177257+0000","last_clean":"2024-09-14T11:53:15.177257+0000","last_became_active":"2024-09-14T11:11:10.670528+0000","last_became_peered":"2024-09-14T11:11:10.670528+0000","last_unstale":"2024-09-14T11:53:15.177257+0000","last_undegraded":"2024-09-14T11:53:15.177257+0000","last_fullsized":"2024-09-14T11:53:15.177257+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:53:15.177164+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.177164+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:23.136369+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.099503+0000","last_change":"2024-09-14T11:53:24.099503+0000","last_active":"2024-09-14T11:53:24.099503+0000","last_peered":"2024-09-14T11:53:24.099503+0000","last_clean":"2024-09-14T11:53:24.099503+0000","last_became_active":"2024-09-14T11:11:12.679538+0000","last_became_peered":"2024-09-14T11:11:12.679538+0000","last_unstale":"2024-09-14T11:53:24.099503+0000","last_undegraded":"2024-09-14T11:53:24.099503+0000","last_fullsized":"2024-09-14T11:53:24.099503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:24.099423+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.099423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:22.546626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'147","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:34.197477+0000","last_change":"2024-09-14T11:53:34.197477+0000","last_active":"2024-09-14T11:53:34.197477+0000","last_peered":"2024-09-14T11:53:34.197477+0000","last_clean":"2024-09-14T11:53:34.197477+0000","last_became_active":"2024-09-14T11:11:14.690187+0000","last_became_peered":"2024-09-14T11:11:14.690187+0000","last_unstale":"2024-09-14T11:53:34.197477+0000","last_undegraded":"2024-09-14T11:53:34.197477+0000","last_fullsized":"2024-09-14T11:53:34.197477+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-14T11:53:34.197397+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-14T11:53:34.197397+0000","last_clean_scrub_stamp":"2024-09-14T11:53:34.197397+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:22.083165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":126,"num_write":351,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'714","reported_seq":2088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.612425+0000","last_change":"2024-09-14T11:53:02.612361+0000","last_active":"2024-09-14T11:53:02.612425+0000","last_peered":"2024-09-14T11:53:02.612425+0000","last_clean":"2024-09-14T11:53:02.612425+0000","last_became_active":"2024-09-14T11:11:06.656343+0000","last_became_peered":"2024-09-14T11:11:06.656343+0000","last_unstale":"2024-09-14T11:53:02.612425+0000","last_undegraded":"2024-09-14T11:53:02.612425+0000","last_fullsized":"2024-09-14T11:53:02.612425+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'714","last_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_deep_scrub":"263'714","last_deep_scrub_stamp":"2024-09-14T11:53:02.612273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.612273+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:14.047702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3303,"num_read_kb":2962,"num_write":932,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'188","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.133662+0000","last_change":"2024-09-14T11:53:02.133662+0000","last_active":"2024-09-14T11:53:02.133662+0000","last_peered":"2024-09-14T11:53:02.133662+0000","last_clean":"2024-09-14T11:53:02.133662+0000","last_became_active":"2024-09-14T11:11:04.662276+0000","last_became_peered":"2024-09-14T11:11:04.662276+0000","last_unstale":"2024-09-14T11:53:02.133662+0000","last_undegraded":"2024-09-14T11:53:02.133662+0000","last_fullsized":"2024-09-14T11:53:02.133662+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'188","last_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_deep_scrub":"263'188","last_deep_scrub_stamp":"2024-09-14T11:53:02.133543+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.133543+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:44.205392+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":463,"num_read_kb":26239,"num_write":895,"num_write_kb":27135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.095817+0000","last_change":"2024-09-14T11:53:11.095817+0000","last_active":"2024-09-14T11:53:11.095817+0000","last_peered":"2024-09-14T11:53:11.095817+0000","last_clean":"2024-09-14T11:53:11.095817+0000","last_became_active":"2024-09-14T11:11:08.648906+0000","last_became_peered":"2024-09-14T11:11:08.648906+0000","last_unstale":"2024-09-14T11:53:11.095817+0000","last_undegraded":"2024-09-14T11:53:11.095817+0000","last_fullsized":"2024-09-14T11:53:11.095817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.095748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.095748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:44.339265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'56","reported_seq":560,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.134541+0000","last_change":"2024-09-14T11:53:13.134495+0000","last_active":"2024-09-14T11:53:13.134541+0000","last_peered":"2024-09-14T11:53:13.134541+0000","last_clean":"2024-09-14T11:53:13.134541+0000","last_became_active":"2024-09-14T11:11:10.669008+0000","last_became_peered":"2024-09-14T11:11:10.669008+0000","last_unstale":"2024-09-14T11:53:13.134541+0000","last_undegraded":"2024-09-14T11:53:13.134541+0000","last_fullsized":"2024-09-14T11:53:13.134541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'56","last_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_deep_scrub":"263'56","last_deep_scrub_stamp":"2024-09-14T11:53:13.134433+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.134433+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:17.922011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.276886+0000","last_change":"2024-09-14T11:53:22.276886+0000","last_active":"2024-09-14T11:53:22.276886+0000","last_peered":"2024-09-14T11:53:22.276886+0000","last_clean":"2024-09-14T11:53:22.276886+0000","last_became_active":"2024-09-14T11:11:12.679850+0000","last_became_peered":"2024-09-14T11:11:12.679850+0000","last_unstale":"2024-09-14T11:53:22.276886+0000","last_undegraded":"2024-09-14T11:53:22.276886+0000","last_fullsized":"2024-09-14T11:53:22.276886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.276785+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.276785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:00.923129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'196","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.178319+0000","last_change":"2024-09-14T11:53:27.178248+0000","last_active":"2024-09-14T11:53:27.178319+0000","last_peered":"2024-09-14T11:53:27.178319+0000","last_clean":"2024-09-14T11:53:27.178319+0000","last_became_active":"2024-09-14T11:11:14.692163+0000","last_became_peered":"2024-09-14T11:11:14.692163+0000","last_unstale":"2024-09-14T11:53:27.178319+0000","last_undegraded":"2024-09-14T11:53:27.178319+0000","last_fullsized":"2024-09-14T11:53:27.178319+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:53:27.178165+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.178165+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:20.272802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":295,"num_read_kb":287,"num_write":440,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'490","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.224894+0000","last_change":"2024-09-14T11:53:03.224838+0000","last_active":"2024-09-14T11:53:03.224894+0000","last_peered":"2024-09-14T11:53:03.224894+0000","last_clean":"2024-09-14T11:53:03.224894+0000","last_became_active":"2024-09-14T11:11:06.655987+0000","last_became_peered":"2024-09-14T11:11:06.655987+0000","last_unstale":"2024-09-14T11:53:03.224894+0000","last_undegraded":"2024-09-14T11:53:03.224894+0000","last_fullsized":"2024-09-14T11:53:03.224894+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'490","last_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_deep_scrub":"263'490","last_deep_scrub_stamp":"2024-09-14T11:53:03.224751+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.224751+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:34.212444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2599,"num_read_kb":2394,"num_write":612,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1335,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'205","reported_seq":827,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.109079+0000","last_change":"2024-09-14T11:52:56.109079+0000","last_active":"2024-09-14T11:52:56.109079+0000","last_peered":"2024-09-14T11:52:56.109079+0000","last_clean":"2024-09-14T11:52:56.109079+0000","last_became_active":"2024-09-14T11:11:04.660884+0000","last_became_peered":"2024-09-14T11:11:04.660884+0000","last_unstale":"2024-09-14T11:52:56.109079+0000","last_undegraded":"2024-09-14T11:52:56.109079+0000","last_fullsized":"2024-09-14T11:52:56.109079+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'205","last_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_deep_scrub":"263'205","last_deep_scrub_stamp":"2024-09-14T11:52:56.108961+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.108961+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:38.858667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":474,"num_read_kb":67081,"num_write":927,"num_write_kb":33654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.152240+0000","last_change":"2024-09-14T11:53:12.152240+0000","last_active":"2024-09-14T11:53:12.152240+0000","last_peered":"2024-09-14T11:53:12.152240+0000","last_clean":"2024-09-14T11:53:12.152240+0000","last_became_active":"2024-09-14T11:11:08.654007+0000","last_became_peered":"2024-09-14T11:11:08.654007+0000","last_unstale":"2024-09-14T11:53:12.152240+0000","last_undegraded":"2024-09-14T11:53:12.152240+0000","last_fullsized":"2024-09-14T11:53:12.152240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.152139+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.152139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:42.429598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'167","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.162673+0000","last_change":"2024-09-14T11:53:21.162673+0000","last_active":"2024-09-14T11:53:21.162673+0000","last_peered":"2024-09-14T11:53:21.162673+0000","last_clean":"2024-09-14T11:53:21.162673+0000","last_became_active":"2024-09-14T11:11:10.671741+0000","last_became_peered":"2024-09-14T11:11:10.671741+0000","last_unstale":"2024-09-14T11:53:21.162673+0000","last_undegraded":"2024-09-14T11:53:21.162673+0000","last_fullsized":"2024-09-14T11:53:21.162673+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'167","last_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_deep_scrub":"263'167","last_deep_scrub_stamp":"2024-09-14T11:53:21.162567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.162567+0000","objects_scrubbed":5,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:31.657212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":278,"num_write":116,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.083218+0000","last_change":"2024-09-14T11:53:10.083150+0000","last_active":"2024-09-14T11:53:10.083218+0000","last_peered":"2024-09-14T11:53:10.083218+0000","last_clean":"2024-09-14T11:53:10.083218+0000","last_became_active":"2024-09-14T11:11:12.680656+0000","last_became_peered":"2024-09-14T11:11:12.680656+0000","last_unstale":"2024-09-14T11:53:10.083218+0000","last_undegraded":"2024-09-14T11:53:10.083218+0000","last_fullsized":"2024-09-14T11:53:10.083218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.083034+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.083034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:32:04.878196+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'160","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.350996+0000","last_change":"2024-09-14T11:53:27.350930+0000","last_active":"2024-09-14T11:53:27.350996+0000","last_peered":"2024-09-14T11:53:27.350996+0000","last_clean":"2024-09-14T11:53:27.350996+0000","last_became_active":"2024-09-14T11:11:14.690384+0000","last_became_peered":"2024-09-14T11:11:14.690384+0000","last_unstale":"2024-09-14T11:53:27.350996+0000","last_undegraded":"2024-09-14T11:53:27.350996+0000","last_fullsized":"2024-09-14T11:53:27.350996+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'160","last_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_deep_scrub":"263'160","last_deep_scrub_stamp":"2024-09-14T11:53:27.350845+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.350845+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:40.944695+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":179,"num_read_kb":173,"num_write":387,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'1180","reported_seq":2930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.193367+0000","last_change":"2024-09-14T11:53:02.193307+0000","last_active":"2024-09-14T11:53:02.193367+0000","last_peered":"2024-09-14T11:53:02.193367+0000","last_clean":"2024-09-14T11:53:02.193367+0000","last_became_active":"2024-09-14T11:11:06.652033+0000","last_became_peered":"2024-09-14T11:11:06.652033+0000","last_unstale":"2024-09-14T11:53:02.193367+0000","last_undegraded":"2024-09-14T11:53:02.193367+0000","last_fullsized":"2024-09-14T11:53:02.193367+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1180","last_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_deep_scrub":"263'1180","last_deep_scrub_stamp":"2024-09-14T11:53:02.193183+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.193183+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":1100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:52.922671+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5510,"num_read_kb":4908,"num_write":1594,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'190","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.177272+0000","last_change":"2024-09-14T11:52:52.177272+0000","last_active":"2024-09-14T11:52:52.177272+0000","last_peered":"2024-09-14T11:52:52.177272+0000","last_clean":"2024-09-14T11:52:52.177272+0000","last_became_active":"2024-09-14T11:11:04.662830+0000","last_became_peered":"2024-09-14T11:11:04.662830+0000","last_unstale":"2024-09-14T11:52:52.177272+0000","last_undegraded":"2024-09-14T11:52:52.177272+0000","last_fullsized":"2024-09-14T11:52:52.177272+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-14T11:52:52.177191+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.177191+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:25.347583+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":487,"num_read_kb":13209,"num_write":830,"num_write_kb":32927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.059077+0000","last_change":"2024-09-14T11:53:05.059021+0000","last_active":"2024-09-14T11:53:05.059077+0000","last_peered":"2024-09-14T11:53:05.059077+0000","last_clean":"2024-09-14T11:53:05.059077+0000","last_became_active":"2024-09-14T11:11:08.653305+0000","last_became_peered":"2024-09-14T11:11:08.653305+0000","last_unstale":"2024-09-14T11:53:05.059077+0000","last_undegraded":"2024-09-14T11:53:05.059077+0000","last_fullsized":"2024-09-14T11:53:05.059077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:05.058935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.058935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:10.616585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'128","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.283758+0000","last_change":"2024-09-14T11:53:18.283758+0000","last_active":"2024-09-14T11:53:18.283758+0000","last_peered":"2024-09-14T11:53:18.283758+0000","last_clean":"2024-09-14T11:53:18.283758+0000","last_became_active":"2024-09-14T11:11:10.670552+0000","last_became_peered":"2024-09-14T11:11:10.670552+0000","last_unstale":"2024-09-14T11:53:18.283758+0000","last_undegraded":"2024-09-14T11:53:18.283758+0000","last_fullsized":"2024-09-14T11:53:18.283758+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'128","last_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_deep_scrub":"263'128","last_deep_scrub_stamp":"2024-09-14T11:53:18.283644+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.283644+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:20.993861+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":157,"num_read_kb":210,"num_write":80,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.167421+0000","last_change":"2024-09-14T11:53:18.167421+0000","last_active":"2024-09-14T11:53:18.167421+0000","last_peered":"2024-09-14T11:53:18.167421+0000","last_clean":"2024-09-14T11:53:18.167421+0000","last_became_active":"2024-09-14T11:11:12.682057+0000","last_became_peered":"2024-09-14T11:11:12.682057+0000","last_unstale":"2024-09-14T11:53:18.167421+0000","last_undegraded":"2024-09-14T11:53:18.167421+0000","last_fullsized":"2024-09-14T11:53:18.167421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:18.167336+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.167336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:49.069995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'1630","reported_seq":3338,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.020929+0000","last_change":"2024-09-14T11:53:00.020929+0000","last_active":"2024-09-14T11:53:00.020929+0000","last_peered":"2024-09-14T11:53:00.020929+0000","last_clean":"2024-09-14T11:53:00.020929+0000","last_became_active":"2024-09-14T11:11:06.654023+0000","last_became_peered":"2024-09-14T11:11:06.654023+0000","last_unstale":"2024-09-14T11:53:00.020929+0000","last_undegraded":"2024-09-14T11:53:00.020929+0000","last_fullsized":"2024-09-14T11:53:00.020929+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1630","last_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_deep_scrub":"263'1630","last_deep_scrub_stamp":"2024-09-14T11:53:00.020831+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.020831+0000","objects_scrubbed":3,"log_size":30,"log_dups_size":1600,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:01.658072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7376,"num_read_kb":6431,"num_write":2311,"num_write_kb":1033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'230","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.223218+0000","last_change":"2024-09-14T11:52:54.223218+0000","last_active":"2024-09-14T11:52:54.223218+0000","last_peered":"2024-09-14T11:52:54.223218+0000","last_clean":"2024-09-14T11:52:54.223218+0000","last_became_active":"2024-09-14T11:11:04.645066+0000","last_became_peered":"2024-09-14T11:11:04.645066+0000","last_unstale":"2024-09-14T11:52:54.223218+0000","last_undegraded":"2024-09-14T11:52:54.223218+0000","last_fullsized":"2024-09-14T11:52:54.223218+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.223086+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.223086+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:16.621473+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190240,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":575,"num_read_kb":62996,"num_write":1114,"num_write_kb":37749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.072476+0000","last_change":"2024-09-14T11:53:10.072366+0000","last_active":"2024-09-14T11:53:10.072476+0000","last_peered":"2024-09-14T11:53:10.072476+0000","last_clean":"2024-09-14T11:53:10.072476+0000","last_became_active":"2024-09-14T11:11:08.650702+0000","last_became_peered":"2024-09-14T11:11:08.650702+0000","last_unstale":"2024-09-14T11:53:10.072476+0000","last_undegraded":"2024-09-14T11:53:10.072476+0000","last_fullsized":"2024-09-14T11:53:10.072476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:10.072273+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.072273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:59:53.959740+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'212","reported_seq":840,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.646851+0000","last_change":"2024-09-14T11:53:12.646754+0000","last_active":"2024-09-14T11:53:12.646851+0000","last_peered":"2024-09-14T11:53:12.646851+0000","last_clean":"2024-09-14T11:53:12.646851+0000","last_became_active":"2024-09-14T11:11:10.669689+0000","last_became_peered":"2024-09-14T11:11:10.669689+0000","last_unstale":"2024-09-14T11:53:12.646851+0000","last_undegraded":"2024-09-14T11:53:12.646851+0000","last_fullsized":"2024-09-14T11:53:12.646851+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'212","last_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_deep_scrub":"263'212","last_deep_scrub_stamp":"2024-09-14T11:53:12.646643+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.646643+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:18.251475+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22265,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":490,"num_write":204,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.429725+0000","last_change":"2024-09-14T11:53:21.429630+0000","last_active":"2024-09-14T11:53:21.429725+0000","last_peered":"2024-09-14T11:53:21.429725+0000","last_clean":"2024-09-14T11:53:21.429725+0000","last_became_active":"2024-09-14T11:11:12.682852+0000","last_became_peered":"2024-09-14T11:11:12.682852+0000","last_unstale":"2024-09-14T11:53:21.429725+0000","last_undegraded":"2024-09-14T11:53:21.429725+0000","last_fullsized":"2024-09-14T11:53:21.429725+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:21.429514+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.429514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:02.974268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'166","reported_seq":684,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:29.136731+0000","last_change":"2024-09-14T11:53:29.136731+0000","last_active":"2024-09-14T11:53:29.136731+0000","last_peered":"2024-09-14T11:53:29.136731+0000","last_clean":"2024-09-14T11:53:29.136731+0000","last_became_active":"2024-09-14T11:11:14.886182+0000","last_became_peered":"2024-09-14T11:11:14.886182+0000","last_unstale":"2024-09-14T11:53:29.136731+0000","last_undegraded":"2024-09-14T11:53:29.136731+0000","last_fullsized":"2024-09-14T11:53:29.136731+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'166","last_scrub_stamp":"2024-09-14T11:53:29.136643+0000","last_deep_scrub":"263'166","last_deep_scrub_stamp":"2024-09-14T11:53:29.136643+0000","last_clean_scrub_stamp":"2024-09-14T11:53:29.136643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:48.253911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":226,"num_read_kb":226,"num_write":375,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'426","reported_seq":2040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.118762+0000","last_change":"2024-09-14T11:53:03.118696+0000","last_active":"2024-09-14T11:53:03.118762+0000","last_peered":"2024-09-14T11:53:03.118762+0000","last_clean":"2024-09-14T11:53:03.118762+0000","last_became_active":"2024-09-14T11:11:06.650622+0000","last_became_peered":"2024-09-14T11:11:06.650622+0000","last_unstale":"2024-09-14T11:53:03.118762+0000","last_undegraded":"2024-09-14T11:53:03.118762+0000","last_fullsized":"2024-09-14T11:53:03.118762+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:53:03.118613+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.118613+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:08.478029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2336,"num_read_kb":2238,"num_write":479,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'181","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.646490+0000","last_change":"2024-09-14T11:52:58.646490+0000","last_active":"2024-09-14T11:52:58.646490+0000","last_peered":"2024-09-14T11:52:58.646490+0000","last_clean":"2024-09-14T11:52:58.646490+0000","last_became_active":"2024-09-14T11:11:04.649848+0000","last_became_peered":"2024-09-14T11:11:04.649848+0000","last_unstale":"2024-09-14T11:52:58.646490+0000","last_undegraded":"2024-09-14T11:52:58.646490+0000","last_fullsized":"2024-09-14T11:52:58.646490+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'181","last_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_deep_scrub":"263'181","last_deep_scrub_stamp":"2024-09-14T11:52:58.646391+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.646391+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:28.666065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":457,"num_read_kb":12441,"num_write":906,"num_write_kb":22568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"263'5","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.108231+0000","last_change":"2024-09-14T11:53:06.108231+0000","last_active":"2024-09-14T11:53:06.108231+0000","last_peered":"2024-09-14T11:53:06.108231+0000","last_clean":"2024-09-14T11:53:06.108231+0000","last_became_active":"2024-09-14T11:11:08.653102+0000","last_became_peered":"2024-09-14T11:11:08.653102+0000","last_unstale":"2024-09-14T11:53:06.108231+0000","last_undegraded":"2024-09-14T11:53:06.108231+0000","last_fullsized":"2024-09-14T11:53:06.108231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:53:06.108140+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.108140+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:42.873671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":1194,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'171","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:21.305984+0000","last_change":"2024-09-14T11:53:21.305912+0000","last_active":"2024-09-14T11:53:21.305984+0000","last_peered":"2024-09-14T11:53:21.305984+0000","last_clean":"2024-09-14T11:53:21.305984+0000","last_became_active":"2024-09-14T11:11:10.668504+0000","last_became_peered":"2024-09-14T11:11:10.668504+0000","last_unstale":"2024-09-14T11:53:21.305984+0000","last_undegraded":"2024-09-14T11:53:21.305984+0000","last_fullsized":"2024-09-14T11:53:21.305984+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:53:21.305812+0000","last_clean_scrub_stamp":"2024-09-14T11:53:21.305812+0000","objects_scrubbed":8,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:16.144405+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9714,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":303,"num_write":148,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:13.665685+0000","last_change":"2024-09-14T11:53:13.665636+0000","last_active":"2024-09-14T11:53:13.665685+0000","last_peered":"2024-09-14T11:53:13.665685+0000","last_clean":"2024-09-14T11:53:13.665685+0000","last_became_active":"2024-09-14T11:11:12.680699+0000","last_became_peered":"2024-09-14T11:11:12.680699+0000","last_unstale":"2024-09-14T11:53:13.665685+0000","last_undegraded":"2024-09-14T11:53:13.665685+0000","last_fullsized":"2024-09-14T11:53:13.665685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:13.665547+0000","last_clean_scrub_stamp":"2024-09-14T11:53:13.665547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:32:19.013303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'179","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.158325+0000","last_change":"2024-09-14T11:53:14.158325+0000","last_active":"2024-09-14T11:53:14.158325+0000","last_peered":"2024-09-14T11:53:14.158325+0000","last_clean":"2024-09-14T11:53:14.158325+0000","last_became_active":"2024-09-14T11:11:14.689900+0000","last_became_peered":"2024-09-14T11:11:14.689900+0000","last_unstale":"2024-09-14T11:53:14.158325+0000","last_undegraded":"2024-09-14T11:53:14.158325+0000","last_fullsized":"2024-09-14T11:53:14.158325+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:53:14.158221+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.158221+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:36.491282+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1821,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":311,"num_write":524,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'378","reported_seq":1791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.177685+0000","last_change":"2024-09-14T11:53:07.177623+0000","last_active":"2024-09-14T11:53:07.177685+0000","last_peered":"2024-09-14T11:53:07.177685+0000","last_clean":"2024-09-14T11:53:07.177685+0000","last_became_active":"2024-09-14T11:11:06.650871+0000","last_became_peered":"2024-09-14T11:11:06.650871+0000","last_unstale":"2024-09-14T11:53:07.177685+0000","last_undegraded":"2024-09-14T11:53:07.177685+0000","last_fullsized":"2024-09-14T11:53:07.177685+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-14T11:53:07.177534+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.177534+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:21.980111+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1980,"num_read_kb":1872,"num_write":419,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'245","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:51.133728+0000","last_change":"2024-09-14T11:52:51.133645+0000","last_active":"2024-09-14T11:52:51.133728+0000","last_peered":"2024-09-14T11:52:51.133728+0000","last_clean":"2024-09-14T11:52:51.133728+0000","last_became_active":"2024-09-14T11:11:04.647586+0000","last_became_peered":"2024-09-14T11:11:04.647586+0000","last_unstale":"2024-09-14T11:52:51.133728+0000","last_undegraded":"2024-09-14T11:52:51.133728+0000","last_fullsized":"2024-09-14T11:52:51.133728+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'245","last_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_deep_scrub":"263'245","last_deep_scrub_stamp":"2024-09-14T11:52:51.133522+0000","last_clean_scrub_stamp":"2024-09-14T11:52:51.133522+0000","objects_scrubbed":5,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:30:35.776995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":23729,"num_write":1071,"num_write_kb":35459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.020228+0000","last_change":"2024-09-14T11:53:14.020147+0000","last_active":"2024-09-14T11:53:14.020228+0000","last_peered":"2024-09-14T11:53:14.020228+0000","last_clean":"2024-09-14T11:53:14.020228+0000","last_became_active":"2024-09-14T11:11:08.651505+0000","last_became_peered":"2024-09-14T11:11:08.651505+0000","last_unstale":"2024-09-14T11:53:14.020228+0000","last_undegraded":"2024-09-14T11:53:14.020228+0000","last_fullsized":"2024-09-14T11:53:14.020228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.020037+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.020037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:43.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'151","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.179369+0000","last_change":"2024-09-14T11:53:18.179369+0000","last_active":"2024-09-14T11:53:18.179369+0000","last_peered":"2024-09-14T11:53:18.179369+0000","last_clean":"2024-09-14T11:53:18.179369+0000","last_became_active":"2024-09-14T11:11:10.882869+0000","last_became_peered":"2024-09-14T11:11:10.882869+0000","last_unstale":"2024-09-14T11:53:18.179369+0000","last_undegraded":"2024-09-14T11:53:18.179369+0000","last_fullsized":"2024-09-14T11:53:18.179369+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-14T11:53:18.179285+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.179285+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:06.813662+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33350,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":317,"num_write":100,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.692287+0000","last_change":"2024-09-14T11:53:14.692236+0000","last_active":"2024-09-14T11:53:14.692287+0000","last_peered":"2024-09-14T11:53:14.692287+0000","last_clean":"2024-09-14T11:53:14.692287+0000","last_became_active":"2024-09-14T11:11:12.681179+0000","last_became_peered":"2024-09-14T11:11:12.681179+0000","last_unstale":"2024-09-14T11:53:14.692287+0000","last_undegraded":"2024-09-14T11:53:14.692287+0000","last_fullsized":"2024-09-14T11:53:14.692287+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.692150+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.692150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:07.310954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'125","reported_seq":617,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.376629+0000","last_change":"2024-09-14T11:53:25.376629+0000","last_active":"2024-09-14T11:53:25.376629+0000","last_peered":"2024-09-14T11:53:25.376629+0000","last_clean":"2024-09-14T11:53:25.376629+0000","last_became_active":"2024-09-14T11:11:14.691415+0000","last_became_peered":"2024-09-14T11:11:14.691415+0000","last_unstale":"2024-09-14T11:53:25.376629+0000","last_undegraded":"2024-09-14T11:53:25.376629+0000","last_fullsized":"2024-09-14T11:53:25.376629+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'125","last_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_deep_scrub":"263'125","last_deep_scrub_stamp":"2024-09-14T11:53:25.376525+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.376525+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:48.017199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":104,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'482","reported_seq":2285,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.573625+0000","last_change":"2024-09-14T11:52:59.573570+0000","last_active":"2024-09-14T11:52:59.573625+0000","last_peered":"2024-09-14T11:52:59.573625+0000","last_clean":"2024-09-14T11:52:59.573625+0000","last_became_active":"2024-09-14T11:11:37.748208+0000","last_became_peered":"2024-09-14T11:11:37.748208+0000","last_unstale":"2024-09-14T11:52:59.573625+0000","last_undegraded":"2024-09-14T11:52:59.573625+0000","last_fullsized":"2024-09-14T11:52:59.573625+0000","mapping_epoch":38,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'482","last_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_deep_scrub":"263'482","last_deep_scrub_stamp":"2024-09-14T11:52:59.573481+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.573481+0000","objects_scrubbed":2,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:46.583273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2742,"num_read_kb":2618,"num_write":547,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'294","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.166128+0000","last_change":"2024-09-14T11:52:53.166071+0000","last_active":"2024-09-14T11:52:53.166128+0000","last_peered":"2024-09-14T11:52:53.166128+0000","last_clean":"2024-09-14T11:52:53.166128+0000","last_became_active":"2024-09-14T11:11:04.649406+0000","last_became_peered":"2024-09-14T11:11:04.649406+0000","last_unstale":"2024-09-14T11:52:53.166128+0000","last_undegraded":"2024-09-14T11:52:53.166128+0000","last_fullsized":"2024-09-14T11:52:53.166128+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:52:53.165977+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.165977+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:14.077350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079916,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":821,"num_read_kb":27323,"num_write":1074,"num_write_kb":45167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.659560+0000","last_change":"2024-09-14T11:53:09.659489+0000","last_active":"2024-09-14T11:53:09.659560+0000","last_peered":"2024-09-14T11:53:09.659560+0000","last_clean":"2024-09-14T11:53:09.659560+0000","last_became_active":"2024-09-14T11:11:08.657466+0000","last_became_peered":"2024-09-14T11:11:08.657466+0000","last_unstale":"2024-09-14T11:53:09.659560+0000","last_undegraded":"2024-09-14T11:53:09.659560+0000","last_fullsized":"2024-09-14T11:53:09.659560+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:09.659406+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.659406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:21.088615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'76","reported_seq":597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:19.011688+0000","last_change":"2024-09-14T11:53:19.011688+0000","last_active":"2024-09-14T11:53:19.011688+0000","last_peered":"2024-09-14T11:53:19.011688+0000","last_clean":"2024-09-14T11:53:19.011688+0000","last_became_active":"2024-09-14T11:11:10.882946+0000","last_became_peered":"2024-09-14T11:11:10.882946+0000","last_unstale":"2024-09-14T11:53:19.011688+0000","last_undegraded":"2024-09-14T11:53:19.011688+0000","last_fullsized":"2024-09-14T11:53:19.011688+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'76","last_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_deep_scrub":"263'76","last_deep_scrub_stamp":"2024-09-14T11:53:19.011587+0000","last_clean_scrub_stamp":"2024-09-14T11:53:19.011587+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:38:34.369755+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":79,"num_read_kb":74,"num_write":58,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2333,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.136517+0000","last_change":"2024-09-14T11:53:12.136517+0000","last_active":"2024-09-14T11:53:12.136517+0000","last_peered":"2024-09-14T11:53:12.136517+0000","last_clean":"2024-09-14T11:53:12.136517+0000","last_became_active":"2024-09-14T11:11:12.679268+0000","last_became_peered":"2024-09-14T11:11:12.679268+0000","last_unstale":"2024-09-14T11:53:12.136517+0000","last_undegraded":"2024-09-14T11:53:12.136517+0000","last_fullsized":"2024-09-14T11:53:12.136517+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-14T11:53:12.136418+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.136418+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:50.248965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'104","reported_seq":598,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:25.303133+0000","last_change":"2024-09-14T11:53:25.303133+0000","last_active":"2024-09-14T11:53:25.303133+0000","last_peered":"2024-09-14T11:53:25.303133+0000","last_clean":"2024-09-14T11:53:25.303133+0000","last_became_active":"2024-09-14T11:11:14.692979+0000","last_became_peered":"2024-09-14T11:11:14.692979+0000","last_unstale":"2024-09-14T11:53:25.303133+0000","last_undegraded":"2024-09-14T11:53:25.303133+0000","last_fullsized":"2024-09-14T11:53:25.303133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'104","last_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_deep_scrub":"263'104","last_deep_scrub_stamp":"2024-09-14T11:53:25.303031+0000","last_clean_scrub_stamp":"2024-09-14T11:53:25.303031+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:08.353469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":94,"num_write":238,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'1013","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.967467+0000","last_change":"2024-09-14T11:53:02.967406+0000","last_active":"2024-09-14T11:53:02.967467+0000","last_peered":"2024-09-14T11:53:02.967467+0000","last_clean":"2024-09-14T11:53:02.967467+0000","last_became_active":"2024-09-14T11:11:06.651411+0000","last_became_peered":"2024-09-14T11:11:06.651411+0000","last_unstale":"2024-09-14T11:53:02.967467+0000","last_undegraded":"2024-09-14T11:53:02.967467+0000","last_fullsized":"2024-09-14T11:53:02.967467+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1013","last_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_deep_scrub":"263'1013","last_deep_scrub_stamp":"2024-09-14T11:53:02.967314+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.967314+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1000,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:15.598856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7277,"num_read_kb":6770,"num_write":1596,"num_write_kb":681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'216","reported_seq":836,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.111255+0000","last_change":"2024-09-14T11:52:57.111172+0000","last_active":"2024-09-14T11:52:57.111255+0000","last_peered":"2024-09-14T11:52:57.111255+0000","last_clean":"2024-09-14T11:52:57.111255+0000","last_became_active":"2024-09-14T11:11:04.660936+0000","last_became_peered":"2024-09-14T11:11:04.660936+0000","last_unstale":"2024-09-14T11:52:57.111255+0000","last_undegraded":"2024-09-14T11:52:57.111255+0000","last_fullsized":"2024-09-14T11:52:57.111255+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'216","last_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_deep_scrub":"263'216","last_deep_scrub_stamp":"2024-09-14T11:52:57.111027+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.111027+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:22.998621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079942,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":12794,"num_write":1051,"num_write_kb":21175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:14.178083+0000","last_change":"2024-09-14T11:53:14.178019+0000","last_active":"2024-09-14T11:53:14.178083+0000","last_peered":"2024-09-14T11:53:14.178083+0000","last_clean":"2024-09-14T11:53:14.178083+0000","last_became_active":"2024-09-14T11:11:08.653410+0000","last_became_peered":"2024-09-14T11:11:08.653410+0000","last_unstale":"2024-09-14T11:53:14.178083+0000","last_undegraded":"2024-09-14T11:53:14.178083+0000","last_fullsized":"2024-09-14T11:53:14.178083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:14.177941+0000","last_clean_scrub_stamp":"2024-09-14T11:53:14.177941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:58.565764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'177","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:18.383053+0000","last_change":"2024-09-14T11:53:18.383053+0000","last_active":"2024-09-14T11:53:18.383053+0000","last_peered":"2024-09-14T11:53:18.383053+0000","last_clean":"2024-09-14T11:53:18.383053+0000","last_became_active":"2024-09-14T11:11:10.669361+0000","last_became_peered":"2024-09-14T11:11:10.669361+0000","last_unstale":"2024-09-14T11:53:18.383053+0000","last_undegraded":"2024-09-14T11:53:18.383053+0000","last_fullsized":"2024-09-14T11:53:18.383053+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-14T11:53:18.382949+0000","last_clean_scrub_stamp":"2024-09-14T11:53:18.382949+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:34.005583+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11958,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":213,"num_read_kb":294,"num_write":122,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.160633+0000","last_change":"2024-09-14T11:53:20.160633+0000","last_active":"2024-09-14T11:53:20.160633+0000","last_peered":"2024-09-14T11:53:20.160633+0000","last_clean":"2024-09-14T11:53:20.160633+0000","last_became_active":"2024-09-14T11:11:12.680688+0000","last_became_peered":"2024-09-14T11:11:12.680688+0000","last_unstale":"2024-09-14T11:53:20.160633+0000","last_undegraded":"2024-09-14T11:53:20.160633+0000","last_fullsized":"2024-09-14T11:53:20.160633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.160545+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.160545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:21.719505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'119","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:27.282076+0000","last_change":"2024-09-14T11:53:27.282076+0000","last_active":"2024-09-14T11:53:27.282076+0000","last_peered":"2024-09-14T11:53:27.282076+0000","last_clean":"2024-09-14T11:53:27.282076+0000","last_became_active":"2024-09-14T11:11:14.696884+0000","last_became_peered":"2024-09-14T11:11:14.696884+0000","last_unstale":"2024-09-14T11:53:27.282076+0000","last_undegraded":"2024-09-14T11:53:27.282076+0000","last_fullsized":"2024-09-14T11:53:27.282076+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:53:27.281969+0000","last_clean_scrub_stamp":"2024-09-14T11:53:27.281969+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:34.059929+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":173,"num_read_kb":155,"num_write":284,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'1158","reported_seq":2820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:02.002658+0000","last_change":"2024-09-14T11:53:02.002594+0000","last_active":"2024-09-14T11:53:02.002658+0000","last_peered":"2024-09-14T11:53:02.002658+0000","last_clean":"2024-09-14T11:53:02.002658+0000","last_became_active":"2024-09-14T11:11:06.642165+0000","last_became_peered":"2024-09-14T11:11:06.642165+0000","last_unstale":"2024-09-14T11:53:02.002658+0000","last_undegraded":"2024-09-14T11:53:02.002658+0000","last_fullsized":"2024-09-14T11:53:02.002658+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1158","last_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_deep_scrub":"263'1158","last_deep_scrub_stamp":"2024-09-14T11:53:02.002510+0000","last_clean_scrub_stamp":"2024-09-14T11:53:02.002510+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:39.793177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5502,"num_read_kb":4893,"num_write":1571,"num_write_kb":633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'199","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.195865+0000","last_change":"2024-09-14T11:52:59.195803+0000","last_active":"2024-09-14T11:52:59.195865+0000","last_peered":"2024-09-14T11:52:59.195865+0000","last_clean":"2024-09-14T11:52:59.195865+0000","last_became_active":"2024-09-14T11:11:04.661996+0000","last_became_peered":"2024-09-14T11:11:04.661996+0000","last_unstale":"2024-09-14T11:52:59.195865+0000","last_undegraded":"2024-09-14T11:52:59.195865+0000","last_fullsized":"2024-09-14T11:52:59.195865+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-14T11:52:59.195690+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.195690+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:29.093296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":665,"num_read_kb":26583,"num_write":943,"num_write_kb":21832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.294858+0000","last_change":"2024-09-14T11:53:15.294788+0000","last_active":"2024-09-14T11:53:15.294858+0000","last_peered":"2024-09-14T11:53:15.294858+0000","last_clean":"2024-09-14T11:53:15.294858+0000","last_became_active":"2024-09-14T11:11:08.655644+0000","last_became_peered":"2024-09-14T11:11:08.655644+0000","last_unstale":"2024-09-14T11:53:15.294858+0000","last_undegraded":"2024-09-14T11:53:15.294858+0000","last_fullsized":"2024-09-14T11:53:15.294858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:15.294690+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.294690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:16.105550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'136","reported_seq":704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:15.127529+0000","last_change":"2024-09-14T11:53:15.127529+0000","last_active":"2024-09-14T11:53:15.127529+0000","last_peered":"2024-09-14T11:53:15.127529+0000","last_clean":"2024-09-14T11:53:15.127529+0000","last_became_active":"2024-09-14T11:11:10.672816+0000","last_became_peered":"2024-09-14T11:11:10.672816+0000","last_unstale":"2024-09-14T11:53:15.127529+0000","last_undegraded":"2024-09-14T11:53:15.127529+0000","last_fullsized":"2024-09-14T11:53:15.127529+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:15.127435+0000","last_clean_scrub_stamp":"2024-09-14T11:53:15.127435+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:53.936595+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":165,"num_read_kb":236,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:11.132137+0000","last_change":"2024-09-14T11:53:11.132137+0000","last_active":"2024-09-14T11:53:11.132137+0000","last_peered":"2024-09-14T11:53:11.132137+0000","last_clean":"2024-09-14T11:53:11.132137+0000","last_became_active":"2024-09-14T11:11:12.680306+0000","last_became_peered":"2024-09-14T11:11:12.680306+0000","last_unstale":"2024-09-14T11:53:11.132137+0000","last_undegraded":"2024-09-14T11:53:11.132137+0000","last_fullsized":"2024-09-14T11:53:11.132137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:11.132038+0000","last_clean_scrub_stamp":"2024-09-14T11:53:11.132038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:40.642717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'127","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:31.202529+0000","last_change":"2024-09-14T11:53:31.202529+0000","last_active":"2024-09-14T11:53:31.202529+0000","last_peered":"2024-09-14T11:53:31.202529+0000","last_clean":"2024-09-14T11:53:31.202529+0000","last_became_active":"2024-09-14T11:11:14.886150+0000","last_became_peered":"2024-09-14T11:11:14.886150+0000","last_unstale":"2024-09-14T11:53:31.202529+0000","last_undegraded":"2024-09-14T11:53:31.202529+0000","last_fullsized":"2024-09-14T11:53:31.202529+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T11:53:31.202451+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T11:53:31.202451+0000","last_clean_scrub_stamp":"2024-09-14T11:53:31.202451+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:02.593494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'509","reported_seq":2153,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.192324+0000","last_change":"2024-09-14T11:53:06.192324+0000","last_active":"2024-09-14T11:53:06.192324+0000","last_peered":"2024-09-14T11:53:06.192324+0000","last_clean":"2024-09-14T11:53:06.192324+0000","last_became_active":"2024-09-14T11:11:06.653402+0000","last_became_peered":"2024-09-14T11:11:06.653402+0000","last_unstale":"2024-09-14T11:53:06.192324+0000","last_undegraded":"2024-09-14T11:53:06.192324+0000","last_fullsized":"2024-09-14T11:53:06.192324+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'509","last_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_deep_scrub":"263'509","last_deep_scrub_stamp":"2024-09-14T11:53:06.192233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.192233+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:36.491268+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2788,"num_read_kb":2608,"num_write":608,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"263'219","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.233234+0000","last_change":"2024-09-14T11:52:56.233144+0000","last_active":"2024-09-14T11:52:56.233234+0000","last_peered":"2024-09-14T11:52:56.233234+0000","last_clean":"2024-09-14T11:52:56.233234+0000","last_became_active":"2024-09-14T11:11:04.650191+0000","last_became_peered":"2024-09-14T11:11:04.650191+0000","last_unstale":"2024-09-14T11:52:56.233234+0000","last_undegraded":"2024-09-14T11:52:56.233234+0000","last_fullsized":"2024-09-14T11:52:56.233234+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:56.232989+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.232989+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:07.476932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":7926,"num_write":973,"num_write_kb":24787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:12.970245+0000","last_change":"2024-09-14T11:53:12.970245+0000","last_active":"2024-09-14T11:53:12.970245+0000","last_peered":"2024-09-14T11:53:12.970245+0000","last_clean":"2024-09-14T11:53:12.970245+0000","last_became_active":"2024-09-14T11:11:08.653823+0000","last_became_peered":"2024-09-14T11:11:08.653823+0000","last_unstale":"2024-09-14T11:53:12.970245+0000","last_undegraded":"2024-09-14T11:53:12.970245+0000","last_fullsized":"2024-09-14T11:53:12.970245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:12.970152+0000","last_clean_scrub_stamp":"2024-09-14T11:53:12.970152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:58.911318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'110","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.124452+0000","last_change":"2024-09-14T11:53:22.124391+0000","last_active":"2024-09-14T11:53:22.124452+0000","last_peered":"2024-09-14T11:53:22.124452+0000","last_clean":"2024-09-14T11:53:22.124452+0000","last_became_active":"2024-09-14T11:11:10.668709+0000","last_became_peered":"2024-09-14T11:11:10.668709+0000","last_unstale":"2024-09-14T11:53:22.124452+0000","last_undegraded":"2024-09-14T11:53:22.124452+0000","last_fullsized":"2024-09-14T11:53:22.124452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'110","last_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_deep_scrub":"263'110","last_deep_scrub_stamp":"2024-09-14T11:53:22.124277+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.124277+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:22.955274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10172,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":132,"num_read_kb":208,"num_write":66,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:20.012941+0000","last_change":"2024-09-14T11:53:20.012861+0000","last_active":"2024-09-14T11:53:20.012941+0000","last_peered":"2024-09-14T11:53:20.012941+0000","last_clean":"2024-09-14T11:53:20.012941+0000","last_became_active":"2024-09-14T11:11:12.681555+0000","last_became_peered":"2024-09-14T11:11:12.681555+0000","last_unstale":"2024-09-14T11:53:20.012941+0000","last_undegraded":"2024-09-14T11:53:20.012941+0000","last_fullsized":"2024-09-14T11:53:20.012941+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:20.012748+0000","last_clean_scrub_stamp":"2024-09-14T11:53:20.012748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:47.176018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'192","reported_seq":1650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:26.272832+0000","last_change":"2024-09-14T11:53:26.272832+0000","last_active":"2024-09-14T11:53:26.272832+0000","last_peered":"2024-09-14T11:53:26.272832+0000","last_clean":"2024-09-14T11:53:26.272832+0000","last_became_active":"2024-09-14T11:11:14.689585+0000","last_became_peered":"2024-09-14T11:11:14.689585+0000","last_unstale":"2024-09-14T11:53:26.272832+0000","last_undegraded":"2024-09-14T11:53:26.272832+0000","last_fullsized":"2024-09-14T11:53:26.272832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:53:26.272731+0000","last_clean_scrub_stamp":"2024-09-14T11:53:26.272731+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:08.934882+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":255,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1176,"num_read_kb":1174,"num_write":413,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'449","reported_seq":2061,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.047117+0000","last_change":"2024-09-14T11:53:01.047117+0000","last_active":"2024-09-14T11:53:01.047117+0000","last_peered":"2024-09-14T11:53:01.047117+0000","last_clean":"2024-09-14T11:53:01.047117+0000","last_became_active":"2024-09-14T11:11:06.656092+0000","last_became_peered":"2024-09-14T11:11:06.656092+0000","last_unstale":"2024-09-14T11:53:01.047117+0000","last_undegraded":"2024-09-14T11:53:01.047117+0000","last_fullsized":"2024-09-14T11:53:01.047117+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'449","last_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_deep_scrub":"263'449","last_deep_scrub_stamp":"2024-09-14T11:53:01.047027+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.047027+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:29.624414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2581,"num_read_kb":2445,"num_write":509,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'230","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.174275+0000","last_change":"2024-09-14T11:52:54.174275+0000","last_active":"2024-09-14T11:52:54.174275+0000","last_peered":"2024-09-14T11:52:54.174275+0000","last_clean":"2024-09-14T11:52:54.174275+0000","last_became_active":"2024-09-14T11:11:04.658198+0000","last_became_peered":"2024-09-14T11:11:04.658198+0000","last_unstale":"2024-09-14T11:52:54.174275+0000","last_undegraded":"2024-09-14T11:52:54.174275+0000","last_fullsized":"2024-09-14T11:52:54.174275+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:54.174100+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.174100+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:15.196149+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1057,"num_read_kb":144594,"num_write":1045,"num_write_kb":44456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.621816+0000","last_change":"2024-09-14T11:53:08.621816+0000","last_active":"2024-09-14T11:53:08.621816+0000","last_peered":"2024-09-14T11:53:08.621816+0000","last_clean":"2024-09-14T11:53:08.621816+0000","last_became_active":"2024-09-14T11:11:08.652680+0000","last_became_peered":"2024-09-14T11:11:08.652680+0000","last_unstale":"2024-09-14T11:53:08.621816+0000","last_undegraded":"2024-09-14T11:53:08.621816+0000","last_fullsized":"2024-09-14T11:53:08.621816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:53:08.621675+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.621675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:07.357313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'161","reported_seq":744,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:16.983622+0000","last_change":"2024-09-14T11:53:16.983558+0000","last_active":"2024-09-14T11:53:16.983622+0000","last_peered":"2024-09-14T11:53:16.983622+0000","last_clean":"2024-09-14T11:53:16.983622+0000","last_became_active":"2024-09-14T11:11:10.668013+0000","last_became_peered":"2024-09-14T11:11:10.668013+0000","last_unstale":"2024-09-14T11:53:16.983622+0000","last_undegraded":"2024-09-14T11:53:16.983622+0000","last_fullsized":"2024-09-14T11:53:16.983622+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'161","last_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_deep_scrub":"263'161","last_deep_scrub_stamp":"2024-09-14T11:53:16.983469+0000","last_clean_scrub_stamp":"2024-09-14T11:53:16.983469+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:33.140461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":208,"num_write":106,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:22.118868+0000","last_change":"2024-09-14T11:53:22.118805+0000","last_active":"2024-09-14T11:53:22.118868+0000","last_peered":"2024-09-14T11:53:22.118868+0000","last_clean":"2024-09-14T11:53:22.118868+0000","last_became_active":"2024-09-14T11:11:12.680612+0000","last_became_peered":"2024-09-14T11:11:12.680612+0000","last_unstale":"2024-09-14T11:53:22.118868+0000","last_undegraded":"2024-09-14T11:53:22.118868+0000","last_fullsized":"2024-09-14T11:53:22.118868+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:53:22.118721+0000","last_clean_scrub_stamp":"2024-09-14T11:53:22.118721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:09.915267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'136","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:24.055980+0000","last_change":"2024-09-14T11:53:24.055980+0000","last_active":"2024-09-14T11:53:24.055980+0000","last_peered":"2024-09-14T11:53:24.055980+0000","last_clean":"2024-09-14T11:53:24.055980+0000","last_became_active":"2024-09-14T11:11:14.696857+0000","last_became_peered":"2024-09-14T11:11:14.696857+0000","last_unstale":"2024-09-14T11:53:24.055980+0000","last_undegraded":"2024-09-14T11:53:24.055980+0000","last_fullsized":"2024-09-14T11:53:24.055980+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-14T11:53:24.055885+0000","last_clean_scrub_stamp":"2024-09-14T11:53:24.055885+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:02.367890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1240,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":124,"num_write":316,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'852","reported_seq":2578,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.568807+0000","last_change":"2024-09-14T11:53:05.568807+0000","last_active":"2024-09-14T11:53:05.568807+0000","last_peered":"2024-09-14T11:53:05.568807+0000","last_clean":"2024-09-14T11:53:05.568807+0000","last_became_active":"2024-09-14T11:11:06.654977+0000","last_became_peered":"2024-09-14T11:11:06.654977+0000","last_unstale":"2024-09-14T11:53:05.568807+0000","last_undegraded":"2024-09-14T11:53:05.568807+0000","last_fullsized":"2024-09-14T11:53:05.568807+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'852","last_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_deep_scrub":"263'852","last_deep_scrub_stamp":"2024-09-14T11:53:05.568712+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.568712+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:18.647100+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4244,"num_read_kb":3854,"num_write":1103,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'248","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.065807+0000","last_change":"2024-09-14T11:52:56.065807+0000","last_active":"2024-09-14T11:52:56.065807+0000","last_peered":"2024-09-14T11:52:56.065807+0000","last_clean":"2024-09-14T11:52:56.065807+0000","last_became_active":"2024-09-14T11:11:04.666390+0000","last_became_peered":"2024-09-14T11:11:04.666390+0000","last_unstale":"2024-09-14T11:52:56.065807+0000","last_undegraded":"2024-09-14T11:52:56.065807+0000","last_fullsized":"2024-09-14T11:52:56.065807+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'248","last_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_deep_scrub":"263'248","last_deep_scrub_stamp":"2024-09-14T11:52:56.065655+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.065655+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:38.524060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":737,"num_read_kb":42950,"num_write":1092,"num_write_kb":32908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'568","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.610451+0000","last_change":"2024-09-14T11:53:04.610451+0000","last_active":"2024-09-14T11:53:04.610451+0000","last_peered":"2024-09-14T11:53:04.610451+0000","last_clean":"2024-09-14T11:53:04.610451+0000","last_became_active":"2024-09-14T11:11:06.651334+0000","last_became_peered":"2024-09-14T11:11:06.651334+0000","last_unstale":"2024-09-14T11:53:04.610451+0000","last_undegraded":"2024-09-14T11:53:04.610451+0000","last_fullsized":"2024-09-14T11:53:04.610451+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'568","last_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_deep_scrub":"263'568","last_deep_scrub_stamp":"2024-09-14T11:53:04.610328+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.610328+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:59.992487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3151,"num_read_kb":2887,"num_write":733,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1797,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'180","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:52.720382+0000","last_change":"2024-09-14T11:52:52.720382+0000","last_active":"2024-09-14T11:52:52.720382+0000","last_peered":"2024-09-14T11:52:52.720382+0000","last_clean":"2024-09-14T11:52:52.720382+0000","last_became_active":"2024-09-14T11:11:38.679688+0000","last_became_peered":"2024-09-14T11:11:38.679688+0000","last_unstale":"2024-09-14T11:52:52.720382+0000","last_undegraded":"2024-09-14T11:52:52.720382+0000","last_fullsized":"2024-09-14T11:52:52.720382+0000","mapping_epoch":38,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-14T11:52:52.720305+0000","last_clean_scrub_stamp":"2024-09-14T11:52:52.720305+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:22.441860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":516,"num_read_kb":43631,"num_write":872,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,7],"acting":[2,3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'531","reported_seq":2325,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.174316+0000","last_change":"2024-09-14T11:53:06.174316+0000","last_active":"2024-09-14T11:53:06.174316+0000","last_peered":"2024-09-14T11:53:06.174316+0000","last_clean":"2024-09-14T11:53:06.174316+0000","last_became_active":"2024-09-14T11:11:06.653504+0000","last_became_peered":"2024-09-14T11:11:06.653504+0000","last_unstale":"2024-09-14T11:53:06.174316+0000","last_undegraded":"2024-09-14T11:53:06.174316+0000","last_fullsized":"2024-09-14T11:53:06.174316+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'531","last_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_deep_scrub":"263'531","last_deep_scrub_stamp":"2024-09-14T11:53:06.174226+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.174226+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":500,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:29.796542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3054,"num_read_kb":2872,"num_write":633,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'217","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.151067+0000","last_change":"2024-09-14T11:52:58.151067+0000","last_active":"2024-09-14T11:52:58.151067+0000","last_peered":"2024-09-14T11:52:58.151067+0000","last_clean":"2024-09-14T11:52:58.151067+0000","last_became_active":"2024-09-14T11:11:04.657714+0000","last_became_peered":"2024-09-14T11:11:04.657714+0000","last_unstale":"2024-09-14T11:52:58.151067+0000","last_undegraded":"2024-09-14T11:52:58.151067+0000","last_fullsized":"2024-09-14T11:52:58.151067+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'217","last_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_deep_scrub":"263'217","last_deep_scrub_stamp":"2024-09-14T11:52:58.150955+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.150955+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:54.421678+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":496,"num_read_kb":22878,"num_write":1010,"num_write_kb":46666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'805","reported_seq":2395,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.635510+0000","last_change":"2024-09-14T11:53:03.635510+0000","last_active":"2024-09-14T11:53:03.635510+0000","last_peered":"2024-09-14T11:53:03.635510+0000","last_clean":"2024-09-14T11:53:03.635510+0000","last_became_active":"2024-09-14T11:11:06.650945+0000","last_became_peered":"2024-09-14T11:11:06.650945+0000","last_unstale":"2024-09-14T11:53:03.635510+0000","last_undegraded":"2024-09-14T11:53:03.635510+0000","last_fullsized":"2024-09-14T11:53:03.635510+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'805","last_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_deep_scrub":"263'805","last_deep_scrub_stamp":"2024-09-14T11:53:03.635426+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.635426+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:26.207368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3936,"num_read_kb":3544,"num_write":1075,"num_write_kb":394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'196","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.172379+0000","last_change":"2024-09-14T11:52:55.172379+0000","last_active":"2024-09-14T11:52:55.172379+0000","last_peered":"2024-09-14T11:52:55.172379+0000","last_clean":"2024-09-14T11:52:55.172379+0000","last_became_active":"2024-09-14T11:11:04.650383+0000","last_became_peered":"2024-09-14T11:11:04.650383+0000","last_unstale":"2024-09-14T11:52:55.172379+0000","last_undegraded":"2024-09-14T11:52:55.172379+0000","last_fullsized":"2024-09-14T11:52:55.172379+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-14T11:52:55.172292+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.172292+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:27.954230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":47732,"num_write":877,"num_write_kb":35544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1009","reported_seq":2736,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.107587+0000","last_change":"2024-09-14T11:53:09.107587+0000","last_active":"2024-09-14T11:53:09.107587+0000","last_peered":"2024-09-14T11:53:09.107587+0000","last_clean":"2024-09-14T11:53:09.107587+0000","last_became_active":"2024-09-14T11:11:06.654318+0000","last_became_peered":"2024-09-14T11:11:06.654318+0000","last_unstale":"2024-09-14T11:53:09.107587+0000","last_undegraded":"2024-09-14T11:53:09.107587+0000","last_fullsized":"2024-09-14T11:53:09.107587+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1009","last_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_deep_scrub":"263'1009","last_deep_scrub_stamp":"2024-09-14T11:53:09.107505+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.107505+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":900,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:57.020223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4874,"num_read_kb":4356,"num_write":1365,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'279","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.244702+0000","last_change":"2024-09-14T11:52:57.244702+0000","last_active":"2024-09-14T11:52:57.244702+0000","last_peered":"2024-09-14T11:52:57.244702+0000","last_clean":"2024-09-14T11:52:57.244702+0000","last_became_active":"2024-09-14T11:11:38.148739+0000","last_became_peered":"2024-09-14T11:11:38.148739+0000","last_unstale":"2024-09-14T11:52:57.244702+0000","last_undegraded":"2024-09-14T11:52:57.244702+0000","last_fullsized":"2024-09-14T11:52:57.244702+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'279","last_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_deep_scrub":"263'279","last_deep_scrub_stamp":"2024-09-14T11:52:57.244601+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.244601+0000","objects_scrubbed":6,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:06.713036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":719,"num_read_kb":31338,"num_write":1105,"num_write_kb":30034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,7],"acting":[3,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'444","reported_seq":1991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:03.964108+0000","last_change":"2024-09-14T11:53:03.964108+0000","last_active":"2024-09-14T11:53:03.964108+0000","last_peered":"2024-09-14T11:53:03.964108+0000","last_clean":"2024-09-14T11:53:03.964108+0000","last_became_active":"2024-09-14T11:11:06.653328+0000","last_became_peered":"2024-09-14T11:11:06.653328+0000","last_unstale":"2024-09-14T11:53:03.964108+0000","last_undegraded":"2024-09-14T11:53:03.964108+0000","last_fullsized":"2024-09-14T11:53:03.964108+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'444","last_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_deep_scrub":"263'444","last_deep_scrub_stamp":"2024-09-14T11:53:03.963982+0000","last_clean_scrub_stamp":"2024-09-14T11:53:03.963982+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:15.186551+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2421,"num_read_kb":2277,"num_write":538,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'261","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.641663+0000","last_change":"2024-09-14T11:52:53.641663+0000","last_active":"2024-09-14T11:52:53.641663+0000","last_peered":"2024-09-14T11:52:53.641663+0000","last_clean":"2024-09-14T11:52:53.641663+0000","last_became_active":"2024-09-14T11:11:04.642327+0000","last_became_peered":"2024-09-14T11:11:04.642327+0000","last_unstale":"2024-09-14T11:52:53.641663+0000","last_undegraded":"2024-09-14T11:52:53.641663+0000","last_fullsized":"2024-09-14T11:52:53.641663+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'261","last_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_deep_scrub":"263'261","last_deep_scrub_stamp":"2024-09-14T11:52:53.641559+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.641559+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:15.729013+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079905,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1027,"num_read_kb":155043,"num_write":1124,"num_write_kb":48471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'1176","reported_seq":2843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:08.128014+0000","last_change":"2024-09-14T11:53:08.128014+0000","last_active":"2024-09-14T11:53:08.128014+0000","last_peered":"2024-09-14T11:53:08.128014+0000","last_clean":"2024-09-14T11:53:08.128014+0000","last_became_active":"2024-09-14T11:11:06.651376+0000","last_became_peered":"2024-09-14T11:11:06.651376+0000","last_unstale":"2024-09-14T11:53:08.128014+0000","last_undegraded":"2024-09-14T11:53:08.128014+0000","last_fullsized":"2024-09-14T11:53:08.128014+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1176","last_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_deep_scrub":"263'1176","last_deep_scrub_stamp":"2024-09-14T11:53:08.127935+0000","last_clean_scrub_stamp":"2024-09-14T11:53:08.127935+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:40.579497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5522,"num_read_kb":4893,"num_write":1641,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'242","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:57.094291+0000","last_change":"2024-09-14T11:52:57.094291+0000","last_active":"2024-09-14T11:52:57.094291+0000","last_peered":"2024-09-14T11:52:57.094291+0000","last_clean":"2024-09-14T11:52:57.094291+0000","last_became_active":"2024-09-14T11:11:04.656749+0000","last_became_peered":"2024-09-14T11:11:04.656749+0000","last_unstale":"2024-09-14T11:52:57.094291+0000","last_undegraded":"2024-09-14T11:52:57.094291+0000","last_fullsized":"2024-09-14T11:52:57.094291+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'242","last_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_deep_scrub":"263'242","last_deep_scrub_stamp":"2024-09-14T11:52:57.094079+0000","last_clean_scrub_stamp":"2024-09-14T11:52:57.094079+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:41.823322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159825,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":553,"num_read_kb":17781,"num_write":1116,"num_write_kb":51480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'429","reported_seq":1964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.075754+0000","last_change":"2024-09-14T11:53:01.075754+0000","last_active":"2024-09-14T11:53:01.075754+0000","last_peered":"2024-09-14T11:53:01.075754+0000","last_clean":"2024-09-14T11:53:01.075754+0000","last_became_active":"2024-09-14T11:11:06.653856+0000","last_became_peered":"2024-09-14T11:11:06.653856+0000","last_unstale":"2024-09-14T11:53:01.075754+0000","last_undegraded":"2024-09-14T11:53:01.075754+0000","last_fullsized":"2024-09-14T11:53:01.075754+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'429","last_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_deep_scrub":"263'429","last_deep_scrub_stamp":"2024-09-14T11:53:01.075650+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.075650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:47.154836+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2233,"num_read_kb":2121,"num_write":487,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'185","reported_seq":816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:59.248333+0000","last_change":"2024-09-14T11:52:59.248333+0000","last_active":"2024-09-14T11:52:59.248333+0000","last_peered":"2024-09-14T11:52:59.248333+0000","last_clean":"2024-09-14T11:52:59.248333+0000","last_became_active":"2024-09-14T11:11:04.654130+0000","last_became_peered":"2024-09-14T11:11:04.654130+0000","last_unstale":"2024-09-14T11:52:59.248333+0000","last_undegraded":"2024-09-14T11:52:59.248333+0000","last_fullsized":"2024-09-14T11:52:59.248333+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'185","last_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_deep_scrub":"263'185","last_deep_scrub_stamp":"2024-09-14T11:52:59.248194+0000","last_clean_scrub_stamp":"2024-09-14T11:52:59.248194+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:41.711860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":539,"num_read_kb":12452,"num_write":860,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'1183","reported_seq":2671,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.137570+0000","last_change":"2024-09-14T11:53:05.137512+0000","last_active":"2024-09-14T11:53:05.137570+0000","last_peered":"2024-09-14T11:53:05.137570+0000","last_clean":"2024-09-14T11:53:05.137570+0000","last_became_active":"2024-09-14T11:11:06.652599+0000","last_became_peered":"2024-09-14T11:11:06.652599+0000","last_unstale":"2024-09-14T11:53:05.137570+0000","last_undegraded":"2024-09-14T11:53:05.137570+0000","last_fullsized":"2024-09-14T11:53:05.137570+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1183","last_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_deep_scrub":"263'1183","last_deep_scrub_stamp":"2024-09-14T11:53:05.137429+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.137429+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":1100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:37.154275+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5278,"num_read_kb":4640,"num_write":1642,"num_write_kb":692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'246","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.181196+0000","last_change":"2024-09-14T11:53:00.181196+0000","last_active":"2024-09-14T11:53:00.181196+0000","last_peered":"2024-09-14T11:53:00.181196+0000","last_clean":"2024-09-14T11:53:00.181196+0000","last_became_active":"2024-09-14T11:11:04.656874+0000","last_became_peered":"2024-09-14T11:11:04.656874+0000","last_unstale":"2024-09-14T11:53:00.181196+0000","last_undegraded":"2024-09-14T11:53:00.181196+0000","last_fullsized":"2024-09-14T11:53:00.181196+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'246","last_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_deep_scrub":"263'246","last_deep_scrub_stamp":"2024-09-14T11:53:00.181003+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.181003+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:48.772246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":534,"num_read_kb":3825,"num_write":1017,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'761","reported_seq":2301,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.984873+0000","last_change":"2024-09-14T11:53:05.984808+0000","last_active":"2024-09-14T11:53:05.984873+0000","last_peered":"2024-09-14T11:53:05.984873+0000","last_clean":"2024-09-14T11:53:05.984873+0000","last_became_active":"2024-09-14T11:11:06.651566+0000","last_became_peered":"2024-09-14T11:11:06.651566+0000","last_unstale":"2024-09-14T11:53:05.984873+0000","last_undegraded":"2024-09-14T11:53:05.984873+0000","last_fullsized":"2024-09-14T11:53:05.984873+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:53:05.984718+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.984718+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:22.922626+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3719,"num_read_kb":3372,"num_write":999,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'244","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:58.261037+0000","last_change":"2024-09-14T11:52:58.260968+0000","last_active":"2024-09-14T11:52:58.261037+0000","last_peered":"2024-09-14T11:52:58.261037+0000","last_clean":"2024-09-14T11:52:58.261037+0000","last_became_active":"2024-09-14T11:11:04.650880+0000","last_became_peered":"2024-09-14T11:11:04.650880+0000","last_unstale":"2024-09-14T11:52:58.261037+0000","last_undegraded":"2024-09-14T11:52:58.261037+0000","last_fullsized":"2024-09-14T11:52:58.261037+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'244","last_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_deep_scrub":"263'244","last_deep_scrub_stamp":"2024-09-14T11:52:58.260863+0000","last_clean_scrub_stamp":"2024-09-14T11:52:58.260863+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:49.114336+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":601,"num_read_kb":9466,"num_write":1107,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'693","reported_seq":2471,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.619328+0000","last_change":"2024-09-14T11:52:56.619266+0000","last_active":"2024-09-14T11:52:56.619328+0000","last_peered":"2024-09-14T11:52:56.619328+0000","last_clean":"2024-09-14T11:52:56.619328+0000","last_became_active":"2024-09-14T11:11:06.656345+0000","last_became_peered":"2024-09-14T11:11:06.656345+0000","last_unstale":"2024-09-14T11:52:56.619328+0000","last_undegraded":"2024-09-14T11:52:56.619328+0000","last_fullsized":"2024-09-14T11:52:56.619328+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'693","last_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_deep_scrub":"263'693","last_deep_scrub_stamp":"2024-09-14T11:52:56.619176+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.619176+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:46.303405+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3767,"num_read_kb":3425,"num_write":991,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'230","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:53.693886+0000","last_change":"2024-09-14T11:52:53.693886+0000","last_active":"2024-09-14T11:52:53.693886+0000","last_peered":"2024-09-14T11:52:53.693886+0000","last_clean":"2024-09-14T11:52:53.693886+0000","last_became_active":"2024-09-14T11:11:38.680398+0000","last_became_peered":"2024-09-14T11:11:38.680398+0000","last_unstale":"2024-09-14T11:52:53.693886+0000","last_undegraded":"2024-09-14T11:52:53.693886+0000","last_fullsized":"2024-09-14T11:52:53.693886+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'230","last_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_deep_scrub":"263'230","last_deep_scrub_stamp":"2024-09-14T11:52:53.693782+0000","last_clean_scrub_stamp":"2024-09-14T11:52:53.693782+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:02.123870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":774,"num_read_kb":20654,"num_write":1086,"num_write_kb":29695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6,3],"acting":[2,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"263'572","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.004728+0000","last_change":"2024-09-14T11:53:05.004654+0000","last_active":"2024-09-14T11:53:05.004728+0000","last_peered":"2024-09-14T11:53:05.004728+0000","last_clean":"2024-09-14T11:53:05.004728+0000","last_became_active":"2024-09-14T11:11:06.655692+0000","last_became_peered":"2024-09-14T11:11:06.655692+0000","last_unstale":"2024-09-14T11:53:05.004728+0000","last_undegraded":"2024-09-14T11:53:05.004728+0000","last_fullsized":"2024-09-14T11:53:05.004728+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'572","last_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_deep_scrub":"263'572","last_deep_scrub_stamp":"2024-09-14T11:53:05.004567+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.004567+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:12.480296+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2944,"num_read_kb":2679,"num_write":767,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'179","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:56.170219+0000","last_change":"2024-09-14T11:52:56.170135+0000","last_active":"2024-09-14T11:52:56.170219+0000","last_peered":"2024-09-14T11:52:56.170219+0000","last_clean":"2024-09-14T11:52:56.170219+0000","last_became_active":"2024-09-14T11:11:04.662775+0000","last_became_peered":"2024-09-14T11:11:04.662775+0000","last_unstale":"2024-09-14T11:52:56.170219+0000","last_undegraded":"2024-09-14T11:52:56.170219+0000","last_fullsized":"2024-09-14T11:52:56.170219+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'179","last_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_deep_scrub":"263'179","last_deep_scrub_stamp":"2024-09-14T11:52:56.169996+0000","last_clean_scrub_stamp":"2024-09-14T11:52:56.169996+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:19.783821+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254527,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":19362,"num_write":819,"num_write_kb":34648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'504","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.181388+0000","last_change":"2024-09-14T11:53:10.181330+0000","last_active":"2024-09-14T11:53:10.181388+0000","last_peered":"2024-09-14T11:53:10.181388+0000","last_clean":"2024-09-14T11:53:10.181388+0000","last_became_active":"2024-09-14T11:11:06.658627+0000","last_became_peered":"2024-09-14T11:11:06.658627+0000","last_unstale":"2024-09-14T11:53:10.181388+0000","last_undegraded":"2024-09-14T11:53:10.181388+0000","last_fullsized":"2024-09-14T11:53:10.181388+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'504","last_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_deep_scrub":"263'504","last_deep_scrub_stamp":"2024-09-14T11:53:10.181245+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.181245+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:04.696409+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2615,"num_read_kb":2448,"num_write":600,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'219","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.074057+0000","last_change":"2024-09-14T11:52:54.073972+0000","last_active":"2024-09-14T11:52:54.074057+0000","last_peered":"2024-09-14T11:52:54.074057+0000","last_clean":"2024-09-14T11:52:54.074057+0000","last_became_active":"2024-09-14T11:11:04.662678+0000","last_became_peered":"2024-09-14T11:11:04.662678+0000","last_unstale":"2024-09-14T11:52:54.074057+0000","last_undegraded":"2024-09-14T11:52:54.074057+0000","last_fullsized":"2024-09-14T11:52:54.074057+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'219","last_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_deep_scrub":"263'219","last_deep_scrub_stamp":"2024-09-14T11:52:54.073820+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.073820+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:29.734459+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152081,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":495,"num_read_kb":22963,"num_write":995,"num_write_kb":49299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'1731","reported_seq":3544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:04.121071+0000","last_change":"2024-09-14T11:53:04.120989+0000","last_active":"2024-09-14T11:53:04.121071+0000","last_peered":"2024-09-14T11:53:04.121071+0000","last_clean":"2024-09-14T11:53:04.121071+0000","last_became_active":"2024-09-14T11:11:06.648921+0000","last_became_peered":"2024-09-14T11:11:06.648921+0000","last_unstale":"2024-09-14T11:53:04.121071+0000","last_undegraded":"2024-09-14T11:53:04.121071+0000","last_fullsized":"2024-09-14T11:53:04.121071+0000","mapping_epoch":27,"log_start":"263'1700","ondisk_log_start":"263'1700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1731","last_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_deep_scrub":"263'1731","last_deep_scrub_stamp":"2024-09-14T11:53:04.120897+0000","last_clean_scrub_stamp":"2024-09-14T11:53:04.120897+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":1700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:50.055522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8061,"num_read_kb":7051,"num_write":2506,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'220","reported_seq":835,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:09.202933+0000","last_change":"2024-09-14T11:53:09.202838+0000","last_active":"2024-09-14T11:53:09.202933+0000","last_peered":"2024-09-14T11:53:09.202933+0000","last_clean":"2024-09-14T11:53:09.202933+0000","last_became_active":"2024-09-14T11:11:04.667529+0000","last_became_peered":"2024-09-14T11:11:04.667529+0000","last_unstale":"2024-09-14T11:53:09.202933+0000","last_undegraded":"2024-09-14T11:53:09.202933+0000","last_fullsized":"2024-09-14T11:53:09.202933+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'220","last_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_deep_scrub":"263'220","last_deep_scrub_stamp":"2024-09-14T11:53:09.202630+0000","last_clean_scrub_stamp":"2024-09-14T11:53:09.202630+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:51.781845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":9299,"num_write":1026,"num_write_kb":43860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'392","reported_seq":1873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:10.127386+0000","last_change":"2024-09-14T11:53:10.127322+0000","last_active":"2024-09-14T11:53:10.127386+0000","last_peered":"2024-09-14T11:53:10.127386+0000","last_clean":"2024-09-14T11:53:10.127386+0000","last_became_active":"2024-09-14T11:11:06.645895+0000","last_became_peered":"2024-09-14T11:11:06.645895+0000","last_unstale":"2024-09-14T11:53:10.127386+0000","last_undegraded":"2024-09-14T11:53:10.127386+0000","last_fullsized":"2024-09-14T11:53:10.127386+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:53:10.127233+0000","last_clean_scrub_stamp":"2024-09-14T11:53:10.127233+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:01.279892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2119,"num_read_kb":2011,"num_write":446,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'221","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:54.648290+0000","last_change":"2024-09-14T11:52:54.648221+0000","last_active":"2024-09-14T11:52:54.648290+0000","last_peered":"2024-09-14T11:52:54.648290+0000","last_clean":"2024-09-14T11:52:54.648290+0000","last_became_active":"2024-09-14T11:11:04.650864+0000","last_became_peered":"2024-09-14T11:11:04.650864+0000","last_unstale":"2024-09-14T11:52:54.648290+0000","last_undegraded":"2024-09-14T11:52:54.648290+0000","last_fullsized":"2024-09-14T11:52:54.648290+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'221","last_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_deep_scrub":"263'221","last_deep_scrub_stamp":"2024-09-14T11:52:54.648125+0000","last_clean_scrub_stamp":"2024-09-14T11:52:54.648125+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:31.594989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":581,"num_read_kb":67022,"num_write":1011,"num_write_kb":42085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'461","reported_seq":2122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:05.119760+0000","last_change":"2024-09-14T11:53:05.119760+0000","last_active":"2024-09-14T11:53:05.119760+0000","last_peered":"2024-09-14T11:53:05.119760+0000","last_clean":"2024-09-14T11:53:05.119760+0000","last_became_active":"2024-09-14T11:11:06.659703+0000","last_became_peered":"2024-09-14T11:11:06.659703+0000","last_unstale":"2024-09-14T11:53:05.119760+0000","last_undegraded":"2024-09-14T11:53:05.119760+0000","last_fullsized":"2024-09-14T11:53:05.119760+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'461","last_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_deep_scrub":"263'461","last_deep_scrub_stamp":"2024-09-14T11:53:05.119654+0000","last_clean_scrub_stamp":"2024-09-14T11:53:05.119654+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:53.766096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2621,"num_read_kb":2482,"num_write":556,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2041,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'211","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:52:55.651967+0000","last_change":"2024-09-14T11:52:55.651909+0000","last_active":"2024-09-14T11:52:55.651967+0000","last_peered":"2024-09-14T11:52:55.651967+0000","last_clean":"2024-09-14T11:52:55.651967+0000","last_became_active":"2024-09-14T11:11:38.680457+0000","last_became_peered":"2024-09-14T11:11:38.680457+0000","last_unstale":"2024-09-14T11:52:55.651967+0000","last_undegraded":"2024-09-14T11:52:55.651967+0000","last_fullsized":"2024-09-14T11:52:55.651967+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-14T11:52:55.651812+0000","last_clean_scrub_stamp":"2024-09-14T11:52:55.651812+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:24.237587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":644,"num_read_kb":27752,"num_write":889,"num_write_kb":37709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"263'207","reported_seq":803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:01.136326+0000","last_change":"2024-09-14T11:53:01.136253+0000","last_active":"2024-09-14T11:53:01.136326+0000","last_peered":"2024-09-14T11:53:01.136326+0000","last_clean":"2024-09-14T11:53:01.136326+0000","last_became_active":"2024-09-14T11:11:04.660528+0000","last_became_peered":"2024-09-14T11:11:04.660528+0000","last_unstale":"2024-09-14T11:53:01.136326+0000","last_undegraded":"2024-09-14T11:53:01.136326+0000","last_fullsized":"2024-09-14T11:53:01.136326+0000","mapping_epoch":25,"log_start":"263'100","ondisk_log_start":"263'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'207","last_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_deep_scrub":"263'207","last_deep_scrub_stamp":"2024-09-14T11:53:01.136124+0000","last_clean_scrub_stamp":"2024-09-14T11:53:01.136124+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:03.376828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":2089,"num_write":994,"num_write_kb":27031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'476","reported_seq":1942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:06.095010+0000","last_change":"2024-09-14T11:53:06.095010+0000","last_active":"2024-09-14T11:53:06.095010+0000","last_peered":"2024-09-14T11:53:06.095010+0000","last_clean":"2024-09-14T11:53:06.095010+0000","last_became_active":"2024-09-14T11:11:06.653546+0000","last_became_peered":"2024-09-14T11:11:06.653546+0000","last_unstale":"2024-09-14T11:53:06.095010+0000","last_undegraded":"2024-09-14T11:53:06.095010+0000","last_fullsized":"2024-09-14T11:53:06.095010+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'476","last_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_deep_scrub":"263'476","last_deep_scrub_stamp":"2024-09-14T11:53:06.094919+0000","last_clean_scrub_stamp":"2024-09-14T11:53:06.094919+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:39.988396+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2473,"num_read_kb":2275,"num_write":594,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":919,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'262","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:00.594608+0000","last_change":"2024-09-14T11:53:00.594508+0000","last_active":"2024-09-14T11:53:00.594608+0000","last_peered":"2024-09-14T11:53:00.594608+0000","last_clean":"2024-09-14T11:53:00.594608+0000","last_became_active":"2024-09-14T11:11:04.646680+0000","last_became_peered":"2024-09-14T11:11:04.646680+0000","last_unstale":"2024-09-14T11:53:00.594608+0000","last_undegraded":"2024-09-14T11:53:00.594608+0000","last_fullsized":"2024-09-14T11:53:00.594608+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-14T11:53:00.594344+0000","last_clean_scrub_stamp":"2024-09-14T11:53:00.594344+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:04.083599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":42624,"num_write":1182,"num_write_kb":52114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'383","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:07.201899+0000","last_change":"2024-09-14T11:53:07.201899+0000","last_active":"2024-09-14T11:53:07.201899+0000","last_peered":"2024-09-14T11:53:07.201899+0000","last_clean":"2024-09-14T11:53:07.201899+0000","last_became_active":"2024-09-14T11:11:06.650965+0000","last_became_peered":"2024-09-14T11:11:06.650965+0000","last_unstale":"2024-09-14T11:53:07.201899+0000","last_undegraded":"2024-09-14T11:53:07.201899+0000","last_fullsized":"2024-09-14T11:53:07.201899+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:53:07.201806+0000","last_clean_scrub_stamp":"2024-09-14T11:53:07.201806+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:07.993574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2236,"num_read_kb":2166,"num_write":425,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10838,"num_read_kb":9078,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15143,"num_read_kb":14809,"num_write":17108,"num_write_kb":4991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1574,"ondisk_log_size":1574,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":429920,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":8367,"num_read_kb":10850,"num_write":5651,"num_write_kb":2859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701838,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2404,"num_read_kb":2871,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":219863,"num_read_kb":201240,"num_write":55703,"num_write_kb":18957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35727,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4116,"ondisk_log_size":4116,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":29484888,"num_objects":168,"num_object_clones":0,"num_object_copies":672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":0,"num_read":42482,"num_read_kb":2539626,"num_write":64328,"num_write_kb":2242860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":41172992,"data_stored":41172992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":168157,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":5242880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":181387,"num_write":190,"num_write_kb":136309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542671,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272784,"kb_used_data":11136,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94099056,"statfs":{"total":96636764160,"available":96357433344,"internally_reserved":0,"allocated":11403264,"data_stored":9409551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542671,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250432,"kb_used_data":8240,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94121408,"statfs":{"total":96636764160,"available":96380321792,"internally_reserved":0,"allocated":8437760,"data_stored":6489937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":247986630},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542669,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107580,"kb_used_data":8364,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264260,"statfs":{"total":96636764160,"available":96526602240,"internally_reserved":0,"allocated":8564736,"data_stored":6565787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542669,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107804,"kb_used_data":8588,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94264036,"statfs":{"total":96636764160,"available":96526372864,"internally_reserved":0,"allocated":8794112,"data_stored":6869156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542668,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251756,"kb_used_data":8156,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94120084,"statfs":{"total":96636764160,"available":96378966016,"internally_reserved":0,"allocated":8351744,"data_stored":6374693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542669,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94580,"kb_used_data":9252,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94277260,"statfs":{"total":96636764160,"available":96539914240,"internally_reserved":0,"allocated":9474048,"data_stored":7547937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542669,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153580,"kb_used_data":10012,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94218260,"statfs":{"total":96636764160,"available":96479498240,"internally_reserved":0,"allocated":10252288,"data_stored":8286792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542670,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284668,"kb_used_data":10604,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94087172,"statfs":{"total":96636764160,"available":96345264128,"internally_reserved":0,"allocated":10858496,"data_stored":8869545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6021120,"data_stored":6021120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6029312,"data_stored":6029312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5292032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4116480,"data_stored":4116480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4612096,"data_stored":4612096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4308992,"data_stored":4308992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4231168,"data_stored":4231168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6561792,"data_stored":6561792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:54:14.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:54:14.558 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:54:14.558 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:54:14.559 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:54:14.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.607 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:54:14.607 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:54:14.607 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.648 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:54:14.649 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:54:14.649 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.690 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:54:14.691 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:54:14.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.740 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:54:14.740 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T11:54:14.740 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.785 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T11:54:14.785 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T11:54:14.785 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.837 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T11:54:14.837 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T11:54:14.837 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.899 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T11:54:14.900 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T11:54:14.900 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.955 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T11:54:14.955 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:54:14.955 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T11:54:14.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:14.979 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T11:54:14.980 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:54:14.980 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:15.010 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:54:15.010 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:54:15.010 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:54:15.010 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:15.035 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:54:15.035 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T11:54:15.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:15.087 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T11:54:15.088 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T11:54:15.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:54:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-14T11:54:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-14T11:54:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-14T11:54:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-14T11:54:15.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-14T11:54:15.101 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T11:54:15.101 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:54:15.102 DEBUG:teuthology.orchestra.run.smithi130:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T11:54:15.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:54:15.169 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:54:15.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:54:15.547 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:54:15.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:54:15.668 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:54:15.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:54:15.747 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:54:15.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:54:15.831 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T11:54:16.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:54:16.067 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T11:54:16.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:54:16.136 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T11:54:16.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:54:16.210 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T11:54:16.287 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:54:16.288 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/data/mon.a.tgz 2024-09-14T11:54:16.289 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-14T11:54:16.318 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.nqLZZarM2N 2024-09-14T11:54:16.318 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nqLZZarM2N 2024-09-14T11:54:16.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.nqLZZarM2N 2024-09-14T11:54:16.607 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.nqLZZarM2N is 429KB 2024-09-14T11:54:16.689 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.nqLZZarM2N 2024-09-14T11:54:16.717 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/data/mon.c.tgz 2024-09-14T11:54:16.717 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-09-14T11:54:16.786 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.E1PDZS3XaY 2024-09-14T11:54:16.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.E1PDZS3XaY 2024-09-14T11:54:16.954 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.E1PDZS3XaY 2024-09-14T11:54:17.065 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.E1PDZS3XaY is 432KB 2024-09-14T11:54:17.167 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.E1PDZS3XaY 2024-09-14T11:54:17.197 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/data/mon.b.tgz 2024-09-14T11:54:17.197 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-14T11:54:17.231 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.vQwnpz1XEF 2024-09-14T11:54:17.231 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vQwnpz1XEF 2024-09-14T11:54:17.418 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.vQwnpz1XEF 2024-09-14T11:54:17.530 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.vQwnpz1XEF is 432KB 2024-09-14T11:54:17.612 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.vQwnpz1XEF 2024-09-14T11:54:17.641 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:54:17.642 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:54:17.644 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:54:17.752 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:54:17.790 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:54:17.790 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:54:17.792 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi130/crash 2024-09-14T11:54:17.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:54:17.831 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi171/crash 2024-09-14T11:54:17.832 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:54:17.870 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:54:17.870 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:54:17.877 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:54:17.911 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:54:17.912 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191777.log 2024-09-14T11:54:17.912 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.73129.log 2024-09-14T11:54:17.964 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-09-14T11:54:17.964 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32638.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32869.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32869.log.gz 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-09-14T11:54:17.965 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32726.log 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32726.log.gz 2024-09-14T11:54:17.966 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:54:17.972 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32825.log 2024-09-14T11:54:17.972 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-09-14T11:54:17.972 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32682.log 2024-09-14T11:54:17.972 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32825.log: /var/log/ceph/ceph-client.admin.32682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32825.log.gz 2024-09-14T11:54:17.972 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32682.log.gz 2024-09-14T11:54:18.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38674.log 2024-09-14T11:54:18.107 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191777.log.gz 2024-09-14T11:54:18.107 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.73129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188392.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.73129.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38674.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151054.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.188392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39253.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188392.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94506.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185812.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39253.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.94506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84493.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94506.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.185812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90383.log 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.185812.log.gz 2024-09-14T11:54:18.108 INFO:teuthology.orchestra.run.smithi130.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.151054.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.84493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39371.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.90383.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.84493.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103343.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.90383.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79192.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39371.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.103343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189149.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103343.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.79192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182767.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79192.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83315.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.189149.log.gz 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.182767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109822.log 2024-09-14T11:54:18.109 INFO:teuthology.orchestra.run.smithi130.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.182767.log.gz/var/log/ceph/ceph-client.admin.83315.log: 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.83315.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.109822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92739.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.109822.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.92739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165897.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92739.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118068.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134560.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.165897.log: /var/log/ceph/ceph-client.admin.118068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189845.log 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165897.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.118068.log.gz 2024-09-14T11:54:18.110 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.134560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39050.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.189845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57784.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.189845.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74310.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39050.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39049.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.57784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57784.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.134560.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.74310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192375.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39049.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61390.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.74310.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39442.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192375.log.gz 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.61390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192053.log 2024-09-14T11:54:18.111 INFO:teuthology.orchestra.run.smithi130.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.61390.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39442.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63118.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136917.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192053.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.63118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr: 54.3% -- replaced with /var/log/ceph/ceph-client.admin.63118.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191639.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.136917.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100987.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119246.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191639.log.gz 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.100987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158711.log 2024-09-14T11:54:18.112 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.119246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191452.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100987.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119246.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.158711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132793.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.158711.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191915.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191452.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165284.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33097.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191915.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132793.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.165284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165284.log.gz 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33097.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.173316.log 2024-09-14T11:54:18.113 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33097.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39044.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.173316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62907.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130437.log 92.2% 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173316.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.62907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63052.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62907.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.130437.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.130437.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.63052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171343.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143985.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.171343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105110.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143985.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171343.log.gz 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123958.log 2024-09-14T11:54:18.114 INFO:teuthology.orchestra.run.smithi130.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.143985.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.105110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106877.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105110.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47651.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123958.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85082.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.106877.log: 82.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139862.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47651.log: -- replaced with /var/log/ceph/ceph-client.admin.106877.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.85082.log: 83.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.47651.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.188416.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85082.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68886.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.139862.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65163.log 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.188416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188416.log.gz 2024-09-14T11:54:18.115 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187780.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.68886.log: /var/log/ceph/ceph-client.admin.65163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99218.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.187780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129848.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.187780.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.65163.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99218.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.99218.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83904.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64534.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.83904.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129848.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151643.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.83904.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-client.admin.64534.log: --verbose -- /var/log/ceph/ceph-client.admin.171951.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.151643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159889.log 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151643.log.gz 2024-09-14T11:54:18.116 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.171951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.159889.log: 81.4% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.159889.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.171951.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192283.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39712.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.192465.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74900.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192283.log: /var/log/ceph/ceph-client.admin.192465.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192283.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192465.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.74900.log: gzip -5 81.5% -- replaced with /var/log/ceph/ceph-client.admin.74900.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.131615.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39990.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gz 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.191547.log 2024-09-14T11:54:18.117 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.131615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85671.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 85.4%/var/log/ceph/ceph-client.admin.191547.log: -- replaced with /var/log/ceph/ceph-client.admin.131615.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191547.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192099.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.85671.log: gzip -5 --verbose 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85671.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: -- /var/log/ceph/ceph-client.admin.141629.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100396.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192099.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 88.0%/var/log/ceph/ceph-client.admin.141629.log: -- replaced with /var/log/ceph/ceph-client.admin.63052.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170127.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141629.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.100396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38332.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.100396.log.gz 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.170127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39388.log 2024-09-14T11:54:18.118 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38332.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122780.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38332.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39666.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39388.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.170127.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39388.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112767.log 82.4% -- replaced with /var/log/ceph/ceph-client.admin.122780.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39666.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117479.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.112767.log: gzip -5 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112767.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51822.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.117479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137506.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117479.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51822.log.gz 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162267.log 2024-09-14T11:54:18.119 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70745.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.137506.log: /var/log/ceph/ceph-client.admin.162267.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.137506.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65782.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.162267.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip/var/log/ceph/ceph-client.admin.70745.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40034.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.65782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72030.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40034.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112178.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70745.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.72030.log: /var/log/ceph/ceph-client.admin.112178.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.72030.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60801.log 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112178.log.gz 2024-09-14T11:54:18.120 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64534.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz/var/log/ceph/ceph-client.admin.60801.log: 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192191.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: 86.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41455.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60801.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48240.log: /var/log/ceph/ceph-client.admin.192191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192191.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153410.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.41455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77571.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.0.41455.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.153410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165308.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.153410.log.gz 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.77571.log: /var/log/ceph/ceph-client.0.176675.log 2024-09-14T11:54:18.121 INFO:teuthology.orchestra.run.smithi130.stderr: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.77571.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.165308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131026.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 90.0%/var/log/ceph/ceph-client.0.176675.log: -- replaced with /var/log/ceph/ceph-client.admin.165308.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92150.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.176675.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.131026.log: -- /var/log/ceph/ceph-client.admin.58397.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.92150.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.131026.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189100.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.92150.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65782.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.58397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43270.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.58397.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39364.log 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189100.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.43270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164671.log 44.6% -- replaced with /var/log/ceph/ceph-client.0.43270.log.gz 2024-09-14T11:54:18.122 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.68886.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39364.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191823.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42667.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164671.log: /var/log/ceph/ceph-client.admin.191823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190549.log 0.0% 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191823.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164671.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.42667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113945.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.42667.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.190549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95684.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.113945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155766.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.95684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86260.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155766.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.95684.log.gz 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115712.log 2024-09-14T11:54:18.123 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.155766.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.86260.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113945.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.190549.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.86260.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155177.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90972.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115712.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.155177.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.155177.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38039.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.90972.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96273.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95095.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38039.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.96273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49466.log 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.96273.log.gz 86.3% -- replaced with /var/log/ceph/ceph-client.admin.90972.log.gz 2024-09-14T11:54:18.124 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177284.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.95095.log: /var/log/ceph/ceph-client.admin.49466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54226.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95095.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.49466.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:gzip/var/log/ceph/ceph-client.0.177284.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62562.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.177284.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38273.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.54226.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.62562.log: gzip -5 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 57.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.62562.log.gz /var/log/ceph/ceph-client.admin.51233.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178504.log 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38273.log.gz 2024-09-14T11:54:18.125 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102754.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.51233.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.178504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99807.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.178504.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.102754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76082.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.102754.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.99807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42064.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.99807.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.76082.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.76082.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150465.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116301.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.42064.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.42064.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133971.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.150465.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.150465.log.gz 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127492.log 2024-09-14T11:54:18.126 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.116301.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.133971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115123.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.133971.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.127492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160479.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.127492.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.115123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43873.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.115123.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116890.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160479.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160500.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 44.6% -- replaced with /var/log/ceph/ceph-client.0.43873.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.116890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39440.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.116890.log.gz 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.160500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38683.log 2024-09-14T11:54:18.127 INFO:teuthology.orchestra.run.smithi130.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.160500.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81548.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39440.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38683.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.120424.log -- replaced with /var/log/ceph/ceph-client.admin.38683.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.81548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114534.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.120424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62288.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81548.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120424.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.114534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.114534.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.62288.log: 60.7% -- replaced with /var/log/ceph/ceph-client.admin.62288.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.32753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67029.log 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-09-14T11:54:18.128 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191731.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.67029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110411.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191731.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191731.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.0.184594.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.110411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67648.log 82.1% -- replaced with /var/log/ceph/ceph-client.admin.110411.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.184594.log: gzip -5 --verbose -- 84.3% -- replaced with /var/log/ceph/ceph-client.0.184594.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr: /var/log/ceph/ceph-client.admin.163493.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.67648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164082.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170735.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.163493.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.164082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49442.log 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.170735.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.164082.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.67648.log.gz 2024-09-14T11:54:18.129 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170735.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97451.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49442.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78326.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.67029.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.97451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147520.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97451.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.78326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191360.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.78326.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.147520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93328.log 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.147520.log.gz 2024-09-14T11:54:18.130 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180331.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191360.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.93328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39391.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93328.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.180331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38184.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.180331.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123369.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39391.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38184.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38184.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.123369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98040.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.c.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123369.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179113.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.98040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40124.log 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.98040.log.gz 2024-09-14T11:54:18.131 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.179113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191406.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40124.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.179113.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.0.180940.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40124.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191406.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183985.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129259.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.180940.log: 84.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154588.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.183985.log: -- replaced with /var/log/ceph/ceph-client.0.180940.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.183985.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.129259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185203.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.129259.log.gz 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.154588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191314.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.185203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57808.log 2024-09-14T11:54:18.132 INFO:teuthology.orchestra.run.smithi130.stderr: 83.8%/var/log/ceph/ceph-client.admin.191314.log: -- replaced with /var/log/ceph/ceph-client.0.185203.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191314.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133382.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167932.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.57808.log: /var/log/ceph/ceph-client.admin.133382.log: 85.8% 84.9% -- replaced with /var/log/ceph/ceph-client.admin.57808.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154588.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163469.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.133382.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.167932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173924.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.163469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76860.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163469.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.167932.log.gz 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.173924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-client.0.76860.log: --verbose -- /var/log/ceph/ceph-client.admin.80370.log 2024-09-14T11:54:18.133 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173924.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.108644.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.76860.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.189052.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.80370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142807.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80370.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189052.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105699.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142807.log: /var/log/ceph/ceph-client.admin.105699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70124.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132204.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105699.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109233.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.70124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.132204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39052.log 2024-09-14T11:54:18.134 INFO:teuthology.orchestra.run.smithi130.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.142807.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.109233.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132204.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109233.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54815.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70124.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.39052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152821.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39052.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89205.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.54815.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54815.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162856.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip/var/log/ceph/ceph-client.admin.89205.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.138095.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.162856.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.89205.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93917.log 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.162856.log.gz 2024-09-14T11:54:18.135 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139273.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.152821.log.gz 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138095.log.gz/var/log/ceph/ceph-client.admin.93917.log: 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55993.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93917.log.gz 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.139273.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55993.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139273.log.gz 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.126903.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.55993.log.gz 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138684.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175428.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.126903.log.gz 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.138684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2024-09-14T11:54:18.136 INFO:teuthology.orchestra.run.smithi130.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.138684.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.175428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188440.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.45552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182158.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.188440.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.188440.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.182158.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.175428.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.182158.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148698.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79781.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz/var/log/ceph/ceph-client.admin.148698.log: 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63945.log 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148698.log.gz 2024-09-14T11:54:18.137 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121013.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.79781.log: /var/log/ceph/ceph-client.admin.63945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57760.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.79781.log.gz/var/log/ceph/ceph-client.admin.121013.log: 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.63945.log.gz 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.121013.log.gz 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86849.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.57760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57760.log.gz 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63831.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.86849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38684.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.86849.log.gz 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.63831.log: 21.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140451.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63831.log.gz 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159300.log 2024-09-14T11:54:18.138 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38684.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125136.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.140451.log: /var/log/ceph/ceph-client.admin.159300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76251.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.140451.log.gz/var/log/ceph/ceph-client.admin.125136.log: 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.159300.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.125136.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38675.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.76251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191961.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.76251.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38675.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192329.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69505.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191961.log: /var/log/ceph/ceph-client.admin.192329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191961.log.gz 2024-09-14T11:54:18.139 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192329.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.69505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40810.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89794.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.40810.log: 44.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125725.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.0.40810.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.89794.log: /var/log/ceph/ceph-client.admin.125725.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89794.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr: 92.4% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125725.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69505.log.gz 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165260.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80959.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.165260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56582.log 2024-09-14T11:54:18.140 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165260.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.80959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122191.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.80959.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.56582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172708.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.56582.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.122191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.172708.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172708.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145753.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 87.1%/var/log/ceph/ceph-client.admin.96862.log: -- replaced with /var/log/ceph/ceph-client.admin.122191.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39620.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145753.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26653.log 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 82.2%/var/log/ceph/ceph-client.admin.39620.log: -- replaced with /var/log/ceph/ceph-client.admin.145753.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39620.log.gz 2024-09-14T11:54:18.141 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106288.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.tmp-client.admin.26653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174532.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26653.log.gz 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.106288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126314.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106288.log.gz 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.174532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156355.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.126314.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.174532.log.gz 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126314.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111000.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.y.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.156355.log.gz 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191593.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111000.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111000.log.gz 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156944.log 2024-09-14T11:54:18.142 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191593.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71364.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.156944.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.156944.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192237.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.71364.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.71364.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192237.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101576.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188370.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.101576.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62681.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.188370.log: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.188370.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.101576.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161089.log 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.62681.log: 51.0% -- replaced with /var/log/ceph/ceph-client.admin.62681.log.gz 2024-09-14T11:54:18.143 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191869.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161089.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161089.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189030.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191869.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128670.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189030.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.189030.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143396.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128670.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.128670.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181549.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.143396.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143396.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192145.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.181549.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.181549.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158122.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192145.log.gz 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60212.log 2024-09-14T11:54:18.144 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.158122.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158122.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103932.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.60212.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.60212.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189076.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.103932.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103932.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.169189.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189076.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60188.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.189076.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.169189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119835.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.60188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60188.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142218.log 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169189.log.gz/var/log/ceph/ceph-client.admin.119835.log: 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119835.log.gz 2024-09-14T11:54:18.145 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128081.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.142218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135738.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.142218.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.128081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166486.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.135738.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135738.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 86.1% -- replaced with /var/log/ceph/ceph-client.admin.128081.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.admin.148109.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.148109.log: /var/log/ceph/ceph-client.admin.166486.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.166486.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.148109.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51870.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.38884.log: -- /var/log/ceph/ceph-client.admin.161678.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.51870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75491.log 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.161678.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.51870.log.gz 2024-09-14T11:54:18.146 INFO:teuthology.orchestra.run.smithi130.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.161678.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82137.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.75491.log: /var/log/ceph/ceph-client.admin.39048.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.75491.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88616.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141040.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.82137.log: /var/log/ceph/ceph-client.admin.88616.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82137.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.88616.log.gzgzip 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.113356.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121602.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.141040.log: /var/log/ceph/ceph-client.admin.113356.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.141040.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113356.log.gz 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124547.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163445.log 2024-09-14T11:54:18.147 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.121602.log: /var/log/ceph/ceph-client.admin.124547.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121602.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gzgzip 82.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.124547.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: --verbose -- /var/log/ceph/ceph-client.0.183376.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5/var/log/ceph/ceph-client.admin.163445.log: --verbose -- /var/log/ceph/ceph-client.admin.191685.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163445.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.183376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98629.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.183376.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.191685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191685.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58986.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.98629.log: -- /var/log/ceph/ceph-client.admin.40080.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.58986.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98629.log.gz 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149287.log 2024-09-14T11:54:18.148 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.58986.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.40080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40080.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177895.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77717.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149287.log: 85.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73718.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149287.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.177895.log: /var/log/ceph/ceph-client.0.77717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144575.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.177895.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.73718.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.73718.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38682.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50644.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38682.log: /var/log/ceph/ceph-client.admin.144575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38682.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.144575.log.gz 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63182.log 2024-09-14T11:54:18.149 INFO:teuthology.orchestra.run.smithi130.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50644.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.77717.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.63182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176036.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.63182.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.50055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60164.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82726.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.176036.log: /var/log/ceph/ceph-client.admin.60164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60164.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176036.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88027.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.82726.log: -- /var/log/ceph/ceph-client.admin.104521.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.88027.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.82726.log.gz 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191501.log 2024-09-14T11:54:18.150 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.88027.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.104521.log: /var/log/ceph/ceph-client.admin.191501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53637.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.191501.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104521.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136328.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.53637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68267.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.53637.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.136328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108055.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.68267.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136328.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68267.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192007.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.108055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102165.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108055.log.gz 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52459.log 2024-09-14T11:54:18.151 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0%/var/log/ceph/ceph-client.admin.102165.log: -- replaced with /var/log/ceph/ceph-client.admin.192007.log.gz 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102165.log.gz 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146342.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52459.log: /var/log/ceph/ceph-client.admin.63765.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.52459.log.gz/var/log/ceph/ceph-client.admin.146342.log: 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.146342.log.gz 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.63765.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.63765.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135149.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107466.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.48829.log: /var/log/ceph/ceph-client.admin.135149.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.135149.log.gz 84.3% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40193.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.107466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149876.log 2024-09-14T11:54:18.152 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.40193.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.107466.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.40193.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87438.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.149876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189125.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149876.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.87438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33190.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.189125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189125.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.87438.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38677.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.33190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33190.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62988.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59575.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.62988.log: /var/log/ceph/ceph-client.admin.38677.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62988.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38677.log.gz 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168581.log 2024-09-14T11:54:18.153 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.59575.log: /var/log/ceph/ceph-client.admin.168581.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.59575.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192421.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.46147.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.168581.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.192421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192421.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187191.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66408.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.57171.log: /var/log/ceph/ceph-client.admin.187191.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr: 82.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153999.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187191.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152232.log 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.66408.log: /var/log/ceph/ceph-client.admin.153999.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.153999.log.gz 2024-09-14T11:54:18.154 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111589.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.152232.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.152232.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146931.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.111589.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.111589.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38378.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.146931.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.146931.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118657.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38378.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179722.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.118657.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66408.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118657.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.0.179722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.179722.log.gz 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91561.log 2024-09-14T11:54:18.155 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47062.log 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.91561.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.91561.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.47062.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.47062.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55404.log 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.38424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145164.log 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.55404.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.55404.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157533.log 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.145164.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.145164.log.gz 2024-09-14T11:54:18.156 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.157533.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.157533.log.gz 2024-09-14T11:54:18.392 INFO:teuthology.orchestra.run.smithi171.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:54:18.852 INFO:teuthology.orchestra.run.smithi130.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T11:54:19.017 INFO:teuthology.orchestra.run.smithi171.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T11:54:20.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-14T11:54:20.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-14T11:54:20.235 INFO:teuthology.orchestra.run.smithi130.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:54:21.026 INFO:teuthology.orchestra.run.smithi130.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:54:26.259 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:54:27.680 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:54:27.941 INFO:teuthology.orchestra.run.smithi171.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T11:54:28.750 INFO:teuthology.orchestra.run.smithi171.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T11:54:28.827 INFO:teuthology.orchestra.run.smithi171.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T11:54:33.580 INFO:teuthology.orchestra.run.smithi130.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:54:36.232 INFO:teuthology.orchestra.run.smithi171.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T11:54:36.234 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-09-14T11:54:36.235 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m18.289s 2024-09-14T11:54:36.235 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m49.584s 2024-09-14T11:54:36.235 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m1.769s 2024-09-14T11:54:40.667 INFO:teuthology.orchestra.run.smithi130.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:54:40.669 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-09-14T11:54:40.669 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m22.767s 2024-09-14T11:54:40.669 INFO:teuthology.orchestra.run.smithi130.stderr:user 1m0.398s 2024-09-14T11:54:40.669 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m2.384s 2024-09-14T11:54:40.669 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:54:40.670 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi130/log 2024-09-14T11:54:40.671 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:54:48.724 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi171/log 2024-09-14T11:54:48.725 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:54:55.353 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:54:55.364 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:54:55.364 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:54:55.367 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:54:55.467 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:54:55.477 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:54:55.477 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:54:55.480 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:54:55.509 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:54:55.511 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:54:55.514 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:54:55.515 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-09-14T11:54:55.515 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +2053us[+2085us] +/- 38ms 2024-09-14T11:54:55.515 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 +2588us[+2620us] +/- 53ms 2024-09-14T11:54:55.515 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -10ms[ -10ms] +/- 97ms 2024-09-14T11:54:55.515 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:54:55.516 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:54:55.517 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-09-14T11:54:55.517 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +2055us[+2168us] +/- 38ms 2024-09-14T11:54:55.517 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +2609us[+2609us] +/- 53ms 2024-09-14T11:54:55.517 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -10ms[ -10ms] +/- 97ms 2024-09-14T11:54:55.517 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:54:55.517 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:54:55.527 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:54:55.528 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:54:55.537 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:54:55.637 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:54:55.714 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:54:55.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:55.756 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:54:55.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:55.798 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:54:55.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:54:55.819 INFO:teuthology.task.internal:Duration was 3070.396441 seconds 2024-09-14T11:54:55.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:54:55.829 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:54:55.829 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:54:55.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:54:55.881 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:54:55.891 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:54:56.165 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:54:56.165 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-09-14T11:54:56.165 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:54:56.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-09-14T11:54:56.199 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:54:56.240 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:54:56.241 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:54:56.243 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:54:56.321 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:54:56.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:54:56.324 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:54:56.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:54:56.485 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:54:56.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:54:56.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:54:56.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:54:56.574 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:54:56.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:54:56.611 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-09-14T11:54:56.639 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-09-14T11:54:56.662 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:54:56.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:56.691 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:54:56.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:54:56.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:54:56.742 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:54:56.742 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi130 2024-09-14T11:54:56.742 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:54:56.795 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904168/remote/smithi171 2024-09-14T11:54:56.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:54:56.840 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:54:56.841 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:54:56.843 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:54:56.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:54:56.917 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:54:56.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:54:56.927 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:54:56.927 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:54:56.929 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:54:56.955 INFO:teuthology.orchestra.run.smithi130.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:54 /home/ubuntu/cephtest 2024-09-14T11:54:56.973 INFO:teuthology.orchestra.run.smithi171.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:54 /home/ubuntu/cephtest 2024-09-14T11:54:56.974 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:54:56.987 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:54:57.011 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3070.3964414596558 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:54:57.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:54:57.084 INFO:teuthology.run:pass